-- Logs begin at Thu 2022-10-06 11:59:40 UTC, end at Thu 2022-10-06 14:42:25 UTC. -- Oct 06 12:37:27.406829 n-d-860556-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 12:37:27.416578 n-d-860556-1 devstack@n-api.service[113720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 12:37:27 2022] *** Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: nodename: n-d-860556-1 Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: machine: x86_64 Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: clock source: unix Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: pcre jit disabled Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: detected number of CPU cores: 4 Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: current working directory: / Oct 06 12:37:27.418607 n-d-860556-1 devstack@n-api.service[113720]: detected binary path: /usr/bin/uwsgi-core Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: your processes number limit is 47680 Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: your memory page size is 4096 bytes Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: detected max file descriptor number: 2048 Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: lock engine: pthread robust mutexes Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: thunder lock: enabled Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 12:37:27.419293 n-d-860556-1 devstack@n-api.service[113720]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 12:37:27.457785 n-d-860556-1 devstack@n-api.service[113720]: Python main interpreter initialized at 0x56231502a9c0 Oct 06 12:37:27.457785 n-d-860556-1 devstack@n-api.service[113720]: python threads support enabled Oct 06 12:37:27.457785 n-d-860556-1 devstack@n-api.service[113720]: your server socket listen backlog is limited to 100 connections Oct 06 12:37:27.457785 n-d-860556-1 devstack@n-api.service[113720]: your mercy for graceful operations on workers is 90 seconds Oct 06 12:37:27.458096 n-d-860556-1 devstack@n-api.service[113720]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 12:37:27.458191 n-d-860556-1 devstack@n-api.service[113720]: *** Operational MODE: preforking *** Oct 06 12:37:27.458449 n-d-860556-1 devstack@n-api.service[113720]: *** uWSGI is running in multiple interpreter mode *** Oct 06 12:37:27.458449 n-d-860556-1 devstack@n-api.service[113720]: spawned uWSGI master process (pid: 113720) Oct 06 12:37:27.458621 n-d-860556-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 06 12:37:27.459164 n-d-860556-1 devstack@n-api.service[113720]: spawned uWSGI worker 1 (pid: 113721, cores: 1) Oct 06 12:37:27.459501 n-d-860556-1 devstack@n-api.service[113720]: spawned uWSGI worker 2 (pid: 113722, cores: 1) Oct 06 12:37:27.459664 n-d-860556-1 devstack@n-api.service[113720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 12:37:28.115347 n-d-860556-1 devstack@n-api.service[113722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:37:28.126976 n-d-860556-1 devstack@n-api.service[113721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:37:29.191562 n-d-860556-1 devstack@n-api.service[113722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:37:29.191562 n-d-860556-1 devstack@n-api.service[113722]: from cryptography.utils import int_from_bytes Oct 06 12:37:29.192191 n-d-860556-1 devstack@n-api.service[113722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:37:29.192191 n-d-860556-1 devstack@n-api.service[113722]: from cryptography.utils import int_from_bytes Oct 06 12:37:29.192345 n-d-860556-1 devstack@n-api.service[113721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:37:29.192345 n-d-860556-1 devstack@n-api.service[113721]: from cryptography.utils import int_from_bytes Oct 06 12:37:29.192747 n-d-860556-1 devstack@n-api.service[113721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:37:29.192747 n-d-860556-1 devstack@n-api.service[113721]: from cryptography.utils import int_from_bytes Oct 06 12:37:31.651897 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:37:31.652455 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:37:31.652667 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:37:31.653023 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:37:31.653274 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:37:31.653654 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.654004 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.654326 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.654644 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.654969 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.655278 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.655593 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.655904 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.656225 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.656482 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.656791 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.657109 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860556-1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.657425 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.657678 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:37:31.658077 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.658169 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:37:31.658258 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.658345 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.658474 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:37:31.658632 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.658830 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:37:31.658949 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.659085 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:37:31.659248 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.659469 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.659736 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660129 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660129 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660362 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660477 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660592 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660698 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660802 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.660998 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661126 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661314 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661412 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661627 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661726 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.661973 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662057 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662230 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662322 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662540 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662633 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662881 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860556-1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.662976 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663202 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663341 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860556-1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663505 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663598 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663810 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.663897 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664121 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664277 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664410 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664539 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664722 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.664848 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665023 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665154 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665487 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665619 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665821 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.665911 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666127 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666297 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666431 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666516 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666747 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.666832 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667058 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667156 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667361 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667464 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667655 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667748 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.667959 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668097 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668257 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668344 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668560 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668647 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668857 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.668942 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860556-1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669154 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669250 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669400 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669535 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669701 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.669868 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670041 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670275 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670361 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670583 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670669 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670889 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.670977 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671132 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671218 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671445 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671533 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671758 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.671847 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672063 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672150 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672367 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672454 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672669 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672770 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.672971 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673058 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673269 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673363 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673569 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673661 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673894 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.673984 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674197 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674325 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674494 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674580 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674802 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.674893 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675070 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675163 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675376 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675469 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675694 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.675787 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676011 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676110 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676322 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676413 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676567 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676653 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676820 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.676942 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677135 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677255 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677449 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677582 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677768 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.677870 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.678078 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.678193 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.678379 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679230 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679345 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679428 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679508 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679618 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679787 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.679931 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680089 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680258 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680391 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680559 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680705 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.680799 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681015 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681101 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681334 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681420 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681638 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681751 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.681985 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682072 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682284 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682380 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682589 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682676 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682884 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.682976 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683187 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683280 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683488 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683575 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683790 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.683878 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684089 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684183 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684395 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684519 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684698 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684800 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.684996 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685081 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685295 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685381 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685596 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685689 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.685924 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686027 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686237 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686323 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686486 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686573 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686784 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.686883 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687085 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687179 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687404 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687492 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687702 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.687800 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688002 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688087 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688305 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688396 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688596 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688689 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688900 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.688987 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689199 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689283 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689498 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689598 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689822 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.689923 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690124 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690218 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690424 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690521 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690719 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.690812 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691022 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691107 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691320 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691478 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691615 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691707 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.691921 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692019 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692221 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692308 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692517 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692612 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692814 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.692908 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693111 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693213 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693409 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693500 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693702 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.693814 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.694024 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.694145 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.694867 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.694967 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695184 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695270 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695487 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695583 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695788 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.695933 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696089 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696175 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696389 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696481 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696692 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.696778 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.697005 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.697099 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.697305 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.697392 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.697607 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.697693 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.697977 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.698083 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.698305 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.698390 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.698606 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.698693 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.698904 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.698998 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.699203 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.699289 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.699500 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.699593 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.699801 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.699895 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.700099 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.700186 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.700398 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.700484 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.700691 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.700785 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.701003 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.701090 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.701316 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.701401 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.701616 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.701711 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.701944 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.702030 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.702248 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.702335 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.702562 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:37:31.702650 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.702866 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.702957 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703183 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703268 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703506 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703604 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703819 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.703905 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704126 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704221 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704457 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704550 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704774 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.704925 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705082 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705171 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705393 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705502 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705705 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.705877 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706035 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706132 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706338 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706423 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706643 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706735 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.706958 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707052 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707276 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707362 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707589 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707683 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707897 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.707995 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708202 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708287 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708514 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708608 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708819 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.708918 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709121 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709206 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709428 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709515 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709770 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.709872 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710082 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710167 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710408 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710500 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710720 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.710808 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711041 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711137 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711349 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711440 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711661 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711748 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.711966 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712050 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712271 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712356 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712576 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712661 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712883 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.712977 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713184 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713277 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713484 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713573 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713814 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.713903 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714123 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714221 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714423 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714510 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714736 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.714822 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715046 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715185 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715348 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715435 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715654 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715740 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.715961 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716057 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716268 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716352 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716575 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716667 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716882 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.716981 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717185 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717284 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717497 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717588 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717825 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.717915 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718132 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718218 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718438 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718523 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718746 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.718834 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719046 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719138 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719342 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719426 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719642 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719729 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.719944 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720029 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720240 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720325 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720548 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720638 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720863 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.720948 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721161 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721246 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721465 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721551 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721801 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.721889 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722111 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722210 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722418 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722503 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722720 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.722812 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723020 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723114 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723329 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723472 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723635 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723725 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.723937 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724033 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724254 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724340 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724555 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724643 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724852 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.724945 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725150 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725276 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725472 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725559 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725796 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.725886 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726106 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726238 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726408 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726504 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726708 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.726796 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727007 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727092 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727307 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727393 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727606 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727693 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.727922 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728015 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728228 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728321 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728531 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728618 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728831 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.728917 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729131 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729226 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729455 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729541 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729802 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.729891 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730117 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730216 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730422 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730509 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730730 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.730816 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731032 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731130 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731332 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731419 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731633 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731720 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.731938 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732032 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732268 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732355 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732678 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732767 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.732983 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733077 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733285 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733372 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733587 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733681 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.733932 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734029 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734237 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734322 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734535 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734622 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734838 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.734933 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735137 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735224 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735443 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735538 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735755 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.735843 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736089 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736175 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736414 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736510 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736728 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.736813 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737042 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737127 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737352 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737452 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737661 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737803 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.737991 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738076 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738298 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738394 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738602 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738694 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738908 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.738994 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739219 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739317 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739524 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739609 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739836 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.739920 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740139 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740232 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740452 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740537 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740756 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.740840 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.741596 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.741699 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.741925 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742012 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742236 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742330 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742556 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742644 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742882 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.742968 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743188 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743284 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743499 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743586 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743806 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.743897 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744108 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744193 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744413 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744499 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744716 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.744819 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745016 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745111 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745315 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745446 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745619 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745707 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.745951 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746050 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746255 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746341 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746558 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746653 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746855 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.746948 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747163 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747250 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747466 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747558 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747765 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.747859 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748063 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748149 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748371 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748457 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748686 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748773 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.748989 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749074 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749299 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749385 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749612 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749697 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.749939 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750025 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750240 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750334 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750546 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750632 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750847 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.750933 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751143 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751229 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751441 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751528 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751736 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.751823 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752039 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752137 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752344 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752431 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752645 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752731 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.752953 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753050 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753253 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753338 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753553 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753639 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.753882 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.754242 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.754439 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.754526 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.754745 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.754840 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755051 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755153 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755359 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755443 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755663 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755749 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.755959 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.756044 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.756259 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.756346 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.756562 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.756705 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.757469 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.757556 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.757794 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.757883 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758100 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758188 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758402 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758489 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758739 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.758825 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759043 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759131 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759341 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759427 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759650 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759734 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.759965 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760210 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760297 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760539 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760624 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760854 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.760940 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761154 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761240 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761469 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761555 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761801 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.761904 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762109 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762203 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762414 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762501 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762720 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.762806 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763026 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763129 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763329 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763414 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763631 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763718 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.763933 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764027 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764235 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764327 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764534 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764620 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764831 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.764924 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.765130 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.765222 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.765437 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.765523 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.765812 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766018 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766106 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766351 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766437 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766649 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766746 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.766959 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767046 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767262 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767349 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767573 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767735 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767875 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.767963 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768192 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768279 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768499 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768584 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768797 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.768940 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769095 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769182 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769395 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769488 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769698 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.769805 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770028 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770115 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770330 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770427 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770630 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770725 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.770930 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771024 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771235 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771335 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771537 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771623 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771835 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.771921 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772134 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772266 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772460 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772548 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772770 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.772856 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773070 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773173 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773377 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773463 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773674 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.773814 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774014 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774102 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774317 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774402 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774617 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774712 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.774917 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775017 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775212 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775304 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775516 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775609 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775816 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.775906 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776128 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776224 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776432 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776518 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776730 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.776830 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777029 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777117 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777335 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777429 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777637 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777724 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.777962 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778049 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778268 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778365 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778566 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778689 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778873 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.778967 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779170 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779269 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779466 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779551 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779760 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.779845 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780065 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780162 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780365 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780450 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780666 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780750 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.780963 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781051 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781268 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781353 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781566 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781686 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781892 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.781982 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782194 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782281 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782491 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782576 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782785 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.782871 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783086 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783171 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783385 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783470 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783681 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783768 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.783984 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.784070 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.786721 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.786889 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.786889 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787097 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787217 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787324 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787430 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787543 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787662 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787768 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.787912 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788022 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788022 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788241 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788349 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788455 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788455 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788655 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788769 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788883 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.788989 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789115 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789115 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789253 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789253 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789413 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789493 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789573 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789651 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789729 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789729 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.789938 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790018 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790103 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790183 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790269 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790358 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790446 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790526 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790605 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790684 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790769 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790856 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.790937 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791015 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791093 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791171 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791262 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791342 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791421 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791609 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791728 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.791908 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792035 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792208 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792342 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792507 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792644 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792825 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.792942 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793131 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793258 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793432 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793567 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793755 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.793915 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794052 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794234 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794391 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794553 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794713 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.794871 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795034 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795171 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795341 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795478 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795653 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795785 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.795970 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796089 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796281 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796394 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796594 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796683 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796904 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.796991 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797207 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797302 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797522 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797609 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797896 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.797986 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798205 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798292 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798507 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798594 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798802 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.798887 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799104 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799198 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799404 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799490 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799709 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.799803 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800015 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800108 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800316 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800402 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800619 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800706 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.800923 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801017 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801226 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801310 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801522 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801607 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801853 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.801974 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802162 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802287 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802468 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802598 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802778 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.802900 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.803087 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.803209 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.803395 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804031 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804221 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804353 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804535 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804671 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804840 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.804971 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.805151 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.805386 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.805488 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.805696 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.805811 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806127 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806234 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806340 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806432 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806642 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806745 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.806942 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807040 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807246 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807334 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807557 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807645 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807854 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.807942 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.808153 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.808280 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.808455 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809027 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809121 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809193 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809259 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809325 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809390 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809470 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809770 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.809879 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810084 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810178 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810384 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810475 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810685 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.810793 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811100 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811186 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811402 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811489 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811709 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.811795 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812019 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812106 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812322 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812410 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812622 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812708 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.812930 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813023 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813234 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813320 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813540 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813626 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813864 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.813967 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814166 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814274 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814477 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814566 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814778 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.814871 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815095 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815190 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815415 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815502 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815725 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.815811 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816044 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816139 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816454 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816541 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816772 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.816858 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817077 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817171 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817390 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817475 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817706 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.817845 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818033 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818131 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818334 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818422 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818640 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818725 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.818937 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.819023 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.819788 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.819906 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820107 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820194 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820411 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820499 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820720 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.820808 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821022 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821116 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821324 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821411 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821626 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821712 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.821954 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822045 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822272 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822362 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822570 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822744 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.822890 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823071 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823199 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823382 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823516 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823704 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.823831 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824027 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824122 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824330 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824417 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824634 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824720 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.824943 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825043 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825246 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825333 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825547 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825634 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825891 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.825984 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826197 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826334 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826507 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826611 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826816 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.826903 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827123 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827210 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827427 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827523 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827724 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.827810 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828044 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828132 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828347 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828447 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828650 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828746 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.828961 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829054 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829277 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829372 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829577 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829670 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829901 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.829988 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830213 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830300 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830514 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830601 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830811 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.830902 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831110 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831204 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831407 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831493 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831704 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.831797 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832001 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832088 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832296 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832383 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832615 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832701 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.832915 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833002 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833230 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833316 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833532 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833627 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833856 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.833948 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834158 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834244 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834456 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834590 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834814 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.834904 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835115 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835202 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835425 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835519 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835727 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.835813 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836033 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836122 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836332 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836432 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836632 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836727 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.836934 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837021 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837237 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837325 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837539 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837627 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837865 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.837956 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838167 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838255 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838470 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838562 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838770 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.838855 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839081 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839167 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839382 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839468 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839681 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.839906 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840042 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840231 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840318 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840540 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840636 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840853 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.840949 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841160 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841246 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841470 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841556 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841802 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.841899 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842113 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842203 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842420 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842515 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842725 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.842821 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843030 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843117 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843339 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843437 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843650 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843736 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.843960 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844047 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844264 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844363 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844573 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844666 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844879 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.844966 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.845185 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.845278 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.845491 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.845708 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.845866 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846055 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846181 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846365 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846483 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846673 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846790 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.846980 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847098 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847296 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847390 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847608 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847731 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.847988 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848084 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848295 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848381 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848602 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848688 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848910 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.848998 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849210 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849296 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849516 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849604 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849849 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.849942 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850172 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850261 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850527 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850616 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850841 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.850928 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851150 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851243 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851456 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851554 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851765 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.851911 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852106 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852278 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852408 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852592 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852718 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.852920 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853015 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853244 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853340 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853574 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853718 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853899 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.853986 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854213 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854313 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854527 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854615 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854827 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.854913 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855130 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855229 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855432 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855518 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855735 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.855829 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856033 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856129 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856349 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856446 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856655 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856778 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.856954 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.857051 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.857264 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.857356 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.857564 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.857649 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858099 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858200 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858415 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858503 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858743 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.858830 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859064 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859151 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859383 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859469 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859692 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859778 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.859992 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860078 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860311 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860398 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860612 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860713 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860911 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.860998 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861218 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861304 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861519 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861614 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861846 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.861936 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862146 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862231 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862451 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862550 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862748 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.862835 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863045 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863130 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863349 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863443 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863644 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863872 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.863958 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864213 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864309 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864524 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864611 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864820 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.864908 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865128 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865223 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865425 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865512 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865723 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.865828 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.866588 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.866697 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.866890 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.866976 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867194 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867290 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867490 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867592 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867793 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.867879 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868090 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868224 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868388 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868475 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868694 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868781 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.868998 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869085 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869298 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869386 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869602 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869690 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.869924 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870014 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870223 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870347 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870533 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870621 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870837 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.870924 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871153 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871242 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871460 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871545 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871758 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.871853 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872057 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872152 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872355 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872442 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872654 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872899 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.872994 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873229 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873317 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873530 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873615 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873852 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.873944 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874163 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874264 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874487 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874573 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874790 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.874884 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875085 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875178 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875402 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875497 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875699 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875784 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.875996 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876090 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876299 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876397 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876599 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876684 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.876900 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877030 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877203 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877300 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877506 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877598 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877828 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.877916 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.878133 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.878223 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.878436 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.878700 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.878788 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879280 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879382 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879584 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879671 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879886 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.879974 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880191 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880286 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880506 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880600 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880808 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.880896 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.881111 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.881206 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.881430 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.881522 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.882303 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.882402 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.882611 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.882700 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.882916 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883005 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883218 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883303 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883521 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883615 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883828 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.883915 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884132 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884219 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884436 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884524 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884732 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.884818 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885035 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885340 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885427 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885644 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885749 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.885975 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886073 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886281 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886370 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886590 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886731 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.886928 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887017 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887245 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887348 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887557 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887644 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887872 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.887972 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888178 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888264 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888480 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888567 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888784 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.888879 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889088 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889175 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889393 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889481 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889705 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.889844 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890047 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890133 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890350 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890436 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890656 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890746 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.890969 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891274 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891358 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891580 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891675 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891881 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.891968 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892186 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892281 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892485 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892580 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892782 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.892912 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893081 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893207 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893380 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893467 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893683 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.893790 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894021 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894108 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894319 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894408 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894616 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894725 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.894914 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895052 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895211 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895375 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895507 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895678 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895809 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.895980 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896106 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896282 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896402 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896587 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896697 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896903 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.896990 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897226 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897319 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897540 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897627 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897874 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.897967 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898182 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898280 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898480 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898568 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898779 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.898868 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899078 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899165 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899377 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899464 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899680 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899768 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.899978 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900065 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900274 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900374 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900571 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900703 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900868 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.900962 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901165 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901265 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901463 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901551 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901792 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.901883 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902140 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902243 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902392 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902487 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902687 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902774 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.902981 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903081 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903275 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903362 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903601 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903689 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.903916 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904003 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904225 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904310 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904535 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904621 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904842 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.904935 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905145 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905239 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905451 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905582 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905788 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.905881 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906099 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906185 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906404 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906513 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906707 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.906793 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907009 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907095 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907319 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907481 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907623 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907710 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.907925 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908014 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908228 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908324 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908531 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908626 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908835 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.908932 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909155 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909242 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909460 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909547 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909792 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.909881 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910114 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910208 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910426 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910511 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910740 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.910827 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911051 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911140 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911358 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911446 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911680 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911766 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.911986 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.912074 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.912284 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.912369 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.912525 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:37:31.912621 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.913387 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.913696 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.914036 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.914345 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.914652 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.914966 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.915276 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.915599 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.915920 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.916227 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.916545 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.916867 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.917207 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.917517 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.917888 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.918214 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.918525 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.918831 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.919131 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:37:31.919370 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:37:32.064765 n-d-860556-1 devstack@n-api.service[113722]: INFO dbcounter [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Registered counter for database nova_api Oct 06 12:37:32.076114 n-d-860556-1 devstack@n-api.service[113721]: INFO dbcounter [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Registered counter for database nova_api Oct 06 12:37:32.086158 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_db.sqlalchemy.engines [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.092591 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writer thread running {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.095678 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_db.sqlalchemy.engines [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.102671 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writer thread running {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.149845 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.context [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=113722) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:37:32.153755 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:32.154205 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:32.155755 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:32.156468 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:32.156913 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:32.158917 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:32.159781 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.context [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=113721) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:37:32.160874 n-d-860556-1 devstack@n-api.service[113722]: INFO dbcounter [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Registered counter for database nova_cell0 Oct 06 12:37:32.163680 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:32.164153 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:32.164839 n-d-860556-1 devstack@n-api.service[113722]: INFO dbcounter [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Registered counter for database nova_cell1 Oct 06 12:37:32.165727 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:32.166472 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:37:32.166926 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:37:32.168912 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_concurrency.lockutils [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:37:32.170947 n-d-860556-1 devstack@n-api.service[113721]: INFO dbcounter [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Registered counter for database nova_cell0 Oct 06 12:37:32.171896 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_db.sqlalchemy.engines [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.174256 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_db.sqlalchemy.engines [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.175086 n-d-860556-1 devstack@n-api.service[113721]: INFO dbcounter [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Registered counter for database nova_cell1 Oct 06 12:37:32.181157 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writer thread running {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.182344 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_db.sqlalchemy.engines [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.184493 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_db.sqlalchemy.engines [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.185730 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writer thread running {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.189444 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writer thread running {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.192256 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writer thread running {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.326297 n-d-860556-1 devstack@n-api.service[113722]: INFO dbcounter [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Registered counter for database nova_cell0 Oct 06 12:37:32.335198 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_db.sqlalchemy.engines [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.335810 n-d-860556-1 devstack@n-api.service[113721]: INFO dbcounter [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Registered counter for database nova_cell0 Oct 06 12:37:32.339997 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writer thread running {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.342537 n-d-860556-1 devstack@n-api.service[113721]: DEBUG oslo_db.sqlalchemy.engines [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:37:32.347151 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writer thread running {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:37:32.680585 n-d-860556-1 devstack@n-api.service[113721]: WARNING keystonemiddleware.auth_token [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:37:32.682593 n-d-860556-1 devstack@n-api.service[113722]: WARNING keystonemiddleware.auth_token [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:37:32.687840 n-d-860556-1 devstack@n-api.service[113721]: WARNING keystonemiddleware.auth_token [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:37:32.689851 n-d-860556-1 devstack@n-api.service[113722]: WARNING keystonemiddleware.auth_token [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:37:33.029371 n-d-860556-1 devstack@n-api.service[113721]: WARNING keystonemiddleware.auth_token [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:37:33.031715 n-d-860556-1 devstack@n-api.service[113722]: WARNING keystonemiddleware.auth_token [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:37:33.035223 n-d-860556-1 devstack@n-api.service[113721]: WARNING keystonemiddleware.auth_token [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:37:33.037651 n-d-860556-1 devstack@n-api.service[113722]: WARNING keystonemiddleware.auth_token [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:37:33.041002 n-d-860556-1 devstack@n-api.service[113721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56231502a9c0 pid: 113721 (default app) Oct 06 12:37:33.043097 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:37:33.043545 n-d-860556-1 devstack@n-api.service[113722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56231502a9c0 pid: 113722 (default app) Oct 06 12:37:33.044280 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-806bf0ec-267a-44f8-b547-2d2a7cfa8933 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Oct 06 12:37:33.044673 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu Oct 6 12:37:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:56.633534 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:56.634902 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Oct 06 12:38:56.635296 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:38:56.648075 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_api:SELECT=3 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:56.649009 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_cell0:SELECT=3 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:56.650302 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_cell1:SELECT=3 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:56.651092 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:38:57.598453 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7be1f165-8bd4-48af-a42e-bb4c45774ba3 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:38:57.633443 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7be1f165-8bd4-48af-a42e-bb4c45774ba3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.991295 Oct 06 12:38:57.634379 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 12:38:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:39:00.440258 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:00.442002 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-63550774-dcdc-4b68-b7dc-b4ced005daad None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Oct 06 12:39:00.442416 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:00.945213 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-679a26bc-9968-4da7-a576-71f737e4af38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:01.001985 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-679a26bc-9968-4da7-a576-71f737e4af38 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553074 Oct 06 12:39:01.002560 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:01.017461 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_api:SELECT=3 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:01.018415 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_cell1:SELECT=3 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:01.020361 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_cell0:SELECT=3 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:01.021184 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:01.246762 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-37eed4ee-2c13-435d-9b8b-0e5a91fa8d24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:01.329092 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-37eed4ee-2c13-435d-9b8b-0e5a91fa8d24 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.316834 Oct 06 12:39:01.329696 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Oct 6 12:39:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:04.170197 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-679a26bc-9968-4da7-a576-71f737e4af38 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:04.171210 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-679a26bc-9968-4da7-a576-71f737e4af38 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 06 12:39:04.171895 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:05.238789 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-7b8e1510-1fe4-46ef-b44e-a59c2e162453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:05.315249 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-7b8e1510-1fe4-46ef-b44e-a59c2e162453 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.135875 Oct 06 12:39:05.316626 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:39:05.335507 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-39d67177-bb80-4969-8f8e-3822c92700cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:05.397143 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-39d67177-bb80-4969-8f8e-3822c92700cf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067410 Oct 06 12:39:05.398010 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Oct 6 12:39:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:08.616312 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-7b8e1510-1fe4-46ef-b44e-a59c2e162453 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:08.617291 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-7b8e1510-1fe4-46ef-b44e-a59c2e162453 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Oct 06 12:39:08.623204 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:09.232930 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7471f844-6b13-4253-8216-b8d90f104ab1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:09.256083 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7471f844-6b13-4253-8216-b8d90f104ab1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.631291 Oct 06 12:39:09.257314 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:39:09.270330 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-ba910ba4-6eed-4d8a-bb89-df8422534dbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:09.301957 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-ba910ba4-6eed-4d8a-bb89-df8422534dbe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035186 Oct 06 12:39:09.302629 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Oct 6 12:39:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:12.211508 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7471f844-6b13-4253-8216-b8d90f104ab1 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:12.213112 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7471f844-6b13-4253-8216-b8d90f104ab1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Oct 06 12:39:12.213672 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:12.855019 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-9118167b-6d24-40b9-b7b8-3f902ddc3075 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "vcpus": 2, "swap": 0}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:12.882400 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-9118167b-6d24-40b9-b7b8-3f902ddc3075 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.656859 Oct 06 12:39:12.882554 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:39:12.895771 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-c0ff41b6-fce7-4482-8ff1-82b50b249a54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:12.934735 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-c0ff41b6-fce7-4482-8ff1-82b50b249a54 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042566 Oct 06 12:39:12.941836 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Oct 6 12:39:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:15.719743 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-9118167b-6d24-40b9-b7b8-3f902ddc3075 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:15.721465 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-9118167b-6d24-40b9-b7b8-3f902ddc3075 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 Oct 06 12:39:15.738836 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:16.225934 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:16.253545 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524441 Oct 06 12:39:16.268247 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-8bb59e6d-490d-465c-a1ea-2b48690b9f05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:16.275379 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:16.306113 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-8bb59e6d-490d-465c-a1ea-2b48690b9f05 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041439 Oct 06 12:39:16.327774 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Oct 6 12:39:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:19.441412 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:19.442901 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Oct 06 12:39:19.446344 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:20.012151 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-f9712090-d5d2-4df4-a00c-a07273e7e9eb admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:20.039630 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-f9712090-d5d2-4df4-a00c-a07273e7e9eb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.587087 Oct 06 12:39:20.040630 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 12:39:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:39:23.387422 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:23.388457 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-d1b257e7-4fc3-4424-b6ea-0c539b3dc6d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 06 12:39:23.388869 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:39:23.937947 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-1a627deb-eaa1-41d3-93cc-58d740991d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:23.968143 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-1a627deb-eaa1-41d3-93cc-58d740991d08 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.572244 Oct 06 12:39:23.968701 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:39:23.981198 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-e9cb9f33-da74-4579-80d5-1bc1e4955656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:24.010442 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-e9cb9f33-da74-4579-80d5-1bc1e4955656 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032911 Oct 06 12:39:24.011285 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Oct 6 12:39:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:26.734126 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-1a627deb-eaa1-41d3-93cc-58d740991d08 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:26.735151 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-1a627deb-eaa1-41d3-93cc-58d740991d08 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 06 12:39:26.735566 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:27.204088 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-cb55ba75-d5d7-433d-950d-b6ca594af1fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:27.210399 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:27.226181 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-cb55ba75-d5d7-433d-950d-b6ca594af1fc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483711 Oct 06 12:39:27.227070 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:27.238850 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-c762a162-4eb6-4c5a-be1f-a045aff16655 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:27.265889 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-c762a162-4eb6-4c5a-be1f-a045aff16655 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030741 Oct 06 12:39:27.266548 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Oct 6 12:39:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:39:30.020825 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-cb55ba75-d5d7-433d-950d-b6ca594af1fc admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:30.023370 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-cb55ba75-d5d7-433d-950d-b6ca594af1fc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002967 Oct 06 12:39:30.026079 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:30.486482 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-82e77992-211e-412d-87f2-6a3aaba00330 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:30.514414 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-82e77992-211e-412d-87f2-6a3aaba00330 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.482976 Oct 06 12:39:30.515108 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:30.528424 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-fabd1ebe-1ac3-4cb1-8007-9f309ec92507 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:30.555625 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-fabd1ebe-1ac3-4cb1-8007-9f309ec92507 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030756 Oct 06 12:39:30.556372 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Oct 6 12:39:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:33.281756 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-82e77992-211e-412d-87f2-6a3aaba00330 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:33.282859 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-82e77992-211e-412d-87f2-6a3aaba00330 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 06 12:39:33.283179 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:33.788705 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-fe562951-b3e6-4e14-902f-d3edf4d992dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "disk": 80}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:33.814327 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-fe562951-b3e6-4e14-902f-d3edf4d992dc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.523579 Oct 06 12:39:33.815084 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:33.828069 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-1d89a60d-fc09-4df8-b2a5-363772ab4b35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:33.833698 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:33.857271 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-1d89a60d-fc09-4df8-b2a5-363772ab4b35 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032852 Oct 06 12:39:33.858495 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Oct 6 12:39:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:36.761068 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-fe562951-b3e6-4e14-902f-d3edf4d992dc admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:36.762026 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-fe562951-b3e6-4e14-902f-d3edf4d992dc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 06 12:39:36.767519 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:37.292567 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:37.324069 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.554803 Oct 06 12:39:37.324795 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Oct 6 12:39:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:39:37.344626 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-8e3878f1-44c1-4b73-9722-cf33222f4670 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:39:37.372191 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-8e3878f1-44c1-4b73-9722-cf33222f4670 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036842 Oct 06 12:39:37.372789 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Oct 6 12:39:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:39:57.945059 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:57.946098 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 06 12:39:57.946497 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:39:57.956874 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:39:58.391232 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-c250de3f-4131-4cf3-9c11-30201ec817d8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:58.408913 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-c250de3f-4131-4cf3-9c11-30201ec817d8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456560 Oct 06 12:39:58.409467 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 12:39:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:39:59.786970 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:39:59.788588 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-63a67c21-3b6c-4ad8-94ec-be30453114c4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Oct 06 12:39:59.788982 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:00.347057 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-29b5ac06-caa1-4fa3-bbab-6e22d3737ef6 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:00.352947 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.wsgi [None req-29b5ac06-caa1-4fa3-bbab-6e22d3737ef6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-29b5ac06-caa1-4fa3-bbab-6e22d3737ef6 admin admin] Request method failure captured: Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Accept: application/json Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Accept-Encoding: gzip, deflate Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Connection: keep-alive Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Content-Length: 0 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Host: 10.222.0.26 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: Openstack-System-Scope: None Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: User-Agent: python-novaclient Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Auth-Token: gAAAAABjPsyfAgPuM3h4dfuY07vgSpuc_-tgQN_rhxlC_8Iu7JLLf1Avp-HEGFUm7wZMr6YEQLOsATxkkHIm0eqghv_x9XISYsrPlfFQ-MQ6Ww2X7qBZA3amQSpws1_Bn1Qh_FrGeQKt-kgCI1ytjr217eP-Z70YXa8HE7NrCOZWZkNYB8Ho2BI Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Id: None Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Name: None Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Identity-Status: Confirmed Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Is-Admin-Project: True Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Id: default Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Name: Default Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Name: admin Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Role: member,reader,admin Oct 06 12:40:00.356234 n-d-860556-1 devstack@n-api.service[113721]: X-Roles: member,reader,admin Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant: admin Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Name: admin Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-User: admin Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Id: default Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Name: Default Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: X-User-Name: admin Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: method: > Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: exception: Flavor 42 could not be found. Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: action_args: {'id': '42'} Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:00.357720 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:00.358632 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.360005 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-29b5ac06-caa1-4fa3-bbab-6e22d3737ef6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:00.362058 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-29b5ac06-caa1-4fa3-bbab-6e22d3737ef6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.407133 Oct 06 12:40:00.362058 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Oct 6 12:39:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:00.368076 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-c2e8ca02-5ff0-46d1-a28b-f163a63787ba admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:00.372086 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:40:00.391486 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-c2e8ca02-5ff0-46d1-a28b-f163a63787ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027564 Oct 06 12:40:00.392038 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:40:00.404662 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-a50bce54-2f18-4b9c-abee-c59e60d7a930 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:00.427421 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-a50bce54-2f18-4b9c-abee-c59e60d7a930 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027129 Oct 06 12:40:00.427959 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:40:00.438331 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-688266ea-d3ef-4dbb-b97c-1b0870b5443f admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:00.444156 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.wsgi [None req-688266ea-d3ef-4dbb-b97c-1b0870b5443f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-688266ea-d3ef-4dbb-b97c-1b0870b5443f admin admin] Request method failure captured: Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Accept: application/json Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Accept-Encoding: gzip, deflate Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Connection: keep-alive Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Content-Length: 0 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Host: 10.222.0.26 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: Openstack-System-Scope: None Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: User-Agent: python-novaclient Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Auth-Token: gAAAAABjPsyfAgPuM3h4dfuY07vgSpuc_-tgQN_rhxlC_8Iu7JLLf1Avp-HEGFUm7wZMr6YEQLOsATxkkHIm0eqghv_x9XISYsrPlfFQ-MQ6Ww2X7qBZA3amQSpws1_Bn1Qh_FrGeQKt-kgCI1ytjr217eP-Z70YXa8HE7NrCOZWZkNYB8Ho2BI Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Id: None Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Name: None Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Identity-Status: Confirmed Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Is-Admin-Project: True Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Id: default Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Name: Default Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Name: admin Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Role: member,reader,admin Oct 06 12:40:00.447405 n-d-860556-1 devstack@n-api.service[113722]: X-Roles: member,reader,admin Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant: admin Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Name: admin Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-User: admin Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Id: default Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Name: Default Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: X-User-Name: admin Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: method: > Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: exception: Flavor 42 could not be found. Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: action_args: {'id': '42'} Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:00.448866 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:00.449876 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:00.451587 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-688266ea-d3ef-4dbb-b97c-1b0870b5443f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:00.453062 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-688266ea-d3ef-4dbb-b97c-1b0870b5443f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014959 Oct 06 12:40:00.453062 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Oct 6 12:40:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:01.713613 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-a50bce54-2f18-4b9c-abee-c59e60d7a930 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:01.714895 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-a50bce54-2f18-4b9c-abee-c59e60d7a930 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001860 Oct 06 12:40:01.715431 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:02.239306 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0a67ded4-118d-4ffc-84d9-db04f018283e admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:02.244789 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.wsgi [None req-0a67ded4-118d-4ffc-84d9-db04f018283e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0a67ded4-118d-4ffc-84d9-db04f018283e admin admin] Request method failure captured: Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Accept: application/json Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Accept-Encoding: gzip, deflate Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Connection: keep-alive Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Content-Length: 0 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Host: 10.222.0.26 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: Openstack-System-Scope: None Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: User-Agent: python-novaclient Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Auth-Token: gAAAAABjPsyh3RApaITHbqe9YI_mQOPFGMyJqkd1MDTfIdpn7C59y8oadVwWo9_c-h_vk1spnQzwNTStxxqsrAaMVPx6cAUpPwAGHKvxgqJqb6ocRGxocLIGGr2ozx_Mdrwv78mIFmIokWv4nsOCaHCELuQO7ArO1O6c5lgXomaaZztPH8ccAEk Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Id: None Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Name: None Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Identity-Status: Confirmed Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Is-Admin-Project: True Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Id: default Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Name: Default Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Name: admin Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Role: member,reader,admin Oct 06 12:40:02.246299 n-d-860556-1 devstack@n-api.service[113722]: X-Roles: member,reader,admin Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant: admin Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Name: admin Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-User: admin Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Id: default Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Name: Default Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: X-User-Name: admin Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: method: > Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: exception: Flavor 84 could not be found. Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: action_args: {'id': '84'} Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:02.248012 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:02.248983 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.250366 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0a67ded4-118d-4ffc-84d9-db04f018283e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:02.251605 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-0a67ded4-118d-4ffc-84d9-db04f018283e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396118 Oct 06 12:40:02.251605 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Oct 6 12:40:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:02.258670 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-04813132-470f-4776-bbb1-3ab5e220fac2 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:02.273612 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-04813132-470f-4776-bbb1-3ab5e220fac2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019438 Oct 06 12:40:02.274200 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:40:02.283856 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-8bf8b6cd-2c89-48eb-90f4-e1501cc6febe admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:02.300700 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-8bf8b6cd-2c89-48eb-90f4-e1501cc6febe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020498 Oct 06 12:40:02.301258 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:40:02.311910 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-e231acea-465a-4dec-9dcc-7abe98f946e7 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:02.317246 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.wsgi [None req-e231acea-465a-4dec-9dcc-7abe98f946e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-e231acea-465a-4dec-9dcc-7abe98f946e7 admin admin] Request method failure captured: Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Accept: application/json Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Accept-Encoding: gzip, deflate Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Connection: keep-alive Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Content-Length: 0 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Host: 10.222.0.26 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: Openstack-System-Scope: None Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: User-Agent: python-novaclient Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Auth-Token: gAAAAABjPsyh3RApaITHbqe9YI_mQOPFGMyJqkd1MDTfIdpn7C59y8oadVwWo9_c-h_vk1spnQzwNTStxxqsrAaMVPx6cAUpPwAGHKvxgqJqb6ocRGxocLIGGr2ozx_Mdrwv78mIFmIokWv4nsOCaHCELuQO7ArO1O6c5lgXomaaZztPH8ccAEk Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Id: None Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Name: None Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Identity-Status: Confirmed Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Is-Admin-Project: True Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Id: default Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Name: Default Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Name: admin Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Role: member,reader,admin Oct 06 12:40:02.318856 n-d-860556-1 devstack@n-api.service[113721]: X-Roles: member,reader,admin Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant: admin Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Name: admin Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-User: admin Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Id: default Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Name: Default Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: X-User-Name: admin Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: method: > Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: exception: Flavor 84 could not be found. Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: action_args: {'id': '84'} Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:02.320444 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:02.321406 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:02.322790 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-e231acea-465a-4dec-9dcc-7abe98f946e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:02.324049 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-e231acea-465a-4dec-9dcc-7abe98f946e7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012148 Oct 06 12:40:02.324049 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Oct 6 12:40:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:03.573095 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-8bf8b6cd-2c89-48eb-90f4-e1501cc6febe admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:03.574129 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-8bf8b6cd-2c89-48eb-90f4-e1501cc6febe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 06 12:40:03.574516 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:04.244847 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7f823180-0364-4a5c-8702-0bb547ec03e6 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:04.253406 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.wsgi [None req-7f823180-0364-4a5c-8702-0bb547ec03e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7f823180-0364-4a5c-8702-0bb547ec03e6 admin admin] Request method failure captured: Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Accept: application/json Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Accept-Encoding: gzip, deflate Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Connection: keep-alive Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Content-Length: 0 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Host: 10.222.0.26 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: Openstack-System-Scope: None Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: User-Agent: python-novaclient Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Auth-Token: gAAAAABjPsyjlJZk8jn1kEXGwQaqesvfck8D35HydizDJu1P5ZIuTZrAfneYZ24w0K0i6bs68zYSWIJPqYNfcSygXUUhXsZrNyB1tN2YSooHqaGmUndJpU-zKug1WZuJVUCHp9NwRvwgnjxQVvAVe4a3VyOqyUwAJoVM3xV0rE_tDhToYOliL5Y Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Id: None Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Domain-Name: None Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Identity-Status: Confirmed Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Is-Admin-Project: True Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Id: default Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Domain-Name: Default Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Project-Name: admin Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Role: member,reader,admin Oct 06 12:40:04.257121 n-d-860556-1 devstack@n-api.service[113721]: X-Roles: member,reader,admin Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant: admin Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-Tenant-Name: admin Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-User: admin Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Id: default Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-User-Domain-Name: Default Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: X-User-Name: admin Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: method: > Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: exception: Flavor 451 could not be found. Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: action_args: {'id': '451'} Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:04.258853 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:04.259963 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.262476 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7f823180-0364-4a5c-8702-0bb547ec03e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:04.264740 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7f823180-0364-4a5c-8702-0bb547ec03e6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.545684 Oct 06 12:40:04.264740 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:40:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 547 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:04.271901 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-f798b26c-45d4-4bd4-80cf-9d1750372a96 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:04.297755 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-f798b26c-45d4-4bd4-80cf-9d1750372a96 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029713 Oct 06 12:40:04.298661 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:40:04.314750 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:04.336707 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028471 Oct 06 12:40:04.337377 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Oct 6 12:40:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:40:04.347575 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0b1d23f0-68cb-4092-bc46-0f9ffa308b38 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:04.357160 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.wsgi [None req-0b1d23f0-68cb-4092-bc46-0f9ffa308b38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0b1d23f0-68cb-4092-bc46-0f9ffa308b38 admin admin] Request method failure captured: Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Accept: application/json Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Accept-Encoding: gzip, deflate Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Connection: keep-alive Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Content-Length: 0 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Host: 10.222.0.26 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Openstack-Api-Version: compute 2.92 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: Openstack-System-Scope: None Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: User-Agent: python-novaclient Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Auth-Token: gAAAAABjPsyjlJZk8jn1kEXGwQaqesvfck8D35HydizDJu1P5ZIuTZrAfneYZ24w0K0i6bs68zYSWIJPqYNfcSygXUUhXsZrNyB1tN2YSooHqaGmUndJpU-zKug1WZuJVUCHp9NwRvwgnjxQVvAVe4a3VyOqyUwAJoVM3xV0rE_tDhToYOliL5Y Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Id: None Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Domain-Name: None Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Identity-Status: Confirmed Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Is-Admin-Project: True Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Id: default Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Domain-Name: Default Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Project-Name: admin Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Role: member,reader,admin Oct 06 12:40:04.362866 n-d-860556-1 devstack@n-api.service[113722]: X-Roles: member,reader,admin Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0712f99f89b34cd08010a42da0461933", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0712f99f89b34cd08010a42da0461933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0712f99f89b34cd08010a42da0461933"}]}] Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant: admin Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Id: 0712f99f89b34cd08010a42da0461933 Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-Tenant-Name: admin Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-User: admin Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Id: default Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-User-Domain-Name: Default Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-User-Id: d237ec338b4b4fdf8bb55738859752e9 Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: X-User-Name: admin Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: method: > Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: exception: Flavor 451 could not be found. Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: action_args: {'id': '451'} Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:40:04.365818 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:04.367329 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: ERROR nova.api.openstack.wsgi Oct 06 12:40:04.369428 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-0b1d23f0-68cb-4092-bc46-0f9ffa308b38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:40:04.371456 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-0b1d23f0-68cb-4092-bc46-0f9ffa308b38 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.026085 Oct 06 12:40:04.374384 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:40:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:40:05.619011 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:05.620045 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 06 12:40:05.620441 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:06.217050 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-36d86161-61f9-4e7f-be22-5d444b43dab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:06.238654 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-36d86161-61f9-4e7f-be22-5d444b43dab7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.472683 Oct 06 12:40:06.239211 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Oct 6 12:40:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:40:07.478068 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:07.479095 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 06 12:40:07.479489 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:08.008375 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-79f9c5c0-9245-48e2-a9a9-341108678d86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:08.026768 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-79f9c5c0-9245-48e2-a9a9-341108678d86 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.411095 Oct 06 12:40:08.027225 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Oct 6 12:40:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:40:09.267207 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:09.268252 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 06 12:40:09.268665 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:09.800915 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-92157d07-fbfa-437a-800c-fc4ff3606718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:09.823353 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-92157d07-fbfa-437a-800c-fc4ff3606718 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.416429 Oct 06 12:40:09.823903 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Oct 6 12:40:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:40:11.068052 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:11.069161 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 06 12:40:11.069553 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:11.637630 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-aaefde1e-3280-487d-9ceb-2f65449b1e60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:40:11.658437 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-aaefde1e-3280-487d-9ceb-2f65449b1e60 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.449934 Oct 06 12:40:11.658913 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Oct 6 12:40:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:40:12.910216 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:12.911202 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 06 12:40:12.911597 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:40:13.447284 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-9384789e-7df5-45af-b7bf-3ab4446462bd admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:40:13.467685 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-9384789e-7df5-45af-b7bf-3ab4446462bd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.414520 Oct 06 12:40:13.468219 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Oct 6 12:40:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:41:12.978968 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:12.979987 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-1652de70-4c8e-432f-b230-035e8efddad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 06 12:41:12.980382 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Thu Oct 6 12:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:41:12.992206 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:13.384911 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-31282789-67e7-4b08-8ce4-68c5c4e0bf59 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.405238 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-31282789-67e7-4b08-8ce4-68c5c4e0bf59 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417553 Oct 06 12:41:13.405707 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 12:41:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:41:13.426055 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_api:SELECT=14 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:13.430673 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-c795b126-5fa1-4863-972d-3e1994e8610f admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.437921 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-c795b126-5fa1-4863-972d-3e1994e8610f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013280 Oct 06 12:41:13.438451 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Oct 6 12:41:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:13.450736 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-183399cf-c535-4efa-9ef5-729af3fe4659 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.457938 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-183399cf-c535-4efa-9ef5-729af3fe4659 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010801 Oct 06 12:41:13.458954 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Oct 6 12:41:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:13.470289 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.479390 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012511 Oct 06 12:41:13.480334 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Oct 6 12:41:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:41:13.493179 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-690bf419-6f48-4431-a7c4-ab3a1578d51b admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:41:13.500501 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-690bf419-6f48-4431-a7c4-ab3a1578d51b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011175 Oct 06 12:41:13.501026 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Oct 6 12:41:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:46:45.220293 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:45.221306 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 06 12:46:45.221714 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:46:45.365573 n-d-860556-1 devstack@n-api.service[113722]: DEBUG dbcounter [-] [113722] Writing DB stats nova_api:SELECT=6 {{(pid=113722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:46:45.535635 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:45.541210 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:45.541686 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:45.542144 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:45.542854 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:45.543300 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:45.543712 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:45.583699 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-af86d8ba-c9e3-417e-bac4-b203b023e438 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.219237 Oct 06 12:46:45.584283 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:46:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:46:46.736002 n-d-860556-1 devstack@n-api.service[113721]: DEBUG nova.api.openstack.wsgi [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] Calling method '>' {{(pid=113721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:46.737009 n-d-860556-1 devstack@n-api.service[113721]: INFO nova.api.openstack.requestlog [None req-7d2a0f84-e733-4b0e-b116-ffe27f69f899 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 06 12:46:46.737408 n-d-860556-1 devstack@n-api.service[113721]: [pid: 113721|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Oct 6 12:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:46:46.935300 n-d-860556-1 devstack@n-api.service[113722]: DEBUG nova.api.openstack.wsgi [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Calling method '>' {{(pid=113722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:46:46.938749 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:46.939223 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:46.939646 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:46.940350 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:46:46.940795 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:46:46.941264 n-d-860556-1 devstack@n-api.service[113722]: DEBUG oslo_concurrency.lockutils [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:46:46.964184 n-d-860556-1 devstack@n-api.service[113722]: INFO nova.api.openstack.requestlog [None req-9f42dc27-479f-4d5e-84e9-d45df6bae0eb admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.085510 Oct 06 12:46:46.964763 n-d-860556-1 devstack@n-api.service[113722]: [pid: 113722|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:46:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:47:32.488175 n-d-860556-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 06 12:47:32.489247 n-d-860556-1 devstack@n-api.service[113720]: Thu Oct 6 12:47:32 2022 - graceful shutdown triggered... Oct 06 12:47:32.489718 n-d-860556-1 devstack@n-api.service[113721]: Gracefully killing worker 1 (pid: 113721)... Oct 06 12:47:32.490132 n-d-860556-1 devstack@n-api.service[113722]: Gracefully killing worker 2 (pid: 113722)... Oct 06 12:47:32.622414 n-d-860556-1 devstack@n-api.service[113721]: DEBUG dbcounter [-] [113721] Writing DB stats nova_api:SELECT=4 {{(pid=113721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:47:33.489512 n-d-860556-1 devstack@n-api.service[113720]: worker 1 buried after 1 seconds Oct 06 12:47:33.489512 n-d-860556-1 devstack@n-api.service[113720]: worker 2 buried after 1 seconds Oct 06 12:47:33.489512 n-d-860556-1 devstack@n-api.service[113720]: goodbye to uWSGI. Oct 06 12:47:33.491182 n-d-860556-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 06 12:47:33.492225 n-d-860556-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 06 12:47:33.495016 n-d-860556-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 12:47:33.510404 n-d-860556-1 devstack@n-api.service[129600]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 12:47:33 2022] *** Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: nodename: n-d-860556-1 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: machine: x86_64 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: clock source: unix Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: pcre jit disabled Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: detected number of CPU cores: 4 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: current working directory: / Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: detected binary path: /usr/bin/uwsgi-core Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: your processes number limit is 47680 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: your memory page size is 4096 bytes Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: detected max file descriptor number: 2048 Oct 06 12:47:33.528347 n-d-860556-1 devstack@n-api.service[129600]: lock engine: pthread robust mutexes Oct 06 12:47:33.529488 n-d-860556-1 devstack@n-api.service[129600]: thunder lock: enabled Oct 06 12:47:33.529488 n-d-860556-1 devstack@n-api.service[129600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 12:47:33.529488 n-d-860556-1 devstack@n-api.service[129600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 12:47:33.570928 n-d-860556-1 devstack@n-api.service[129600]: Python main interpreter initialized at 0x5619b46e89c0 Oct 06 12:47:33.570928 n-d-860556-1 devstack@n-api.service[129600]: python threads support enabled Oct 06 12:47:33.570928 n-d-860556-1 devstack@n-api.service[129600]: your server socket listen backlog is limited to 100 connections Oct 06 12:47:33.570928 n-d-860556-1 devstack@n-api.service[129600]: your mercy for graceful operations on workers is 90 seconds Oct 06 12:47:33.571417 n-d-860556-1 devstack@n-api.service[129600]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 12:47:33.571417 n-d-860556-1 devstack@n-api.service[129600]: *** Operational MODE: preforking *** Oct 06 12:47:33.571637 n-d-860556-1 devstack@n-api.service[129600]: *** uWSGI is running in multiple interpreter mode *** Oct 06 12:47:33.571637 n-d-860556-1 devstack@n-api.service[129600]: spawned uWSGI master process (pid: 129600) Oct 06 12:47:33.571863 n-d-860556-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 06 12:47:33.572552 n-d-860556-1 devstack@n-api.service[129600]: spawned uWSGI worker 1 (pid: 129614, cores: 1) Oct 06 12:47:33.577780 n-d-860556-1 devstack@n-api.service[129600]: spawned uWSGI worker 2 (pid: 129615, cores: 1) Oct 06 12:47:33.577780 n-d-860556-1 devstack@n-api.service[129600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 12:47:34.251460 n-d-860556-1 devstack@n-api.service[129615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:47:34.253264 n-d-860556-1 devstack@n-api.service[129614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 12:47:35.442003 n-d-860556-1 devstack@n-api.service[129614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:47:35.442003 n-d-860556-1 devstack@n-api.service[129614]: from cryptography.utils import int_from_bytes Oct 06 12:47:35.442708 n-d-860556-1 devstack@n-api.service[129614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:47:35.442708 n-d-860556-1 devstack@n-api.service[129614]: from cryptography.utils import int_from_bytes Oct 06 12:47:35.452058 n-d-860556-1 devstack@n-api.service[129615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:47:35.452058 n-d-860556-1 devstack@n-api.service[129615]: from cryptography.utils import int_from_bytes Oct 06 12:47:35.452651 n-d-860556-1 devstack@n-api.service[129615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:47:35.452651 n-d-860556-1 devstack@n-api.service[129615]: from cryptography.utils import int_from_bytes Oct 06 12:47:37.926813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:47:37.927502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:47:37.927626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:47:37.927987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:47:37.928249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:47:37.928645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.928975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.929891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.930221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.930561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.930879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.931207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.931535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.931872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.932137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.932457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.932953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860556-1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.933293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.933610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.933957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.934283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.934597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.934941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.935243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.935762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.936220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.936534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.936981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.937189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.937508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.937851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.938190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.938491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.938822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.939127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.939554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860556-1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.939863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.940181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.940505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.940940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.941243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.941564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.941915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.942245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.942556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.942909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.943239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.943563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.943886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.944194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.944508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.944868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.945171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.945489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.945831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.946080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.946394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.946723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.947050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.947381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.947634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.947887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.948208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.948533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.948845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.949158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.949469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.949799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.950114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.950423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.950732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.951044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.951367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.951687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.952012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.952103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:47:37.952533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.952632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:47:37.952727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.952871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:47:37.953031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.953240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:47:37.953340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.953504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:47:37.953597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.953923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.954992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.955942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.956856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860556-1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.957927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.958861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.959790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.960859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.961983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.962947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.963910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860556-1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.964856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.965907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.966985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.967931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.968982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.969941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.970855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.971899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.972957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.973166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.973273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.973477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.973575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.973808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.973913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.974120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.974312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.974430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.974528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.974739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.974838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.975047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.975173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.975371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.975497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.975689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.975807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.976546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.976667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.976863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.976966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.977188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.977289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.977608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.977709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.977897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.978005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.978177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.978285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.978520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.978621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.978843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.978951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.979156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.979286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.979478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.979572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.979799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.979892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.980111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.980221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.980420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.980512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.980728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.980827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.981048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.981149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.981375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.981486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.981687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.981792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.981968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.982075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.982275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.982374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.982583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.982705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.982905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.983036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.983212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.983354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.983521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.983679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.983829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.983996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.984134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.984344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.984438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.984664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.984764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.984981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.985078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.985306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.985446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.985624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.985803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.985948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.986091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.986296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.986429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.986525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.986684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.986846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.987017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.987164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.987319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.987476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.987624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.987760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.987900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.988072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.988177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.988380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.988517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.988690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.988796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.988999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.989105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.989324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.989423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.989633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.989755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.989970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.990063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.990282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.990388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.990591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.990682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.990899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.991001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.991212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.991304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.991525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.991615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.992390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.992492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.992713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.992814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.993016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.993116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.993326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.993419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.993646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.994101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.994197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.994296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.994382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.994474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.994569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.994655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.994868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.994971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.995174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.995276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.995483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.995575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.995789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.995941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.996096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.996239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.996428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.996541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.996718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.996825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.997028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.997138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.997343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.997435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.997652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.997766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.997986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.998113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.998308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.998428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:47:37.998631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.998736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.998945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:37.999906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.000946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.001962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.002882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.003829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.004971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.005921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.006989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.007999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.008959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.009944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.010919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.011820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.012768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.013971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.014918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.015089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.015313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.015468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.015879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.016985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.017969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.018913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.019965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.020891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.021838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.022798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.023970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.024912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.025971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.026907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.027852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.028956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.029900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.030887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.031984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.032978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.033975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.034929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.035065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.035244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.035380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.036183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.036476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.036634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.037893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.038038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.038171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.038311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.038433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.038433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.039862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.040953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.041967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.042910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.043885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.044904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.045016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.045128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.046894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.047996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.048918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.049908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.050937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.051853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.052906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.053874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.054017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.054170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.054920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.055999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.056919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.057066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.057472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.057691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.057839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.057983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.058946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.059078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.059211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.059922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.060885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.061832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.062912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.063992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.064960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.065958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.066823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.067985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.068958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.069861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.070968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.071945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.072105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.072313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.072494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.072703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.072919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.073160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.073374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.073581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.073826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.074967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.075941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.076924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.077076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.077307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.077446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.077919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.078922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.079872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.080987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.081966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.082968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.083900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.084871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.085889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.086885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.087026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.087166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.087321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.087557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.087720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.088952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.089950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.090915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.091926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.092997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.093877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.094992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.095196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.095333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.095525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.095672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.095842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.096926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.097110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.097253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.097400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.097548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.097819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.098987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.099942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.100907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.101607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.101796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.101925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.102868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.103994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.104894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.105909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.106989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.107996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.108389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.108544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.108685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.108827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.108969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.109962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.110942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.111902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.112891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.113907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.114829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.115799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.116018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.116231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.116367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.116508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.116665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.117333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.117474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.117605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.117791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.117960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.118184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.118592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.118742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.118876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.119842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.120991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.121142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.121314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.121458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.121635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.121810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.148778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.150176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.150438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.150594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.150594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.150882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.151016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.151230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.151715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.151855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.151990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.152902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.153948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.154953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.155939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.156972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.157727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.158491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.158603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.158688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.158849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.159887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.160967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.161919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.162941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.163166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.163280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.163393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.164936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.165979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.166937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.167887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.168916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.169987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.170120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.170521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.170909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.171956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.172664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.173467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.174181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.174297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.174411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.174640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.174917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.175906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.176965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.177910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.178940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.179061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.179247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.179885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.180957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.181927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.182957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.183898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.184837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.185934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.186995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.187923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.188966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.189899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.190965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.191976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.192909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.193888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.194973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.195891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.196972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.197948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.198906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.199970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.200809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.201257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.201455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.201577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.201695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.201883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.202969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.203917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.204987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.205918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.206878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.207950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.208988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.209958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.210074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.210204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.210323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.210985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.211358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.211489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.211680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.211802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.211919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.213246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.214911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.215115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.215439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.215762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.216077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.216399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.216718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.217050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.217375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.217687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.218041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.218387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.218727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.219044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.219393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.219729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.220046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.220361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.220671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:47:38.220917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:47:38.269988 n-d-860556-1 devstack@n-api.service[129615]: INFO dbcounter [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Registered counter for database nova_api Oct 06 12:47:38.283599 n-d-860556-1 devstack@n-api.service[129614]: INFO dbcounter [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Registered counter for database nova_api Oct 06 12:47:38.293758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.301940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writer thread running {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.305782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.312662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writer thread running {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.361856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.context [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129615) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:47:38.365971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:47:38.366466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:47:38.368151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:47:38.369041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:47:38.369380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.context [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129614) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 12:47:38.369605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:47:38.371972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:47:38.373516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:47:38.374045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:47:38.374144 n-d-860556-1 devstack@n-api.service[129615]: INFO dbcounter [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Registered counter for database nova_cell0 Oct 06 12:47:38.375661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:47:38.376757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:47:38.376885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:47:38.379005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:47:38.379336 n-d-860556-1 devstack@n-api.service[129615]: INFO dbcounter [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Registered counter for database nova_cell1 Oct 06 12:47:38.381082 n-d-860556-1 devstack@n-api.service[129614]: INFO dbcounter [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Registered counter for database nova_cell0 Oct 06 12:47:38.385474 n-d-860556-1 devstack@n-api.service[129614]: INFO dbcounter [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Registered counter for database nova_cell1 Oct 06 12:47:38.389121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.391743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.394016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.395615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.397090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writer thread running {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.400659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writer thread running {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.401782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writer thread running {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.404425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writer thread running {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.552022 n-d-860556-1 devstack@n-api.service[129615]: INFO dbcounter [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Registered counter for database nova_cell0 Oct 06 12:47:38.554479 n-d-860556-1 devstack@n-api.service[129614]: INFO dbcounter [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Registered counter for database nova_cell0 Oct 06 12:47:38.560397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.562020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:47:38.565452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writer thread running {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.566814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writer thread running {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:47:38.922078 n-d-860556-1 devstack@n-api.service[129614]: WARNING keystonemiddleware.auth_token [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:47:38.930331 n-d-860556-1 devstack@n-api.service[129614]: WARNING keystonemiddleware.auth_token [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:47:38.931560 n-d-860556-1 devstack@n-api.service[129615]: WARNING keystonemiddleware.auth_token [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:47:38.939030 n-d-860556-1 devstack@n-api.service[129615]: WARNING keystonemiddleware.auth_token [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:47:39.285364 n-d-860556-1 devstack@n-api.service[129614]: WARNING keystonemiddleware.auth_token [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:47:39.291636 n-d-860556-1 devstack@n-api.service[129614]: WARNING keystonemiddleware.auth_token [None req-f7fc43b7-9194-4bd9-af2e-37741cbca789 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:47:39.297082 n-d-860556-1 devstack@n-api.service[129614]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619b46e89c0 pid: 129614 (default app) Oct 06 12:47:39.300355 n-d-860556-1 devstack@n-api.service[129615]: WARNING keystonemiddleware.auth_token [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 12:47:39.307546 n-d-860556-1 devstack@n-api.service[129615]: WARNING keystonemiddleware.auth_token [None req-cdf0a03e-0fe0-4c6a-9479-f0336186258f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 12:47:39.312886 n-d-860556-1 devstack@n-api.service[129615]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619b46e89c0 pid: 129615 (default app) Oct 06 12:48:21.261168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.262047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.262965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.264118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.412675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.414588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.415478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:21.416410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:22.376322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Calling method '.version_select at 0x7f7d44ebd550>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:22.386898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129614) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 06 12:48:22.387751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.388111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.388826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.415774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.416268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.416704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.429284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.429784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.430374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.436705 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-76b96335-b18a-4758-8c42-b1bda18b8559 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.186123 Oct 06 12:48:22.437785 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1208 bytes} [Thu Oct 6 12:48:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:48:22.485662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8dd28ffa-f825-4cb6-a9ce-8c6567022d1b tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1013838145", "id": 730516999, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:22.537721 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8dd28ffa-f825-4cb6-a9ce-8c6567022d1b tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.130274 Oct 06 12:48:22.538447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:21 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:22.627505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:22.628779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.629684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.630321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.631410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.632291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.633401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.678196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb3db5d6-11db-4139-ac9a-c6d679eea076 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.239102 Oct 06 12:48:22.679656 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:48:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:22.796866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '.version_select at 0x7f7d44ebbdc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:22.805122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129615) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 06 12:48:22.805940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.806573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.807152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.833717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.834156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.834609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.847609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:22.848001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:22.848434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:22.853256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349d40ce-777b-4e61-8195-91d8c6552419 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:22.856441 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e88a7a4-c4fa-4ec6-883b-ffad78e80ae4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.316752 Oct 06 12:48:22.856773 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-349d40ce-777b-4e61-8195-91d8c6552419 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 06 12:48:22.856993 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 12:48:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349d40ce-777b-4e61-8195-91d8c6552419 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin] Request method failure captured: Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6V3-1U61LxMH7Lx-J6_X-aUDo9QSK5aDKn-lK2PERczR_Ch07TXV1fLHu62TslIqQGrMMJaB52sf-kPCNLBbKQH4GdrngpHTuxOtLqH5eeWpEp8vrXXVFIMtptp5L6iRhWA1A-n79gf8mrtIDcOcQwA0mLzUVEuKrIAJseT20Njzs Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9df30812ebb04d6d9189d29fa90d6f4e Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:22.873371 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9df30812ebb04d6d9189d29fa90d6f4e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9df30812ebb04d6d9189d29fa90d6f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9df30812ebb04d6d9189d29fa90d6f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9df30812ebb04d6d9189d29fa90d6f4e"}]}] Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9df30812ebb04d6d9189d29fa90d6f4e Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1ba4fe9b845f4c78bfb6957fa1036e57 Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:22.874871 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid timestamp for date invalid_time Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'invalid_time'} Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:22.875467 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349d40ce-777b-4e61-8195-91d8c6552419 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:22.876617 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-349d40ce-777b-4e61-8195-91d8c6552419 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532 tempest-InstanceUsageAuditLogNegativeTestJSON-883112532-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.194152 Oct 06 12:48:22.877401 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Oct 6 12:48:22 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:48:22.964075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4366802a-8341-411f-aa27-ade8da575e13 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-780987345", "id": 760565814, "os-flavor-access:is_public": "False"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:22.983841 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4366802a-8341-411f-aa27-ade8da575e13 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.125669 Oct 06 12:48:22.984527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3/6] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:22 2022] POST /compute/v2.1/flavors => generated 427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:22.989226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d60af2d-837f-4658-b86c-76840eb00a70 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764443528"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:22.993344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-7d60af2d-837f-4658-b86c-76840eb00a70 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Generated uuid 0a1ec6b3-ff33-4536-9396-572af6fe3268 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:23.065313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d60af2d-837f-4658-b86c-76840eb00a70 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.079396 Oct 06 12:48:23.073222 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 4/7] 10.222.0.26 () {62 vars in 1205 bytes} [Thu Oct 6 12:48:22 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:23.073407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1967559268", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:23.073527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c050613e-16a2-4007-8699-34743cd3c0c8 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.101445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c050613e-16a2-4007-8699-34743cd3c0c8 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/730516999" status: 202 len: 0 microversion: 2.1 time: 0.033485 Oct 06 12:48:23.102279 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:48:23 2022] DELETE /compute/v2.1/flavors/730516999 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:23.283051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-872d3323-aa17-4244-a292-62a2d97a3c45 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.285053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-872d3323-aa17-4244-a292-62a2d97a3c45 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f5e5248176864173afbcf7919d453f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be44fd3e6574686a2f37db9844c4d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-872d3323-aa17-4244-a292-62a2d97a3c45 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Request method failure captured: Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6TvDzPFyNESsnSsCxSnb3zFWM4dl_lqVl_CkySLMKoeNiZ45pT55jS2i8IkvmUcpp6ObZUpfmzW8F4AaaqAR9GVZFBDegcU4aDobXc7pQJ58o0xQ3fhU5r4qvTj9dXQPO_Nve2jeXyjOjw6UzJTUjDciLxeSrEBKFKZ0hMAKCR084 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 7be44fd3e6574686a2f37db9844c4d22 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:23.289639 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7be44fd3e6574686a2f37db9844c4d22", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7be44fd3e6574686a2f37db9844c4d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7be44fd3e6574686a2f37db9844c4d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7be44fd3e6574686a2f37db9844c4d22"}]}] Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 7be44fd3e6574686a2f37db9844c4d22 Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f5e5248176864173afbcf7919d453f53 Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project Oct 06 12:48:23.291268 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: action_args: {} Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:23.291852 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 06 12:48:23.293042 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.294403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-872d3323-aa17-4244-a292-62a2d97a3c45 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:23.294403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-872d3323-aa17-4244-a292-62a2d97a3c45 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.187717 Oct 06 12:48:23.294403 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 6/9] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:23.299588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f928a302-3c11-4fbe-a14a-4fe1b0bfd530 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f907b4486a5744aabcf0d8b09d8a7158"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:23.441280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:48:23.441765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f928a302-3c11-4fbe-a14a-4fe1b0bfd530 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/760565814/action" status: 200 len: 96 microversion: 2.1 time: 0.145165 Oct 06 12:48:23.442217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 7/10] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:48:23 2022] POST /compute/v2.1/flavors/760565814/action => generated 96 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:23.447007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f431804-0149-468f-b821-17d7e6d50438 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-122991823"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:23.564287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f431804-0149-468f-b821-17d7e6d50438 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.120695 Oct 06 12:48:23.564906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 8/11] 10.222.0.26 () {62 vars in 1210 bytes} [Thu Oct 6 12:48:23 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:23.569491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3f2352b-61f4-41c7-bea6-2e6e4ef77a70 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.601697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3f2352b-61f4-41c7-bea6-2e6e4ef77a70 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035009 Oct 06 12:48:23.602963 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 9/12] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:23.658364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-306214e0-ee31-436b-b1a3-a6866ab69737 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-351115323", "id": 85874488, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:23.676271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-306214e0-ee31-436b-b1a3-a6866ab69737 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 0.072078 Oct 06 12:48:23.686133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 10/13] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:48:23 2022] POST /compute/v2.1/flavors => generated 442 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:23.691377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d02beeda-272c-4db9-987d-4b74ec0ac339 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.693341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d02beeda-272c-4db9-987d-4b74ec0ac339 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f5e5248176864173afbcf7919d453f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be44fd3e6574686a2f37db9844c4d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d02beeda-272c-4db9-987d-4b74ec0ac339 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Request method failure captured: Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-06%2012:48:23 HTTP/1.1 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6TvDzPFyNESsnSsCxSnb3zFWM4dl_lqVl_CkySLMKoeNiZ45pT55jS2i8IkvmUcpp6ObZUpfmzW8F4AaaqAR9GVZFBDegcU4aDobXc7pQJ58o0xQ3fhU5r4qvTj9dXQPO_Nve2jeXyjOjw6UzJTUjDciLxeSrEBKFKZ0hMAKCR084 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 7be44fd3e6574686a2f37db9844c4d22 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:23.695547 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7be44fd3e6574686a2f37db9844c4d22", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7be44fd3e6574686a2f37db9844c4d22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7be44fd3e6574686a2f37db9844c4d22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7be44fd3e6574686a2f37db9844c4d22"}]}] Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 7be44fd3e6574686a2f37db9844c4d22 Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f5e5248176864173afbcf7919d453f53 Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project Oct 06 12:48:23.696646 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2022-10-06 12:48:23'} Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:23.697252 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 06 12:48:23.698292 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:23.699105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d02beeda-272c-4db9-987d-4b74ec0ac339 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:23.699105 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d02beeda-272c-4db9-987d-4b74ec0ac339 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262 tempest-InstanceUsageAuditLogNegativeTestJSON-1845159262-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-06 12:48:23" status: 403 len: 128 microversion: 2.1 time: 0.009727 Oct 06 12:48:23.701342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-06%2012%3A48%3A23 => generated 128 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:23.753183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:48:23.753601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:48:23.754106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:48:23.754510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:48:23.754919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:48:23.769243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:23.770198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:23.770633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:23.771637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:23.772252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:23.773429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:23.810491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Getting quotas for project 94a1c2db877744d78cb8a66ba14c9dcc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:23.818424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Getting quotas for user 3b5c371ba92f49edbb4032d48ee7cf9f and project 94a1c2db877744d78cb8a66ba14c9dcc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:23.822669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe806b27-05a9-4a2e-91d0-36dda01f9a88 tempest-FlavorsAccessTestJSON-1592463376 tempest-FlavorsAccessTestJSON-1592463376-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.830827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:48:23.833558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:48:23.860554 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe806b27-05a9-4a2e-91d0-36dda01f9a88 tempest-FlavorsAccessTestJSON-1592463376 tempest-FlavorsAccessTestJSON-1592463376-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.157931 Oct 06 12:48:23.861302 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 12/15] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:23.867062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4707bd37-84d1-4531-9e3a-2f15fd5d54aa tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:23.877508 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4707bd37-84d1-4531-9e3a-2f15fd5d54aa tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.014733 Oct 06 12:48:23.878426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 13/16] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:23.883671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b283940-39fe-4b70-9658-f8d967245d57 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1352527778", "id": 926165203, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:23.903050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b283940-39fe-4b70-9658-f8d967245d57 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.023212 Oct 06 12:48:23.903777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 14/17] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:23.925268 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e853a0dc-31e1-4cf8-90fb-b425cb41d99a tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048190 Oct 06 12:48:23.926414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 4/18] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:48:23.933176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-965348d6-2a9a-435d-b3e6-d69414327ec6 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f907b4486a5744aabcf0d8b09d8a7158"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.042504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fd6d82a-8e25-4ff7-ae9d-e89a426833d2 tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.057879 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fd6d82a-8e25-4ff7-ae9d-e89a426833d2 tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] 10.222.0.26 "GET /compute/v2.1/flavors/85874488" status: 200 len: 442 microversion: 2.55 time: 0.152985 Oct 06 12:48:24.058659 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 15/19] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:48:23 2022] GET /compute/v2.1/flavors/85874488 => generated 442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:24.063172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bccdf4d2-0ddf-4f06-908e-8acf9a709e1e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.074589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bccdf4d2-0ddf-4f06-908e-8acf9a709e1e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:24.075168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bccdf4d2-0ddf-4f06-908e-8acf9a709e1e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:24.075827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bccdf4d2-0ddf-4f06-908e-8acf9a709e1e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:24.216436 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-965348d6-2a9a-435d-b3e6-d69414327ec6 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/760565814/action" status: 200 len: 21 microversion: 2.1 time: 0.288461 Oct 06 12:48:24.216997 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 5/20] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:48:23 2022] POST /compute/v2.1/flavors/760565814/action => generated 21 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:24.226481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73fd9647-9f34-4aa7-90a4-2e1e9f2c2370 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.259793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73fd9647-9f34-4aa7-90a4-2e1e9f2c2370 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5806 microversion: 2.1 time: 0.041732 Oct 06 12:48:24.261056 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 6/21] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5806 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.265939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d1bb173-5871-45bd-a73c-4b00709702db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.267297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d1bb173-5871-45bd-a73c-4b00709702db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:24.382193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d1bb173-5871-45bd-a73c-4b00709702db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:24.397691 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d1bb173-5871-45bd-a73c-4b00709702db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1220 microversion: 2.1 time: 0.135287 Oct 06 12:48:24.398283 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 7/22] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.402822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-467a5f86-9283-454c-a754-b7b64661e319 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] Action: 'update', calling method: .version_select at 0x7f7d4527db80>, body: {"flavor": {"description": "new"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.451811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-467a5f86-9283-454c-a754-b7b64661e319 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/85874488" status: 200 len: 443 microversion: 2.55 time: 0.052293 Oct 06 12:48:24.453236 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 8/23] 10.222.0.26 () {62 vars in 1213 bytes} [Thu Oct 6 12:48:24 2022] PUT /compute/v2.1/flavors/85874488 => generated 443 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:24.459053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-caf89b1c-e131-424f-9cae-2c39707e7fdb tempest-FlavorsAccessTestJSON-1592463376 tempest-FlavorsAccessTestJSON-1592463376-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.483403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bccdf4d2-0ddf-4f06-908e-8acf9a709e1e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.423410 Oct 06 12:48:24.484282 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 16/24] 10.222.0.26 () {62 vars in 1232 bytes} [Thu Oct 6 12:48:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:24.489352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-422e40b1-07db-4ad8-8844-9913c8a95507 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.513317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-422e40b1-07db-4ad8-8844-9913c8a95507 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/926165203" status: 202 len: 0 microversion: 2.1 time: 0.027108 Oct 06 12:48:24.514105 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 17/25] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:48:24 2022] DELETE /compute/v2.1/flavors/926165203 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:24.515058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-caf89b1c-e131-424f-9cae-2c39707e7fdb tempest-FlavorsAccessTestJSON-1592463376 tempest-FlavorsAccessTestJSON-1592463376-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5806 microversion: 2.1 time: 0.060579 Oct 06 12:48:24.521884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1326dfa4-3ec4-42fe-908c-66c980590f1a tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.525910 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 9/26] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5806 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.530941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4fdd407b-e4de-43f6-abbb-bdf0ca00db56 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.548638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1326dfa4-3ec4-42fe-908c-66c980590f1a tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5718 microversion: 2.55 time: 0.032548 Oct 06 12:48:24.549790 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 18/27] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5718 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:48:24.558639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a6c503b-170f-473a-a268-13e2e0cdec27 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.575668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fdd407b-e4de-43f6-abbb-bdf0ca00db56 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:24.578409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fdd407b-e4de-43f6-abbb-bdf0ca00db56 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:24.579383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fdd407b-e4de-43f6-abbb-bdf0ca00db56 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:24.588736 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a6c503b-170f-473a-a268-13e2e0cdec27 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.037843 Oct 06 12:48:24.605896 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 19/28] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.612754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7f6404a-5987-471b-a87b-d4f7be371c63 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.640795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7f6404a-5987-471b-a87b-d4f7be371c63 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/760565814" status: 202 len: 0 microversion: 2.1 time: 0.032798 Oct 06 12:48:24.641057 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 20/29] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:48:24 2022] DELETE /compute/v2.1/flavors/760565814 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:24.650290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14d800ba-4cab-4e62-8e9f-2be1b5e11184 tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.676435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14d800ba-4cab-4e62-8e9f-2be1b5e11184 tempest-FlavorsV255TestJSON-1595445208 tempest-FlavorsV255TestJSON-1595445208-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3150 microversion: 2.55 time: 0.027970 Oct 06 12:48:24.676435 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 21/30] 10.222.0.26 () {60 vars in 1166 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors => generated 3150 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:48:24.679553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ec4977e-09cd-44c4-8fe2-1c6cb7389064 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-796834650", "id": 513983587, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.698614 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ec4977e-09cd-44c4-8fe2-1c6cb7389064 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.023349 Oct 06 12:48:24.699625 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 22/31] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:24 2022] POST /compute/v2.1/flavors => generated 425 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:24.704336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ed6e17d-09e3-4e6c-af17-cd4d5f61f3b1 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.728122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ed6e17d-09e3-4e6c-af17-cd4d5f61f3b1 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.027238 Oct 06 12:48:24.733874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 23/32] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.747114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ce42a3b-6483-48cc-af63-ccef6892ab44 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.805816 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ce42a3b-6483-48cc-af63-ccef6892ab44 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/85874488" status: 202 len: 0 microversion: 2.55 time: 0.068808 Oct 06 12:48:24.805816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 24/33] 10.222.0.26 () {60 vars in 1196 bytes} [Thu Oct 6 12:48:24 2022] DELETE /compute/v2.1/flavors/85874488 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:48:24.832731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4293be42-6dc6-4218-99fe-b4bc516ced7e tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.861633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:DELETE=14,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:24.883407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4293be42-6dc6-4218-99fe-b4bc516ced7e tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/513983587" status: 202 len: 0 microversion: 2.1 time: 0.073040 Oct 06 12:48:24.884435 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 25/34] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:48:24 2022] DELETE /compute/v2.1/flavors/513983587 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:24.902793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27bf9b79-7818-4178-9913-1c7b49195a64 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1197474026", "id": 2127371010, "os-flavor-access:is_public": "False"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:24.931462 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27bf9b79-7818-4178-9913-1c7b49195a64 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.042211 Oct 06 12:48:24.932060 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 26/35] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:24 2022] POST /compute/v2.1/flavors => generated 431 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:24.938958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d67fdc51-9cef-47eb-b68c-67bc889336e3 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.957718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d67fdc51-9cef-47eb-b68c-67bc889336e3 tempest-FlavorsV255TestJSON-1185131517 tempest-FlavorsV255TestJSON-1185131517-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.024584 Oct 06 12:48:24.958488 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 27/36] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:48:24.963140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4c891a3-6941-4f70-92b5-54905b3429da tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:24.986733 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4c891a3-6941-4f70-92b5-54905b3429da tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027348 Oct 06 12:48:24.987355 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 28/37] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:24.997169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-533d75df-5159-4971-a00e-b444237a1889 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.021999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-533d75df-5159-4971-a00e-b444237a1889 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/2127371010/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029709 Oct 06 12:48:25.027982 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 29/38] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Oct 6 12:48:24 2022] GET /compute/v2.1/flavors/2127371010/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:25.029681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af84d79a-8469-4918-83a4-eac07cfb6250 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-480852147", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.058502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af84d79a-8469-4918-83a4-eac07cfb6250 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.033518 Oct 06 12:48:25.059607 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 30/39] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/flavors => generated 506 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.066239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7c9b6a2-aa64-4ac0-9448-37958f155871 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.082568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4fdd407b-e4de-43f6-abbb-bdf0ca00db56 tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.552030 Oct 06 12:48:25.091431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7c9b6a2-aa64-4ac0-9448-37958f155871 tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2127371010" status: 202 len: 0 microversion: 2.1 time: 0.030547 Oct 06 12:48:25.091805 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 10/40] 10.222.0.26 () {62 vars in 1232 bytes} [Thu Oct 6 12:48:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:25.092515 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 31/41] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:25 2022] DELETE /compute/v2.1/flavors/2127371010 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:25.101672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88bf0ced-7385-4b8a-ba01-7b6f8ff5f03e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.109952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6f90289-16eb-4e6d-95b0-032cd49a175a tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.129644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88bf0ced-7385-4b8a-ba01-7b6f8ff5f03e tempest-AggregatesAdminTestV241-1196844654 tempest-AggregatesAdminTestV241-1196844654-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.032527 Oct 06 12:48:25.131352 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 32/42] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:48:25 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.139346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-411168aa-1142-4111-a588-7f189513a49c tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.179096 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-411168aa-1142-4111-a588-7f189513a49c tempest-FlavorsAccessTestJSON-1621758900 tempest-FlavorsAccessTestJSON-1621758900-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.045304 Oct 06 12:48:25.197168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 33/43] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:25.202102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e6b90dd-ae6e-49ef-ae7b-17eb11f26f52 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1157701111"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.205454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6f90289-16eb-4e6d-95b0-032cd49a175a tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/ad03fc7d-251c-4b1e-9964-ab7bb8b44efc" status: 202 len: 0 microversion: 2.1 time: 0.094854 Oct 06 12:48:25.206182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-3e6b90dd-ae6e-49ef-ae7b-17eb11f26f52 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 2aa7fd46-5cae-4806-81c4-76878021cb8e for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:25.208675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 11/44] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:48:25 2022] DELETE /compute/v2.1/flavors/ad03fc7d-251c-4b1e-9964-ab7bb8b44efc => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:25.227540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8b12a7f-638e-4dd7-b724-f077b583e577 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.237502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e6b90dd-ae6e-49ef-ae7b-17eb11f26f52 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038339 Oct 06 12:48:25.238376 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 34/45] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.253931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63c1c205-1ac8-4293-b8c5-7869eeda0b49 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.267789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63c1c205-1ac8-4293-b8c5-7869eeda0b49 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:25.268409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63c1c205-1ac8-4293-b8c5-7869eeda0b49 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:25.268952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63c1c205-1ac8-4293-b8c5-7869eeda0b49 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:25.279743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8b12a7f-638e-4dd7-b724-f077b583e577 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066001 Oct 06 12:48:25.281435 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 12/46] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:25.302272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bbd9627b-525a-4e25-955f-61b5d9817bd2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-488637569", "id": "6c5107bf-7937-4d00-9645-093e998e4a71", "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.341653 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bbd9627b-525a-4e25-955f-61b5d9817bd2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.043646 Oct 06 12:48:25.350262 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 13/47] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/flavors => generated 506 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.357092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d5804635-99b4-4d93-b1e1-eaa00d0bcb5c tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.390560 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d5804635-99b4-4d93-b1e1-eaa00d0bcb5c tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/6c5107bf-7937-4d00-9645-093e998e4a71" status: 202 len: 0 microversion: 2.1 time: 0.037796 Oct 06 12:48:25.391173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 14/48] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:48:25 2022] DELETE /compute/v2.1/flavors/6c5107bf-7937-4d00-9645-093e998e4a71 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:25.402682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50cf49aa-276f-460e-aec7-971b48cf328e tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.436972 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50cf49aa-276f-460e-aec7-971b48cf328e tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041016 Oct 06 12:48:25.437670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 15/49] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:25.457759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.459318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:25.468299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:25.469077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:25.469731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:25.471620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:25.472703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:25.473345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:25.517068 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63c1c205-1ac8-4293-b8c5-7869eeda0b49 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.269621 Oct 06 12:48:25.518028 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 35/50] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:48:25.523155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63c8035e-35f5-4eba-9d46-b1f535f68d57 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1476225260", "id": 1234167685, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.552550 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63c8035e-35f5-4eba-9d46-b1f535f68d57 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032664 Oct 06 12:48:25.554101 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 36/51] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.560402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.574831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:25.576422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:25.577131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:25.625081 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-860556-1. Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 39 Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:25.648278 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: {"add_host": {"host": "n-h1-860556-1"}} Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:25.649438 n-d-860556-1 devstack@n-api.service[129615]: exception: Aggregate 2 already has host n-h1-860556-1. Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-860556-1'}}} Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result.read() Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:48:25.650170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860556-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi session.flush() Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 12:48:25.651355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 12:48:25.652325 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:48:25.655113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result.read() Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860556-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 6, 12, 48, 25, 609204), 'updated_at': None, 'host': 'n-h1-860556-1', 'aggregate_id': 2}] Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:25.657102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 402, in add_host Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-860556-1. Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.659046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-860556-1. Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:25.661306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-860556-1. Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-860556-1. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5d58c868-008b-483a-ba85-36d34ee2a2de tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.094653 Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 37/52] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 06 12:48:25.662762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de3eb070-dcb7-4b85-b753-128ea30c6617 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.671945 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de3eb070-dcb7-4b85-b753-128ea30c6617 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1234167685" status: 200 len: 414 microversion: 2.1 time: 0.019488 Oct 06 12:48:25.672674 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 38/53] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/flavors/1234167685 => generated 414 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.678336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4121424a-c1ee-4bde-b070-c238a1996ee9 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.691606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:25.694638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4121424a-c1ee-4bde-b070-c238a1996ee9 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:25.695403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4121424a-c1ee-4bde-b070-c238a1996ee9 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:25.695853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4121424a-c1ee-4bde-b070-c238a1996ee9 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:25.721184 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c83573be-41c6-4b99-9b71-ae57018d47ff tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1224 microversion: 2.1 time: 0.269186 Oct 06 12:48:25.723797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 16/54] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1224 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:25.882724 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4121424a-c1ee-4bde-b070-c238a1996ee9 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.206377 Oct 06 12:48:25.883948 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 39/55] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:25.910828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-738b5b2b-fbd3-455d-a458-e6a34a7d937e tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:25.970745 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-738b5b2b-fbd3-455d-a458-e6a34a7d937e tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.068968 Oct 06 12:48:25.971721 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 40/56] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:25 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:25.989343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a02ac9b-4c7b-462c-aaf9-01fe0e9bc88e tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1562066201"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:25.996026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-7a02ac9b-4c7b-462c-aaf9-01fe0e9bc88e tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid efe2ffb3-52dc-4e17-bb58-e0db266e28a7 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:26.043846 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a02ac9b-4c7b-462c-aaf9-01fe0e9bc88e tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062077 Oct 06 12:48:26.045474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 41/57] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:26.051374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd8e549b-e15a-47b7-9a6d-2dbc7a41a7ad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1737688118", "name": "tempest-test_aggregate-907464993"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:26.097159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-fd8e549b-e15a-47b7-9a6d-2dbc7a41a7ad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 2ee40a22-6d6f-47b2-88f4-48da9f8fb6e5 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:26.150452 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd8e549b-e15a-47b7-9a6d-2dbc7a41a7ad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.103186 Oct 06 12:48:26.151366 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 42/58] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Oct 6 12:48:26 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:26.219092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7f37a5b9-e62a-42e5-a3cc-38fe69aebe3e tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.245928 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7f37a5b9-e62a-42e5-a3cc-38fe69aebe3e tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.507398 Oct 06 12:48:26.246976 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 17/59] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:25 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:26.257866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d1a0d29-fbcc-4e0b-831c-b5c9d768e5d9 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.281644 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d1a0d29-fbcc-4e0b-831c-b5c9d768e5d9 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.033359 Oct 06 12:48:26.282585 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 18/60] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:48:26 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:26.304061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-595eff6d-bc25-4315-8db5-52fa2cf52a8c tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.338935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-595eff6d-bc25-4315-8db5-52fa2cf52a8c tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1234167685" status: 202 len: 0 microversion: 2.1 time: 0.054969 Oct 06 12:48:26.345146 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 19/61] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:26 2022] DELETE /compute/v2.1/flavors/1234167685 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:26.351681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4193f6d4-9ec2-459b-9573-a7886d7138e2 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:26.393108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4193f6d4-9ec2-459b-9573-a7886d7138e2 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:26.394244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4193f6d4-9ec2-459b-9573-a7886d7138e2 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:26.394951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4193f6d4-9ec2-459b-9573-a7886d7138e2 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:26.566957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:26.578849 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4193f6d4-9ec2-459b-9573-a7886d7138e2 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 314 microversion: 2.1 time: 0.236800 Oct 06 12:48:26.593878 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 20/62] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:26 2022] POST /compute/v2.1/os-aggregates/4/action => generated 314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:26.601237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf6d7f36-6e71-4ebc-97d9-88cf49c61070 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.635473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf6d7f36-6e71-4ebc-97d9-88cf49c61070 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040001 Oct 06 12:48:26.636390 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 21/63] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:26.663267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab5fb24e-f82d-4a3c-8223-1f4cea29a8c5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2127762268", "id": 1461781941, "os-flavor-access:is_public": "False"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:26.697484 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab5fb24e-f82d-4a3c-8223-1f4cea29a8c5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.042542 Oct 06 12:48:26.700837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 22/64] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:26 2022] POST /compute/v2.1/flavors => generated 430 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:26.716939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c99f3c48-21e2-44d4-99a8-d4bdcf1922e1 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "1461781941"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:26.754106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c99f3c48-21e2-44d4-99a8-d4bdcf1922e1 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] HTTP exception thrown: Flavor 1461781941 could not be found. Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c99f3c48-21e2-44d4-99a8-d4bdcf1922e1 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Request method failure captured: Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 107 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6SVcx2OUYAeiIS4L3olwmiXxp38AzWyesbcJ6v-mzftVxGAumg-egErqlF13gfoj6tA9-Ur7GmMsvmZO98tfwauo0LaSVZTYlexIKoqQvgtwySTDVrJlHiXoXR9iZrRBoredfINbTlDDBaOq-oOALlsLoiKkTiXrPgRMyGKj8BgmY Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c4433e6bedde45448dd9f99b8699f956 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FlavorsAdminTestJSON-830331165 Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:26.767486 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4433e6bedde45448dd9f99b8699f956", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4433e6bedde45448dd9f99b8699f956"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4433e6bedde45448dd9f99b8699f956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4433e6bedde45448dd9f99b8699f956"}]}] Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FlavorsAdminTestJSON-830331165 Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c4433e6bedde45448dd9f99b8699f956 Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-830331165 Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FlavorsAdminTestJSON-830331165-project Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d56e5f578ccf44ed8391e7686e5995b9 Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FlavorsAdminTestJSON-830331165-project Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "test", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "1461781941"}} Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:26.768708 n-d-860556-1 devstack@n-api.service[129614]: exception: Flavor 1461781941 could not be found. Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '1461781941'}}} Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1461781941 could not be found. Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.769394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1461781941 could not be found. Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:26.770503 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:26.771560 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:26.771560 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:26.771560 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:26.771560 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1461781941 could not be found. Oct 06 12:48:26.771560 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.778868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c99f3c48-21e2-44d4-99a8-d4bdcf1922e1 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Returning 400 to user: Flavor 1461781941 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:26.782789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c99f3c48-21e2-44d4-99a8-d4bdcf1922e1 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.074048 Oct 06 12:48:26.785528 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 23/65] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:26 2022] POST /compute/v2.1/servers => generated 81 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:48:26.804429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.805412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:26.836042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:26.836832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:26.839219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:26.840874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-081ae083-eee0-4d42-b3e7-1e586e07efc9 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:26.841359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:26.842987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:26.843758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:26.845656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-081ae083-eee0-4d42-b3e7-1e586e07efc9 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-081ae083-eee0-4d42-b3e7-1e586e07efc9 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 39 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:26.852214 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: {"add_host": {"host": "n-h1-860556-1"}} Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:26.853593 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-860556-1'}}} Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:26.854872 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 06 12:48:26.856126 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:26.869967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-081ae083-eee0-4d42-b3e7-1e586e07efc9 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:26.872266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-081ae083-eee0-4d42-b3e7-1e586e07efc9 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.719562 Oct 06 12:48:26.873049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 43/66] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 721 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:26.886517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed734235-c0cb-467a-9886-43105196c3f1 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.935525 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed734235-c0cb-467a-9886-43105196c3f1 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1461781941" status: 202 len: 0 microversion: 2.1 time: 0.060669 Oct 06 12:48:26.936545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 44/67] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:26 2022] DELETE /compute/v2.1/flavors/1461781941 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:26.941504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4b8f2130-82d2-4181-bf0f-d38ebd0f5761 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:26.984864 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4b8f2130-82d2-4181-bf0f-d38ebd0f5761 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.046965 Oct 06 12:48:26.985689 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 45/68] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:26 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:26.990477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fefd1b09-8d58-4af0-8217-b2f9129e63e5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.025833 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fefd1b09-8d58-4af0-8217-b2f9129e63e5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038504 Oct 06 12:48:27.039541 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 46/69] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:27.073762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:27.082484 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9314fdf4-6dba-4f83-bd9d-cd3be62a3d7c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1302 microversion: 2.1 time: 0.293063 Oct 06 12:48:27.089847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 24/70] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:26 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1302 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:27.095789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0562251e-bc9e-49e0-9771-66dd06579387 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1761216038"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.110167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-0562251e-bc9e-49e0-9771-66dd06579387 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 3d0503e7-3402-4611-b134-b0354b084563 for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:27.173763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0562251e-bc9e-49e0-9771-66dd06579387 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082404 Oct 06 12:48:27.174586 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 25/71] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.183066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19f73211-8546-4d3f-859b-37bdb248bf33 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1311262666", "id": 1158787868, "os-flavor-access:is_public": "False"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.222352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19f73211-8546-4d3f-859b-37bdb248bf33 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.046698 Oct 06 12:48:27.230326 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 26/72] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/flavors => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.230326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1281834974"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.247619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:27.248485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:27.249229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:27.260992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:27.261849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:27.262544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:27.279688 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1281834974 could not be found. Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 58 Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:27.287521 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: {"add_host": {"host": "tempest-nonexist_host-1281834974"}} Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:27.289398 n-d-860556-1 devstack@n-api.service[129614]: exception: Compute host tempest-nonexist_host-1281834974 could not be found. Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1281834974'}}} Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1281834974' is not mapped to any cell Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.290246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 06 12:48:27.291175 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1281834974 could not be found. Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1281834974 could not be found. Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.293070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1281834974 could not be found. Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1281834974 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d40d60d-a589-4418-8395-53ac84c89c68 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.065847 Oct 06 12:48:27.294447 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 27/73] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:27.304884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6fe62c6-f1b1-4aaa-baac-0417e5df17b2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-927688541", "id": 1354645841, "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.331604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6fe62c6-f1b1-4aaa-baac-0417e5df17b2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035964 Oct 06 12:48:27.332201 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 28/74] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/flavors => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.354023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc08b97d-3a9b-46d0-965e-a8d46ac9e138 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.398576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc08b97d-3a9b-46d0-965e-a8d46ac9e138 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057269 Oct 06 12:48:27.400853 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 29/75] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:27.412024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9dfa031-7211-4c37-bfb6-a2d26da938ed tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.451484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1741352413", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "availability_zone": "tempest-test_az-1737688118"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.478897 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9dfa031-7211-4c37-bfb6-a2d26da938ed tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.073570 Oct 06 12:48:27.481549 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 30/76] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.497356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:27.498563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:27.500341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:27.502140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:27.502967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ad9939b-a2c0-45f3-80ee-c302c5863cd0 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.503668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:27.504100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ad9939b-a2c0-45f3-80ee-c302c5863cd0 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 283 Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:27.517257 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.518727 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:27.519240 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:27.519769 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.520760 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.522108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:27.522108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:27.522108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:48:27.522108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.528292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ad9939b-a2c0-45f3-80ee-c302c5863cd0 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:27.529506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ad9939b-a2c0-45f3-80ee-c302c5863cd0 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.036828 Oct 06 12:48:27.530287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 31/77] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:27.538827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e086b66c-a7f2-43e5-aef7-98845e9ce340 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.555810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e086b66c-a7f2-43e5-aef7-98845e9ce340 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.023672 Oct 06 12:48:27.556948 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 32/78] 10.222.0.26 () {58 vars in 1177 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.572464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b105c36b-a27c-46e4-9e4f-316168250a55 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b105c36b-a27c-46e4-9e4f-316168250a55 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 27 Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:27.577245 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: {"aggregate": {"name": ""}} Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:27.578461 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi '' Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:27.579110 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 06 12:48:27.580223 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.582794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b105c36b-a27c-46e4-9e4f-316168250a55 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:27.584510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b105c36b-a27c-46e4-9e4f-316168250a55 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017559 Oct 06 12:48:27.586392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 33/79] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:27.591855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2685c87f-022d-4ab2-964f-3e7ea43fb1a8 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.603003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=77,nova_api:INSERT=9 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:27.603777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2685c87f-022d-4ab2-964f-3e7ea43fb1a8 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.015682 Oct 06 12:48:27.613710 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 34/80] 10.222.0.26 () {58 vars in 1171 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.620120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d724b341-b07d-431a-8cb2-a0a7706fd68b tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-484477805"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.624449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d724b341-b07d-431a-8cb2-a0a7706fd68b tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d724b341-b07d-431a-8cb2-a0a7706fd68b tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 59 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:27.627563 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: {"aggregate": {"name": "tempest-test_aggregate-484477805"}} Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:27.631229 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-484477805'}}} Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:27.632455 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:27.633432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 06 12:48:27.634474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.634474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d724b341-b07d-431a-8cb2-a0a7706fd68b tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:27.635497 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d724b341-b07d-431a-8cb2-a0a7706fd68b tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015356 Oct 06 12:48:27.636317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 35/81] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:27.641760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47eb9a87-3110-4c75-878c-62e60cb7bdd6 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.653323 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47eb9a87-3110-4c75-878c-62e60cb7bdd6 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.015745 Oct 06 12:48:27.654284 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 36/82] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.663144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e4914f6-3c5f-479c-8045-29bb78b91ca2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1650096306"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.667723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-3e4914f6-3c5f-479c-8045-29bb78b91ca2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 09545a4d-4280-4e0f-ad00-962b41b40d3d for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:27.714451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e4914f6-3c5f-479c-8045-29bb78b91ca2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057672 Oct 06 12:48:27.715246 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 37/83] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:27.727241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b5521bf-278a-4445-b8c7-ef5208ca9bb5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.765227 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b5521bf-278a-4445-b8c7-ef5208ca9bb5 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.045790 Oct 06 12:48:27.770554 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 38/84] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:27.787199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1650096306"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:27.795269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 1160dda5-d925-41f9-9469-6ccd534648cf for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:27.828566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1650096306 already exists. Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 60 Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:27.835955 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: {"aggregate": {"name": "tempest-test_aggregate-1650096306"}} Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:27.837029 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate tempest-test_aggregate-1650096306 already exists. Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1650096306'}}} Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 317, in create Oct 06 12:48:27.837712 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1650096306 already exists. Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:27.840241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1650096306 already exists. Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1650096306 already exists. Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1650096306 already exists. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:27.841770 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ce43011-b195-4a96-84c0-d47cf94653ad tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.065707 Oct 06 12:48:27.843899 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 39/85] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:27.853957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ceee4cb8-0180-4f5a-903d-1bdc90753130 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.895627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ceee4cb8-0180-4f5a-903d-1bdc90753130 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.056421 Oct 06 12:48:27.896227 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 40/86] 10.222.0.26 () {58 vars in 1175 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:27.903860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96554c5d-ec49-4b06-8523-632e0267ecaa tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:27.954562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96554c5d-ec49-4b06-8523-632e0267ecaa tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.054337 Oct 06 12:48:27.959692 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:27.968659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8284215-3820-4640-bcd3-b9cb17fc2c08 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.001316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8284215-3820-4640-bcd3-b9cb17fc2c08 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.038350 Oct 06 12:48:28.001952 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 42/88] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Oct 6 12:48:27 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.020834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9e583db-d50a-4865-9e30-50e8cf88ec20 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1051592913"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:28.025594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-d9e583db-d50a-4865-9e30-50e8cf88ec20 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid fd7c74d6-62a3-4b2e-a2bd-a8a637427f69 for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:28.054328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9e583db-d50a-4865-9e30-50e8cf88ec20 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051238 Oct 06 12:48:28.061984 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 43/89] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:28.068179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c715930-d5ae-42da-917e-28073bcedcbd tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.091010 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c715930-d5ae-42da-917e-28073bcedcbd tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.027819 Oct 06 12:48:28.091754 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.096644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38b08241-3ac8-44ef-943c-4f3d8e3ab746 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.098040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-38b08241-3ac8-44ef-943c-4f3d8e3ab746 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38b08241-3ac8-44ef-943c-4f3d8e3ab746 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:28.099553 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 06 12:48:28.101221 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '7'} Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:28.101857 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.102796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38b08241-3ac8-44ef-943c-4f3d8e3ab746 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:28.103811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38b08241-3ac8-44ef-943c-4f3d8e3ab746 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.008752 Oct 06 12:48:28.105612 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:28.112787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04213f92-01ca-4fcb-919b-3cdacb463726 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.141163 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04213f92-01ca-4fcb-919b-3cdacb463726 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.031927 Oct 06 12:48:28.142063 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:28.162047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e9eb5bc-17ac-4edd-b8b1-7f8473dc8f54 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.186587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e9eb5bc-17ac-4edd-b8b1-7f8473dc8f54 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1354645841" status: 202 len: 0 microversion: 2.1 time: 0.036792 Oct 06 12:48:28.187183 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 47/93] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/flavors/1354645841 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:28.202942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.204293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:28.215328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:28.216207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:28.217037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:28.218165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:28.219014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:28.219732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:28.329202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:28.337973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a293f72-a41d-4568-8635-d13501e8259e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1300 microversion: 2.1 time: 0.146667 Oct 06 12:48:28.338993 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 48/94] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.344545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5db941c2-bb60-470d-b8ea-d62f91a2ba9d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.356515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5db941c2-bb60-470d-b8ea-d62f91a2ba9d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5db941c2-bb60-470d-b8ea-d62f91a2ba9d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:28.359013 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate -1 could not be found. Oct 06 12:48:28.360172 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '-1'} Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:48:28.360798 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.361750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 06 12:48:28.362884 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.364441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5db941c2-bb60-470d-b8ea-d62f91a2ba9d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:28.365716 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5db941c2-bb60-470d-b8ea-d62f91a2ba9d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024685 Oct 06 12:48:28.366769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 49/95] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:28.373041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84329b28-d793-4ac8-81ae-1df52dd0dfaa tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.398315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84329b28-d793-4ac8-81ae-1df52dd0dfaa tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029701 Oct 06 12:48:28.409922 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 50/96] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.417805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9177e093-7b4b-4080-a8d3-967ede0ba97d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-908044736"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:28.423168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-9177e093-7b4b-4080-a8d3-967ede0ba97d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 43c7e874-bbc6-4d13-910d-f9114e155059 for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:48:28.449556 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9177e093-7b4b-4080-a8d3-967ede0ba97d tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037631 Oct 06 12:48:28.450996 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 51/97] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:48:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:28.456742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d79500bb-60f7-41d5-b3e9-46d9d127a7c3 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.481386 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d79500bb-60f7-41d5-b3e9-46d9d127a7c3 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1158787868" status: 202 len: 0 microversion: 2.1 time: 0.029167 Oct 06 12:48:28.482067 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 52/98] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/flavors/1158787868 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:28.488039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e74082d5-b4da-4e33-9e45-564f4d16cece tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.489572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e74082d5-b4da-4e33-9e45-564f4d16cece tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e74082d5-b4da-4e33-9e45-564f4d16cece tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:28.491720 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 06 12:48:28.492887 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '8'} Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:28.493490 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.494485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e74082d5-b4da-4e33-9e45-564f4d16cece tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:28.495335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e74082d5-b4da-4e33-9e45-564f4d16cece tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.010092 Oct 06 12:48:28.495335 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 53/99] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:28.506608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b6e5670-582a-4dfc-a0cd-395a8c3859fe tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.529998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b6e5670-582a-4dfc-a0cd-395a8c3859fe tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034739 Oct 06 12:48:28.536108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 54/100] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.540111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c541ef63-7fa3-4d7d-92c5-a4a5c4721011 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.552031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:28.580404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c541ef63-7fa3-4d7d-92c5-a4a5c4721011 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.048013 Oct 06 12:48:28.587139 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 55/101] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:48:28.594693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dcf8a7ef-24e2-49a7-ac28-556f0f0cccc2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-122108894", "id": 1348384741, "os-flavor-access:is_public": "False"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:28.621644 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dcf8a7ef-24e2-49a7-ac28-556f0f0cccc2 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032590 Oct 06 12:48:28.630077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 56/102] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:28.636230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7cc4a02-acfc-4f15-b8dd-adc28335a9c4 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.644846 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-e7cc4a02-acfc-4f15-b8dd-adc28335a9c4 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7cc4a02-acfc-4f15-b8dd-adc28335a9c4 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:28.646593 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate -1 could not be found. Oct 06 12:48:28.647749 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '-1'} Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.648444 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 06 12:48:28.649432 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.653785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7cc4a02-acfc-4f15-b8dd-adc28335a9c4 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:28.653785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7cc4a02-acfc-4f15-b8dd-adc28335a9c4 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.016378 Oct 06 12:48:28.653785 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 57/103] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:28.653785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9087c0d-d6de-4ddf-81da-df6ae70c8001 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.676262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9087c0d-d6de-4ddf-81da-df6ae70c8001 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026535 Oct 06 12:48:28.690702 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 58/104] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.702727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2938756-497c-4a62-aff9-b0e052d0f097 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.707245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2938756-497c-4a62-aff9-b0e052d0f097 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2938756-497c-4a62-aff9-b0e052d0f097 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:28.710394 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 06 12:48:28.711504 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:28.712917 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:28.714335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2938756-497c-4a62-aff9-b0e052d0f097 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:28.717384 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2938756-497c-4a62-aff9-b0e052d0f097 tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024245 Oct 06 12:48:28.719002 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 59/105] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:28.731470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2125116e-6d70-4263-9845-401d8b61ebdf tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.739216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:48:28.775153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2125116e-6d70-4263-9845-401d8b61ebdf tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055005 Oct 06 12:48:28.777539 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 60/106] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:28.801068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59567836-2dc1-48bc-877d-91214cd3d29f tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.845618 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59567836-2dc1-48bc-877d-91214cd3d29f tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1348384741" status: 202 len: 0 microversion: 2.1 time: 0.049323 Oct 06 12:48:28.847201 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 61/107] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:28 2022] DELETE /compute/v2.1/flavors/1348384741 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:28.856700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a9ee0c2-3eb7-4bd8-92a6-088a89e33536 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:28.893470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a9ee0c2-3eb7-4bd8-92a6-088a89e33536 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040547 Oct 06 12:48:28.901078 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 62/108] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:28.919215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b77cda2b-910d-4040-9768-e075c3e697dc tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1715877379", "id": 1878764934, "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:28.971035 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b77cda2b-910d-4040-9768-e075c3e697dc tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.058070 Oct 06 12:48:28.979808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 63/109] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:28.994545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5027b031-7deb-4afd-ba48-221f5c5bcf90 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:29.042862 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5027b031-7deb-4afd-ba48-221f5c5bcf90 tempest-FlavorsAdminTestJSON-830331165 tempest-FlavorsAdminTestJSON-830331165-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.055430 Oct 06 12:48:29.046611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 64/110] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:28 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:29.072996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f2c5ae3-864a-4a1e-aa27-672f02cc5737 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:29.137968 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f2c5ae3-864a-4a1e-aa27-672f02cc5737 tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1878764934" status: 202 len: 0 microversion: 2.1 time: 0.072405 Oct 06 12:48:29.140358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 65/111] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:29 2022] DELETE /compute/v2.1/flavors/1878764934 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:29.161670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63e6d4a7-7aa6-4e37-8a61-2ab100862d7a tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:29.212974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63e6d4a7-7aa6-4e37-8a61-2ab100862d7a tempest-FlavorsAdminTestJSON-701388085 tempest-FlavorsAdminTestJSON-701388085-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068307 Oct 06 12:48:29.216845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 66/112] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:29.364990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:29.365197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:29.373770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:29.374275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:29.378415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:29.393096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:48:29.393531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:48:29.394076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:48:29.394507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:48:29.394933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:48:29.399577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:29.400118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:29.400571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:29.440348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:29.440854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:29.441304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:29.448970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:29.449525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:29.449946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:29.579847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Getting quotas for project 353737503ced45bb922a941eeb0364a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:29.624754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Getting quotas for user 057e318935274d4ebc5c50b3fd73d43c and project 353737503ced45bb922a941eeb0364a4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:29.655475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:48:29.680517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:48:29.853090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c21767ba-72b6-4844-9dcf-532eecffc480 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.809550 Oct 06 12:48:29.853765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 47/113] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:48:29.881395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90aaf599-9fd0-400f-ac46-98ff8b414b48 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:29.882118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90aaf599-9fd0-400f-ac46-98ff8b414b48 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:29.965699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:29.990885 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e72ccd9-d53c-40b1-879f-0e43a4a51f37 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.629160 Oct 06 12:48:29.994189 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 67/114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:29 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:30.111058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90aaf599-9fd0-400f-ac46-98ff8b414b48 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:30.166090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90aaf599-9fd0-400f-ac46-98ff8b414b48 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1243 microversion: 2.1 time: 0.297449 Oct 06 12:48:30.168265 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 48/115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:29 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1243 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:31.020508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:31.021149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:31.036705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:31.044126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:31.044126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:31.044126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:31.044869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:31.051304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:31.195948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e5e596f-9dca-485c-970b-8049f5036b69 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:31.196722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e5e596f-9dca-485c-970b-8049f5036b69 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:31.357820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5e5e596f-9dca-485c-970b-8049f5036b69 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:31.367706 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e5e596f-9dca-485c-970b-8049f5036b69 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1243 microversion: 2.1 time: 0.176995 Oct 06 12:48:31.375786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 49/116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:31 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1243 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:31.392444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:31.402832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5bf8383-e0af-4a22-a2d8-26f99554f0af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.388879 Oct 06 12:48:31.404027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 68/117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:31 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:32.406979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:32.407848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:32.427058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:32.428073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:32.431637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:32.433832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:32.434755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:32.436008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:32.633830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:32.666092 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-724294a1-cb7f-499a-b750-910ef89e6258 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1291 microversion: 2.1 time: 0.266698 Oct 06 12:48:32.673818 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 69/118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:32 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1291 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:32.689798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:32.690764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:32.716104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:32.716644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:32.717211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:32.717944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:32.718473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:32.718980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:32.853731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-335215834", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:33.002835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:48:33.015728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:33.034295 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a41b2cde-c7fa-44cb-b978-4ff5659e2abf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.358533 Oct 06 12:48:33.034996 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 70/119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:32 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:33.382278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:48:33.383077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:48:33.383714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:48:33.384688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:48:33.385251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:48:33.400416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.401394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.404777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.408502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.409056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.410517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.459047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Getting quotas for project 3e96e87780a8414ebbcad917ddf5bdd5. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:33.478326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Getting quotas for user cc17e783f95d40a892c4fb255e315a46 and project 3e96e87780a8414ebbcad917ddf5bdd5. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:33.521331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:48:33.523992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:48:33.675478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-352397fc-05ad-4cc8-81f3-4be63017bb33 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.600571 Oct 06 12:48:33.679621 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 50/120] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:48:33.694421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3a0b38e-0af2-484f-b8a8-b3346df37b6f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:33.695047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3a0b38e-0af2-484f-b8a8-b3346df37b6f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:33.703945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c2d490-619c-43e6-a4f2-b69d5a1dc34c", "tag": "0ef4ce90-f791-408e-abc8-a45b2052e10e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:33.755311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.758572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.759194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.823003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Creating event network-changed:0ef4ce90-f791-408e-abc8-a45b2052e10e for instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c on n-h1-860556-1 Oct 06 12:48:33.823554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:48:33.823951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-041e0b60-0220-4e72-8f43-52fa5e91a839 req-cdf90cce-6787-4f0d-bc37-2b0f6d5e4cff service nova] Acquired lock "compute-rpcapi-router" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:48:33.825019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.825483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.829444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.830282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.830766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.831206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.843415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3a0b38e-0af2-484f-b8a8-b3346df37b6f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:33.864013 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3a0b38e-0af2-484f-b8a8-b3346df37b6f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1218 microversion: 2.1 time: 0.173297 Oct 06 12:48:33.865162 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 51/121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:33 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:33.868276 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.rpcapi [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 12:48:33.869201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] Releasing lock "compute-rpcapi-router" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:48:33.871717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:33.872904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:33.911157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55d836e0-b415-4f63-851b-f0a719a3acaa None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429949 Oct 06 12:48:33.913919 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 71/122] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:33.917375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.918348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.925226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:33.926299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:33.932902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:33.932902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:34.067000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:34.068206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:34.083107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:34.089769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:34.095281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:34.101526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:34.102665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:34.104492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:34.144182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:34.159673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a62cb40e-dd08-4fae-bb74-9a670922aa08 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1291 microversion: 2.1 time: 0.291941 Oct 06 12:48:34.160297 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 52/123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:33 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1291 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:34.362743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:34.388591 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92256e8e-f34d-4903-ae00-6f6c0533bef2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.326037 Oct 06 12:48:34.395414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 72/124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:34 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:34.893372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:34.894644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:34.918849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:34.920207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:34.921762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:34.923819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:34.924324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:34.925753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:35.031440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:35.041659 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8492045a-7cec-4d76-b9b8-bc69ed06fd08 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1214 microversion: 2.1 time: 0.153750 Oct 06 12:48:35.042595 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 53/125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:34 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:35.183983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:35.185227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:35.196768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:35.198664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:35.199333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:35.199963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:35.200896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:35.201545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:35.202227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:35.307016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:35.318443 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-decb8ce8-2efc-486e-a5e1-440f1718947f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1291 microversion: 2.1 time: 0.138345 Oct 06 12:48:35.319742 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 73/126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:35 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1291 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:35.417407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:35.418509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:35.431100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:35.431607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:35.432263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:35.433095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:35.433847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:35.435833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:35.783210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:35.800366 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62b530c3-7820-49a9-b820-cc0c572a13b1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.387631 Oct 06 12:48:35.802723 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 54/127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:35 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:36.066682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:36.067445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:36.080409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.081204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.081844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:36.082747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.083361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.083943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:36.196501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:36.205869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ccc3a1b5-a52b-4b3a-814c-5ca1a46420de tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1276 microversion: 2.1 time: 0.142945 Oct 06 12:48:36.218426 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 74/128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:36 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:36.349216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:36.349880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:36.363246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.364913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.368625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:36.370673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.380450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.383402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:36.540115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:36.552202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be9964f6-d8a5-4990-b69b-fccf50ff41c2 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1291 microversion: 2.1 time: 0.207427 Oct 06 12:48:36.562794 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 55/129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:36 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1291 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:36.830108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:36.831127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:36.844101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.846263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.846897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:36.849959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:36.850810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:36.852786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.242042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:37.255642 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-988fec41-85ea-4744-a0f0-ee2973ea2d9d tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.429739 Oct 06 12:48:37.259588 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 56/130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:36 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:37.430729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Calling method '.version_select at 0x7f7d440c1ca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:37.432644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.433143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.438047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.506582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.512300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.517693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.550136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.551304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.553309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.571877 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f56dd9f-f1de-4050-9216-b4dff7bc3326 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.968629 Oct 06 12:48:37.582580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 75/131] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:37.587755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:37.594344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:37.621552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.624799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.626377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.627524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.630015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.630640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.854548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:37.890139 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4450d0e1-bd89-4afc-ada2-8069a5cfc2a0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1276 microversion: 2.1 time: 0.300623 Oct 06 12:48:37.891174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 76/132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:37 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1276 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:37.915619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:37.916634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:37.968544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.981658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.983392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:37.989292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:37.991606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:37.992839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:38.041592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:38.186505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c73f3088-9fe2-441e-9b5b-8ce89c8e00c6 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Action: 'create', calling method: .version_select at 0x7f7d3ff06700>, body: {"keypair": {"name": "tempest-keypair-7834641", "type": "ssh", "user_id": "f77a54f48c4b4b3f8a22c7b4cb6f958d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxI5uTMHy7a/YAvXWzHToHfwxYNafCdQtnQvZMjiyf/zLB5iEPLIHoYv6EtnHmg743gJtIRvOq+jkHRpnl8qJ0Q4uyetJJXottf/f/TRpiIbk3h4d0PpSHZxD9qo/EzZg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:38.260994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:38.275600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c73f3088-9fe2-441e-9b5b-8ce89c8e00c6 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:38.275994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a00ef877-05bf-4e4a-91ed-bf22abf3fb81 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1297 microversion: 2.1 time: 0.378981 Oct 06 12:48:38.280329 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 77/133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:37 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1297 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:38.300552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c73f3088-9fe2-441e-9b5b-8ce89c8e00c6 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for user 34ba3bfa0e3b4aba8bbd8ca3c913644c and project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:38.367675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c73f3088-9fe2-441e-9b5b-8ce89c8e00c6 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.10 time: 1.106083 Oct 06 12:48:38.369070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 57/134] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:48:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:48:38.677624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c2028c0-a8fa-434f-8237-019dd7327ec8 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Calling method '.version_select at 0x7f7d3ffe6310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:38.680047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c2028c0-a8fa-434f-8237-019dd7327ec8 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '9f606c2b68164a84942ae01e778c9615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3246c677a74ea39e29dca6fa944b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c2028c0-a8fa-434f-8237-019dd7327ec8 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Request method failure captured: Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hypervisors/n-h1-860556-1/search HTTP/1.1 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6i3IwRaQgg0bhT2P1zKjJ3mBZV1GV7t_C8G5DWBUp5fARxUOEcg4szSCN19wuO3n3NPFdAH-hLPm5Xybwp8u1a_dP9nYMu9eYD0uFERORKuk0mZFNhq3viheY6AUMYeaK5tOtzEhOmUlzNfOrvsNlYQz6BYoIyC-wyH_4fR7d31JM Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3a3246c677a74ea39e29dca6fa944b24 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:38.682255 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a3246c677a74ea39e29dca6fa944b24", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a3246c677a74ea39e29dca6fa944b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a3246c677a74ea39e29dca6fa944b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a3246c677a74ea39e29dca6fa944b24"}]}] Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3a3246c677a74ea39e29dca6fa944b24 Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9f606c2b68164a84942ae01e778c9615 Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 06 12:48:38.683449 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'n-h1-860556-1'} Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:38.684125 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 06 12:48:38.685145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:38.686126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c2028c0-a8fa-434f-8237-019dd7327ec8 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:38.686126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c2028c0-a8fa-434f-8237-019dd7327ec8 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-860556-1/search" status: 403 len: 117 microversion: 2.1 time: 0.400116 Oct 06 12:48:38.694027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 78/135] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Oct 6 12:48:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-860556-1/search => generated 117 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:38.710029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:38.713721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:38.754049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:38.754693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:38.755226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:38.756009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:38.763213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:38.763778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:39.211057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e55bc993-5de0-471f-839c-341e4f0c77a5 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1296162177", "id": 239003404, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:39.277146 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e55bc993-5de0-471f-839c-341e4f0c77a5 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.904907 Oct 06 12:48:39.281166 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 58/136] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:48:38 2022] POST /compute/v2.1/flavors => generated 468 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:39.294845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-982f2ea8-f803-4e7d-a683-29ac61ceef2a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Action: 'create', calling method: .version_select at 0x7f7d3fec51f0>, body: {"keypair": {"name": "tempest-keypair-1428318341", "type": "ssh", "user_id": "f77a54f48c4b4b3f8a22c7b4cb6f958d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdC4iWEVsRcPA6H5Et4vl0yldlHFzEM4Q2gvA2V2Vj9Sbzdu3xzIqSZliKZZK/eay7mspr49Iqs4g4Jpmzi95OWfFvOF5E0oW61oi7Cp8COdnVnrwkVxUiMpW/Y2oarfQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:39.372458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-982f2ea8-f803-4e7d-a683-29ac61ceef2a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:39.394390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-982f2ea8-f803-4e7d-a683-29ac61ceef2a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for user 34ba3bfa0e3b4aba8bbd8ca3c913644c and project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:39.452101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-982f2ea8-f803-4e7d-a683-29ac61ceef2a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.168103 Oct 06 12:48:39.454554 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 59/137] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:48:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:48:39.480753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Calling method '.version_select at 0x7f7d3fec59d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:39.484470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:39.484810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:39.485716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:39.530744 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Request method failure captured: Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6khkn4YwKziCJPWLYqQ4GUYZiwul2kyEMvmRFKMWur4GJ2TmWGmgug6nn3bosnFSgAG4Km_fukuCuGx0Sz5WS2esl6d6VbgENSmb_13UBB1kkGkEO2ewPFdJFwyk4bYpMxR21Wp7jzP6ZkMZoZDKJb5-261g7piwePgAVgyvXOF4g Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b0efbe5d93f04a84bc58161c710c4799 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:39.539617 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b0efbe5d93f04a84bc58161c710c4799", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0efbe5d93f04a84bc58161c710c4799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b0efbe5d93f04a84bc58161c710c4799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0efbe5d93f04a84bc58161c710c4799"}]}] Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b0efbe5d93f04a84bc58161c710c4799 Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 15b0c62099974bd189423e7c3d363f7a Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 06 12:48:39.542705 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:39.544568 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a025a48-4626-4f42-beed-07f551fd84ab tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.086522 Oct 06 12:48:39.553127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 60/138] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 12:48:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:39.562563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:39.565456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:39.574875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:39.575503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:39.575952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:39.576667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:39.577341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:39.578156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:39.608095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:39.620572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f05998d2-8bd9-49b7-a7dd-2d65d33dd4d7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.924976 Oct 06 12:48:39.621142 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 79/139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:38 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:39.636398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8505601a-daab-440e-9f39-d005987d51fd tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:39.812424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:39.826832 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-937185cc-4371-4ca9-b9dd-6166fdc0fb3d tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.273865 Oct 06 12:48:39.844580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 61/140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:39 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:39.859065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:39.860166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:39.871304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:39.874494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:39.877963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:39.878780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:39.879300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:39.879689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.144892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:40.150450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8505601a-daab-440e-9f39-d005987d51fd tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/239003404/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.527318 Oct 06 12:48:40.151767 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 80/141] 10.222.0.26 () {62 vars in 1262 bytes} [Thu Oct 6 12:48:39 2022] POST /compute/v2.1/flavors/239003404/os-extra_specs => generated 62 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:40.156687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4d63c4f-9e98-45d9-94a2-3e63e5b5d5b4 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1297 microversion: 2.1 time: 0.307532 Oct 06 12:48:40.158622 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 62/142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:39 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1297 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:40.158748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a05fb22-8295-4734-aef2-c359ff88601a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Calling method '.version_select at 0x7f7d4404fb80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.178771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Calling method '.version_select at 0x7f7d3feb7820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.181071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.181721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.182315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.183263 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a05fb22-8295-4734-aef2-c359ff88601a tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-7834641?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d" status: 200 len: 509 microversion: 2.10 time: 0.029279 Oct 06 12:48:40.184578 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 81/143] 10.222.0.26 () {60 vars in 1331 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-7834641?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d => generated 509 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:40.240151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.243209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.243831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.276389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.276737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.277176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.296921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7beef5de-8e27-4306-b870-49c93f4b36f7 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.125653 Oct 06 12:48:40.309354 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 63/144] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:40.320593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-edaa80fe-7e99-4741-a9ef-b2dae6ae3084 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.358476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:40.373579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-edaa80fe-7e99-4741-a9ef-b2dae6ae3084 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/239003404" status: 202 len: 0 microversion: 2.86 time: 0.062984 Oct 06 12:48:40.377257 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 64/145] 10.222.0.26 () {60 vars in 1199 bytes} [Thu Oct 6 12:48:40 2022] DELETE /compute/v2.1/flavors/239003404 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:48:40.384657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7111d253-6aeb-47e7-9247-64bf677acf5d tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Action: 'create', calling method: .version_select at 0x7f7d3feb7e50>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1471434887", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDquLwH89ipevfoq2MvfGIYaXb9Wyq1NEUt/2q7Yo/4cN1wTEqUd6/VXIl7NfHUp7x6ynMwQljk67PL4SV5h7lSI3yBHEwj5ld36HZdVbKlafgfAT8xMg160iElwyAPaw=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:40.406506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7111d253-6aeb-47e7-9247-64bf677acf5d tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:48:40.410724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7111d253-6aeb-47e7-9247-64bf677acf5d tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Getting quotas for user 34ba3bfa0e3b4aba8bbd8ca3c913644c and project fb1bcb4977c34d07b78baf40d5aefba0. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:48:40.444318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7111d253-6aeb-47e7-9247-64bf677acf5d tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.065044 Oct 06 12:48:40.468673 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 65/146] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:48:40 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:48:40.474900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77de1f0b-ac33-4bf7-bbdf-f37677199b6f tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-944864987", "ram": 512, "vcpus": 1, "disk": 10, "id": 1884045163, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:40.491604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d96f86b8-1d22-41e2-ae73-fd209a2e0090 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Calling method '.version_select at 0x7f7d3fe8bb80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.496410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d96f86b8-1d22-41e2-ae73-fd209a2e0090 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '9f606c2b68164a84942ae01e778c9615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3246c677a74ea39e29dca6fa944b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d96f86b8-1d22-41e2-ae73-fd209a2e0090 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Request method failure captured: Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6i3IwRaQgg0bhT2P1zKjJ3mBZV1GV7t_C8G5DWBUp5fARxUOEcg4szSCN19wuO3n3NPFdAH-hLPm5Xybwp8u1a_dP9nYMu9eYD0uFERORKuk0mZFNhq3viheY6AUMYeaK5tOtzEhOmUlzNfOrvsNlYQz6BYoIyC-wyH_4fR7d31JM Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a3246c677a74ea39e29dca6fa944b24 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:40.511739 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a3246c677a74ea39e29dca6fa944b24", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a3246c677a74ea39e29dca6fa944b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a3246c677a74ea39e29dca6fa944b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a3246c677a74ea39e29dca6fa944b24"}]}] Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a3246c677a74ea39e29dca6fa944b24 Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029 Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9f606c2b68164a84942ae01e778c9615 Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 06 12:48:40.513040 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1'} Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:40.513698 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 06 12:48:40.514780 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.517792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d96f86b8-1d22-41e2-ae73-fd209a2e0090 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:40.518851 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d96f86b8-1d22-41e2-ae73-fd209a2e0090 tempest-HypervisorAdminNegativeUnderV252Test-1859463029 tempest-HypervisorAdminNegativeUnderV252Test-1859463029-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.036433 Oct 06 12:48:40.526508 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 66/147] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:40.541091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7e93d061-e579-43c6-96b1-f0eef62178f3 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.603258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77de1f0b-ac33-4bf7-bbdf-f37677199b6f tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.411937 Oct 06 12:48:40.612635 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 82/148] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:48:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:40.618293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f524bde-7ca8-450a-9885-f85dba076a77 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Calling method '.version_select at 0x7f7d4407df70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.622939 n-d-860556-1 devstack@n-api.service[129614]: WARNING oslo_db.sqlalchemy.utils [None req-3f524bde-7ca8-450a-9885-f85dba076a77 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 12:48:40.625089 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7e93d061-e579-43c6-96b1-f0eef62178f3 tempest-FlavorMetadataValidation-1771991144 tempest-FlavorMetadataValidation-1771991144-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.095769 Oct 06 12:48:40.627286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 67/149] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:48:40.652480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Calling method '.version_select at 0x7f7d3feb7550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.656276 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f524bde-7ca8-450a-9885-f85dba076a77 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d" status: 200 len: 723 microversion: 2.10 time: 0.042049 Oct 06 12:48:40.668830 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 83/150] 10.222.0.26 () {60 vars in 1259 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/os-keypairs?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d => generated 723 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:40.687279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.687782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.688228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.708410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] HTTP exception thrown: No hypervisor matching '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01' could be found. Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Request method failure captured: Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01/servers HTTP/1.1 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6khkn4YwKziCJPWLYqQ4GUYZiwul2kyEMvmRFKMWur4GJ2TmWGmgug6nn3bosnFSgAG4Km_fukuCuGx0Sz5WS2esl6d6VbgENSmb_13UBB1kkGkEO2ewPFdJFwyk4bYpMxR21Wp7jzP6ZkMZoZDKJb5-261g7piwePgAVgyvXOF4g Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b0efbe5d93f04a84bc58161c710c4799 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:40.709960 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b0efbe5d93f04a84bc58161c710c4799", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0efbe5d93f04a84bc58161c710c4799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b0efbe5d93f04a84bc58161c710c4799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0efbe5d93f04a84bc58161c710c4799"}]}] Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b0efbe5d93f04a84bc58161c710c4799 Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048 Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 15b0c62099974bd189423e7c3d363f7a Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: exception: No hypervisor matching '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01' could be found. Oct 06 12:48:40.711228 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01'} Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01' could be found. Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.711948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01' could be found. Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] Returning 404 to user: No hypervisor matching '595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01' could be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-58346b8b-8bee-48fb-92eb-d42d9435d197 tempest-HypervisorAdminNegativeUnderV252Test-1345607048 tempest-HypervisorAdminNegativeUnderV252Test-1345607048-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01/servers" status: 404 len: 123 microversion: 2.1 time: 0.081861 Oct 06 12:48:40.712973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 68/151] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/os-hypervisors/595fb5b4-3a88-4f3e-9de9-a06f0aaf3d01/servers => generated 123 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:40.744131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.749010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:40.783122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.783628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.784077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.784800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:40.785285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:40.785689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:40.931540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da014080-85e5-4a9c-be08-019178d24b2d tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:40.960069 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-da014080-85e5-4a9c-be08-019178d24b2d tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] HTTP exception thrown: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da014080-85e5-4a9c-be08-019178d24b2d tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Request method failure captured: Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6lGwzCQdjC1jE4Mo-qoL0bjLUGPkPJUK_oJZKQ8RCr8fWDs-hwtqocv_b3PKsS3x5j_njilIDktGKsO5_gJYNZrRInEkHlHkadO2C8VuL3X0-zM40Q7s4CQVu32hz5rYIE6tzoRlVcdCUGqgH8Vv3GLeb27pib9_ScbbQ2eat6GBw Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:40.963033 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d5ca8b9f3194abfb6ba8dc8ed0623bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}] Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 602d38fffb654f2cbcf2341ff9258d44 Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:48:40.964244 n-d-860556-1 devstack@n-api.service[129614]: exception: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'flavor_id': '1884045163', 'id': 'hw:cpu_thread_policy'} Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:40.964924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:40.966461 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:40.971625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da014080-85e5-4a9c-be08-019178d24b2d tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Returning 404 to user: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:40.972986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da014080-85e5-4a9c-be08-019178d24b2d tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] 10.222.0.26 "GET /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.302605 Oct 06 12:48:40.973994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 84/152] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:41.003814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d499a11-0699-4f20-a9ed-05c5c99cf8a9 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Calling method '.version_select at 0x7f7d440c11f0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:41.042429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:41.057694 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d499a11-0699-4f20-a9ed-05c5c99cf8a9 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1471434887" status: 204 len: 0 microversion: 2.10 time: 0.070339 Oct 06 12:48:41.058314 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 85/153] 10.222.0.26 () {60 vars in 1325 bytes} [Thu Oct 6 12:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1471434887 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:48:41.070886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:41.071506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:41.126703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.127208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.129417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.131779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.134067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.134773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.621808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:41.631004 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d818ac3f-19be-4679-95cb-6db5b882be7e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.918124 Oct 06 12:48:41.651016 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 69/154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:40 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:41.660394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8cc28b6d-2fba-4af4-bc5e-3f0e7917d8f1 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:41.664225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8cc28b6d-2fba-4af4-bc5e-3f0e7917d8f1 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '602d38fffb654f2cbcf2341ff9258d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5ca8b9f3194abfb6ba8dc8ed0623bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8cc28b6d-2fba-4af4-bc5e-3f0e7917d8f1 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Request method failure captured: Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/flavors/1884045163/os-extra_specs HTTP/1.1 Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 66 Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6lGwzCQdjC1jE4Mo-qoL0bjLUGPkPJUK_oJZKQ8RCr8fWDs-hwtqocv_b3PKsS3x5j_njilIDktGKsO5_gJYNZrRInEkHlHkadO2C8VuL3X0-zM40Q7s4CQVu32hz5rYIE6tzoRlVcdCUGqgH8Vv3GLeb27pib9_ScbbQ2eat6GBw Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:41.678260 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d5ca8b9f3194abfb6ba8dc8ed0623bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}] Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 602d38fffb654f2cbcf2341ff9258d44 Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 06 12:48:41.679565 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:41.680194 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 06 12:48:41.681181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:41.683170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8cc28b6d-2fba-4af4-bc5e-3f0e7917d8f1 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:41.684186 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8cc28b6d-2fba-4af4-bc5e-3f0e7917d8f1 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] 10.222.0.26 "POST /compute/v2.1/flavors/1884045163/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.032957 Oct 06 12:48:41.685243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 70/155] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:48:41 2022] POST /compute/v2.1/flavors/1884045163/os-extra_specs => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:41.693294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6154d27c-24a4-4927-b3da-e37bab5dc54c tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Calling method '.version_select at 0x7f7d3feb2af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:41.761555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6154d27c-24a4-4927-b3da-e37bab5dc54c tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428318341?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d" status: 204 len: 0 microversion: 2.10 time: 0.074921 Oct 06 12:48:41.762779 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 71/156] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428318341?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:48:41.770410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f1c7d8-9c49-408e-9c5a-f509210aa935", "tag": "290c859e-a81e-4159-8284-6e1bc95ad898"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:41.793683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:41.806114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.807100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.807765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.811351 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b91cdd05-70b7-4332-b2df-1df55df52813 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.739889 Oct 06 12:48:41.816772 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 86/157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:41 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:41.823923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:41.826754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:41.836152 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Creating event network-changed:290c859e-a81e-4159-8284-6e1bc95ad898 for instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 on n-h2-860556-1 Oct 06 12:48:41.842539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.843515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.845204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.845995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:48:41.846519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.847141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e26e81f-0ad3-4979-8606-3a8a41b8f0ae req-45617bf3-2541-4d1d-9916-ff9b6fed1e3a service nova] Acquired lock "compute-rpcapi-router" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:48:41.847276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.848105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.849471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.862542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.863697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.865405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:41.866493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:41.867683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:41.890621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.compute.rpcapi [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 12:48:41.892238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] Releasing lock "compute-rpcapi-router" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:48:41.909412 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cc4c913-804a-4f58-9e30-012b26f435fc None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145196 Oct 06 12:48:41.910564 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 72/158] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:41.915890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99ccc10f-94b5-4a90-908f-feb2b84241bf tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:42.000454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99ccc10f-94b5-4a90-908f-feb2b84241bf tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1884045163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088441 Oct 06 12:48:42.004257 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 73/159] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:48:41 2022] POST /compute/v2.1/flavors/1884045163/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:42.011725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ecf20eb-c42d-48fd-b138-ae20dc624ea7 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] Calling method '.version_select at 0x7f7d3fe62430>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.064343 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ecf20eb-c42d-48fd-b138-ae20dc624ea7 tempest-KeyPairsV210TestJSON-1818143487 tempest-KeyPairsV210TestJSON-1818143487-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7834641?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d" status: 204 len: 0 microversion: 2.10 time: 0.058095 Oct 06 12:48:42.069840 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 74/160] 10.222.0.26 () {60 vars in 1334 bytes} [Thu Oct 6 12:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7834641?user_id=f77a54f48c4b4b3f8a22c7b4cb6f958d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:48:42.079000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e6137e8-4cbd-4114-9c5c-968a8a5d0179 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.092341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e6137e8-4cbd-4114-9c5c-968a8a5d0179 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '602d38fffb654f2cbcf2341ff9258d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5ca8b9f3194abfb6ba8dc8ed0623bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e6137e8-4cbd-4114-9c5c-968a8a5d0179 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Request method failure captured: Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6lGwzCQdjC1jE4Mo-qoL0bjLUGPkPJUK_oJZKQ8RCr8fWDs-hwtqocv_b3PKsS3x5j_njilIDktGKsO5_gJYNZrRInEkHlHkadO2C8VuL3X0-zM40Q7s4CQVu32hz5rYIE6tzoRlVcdCUGqgH8Vv3GLeb27pib9_ScbbQ2eat6GBw Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:42.106038 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d5ca8b9f3194abfb6ba8dc8ed0623bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}] Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 602d38fffb654f2cbcf2341ff9258d44 Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:42.107925 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'id': 'hw:numa_nodes'} Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:42.108910 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.114442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e6137e8-4cbd-4114-9c5c-968a8a5d0179 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:42.118271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e6137e8-4cbd-4114-9c5c-968a8a5d0179 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.040173 Oct 06 12:48:42.118271 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 75/161] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 12:48:42 2022] DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes => generated 124 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:42.132491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-723e8d28-8e33-4ca6-84cf-38dbe13cc16f tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:42.187954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-723e8d28-8e33-4ca6-84cf-38dbe13cc16f tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1884045163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070254 Oct 06 12:48:42.211988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 76/162] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:48:42 2022] POST /compute/v2.1/flavors/1884045163/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:42.218199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33ef0ce4-c247-4e59-81b2-1d5bc3551742 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:42.222861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33ef0ce4-c247-4e59-81b2-1d5bc3551742 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '602d38fffb654f2cbcf2341ff9258d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5ca8b9f3194abfb6ba8dc8ed0623bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33ef0ce4-c247-4e59-81b2-1d5bc3551742 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Request method failure captured: Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 22 Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6lGwzCQdjC1jE4Mo-qoL0bjLUGPkPJUK_oJZKQ8RCr8fWDs-hwtqocv_b3PKsS3x5j_njilIDktGKsO5_gJYNZrRInEkHlHkadO2C8VuL3X0-zM40Q7s4CQVu32hz5rYIE6tzoRlVcdCUGqgH8Vv3GLeb27pib9_ScbbQ2eat6GBw Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:42.226016 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d5ca8b9f3194abfb6ba8dc8ed0623bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d5ca8b9f3194abfb6ba8dc8ed0623bb"}]}] Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0d5ca8b9f3194abfb6ba8dc8ed0623bb Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 602d38fffb654f2cbcf2341ff9258d44 Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: {"hw:numa_nodes": "1"} Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:42.227156 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:42.227839 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 06 12:48:42.228984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.230326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33ef0ce4-c247-4e59-81b2-1d5bc3551742 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:42.230326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33ef0ce4-c247-4e59-81b2-1d5bc3551742 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402 tempest-FlavorsExtraSpecsNegativeTestJSON-292104402-project] 10.222.0.26 "PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014622 Oct 06 12:48:42.231445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 77/163] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Oct 6 12:48:42 2022] PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:42.242634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-106bff11-1d68-4553-a48e-be8b5a6493cd tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.254683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-106bff11-1d68-4553-a48e-be8b5a6493cd tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] HTTP exception thrown: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-106bff11-1d68-4553-a48e-be8b5a6493cd tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Request method failure captured: Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6nTu2lfwxNLoI6P2yss1qkMVx8_y25i31f1QrMEgY4kr-dFZSSWgEBc48B9eOGzHNP2AHov0uCuh5wMg0dMNxphElQeqrkUdYC1Tw8qTZbrNw7KRPDavtA0K7LLulzZkRgUyNm_CGn8AJX1S8YUZNG1ELwE09hqZ3tzTBVK-CGdqQ Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:42.256538 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f52985d275854393bc777ca63e2f4b78", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}] Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ecfda28fa2d6419b897a2e74af3fabaa Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:42.259050 n-d-860556-1 devstack@n-api.service[129615]: exception: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'id': 'hw:cpu_thread_policy'} Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.259874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-106bff11-1d68-4553-a48e-be8b5a6493cd tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Returning 404 to user: Flavor 1884045163 has no extra specs with key hw:cpu_thread_policy. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:42.261309 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-106bff11-1d68-4553-a48e-be8b5a6493cd tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.022676 Oct 06 12:48:42.267290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 78/164] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:48:42 2022] DELETE /compute/v2.1/flavors/1884045163/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:42.290826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-573b2316-9791-433f-bc9a-a67e361873f8 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:42.311341 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-573b2316-9791-433f-bc9a-a67e361873f8 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-573b2316-9791-433f-bc9a-a67e361873f8 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Request method failure captured: Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 27 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6nTu2lfwxNLoI6P2yss1qkMVx8_y25i31f1QrMEgY4kr-dFZSSWgEBc48B9eOGzHNP2AHov0uCuh5wMg0dMNxphElQeqrkUdYC1Tw8qTZbrNw7KRPDavtA0K7LLulzZkRgUyNm_CGn8AJX1S8YUZNG1ELwE09hqZ3tzTBVK-CGdqQ Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:42.315584 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f52985d275854393bc777ca63e2f4b78", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}] Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ecfda28fa2d6419b897a2e74af3fabaa Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: {"hw:cpu_policy": "shared"} Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:42.316814 n-d-860556-1 devstack@n-api.service[129615]: exception: Request body and URI mismatch Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.317535 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-573b2316-9791-433f-bc9a-a67e361873f8 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:42.323364 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-573b2316-9791-433f-bc9a-a67e361873f8 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.047150 Oct 06 12:48:42.326044 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 79/165] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Oct 6 12:48:42 2022] PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes => generated 73 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:48:42.342369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21890d05-ad3f-4f8c-a82e-156fb88ef02a tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21890d05-ad3f-4f8c-a82e-156fb88ef02a tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Request method failure captured: Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 49 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6nTu2lfwxNLoI6P2yss1qkMVx8_y25i31f1QrMEgY4kr-dFZSSWgEBc48B9eOGzHNP2AHov0uCuh5wMg0dMNxphElQeqrkUdYC1Tw8qTZbrNw7KRPDavtA0K7LLulzZkRgUyNm_CGn8AJX1S8YUZNG1ELwE09hqZ3tzTBVK-CGdqQ Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:42.367354 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f52985d275854393bc777ca63e2f4b78", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f52985d275854393bc777ca63e2f4b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f52985d275854393bc777ca63e2f4b78"}]}] Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f52985d275854393bc777ca63e2f4b78 Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ecfda28fa2d6419b897a2e74af3fabaa Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 06 12:48:42.368582 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '1884045163', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance: Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 06 12:48:42.369196 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.370409 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21890d05-ad3f-4f8c-a82e-156fb88ef02a tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:42.371445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21890d05-ad3f-4f8c-a82e-156fb88ef02a tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.041801 Oct 06 12:48:42.375630 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 80/166] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Oct 6 12:48:42 2022] PUT /compute/v2.1/flavors/1884045163/os-extra_specs/hw:numa_nodes => generated 117 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:42.375900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:42.390633 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef3830a1-becd-4b01-b6f7-8677fb7bb4b1 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.572728 Oct 06 12:48:42.391547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 87/167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:41 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:42.394400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0239811d-cf55-4441-95a7-e082b5fa1b57 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.462001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0239811d-cf55-4441-95a7-e082b5fa1b57 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1884045163" status: 202 len: 0 microversion: 2.1 time: 0.082524 Oct 06 12:48:42.463022 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 81/168] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:48:42 2022] DELETE /compute/v2.1/flavors/1884045163 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:48:42.474750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf02a4aa-d06b-4c50-a5cc-b39bb511f5f2 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.516572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf02a4aa-d06b-4c50-a5cc-b39bb511f5f2 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427 tempest-FlavorsExtraSpecsNegativeTestJSON-640131427-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049252 Oct 06 12:48:42.517950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 88/169] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:48:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:42.665962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.668032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:42.680082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:42.682249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:42.683634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:42.685914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:42.689043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:42.691784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:42.844458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:42.845089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:42.861448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:42.862255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:42.862872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:42.863790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:42.864286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:42.864678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:43.246761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:43.279315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4416f17-3371-4baa-b2e6-04fc7a584435 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.438173 Oct 06 12:48:43.281170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 89/170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:42 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:43.389146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:43.397931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f22007b-4083-48a4-a78d-748179e4c322 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.736616 Oct 06 12:48:43.402781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:42 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:43.422033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:43.422650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:43.436195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:43.436710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:43.440873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:43.441915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:43.442653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:43.444538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:43.859433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:43.975140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:44.067342 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f171963-5eef-4a28-8f94-ff17987a9bed tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.649210 Oct 06 12:48:44.092024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 90/172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:43 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:44.304950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:44.305721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:44.318529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:44.321951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:44.331802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:44.332778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:44.336101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:44.337971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:44.427102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677117e7-d4ff-4cb0-9303-ca7d9b70e59a", "tag": "373bb865-046e-4c79-83d6-3ce78647afa9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:44.461174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:44.464056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:44.464795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:44.498924 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] Creating event network-changed:373bb865-046e-4c79-83d6-3ce78647afa9 for instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a on n-h1-860556-1 Oct 06 12:48:44.520505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-23f2d168-1fb3-4eb7-989a-3d7cd42a65f8 req-39eb1f5a-8055-40c3-a89b-1d8d051b264f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236481 Oct 06 12:48:44.526274 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 83/173] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:44.534886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:44.544050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:44.559200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:44.560548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:44.561388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:44.572356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:44.574958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:44.578711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:44.661479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:45.208333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:45.259900 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cebfff74-0e16-4178-bc39-a4c5f5794d74 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.956619 Oct 06 12:48:45.278179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 91/174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:44 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:45.289684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:45.292811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:45.309850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:45.312794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:45.313917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:45.315831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:45.316316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:45.321296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:45.363969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:45.372665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf328194-ec90-474a-84ad-e77d230617af tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.844334 Oct 06 12:48:45.393922 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 84/175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:44 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:45.655962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:45.664925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-234f8b98-8012-46ef-9646-275b00647f90 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.390072 Oct 06 12:48:45.665977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 92/176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:45 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:46.290786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:46.292566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:46.306202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:46.307006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:46.307669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:46.310097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:46.312264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:46.313420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:46.400824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:46.401564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:46.420511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:46.426990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:46.427990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:46.429930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:46.430575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:46.431347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:46.940675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:46.950326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b58fa198-8e78-4dc3-ac23-4ba3a50fb82a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.665659 Oct 06 12:48:46.951489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 85/177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:46 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:46.973594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:46.979860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:46.995461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:46.998034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:47.015141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:47.024289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:47.027170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:47.031580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:47.270010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:47.293205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81e47b51-efb4-433b-90d9-d7d2f45e87b0 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.898026 Oct 06 12:48:47.294242 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 93/178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:46 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:47.452356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:47.462803 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b5b2539-2528-42e1-9c51-de972879c8bb tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.509903 Oct 06 12:48:47.463522 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 86/179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:46 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:47.981152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:47.981800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:47.988090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:47.988569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:47.989186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:47.990071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:47.990668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:47.991294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:48.165527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:48.174418 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f0142fe-c460-498d-b13d-cc3423c8a1a5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.196977 Oct 06 12:48:48.187100 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 94/180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:47 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:48.334711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:48.335589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:48.345095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:48.346072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:48.347226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:48.348681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:48.349479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:48.351168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:48.494197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:48.494882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:48.511479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:48.516510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:48.517562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:48.520039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:48.521284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:48.523091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:48.606173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:48.613994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13cde42d-369b-4ec3-9513-5abebdfcb542 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.300265 Oct 06 12:48:48.617672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 87/181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:48 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:48.797841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:48.808884 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6077ff8-02b9-4aa5-9d0c-bb9ceb401b3c tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.324718 Oct 06 12:48:48.811247 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 95/182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:48 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:49.060189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '.version_select at 0x7f7d3fe8be50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:49.063708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.064186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.064617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.065340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.065820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.066286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.111907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48c35926-0e5b-4c51-b131-3d73683341b3 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.492796 Oct 06 12:48:49.121386 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 88/183] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 12:48:48 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:49.199056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c2d490-619c-43e6-a4f2-b69d5a1dc34c", "name": "network-vif-plugged", "status": "completed", "tag": "0ef4ce90-f791-408e-abc8-a45b2052e10e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:49.212187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.212929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.213531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.230583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] Creating event network-vif-plugged:0ef4ce90-f791-408e-abc8-a45b2052e10e for instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c on n-h1-860556-1 Oct 06 12:48:49.236839 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-51420322-f613-40ac-b289-393fd397aaa4 req-000c6c1c-4b1d-47fe-a9f8-0e83545523d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303580 Oct 06 12:48:49.237431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 96/184] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:49.243834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:49.244715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:49.269695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.270414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.271013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.272183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.272957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.273534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.654146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a6e0d2d-dafe-47d0-9394-e08e0a54a329 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Calling method '.version_select at 0x7f7d3fe8bb80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:49.659137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a6e0d2d-dafe-47d0-9394-e08e0a54a329 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a6e0d2d-dafe-47d0-9394-e08e0a54a329 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:49.663313 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: action_args: {} Oct 06 12:48:49.664497 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:49.665254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 06 12:48:49.666314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.667346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a6e0d2d-dafe-47d0-9394-e08e0a54a329 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:49.667634 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a6e0d2d-dafe-47d0-9394-e08e0a54a329 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.541615 Oct 06 12:48:49.672403 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 89/185] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 12:48:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 549 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:49.688061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:49.688750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:49.707838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.708268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.711821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.713886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:49.714379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:49.714883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:49.832804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:49.841369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab5bb9c7-d25b-4fbf-af2e-2620924f0eef tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.602374 Oct 06 12:48:49.841985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 97/186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:49 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:49.863188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d08daf4b-c024-4b3f-8ee9-1d8b631b70f4 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Calling method '.version_select at 0x7f7d3ffd7af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:49.865509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d08daf4b-c024-4b3f-8ee9-1d8b631b70f4 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d08daf4b-c024-4b3f-8ee9-1d8b631b70f4 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hosts/n-d-860556-1/reboot HTTP/1.1 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:48:49.867820 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'n-d-860556-1'} Oct 06 12:48:49.869008 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:49.869725 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 06 12:48:49.870767 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:49.873077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d08daf4b-c024-4b3f-8ee9-1d8b631b70f4 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:49.874258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d08daf4b-c024-4b3f-8ee9-1d8b631b70f4 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860556-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019050 Oct 06 12:48:49.875329 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 98/187] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Oct 6 12:48:49 2022] GET /compute/v2.1/os-hosts/n-d-860556-1/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:50.096000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:50.111147 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7b037d9-3850-4187-8465-ea3079475acf tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.438391 Oct 06 12:48:50.113981 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 90/188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:49 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:50.127100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.133956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:50.164079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:50.168277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:50.174211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:50.177326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:50.179242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:50.181002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:50.358631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b88bb120-29a9-4f64-bd02-7a73636ec7ee tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] Calling method '.version_select at 0x7f7d4404fa60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.398415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b88bb120-29a9-4f64-bd02-7a73636ec7ee tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.519887 Oct 06 12:48:50.400590 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 99/189] 10.222.0.26 () {60 vars in 1226 bytes} [Thu Oct 6 12:48:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:50.409846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '.version_select at 0x7f7d4407dd30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.420448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=30 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:50.432427 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:48:50.436846 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'nonexistent_hostname'} Oct 06 12:48:50.438162 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:50.438979 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 06 12:48:50.440040 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.441073 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.446157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.447404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.045398 Oct 06 12:48:50.448293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 100/190] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:50.449626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.451061 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c936cf65-a137-4140-a013-ab303dd99f51 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001735 Oct 06 12:48:50.451930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 101/191] 10.222.0.26 () {56 vars in 886 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 06 12:48:50.458022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c85ec32-610d-48f3-8ff1-559bfe45fe5f tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3ffd7310>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:50.586236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:50.594258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9686f3b-8715-45b6-a12e-b4a1c2736962 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.476728 Oct 06 12:48:50.599895 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 91/192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:50.616751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d62129e-164e-462d-bda7-912f63f82ec8 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Calling method '.version_select at 0x7f7d3fe623a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.618734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0d62129e-164e-462d-bda7-912f63f82ec8 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d62129e-164e-462d-bda7-912f63f82ec8 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/n-d-860556-1 HTTP/1.1 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:50.620335 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1'} Oct 06 12:48:50.621524 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.622257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 06 12:48:50.623443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.634030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d62129e-164e-462d-bda7-912f63f82ec8 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.635901 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d62129e-164e-462d-bda7-912f63f82ec8 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860556-1" status: 403 len: 109 microversion: 2.1 time: 0.034461 Oct 06 12:48:50.638602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 92/193] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/n-d-860556-1 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:50.648966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1cb93b6-0a08-4c89-a714-f2079e8206d1 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '.version_select at 0x7f7d3fe770d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.668439 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f1cb93b6-0a08-4c89-a714-f2079e8206d1 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1cb93b6-0a08-4c89-a714-f2079e8206d1 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:50.672722 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'nonexistent_hostname'} Oct 06 12:48:50.675097 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.675795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.676799 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.677772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1cb93b6-0a08-4c89-a714-f2079e8206d1 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.677772 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1cb93b6-0a08-4c89-a714-f2079e8206d1 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030315 Oct 06 12:48:50.677772 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 93/194] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 06 12:48:50.693991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9906b983-b7d6-406a-b598-da5179175167 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Calling method '.version_select at 0x7f7d3fe623a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.699221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9906b983-b7d6-406a-b598-da5179175167 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9906b983-b7d6-406a-b598-da5179175167 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/n-d-860556-1/shutdown HTTP/1.1 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:50.701312 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1'} Oct 06 12:48:50.702787 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.703744 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 06 12:48:50.704840 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.708422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9906b983-b7d6-406a-b598-da5179175167 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.708422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9906b983-b7d6-406a-b598-da5179175167 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860556-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020981 Oct 06 12:48:50.708422 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 94/195] 10.222.0.26 () {58 vars in 1194 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/n-d-860556-1/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:50.720019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31329a99-a177-47ef-86a8-57816efc7fef tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '.version_select at 0x7f7d3fe77310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.747401 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-31329a99-a177-47ef-86a8-57816efc7fef tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31329a99-a177-47ef-86a8-57816efc7fef tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:50.749887 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'nonexistent_hostname'} Oct 06 12:48:50.751078 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:50.751849 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 06 12:48:50.753471 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.754575 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.756351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31329a99-a177-47ef-86a8-57816efc7fef tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.757220 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31329a99-a177-47ef-86a8-57816efc7fef tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.041838 Oct 06 12:48:50.757822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 95/196] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:50.770708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e866a99d-640f-4730-97e3-3ec5a58e50bd tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Calling method '.version_select at 0x7f7d3fec5280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.773667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e866a99d-640f-4730-97e3-3ec5a58e50bd tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e866a99d-640f-4730-97e3-3ec5a58e50bd tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/n-d-860556-1/startup HTTP/1.1 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:50.776094 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1'} Oct 06 12:48:50.777496 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.778459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 06 12:48:50.782120 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.790552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e866a99d-640f-4730-97e3-3ec5a58e50bd tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.790552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e866a99d-640f-4730-97e3-3ec5a58e50bd tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860556-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.019923 Oct 06 12:48:50.790552 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 96/197] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/n-d-860556-1/startup => generated 110 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:50.801954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46ce5a72-e391-4489-a0a2-006dde2e75e7 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Calling method '.version_select at 0x7f7d3fec5820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.814227 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c85ec32-610d-48f3-8ff1-559bfe45fe5f tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.360490 Oct 06 12:48:50.818067 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 102/198] 10.222.0.26 () {62 vars in 1247 bytes} [Thu Oct 6 12:48:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:50.824169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-46ce5a72-e391-4489-a0a2-006dde2e75e7 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46ce5a72-e391-4489-a0a2-006dde2e75e7 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:50.826148 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'nonexistent_hostname'} Oct 06 12:48:50.827361 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:50.828055 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 06 12:48:50.829448 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46ce5a72-e391-4489-a0a2-006dde2e75e7 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46ce5a72-e391-4489-a0a2-006dde2e75e7 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033118 Oct 06 12:48:50.832329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 97/199] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:50.834278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-90f70dfe-8d49-4f85-90ca-b3e79bf0d012 tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] Calling method '.version_select at 0x7f7d3ff0fb80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.838698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b52ff814-8343-40b7-876e-6d6e9f415d54 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fe77ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b52ff814-8343-40b7-876e-6d6e9f415d54 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-hosts/n-d-860556-1 HTTP/1.1 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 51 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:50.851077 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: {"status": "enable", "maintenance_mode": "invalid"} Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.852442 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'disable', Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Enable', Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Disable', Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance: Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'invalid' Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.853195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.854588 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b52ff814-8343-40b7-876e-6d6e9f415d54 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b52ff814-8343-40b7-876e-6d6e9f415d54 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860556-1" status: 400 len: 199 microversion: 2.1 time: 0.019053 Oct 06 12:48:50.856746 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 98/200] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:50 2022] PUT /compute/v2.1/os-hosts/n-d-860556-1 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:50.860957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-90f70dfe-8d49-4f85-90ca-b3e79bf0d012 tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.035577 Oct 06 12:48:50.861726 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 103/201] 10.222.0.26 () {60 vars in 1226 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:48:50.875035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:50.876673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfcaecfb-25cf-40c6-bf3d-2f539641e8a6 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fe62040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:50.876938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfcaecfb-25cf-40c6-bf3d-2f539641e8a6 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-hosts/n-d-860556-1 HTTP/1.1 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 51 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:50.882544 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: {"status": "invalid", "maintenance_mode": "enable"} Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:50.883815 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'disable', Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Enable', Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Disable', Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance: Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'invalid' Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.884905 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:50.886368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfcaecfb-25cf-40c6-bf3d-2f539641e8a6 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfcaecfb-25cf-40c6-bf3d-2f539641e8a6 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860556-1" status: 400 len: 189 microversion: 2.1 time: 0.021302 Oct 06 12:48:50.887680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 99/202] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:50 2022] PUT /compute/v2.1/os-hosts/n-d-860556-1 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:50.892979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:50.893477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:50.893980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:50.894697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:50.895154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:50.898952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c9004a9-68d9-47e8-a81c-0d286f5d5779 tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fec5a60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:50.899843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:50.969034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:51.017990 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c9004a9-68d9-47e8-a81c-0d286f5d5779 tempest-QuotaClassesAdmin257Test-2142908435 tempest-QuotaClassesAdmin257Test-2142908435-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.130569 Oct 06 12:48:51.018985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 100/203] 10.222.0.26 () {62 vars in 1247 bytes} [Thu Oct 6 12:48:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:51.034150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-833cb8ac-1a67-4e07-8605-a1f659859135 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Action: 'update', calling method: .version_select at 0x7f7d3feb2b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:51.039596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-833cb8ac-1a67-4e07-8605-a1f659859135 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2a3a4797093e46aabdf82506d7e7e980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c023630541a4b2592e993ed15f99553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-833cb8ac-1a67-4e07-8605-a1f659859135 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Request method failure captured: Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-hosts/n-d-860556-1 HTTP/1.1 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 50 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6v5mpl_ZoORBwAOdRdsWwI70GqW43Q5X-xEnJ3YfcZTxfY71lllDUIZLbspJgxN8KGYrL9IeA98ESOv3nPs0JN2UZTs2FF5xe6Rtr5TzOPFyl0Ip5XW_miAPCQqzflESH-BAdTAAGehJtRZb0QOUpcWSjBUTGFlABEV0Gp28mtROU Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:48:51.041686 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c023630541a4b2592e993ed15f99553", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c023630541a4b2592e993ed15f99553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c023630541a4b2592e993ed15f99553"}]}] Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9c023630541a4b2592e993ed15f99553 Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1301724007 Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2a3a4797093e46aabdf82506d7e7e980 Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1301724007-project Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: {"status": "enable", "maintenance_mode": "enable"} Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 06 12:48:51.043058 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:51.043925 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 06 12:48:51.044980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.046115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-833cb8ac-1a67-4e07-8605-a1f659859135 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:51.046115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-833cb8ac-1a67-4e07-8605-a1f659859135 tempest-HostsAdminNegativeTestJSON-1301724007 tempest-HostsAdminNegativeTestJSON-1301724007-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860556-1" status: 403 len: 111 microversion: 2.1 time: 0.023054 Oct 06 12:48:51.049850 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 101/204] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:51 2022] PUT /compute/v2.1/os-hosts/n-d-860556-1 => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:48:51.055933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a9ee3e6-8cb4-401e-aa4e-f554db6364b9 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3ff1e3a0>, body: {"status": null, "maintenance_mode": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a9ee3e6-8cb4-401e-aa4e-f554db6364b9 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-hosts/n-d-860556-1 HTTP/1.1 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 42 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:51.060625 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: {"status": null, "maintenance_mode": null} Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 06 12:48:51.062086 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'n-d-860556-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'disable', Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Enable', Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'Disable', Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance: Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi None Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.063014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.064982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.066269 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:48:51.066269 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:48:51.066269 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 06 12:48:51.066269 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.067449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a9ee3e6-8cb4-401e-aa4e-f554db6364b9 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:51.068600 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a9ee3e6-8cb4-401e-aa4e-f554db6364b9 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860556-1" status: 400 len: 127 microversion: 2.1 time: 0.017621 Oct 06 12:48:51.069443 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 102/205] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:48:51 2022] PUT /compute/v2.1/os-hosts/n-d-860556-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:48:51.080856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3feb24c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:51.085579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.hosts [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Enabling host nonexistent_hostname. Oct 06 12:48:51.096155 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Request method failure captured: Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 50 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6wGFeBQGkySXJO3TgG_WOR0QahikP-2x9cBH3vv5Zs4G49mxejSa6mh7IMcSEaifjzD6Fein4CPteKz4DUS7ZmkRzeixD5vWaX35jwKnEZdM40a5AB-3kwtWg1mqRo-DQSLLcMJNnbeiXD6HrGUofFQqwVn_2GSb96GOAOYheD0vA Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:48:51.098784 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2698f92049644f79b670446e3c0ea486", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2698f92049644f79b670446e3c0ea486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2698f92049644f79b670446e3c0ea486"}]}] Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2698f92049644f79b670446e3c0ea486 Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1866865731 Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: df8f4d9c1da948008ca096a8527362f1 Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1866865731-project-admin Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: {"status": "enable", "maintenance_mode": "enable"} Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:51.100758 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:48:51.101784 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:48:51.103059 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 06 12:48:51.104402 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:48:51.108658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:48:51.109996 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18ede881-68c0-4d26-b8c4-a30409678b21 tempest-HostsAdminNegativeTestJSON-1866865731 tempest-HostsAdminNegativeTestJSON-1866865731-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034921 Oct 06 12:48:51.114740 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 103/206] 10.222.0.26 () {60 vars in 1211 bytes} [Thu Oct 6 12:48:51 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:48:51.144090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:51.144877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:51.154088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:51.154642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:51.155124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:51.155926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:51.156438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:51.156878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:51.375053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:51.396031 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9e69615-2113-4cd1-bfe2-5ad5589cbe9a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.527466 Oct 06 12:48:51.399033 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 104/207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:50 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:51.409626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677117e7-d4ff-4cb0-9303-ca7d9b70e59a", "name": "network-vif-plugged", "status": "completed", "tag": "373bb865-046e-4c79-83d6-3ce78647afa9"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:51.428777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:51.429494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:51.430176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:51.448325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] Creating event network-vif-plugged:373bb865-046e-4c79-83d6-3ce78647afa9 for instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a on n-h1-860556-1 Oct 06 12:48:51.456093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-99b8da93-ec07-4b18-ae93-666068ccb45e req-6f9f568a-843f-4f28-a2c5-f08535ed2ea4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054434 Oct 06 12:48:51.457137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 105/208] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:51.586866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:51.608889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa877730-30ba-481c-aca9-eec3fb0dfd44 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.465718 Oct 06 12:48:51.609571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:51 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:51.637375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:51.639490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:51.651944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:51.652623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:51.653702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:51.654869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:51.655597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:51.656262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:52.135430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:52.144807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f3589267-67f5-44b9-89ac-818ca157af61 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.515611 Oct 06 12:48:52.154469 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 106/210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:51 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:52.421651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:52.423763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:52.431794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:52.432576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:52.433166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:52.434399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:52.435594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:52.436212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:52.637099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:52.638881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:52.653610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:52.655888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:52.656775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:52.659443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:52.661259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:52.663230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:52.783362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:52.802641 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aff49229-9078-4b20-b187-16894145f313 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.385814 Oct 06 12:48:52.825226 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 105/211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:52 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:52.987310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:52.997761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95ce61d0-e4ad-49f2-a7f4-463c95b599b5 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1342 microversion: 2.1 time: 0.366045 Oct 06 12:48:53.000758 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 107/212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:52 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1342 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:53.182864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:53.183779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:53.200306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:53.201344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:53.204749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:53.205880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:53.206498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:53.208487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:53.632603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:53.644403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7e553c6-b243-4bef-8fa6-75205f56a346 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1339 microversion: 2.1 time: 0.466518 Oct 06 12:48:53.651266 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 106/213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:53 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1339 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:53.830397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:53.831618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:53.845124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:53.845839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:53.846438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:53.847502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:53.848153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:53.848801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.021822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:54.022753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:54.036472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.037315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.040020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.041985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.042579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.043026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.143221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:54.153136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf9fe6cb-13c7-4cfa-adb9-4c9950d5c48f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.326470 Oct 06 12:48:54.154035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:53 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:54.376802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:54.394383 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0759103-79d9-409d-bd19-757558de423b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1492 microversion: 2.1 time: 0.376059 Oct 06 12:48:54.397664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 107/215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:54 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1492 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:54.669999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:54.670994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:54.685364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.686676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.689184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.690662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.691735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.692946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.847899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:54.848494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:54.857902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.860472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.863892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:54.866315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:54.867669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:54.870067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:55.011476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:55.026246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:48:55.362567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:55.375803 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab759c22-aea0-4f22-9426-3d3b2f77eaff tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1488 microversion: 2.1 time: 0.709499 Oct 06 12:48:55.376959 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 108/216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:54 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1488 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:55.386315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:55.390425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:55.429084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:55.430033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:55.432745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:55.433963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:55.454246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:55.455171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:55.547829 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0ce616e-2223-433b-a912-8eca98850e62 tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 204 len: 0 microversion: 2.1 time: 1.131247 Oct 06 12:48:55.551926 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 109/217] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:48:54 2022] DELETE /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:48:55.560698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:55.569918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:55.591338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:55.591768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:55.592256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:55.593096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:55.593565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:55.594040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:55.978006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:55.999834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec9b2663-db32-4c95-9267-12360980f38b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.620402 Oct 06 12:48:56.001075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 109/218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:55 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:56.006172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:56.007174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:56.024672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:56.025542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:56.026659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:56.027658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:56.029504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:56.030636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:56.438960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:56.456531 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7157e54-2d25-4390-b5fe-97552ecc9791 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1498 microversion: 2.1 time: 0.452648 Oct 06 12:48:56.474091 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1b66f38-5afe-41f8-a81e-3a84c4905810 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1639 microversion: 2.1 time: 0.903010 Oct 06 12:48:56.475188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 110/219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:56 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1498 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:56.475376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 110/220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:55 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1639 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:56.498838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:56.499741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:56.508083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:56.508815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:56.509461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:56.510543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:56.511239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:56.512125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:56.550868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:48:56.978955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2cf58ffa-7855-4978-9c8e-e3fc8483261f tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "DELETE /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 204 len: 0 microversion: 2.1 time: 0.484698 Oct 06 12:48:56.979761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 111/221] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:48:56 2022] DELETE /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:48:56.988523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:56.989236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:57.005204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.006058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.007490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.008376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.008992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.009605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.330955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:57.345658 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6230194a-ee9d-4b1e-a24e-1f25b4fdb373 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1494 microversion: 2.1 time: 0.361392 Oct 06 12:48:57.346816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 112/222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:56 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1494 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:48:57.351935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:57.352591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:57.359324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.359947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.360385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.361074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.361698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.362302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.366778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:57.532226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d4407df70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:57.535970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.536643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.538707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.540001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.542626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.545809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.567209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:57.586683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ad05357-497e-4b4e-afa9-7f8682edae64 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.238770 Oct 06 12:48:57.589821 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 113/223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:57 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:57.596781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f1c7d8-9c49-408e-9c5a-f509210aa935", "name": "network-vif-plugged", "status": "completed", "tag": "290c859e-a81e-4159-8284-6e1bc95ad898"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:57.609131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.610045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.610774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.617515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ab0e8ef-ca7b-47e6-8b86-6f39ae78a8f6 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.668839 Oct 06 12:48:57.622064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 111/224] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 12:48:56 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:48:57.626738 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] Creating event network-vif-plugged:290c859e-a81e-4159-8284-6e1bc95ad898 for instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 on n-h2-860556-1 Oct 06 12:48:57.635374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0052c3fd-c962-4b06-84d9-0e83e4c31bd3 req-3debc8ac-4a7a-4c27-8465-5f29b82d7052 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 Oct 06 12:48:57.636600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 114/225] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:57.643240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d44478c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:57.645679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:57.646838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:57.648836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.649588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.650810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.651932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.652665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.653344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.659462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.660899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.667038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.668293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.668982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.670328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.673764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=11 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:57.714654 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a5a7867b-6508-4064-9cb5-2d20c0291206 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.076235 Oct 06 12:48:57.715432 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 115/226] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Oct 6 12:48:57 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:57.728102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fe77310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:57.732675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.733365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.734141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.734982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:57.735575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:57.736019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:57.791493 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e63ff94-668b-4e65-bd37-fa30631a7ee3 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.068370 Oct 06 12:48:57.793430 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 116/227] 10.222.0.26 () {58 vars in 1145 bytes} [Thu Oct 6 12:48:57 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:48:57.961945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:57.972308 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2beb7c99-68cf-4514-aaf5-cdc3b2278893 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1498 microversion: 2.1 time: 0.349066 Oct 06 12:48:57.973093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:57 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:58.711259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3ff0fb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:58.735256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6232404-8ea5-49e8-9639-82b7db749783 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Calling method '.version_select at 0x7f7d3ff1e310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:58.881352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=8,nova_api:INSERT=7 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:48:58.894496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:58.896502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:58.898092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:58.907994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:58.908824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:58.909454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:58.969894 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6232404-8ea5-49e8-9639-82b7db749783 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 371 microversion: 2.1 time: 0.759013 Oct 06 12:48:58.972534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 117/229] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 12:48:58 2022] GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 371 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:58.992680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:58.996855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:59.008808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.020696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.021292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.022516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.023522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.024158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.028150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-616be5a4-f208-4e4b-8a3b-4a981c19bee7 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7" status: 200 len: 148 microversion: 2.57 time: 0.676809 Oct 06 12:48:59.029921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 113/230] 10.222.0.26 () {62 vars in 1303 bytes} [Thu Oct 6 12:48:58 2022] PUT /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7 => generated 148 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:48:59.038294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:59.038863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:59.045233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.045758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.046206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.046922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.047702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.048293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.417616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:59.427122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '057e318935274d4ebc5c50b3fd73d43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353737503ced45bb922a941eeb0364a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:59.445705 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a851185-5ebe-4ef7-8ab5-1e2e728004c7 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 200 len: 1494 microversion: 2.1 time: 0.471001 Oct 06 12:48:59.446521 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-792750af-ba7f-44cc-84ca-be229dd06861 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1318 microversion: 2.1 time: 0.411363 Oct 06 12:48:59.449696 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 114/231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:59 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:59.451263 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 118/232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:58 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 1494 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:59.463514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44416940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:59.464500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c2d490-619c-43e6-a4f2-b69d5a1dc34c", "name": "network-vif-deleted", "tag": "0ef4ce90-f791-408e-abc8-a45b2052e10e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:48:59.485511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.487003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.487616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.512561 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] Creating event network-vif-deleted:0ef4ce90-f791-408e-abc8-a45b2052e10e for instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c on n-h1-860556-1 Oct 06 12:48:59.520122 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f9e5709e-978b-4ed7-abc6-42946a9863ad req-9b1a503e-89cc-47fc-8650-90079b279949 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068579 Oct 06 12:48:59.521642 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 115/233] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:48:59.544355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:59.545328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:48:59.554985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.555938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.557070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.557869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.558214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.558774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.645154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.648119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.648780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.649413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lazy-loading 'fault' on Instance uuid 78c2d490-619c-43e6-a4f2-b69d5a1dc34c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:48:59.748591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:48:59.768525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c130ba50-f81d-400c-88b9-0fced0fb2fb9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 200 len: 1332 microversion: 2.1 time: 0.244274 Oct 06 12:48:59.769993 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 116/234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:48:59 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 1332 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:48:59.792856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Calling method '.version_select at 0x7f7d3fe9b4c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:48:59.922227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.924388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.927217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:48:59.928273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:48:59.930370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:48:59.931092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.041365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.042121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.042754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.043910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.044583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.045246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.058375 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96787255-3fc4-405a-ba78-d9eaf2d9a37a tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 328 microversion: 2.1 time: 0.605048 Oct 06 12:49:00.060394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 119/235] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:48:59 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 328 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:00.067820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677117e7-d4ff-4cb0-9303-ca7d9b70e59a", "name": "network-vif-deleted", "tag": "373bb865-046e-4c79-83d6-3ce78647afa9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:00.070580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47381848-563e-4e1e-a495-cb11aa4c462f tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7/detail" status: 200 len: 463 microversion: 2.57 time: 0.299079 Oct 06 12:49:00.071753 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 117/236] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Oct 6 12:48:59 2022] GET /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7/detail => generated 463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:00.092767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.093725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.094530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.112781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] Creating event network-vif-deleted:373bb865-046e-4c79-83d6-3ce78647afa9 for instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a on n-h1-860556-1 Oct 06 12:49:00.123345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f3465636-c2b9-462b-ae01-99043458c60a req-9bf856bb-c63e-4663-9e16-b0541ceb2619 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061359 Oct 06 12:49:00.125167 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 120/237] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:00.347700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fec51f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:00.387129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-525864785", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:00.453461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.454340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.454967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.456852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.458048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.460745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.497460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:00.536583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.538954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.539641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.540964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.541594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.542289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.646541 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1cdbad7e-203f-480a-ae87-d7b9636c0c83 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7?user_id=a8fe488386a044e98c32bdfdc680fc9c" status: 200 len: 148 microversion: 2.57 time: 0.304491 Oct 06 12:49:00.649807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 121/238] 10.222.0.26 () {62 vars in 1384 bytes} [Thu Oct 6 12:49:00 2022] PUT /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7?user_id=a8fe488386a044e98c32bdfdc680fc9c => generated 148 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:00.661315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:00.662422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:00.668357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=93,nova_api:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:00.670364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.670898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.671579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.672525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.673448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.674378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.832476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:00.833282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:00.833858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:00.834441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:00.834941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:00.846554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.847289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.847980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.849141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.850667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.851721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.882941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:00.891533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for user 108225920675413ab73453ab44dcd5b9 and project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:00.911179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.utils [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] cores quota exceeded for f7bc1df1ebae44d98e36ccd117ac30b9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129614) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 06 12:49:00.915317 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Request method failure captured: Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 144 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs64EEVA9P5jw4GAd5K6NB88PU0PsVEYDUynjiNV-OpU7qVesLopLHaGMiXqr1Yps7DA6uu44YLF9w0H3tkjJl_3ETRkVUaM8Lc_Vc1aioy__o7cXLouGfB8YFL1_kdTojSd3k-u06b_0NfTVt08sdJQ29tlRUnKwHDJKbN31-J8wLk Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:00.921612 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7bc1df1ebae44d98e36ccd117ac30b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}] Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 108225920675413ab73453ab44dcd5b9 Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-525864785", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} Oct 06 12:49:00.922933 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-525864785', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452'}}} Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 06 12:49:00.923636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:00.924654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.926529 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6882250-8f1e-4f1d-9b82-8426f30a69ef tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.655309 Oct 06 12:49:00.927667 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 118/239] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:00 2022] POST /compute/v2.1/servers => generated 111 bytes in 657 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:00.935341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:00.935964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:00.943196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.943997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.944600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.945474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:00.946116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:00.946900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:00.962243 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] HTTP exception thrown: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Request method failure captured: Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a HTTP/1.1 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TRKMymEFYiILtgCkKiVYkdMIxczfCdHWH9btT7vdihQxWio-5bUFdroaxPOWSmdj34f125U7V6tLdA-mScKQPHzr3f6jUTcvVIfa6IlZUhID1aSDlL6N-a7XCvc6pU8W09urQLn8Wdh0YXODg1gOldlrVGDGNA3PsKUH4F_6DwTU Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:00.964306 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_353737503ced45bb922a941eeb0364a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/353737503ced45bb922a941eeb0364a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}] Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 057e318935274d4ebc5c50b3fd73d43c Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:00.965756 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '677117e7-d4ff-4cb0-9303-ca7d9b70e59a'} Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:00.966586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:00.967956 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:00.969991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Returning 404 to user: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:00.971012 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37291825-8a20-4dcd-9be1-75b9916e5377 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 404 len: 111 microversion: 2.1 time: 0.039870 Oct 06 12:49:00.971738 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 119/240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:00 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:00.976939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d26305eb-b7cc-44dd-98e5-14c295cf47e0 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] Calling method '.version_select at 0x7f7d3fe2bdc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:01.001144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:01.009611 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a19df22-261f-43ae-8d05-4dc36237ea6b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1468 microversion: 2.1 time: 0.358178 Oct 06 12:49:01.026469 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:00 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1468 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:01.032444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:01.033479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:01.042484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.046347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.050211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.051357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.052292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.053561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.073820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c HTTP/1.1 Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:01.077876 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:01.079356 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '78c2d490-619c-43e6-a4f2-b69d5a1dc34c'} Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:01.080205 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:01.081500 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:01.085361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:01.086899 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4fc6f32-ab9f-48aa-9e81-d71e17f46c57 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 404 len: 111 microversion: 2.1 time: 0.065988 Oct 06 12:49:01.089802 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 123/242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:01 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:01.092987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fd63820>, body: {"quota_set": {"cores": 20}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:01.112800 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d26305eb-b7cc-44dd-98e5-14c295cf47e0 tempest-QuotasAdminTestV257-1028651018 tempest-QuotasAdminTestV257-1028651018-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7?user_id=a8fe488386a044e98c32bdfdc680fc9c" status: 200 len: 190 microversion: 2.57 time: 0.139808 Oct 06 12:49:01.117321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 120/243] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Oct 6 12:49:00 2022] GET /compute/v2.1/os-quota-sets/370527341e39472bb823c4fa0ec6b3e7?user_id=a8fe488386a044e98c32bdfdc680fc9c => generated 190 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:01.130272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6005b98c-6911-4b65-bfc4-f3c8410aa818 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:01.162079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6005b98c-6911-4b65-bfc4-f3c8410aa818 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.163111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6005b98c-6911-4b65-bfc4-f3c8410aa818 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.163769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6005b98c-6911-4b65-bfc4-f3c8410aa818 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.182853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.183344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.186723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.187683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.207379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.207938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.364310 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c262e589-0cb7-475d-a465-1f1a41d98267 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 329 microversion: 2.1 time: 0.274668 Oct 06 12:49:01.366871 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 124/244] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:01 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 329 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:01.382679 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6005b98c-6911-4b65-bfc4-f3c8410aa818 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 299 microversion: 2.1 time: 0.262943 Oct 06 12:49:01.387804 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 121/245] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:49:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:01.401101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-800419185", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:01.498798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:01.776814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1459097061", "block_migration": true, "disk_over_commit": false}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:01.782691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:01.804211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.806247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.806941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.809641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:01.813401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:01.813915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:01.978004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:01.978452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:01.979006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:01.979671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:01.980159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:02.010536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:02.013300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:02.014732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:02.022700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:02.025292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:02.027692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:02.083049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Getting quotas for project 94a1c2db877744d78cb8a66ba14c9dcc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:02.094960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Getting quotas for user 3b5c371ba92f49edbb4032d48ee7cf9f and project 94a1c2db877744d78cb8a66ba14c9dcc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:02.131364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:02.136453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:02.244583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d59ea93e-aa8d-4d0c-806e-46adcd2f638e tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853858 Oct 06 12:49:02.250302 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 122/246] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:02.259895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a1aa2dd-adcf-40e3-9960-053e02f5f982 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Calling method '.version_select at 0x7f7d3fd8f3a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:02.448012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lazy-loading 'flavor' on Instance uuid b6f1c7d8-9c49-408e-9c5a-f509210aa935 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:02.571782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Going to try to live migrate instance to tempest-host-1459097061 {{(pid=129615) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:49:02.583824 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] HTTP exception thrown: Compute host tempest-host-1459097061 could not be found. Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Request method failure captured: Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935/action HTTP/1.1 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 107 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6f6t2BVh10dLmJonUvAKqrkZqJlFMwolVjnCJeZ9-j4qdeW8h5kZg0UmgLfmTqGXeU7jaq6AQ_XFaQb86kqzlOgLBWDl23y7Ay93RFscdW2uqJ6shEXGTcuzCEAr7ivqzai3CL_qmF3rxLmbyMfgA3PvtYVcoQ0orYMjx4TRxIAaQ Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: bee0835e44954e7287415ed88c56b690 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:49:02.610207 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bee0835e44954e7287415ed88c56b690", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee0835e44954e7287415ed88c56b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bee0835e44954e7287415ed88c56b690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee0835e44954e7287415ed88c56b690"}]}] Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: bee0835e44954e7287415ed88c56b690 Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveMigrationNegativeTest-947167202-project-admin Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b153887d48dc4f3e8b792ae665b72ab5 Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveMigrationNegativeTest-947167202-project-admin Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: {"os-migrateLive": {"host": "tempest-host-1459097061", "block_migration": true, "disk_over_commit": false}} Oct 06 12:49:02.611448 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: exception: Compute host tempest-host-1459097061 could not be found. Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b6f1c7d8-9c49-408e-9c5a-f509210aa935', 'body': {'os-migrateLive': {'host': 'tempest-host-1459097061', 'block_migration': True, 'disk_over_commit': False}}} Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:02.612125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 480, in get_all_by_host Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in _db_compute_node_get_all_by_host Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1459097061 could not be found. Oct 06 12:49:02.613156 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1459097061 could not be found. Oct 06 12:49:02.614312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1459097061 could not be found. Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Returning 400 to user: Compute host tempest-host-1459097061 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51849789-dcf8-4b7a-bd63-26501c517285 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935/action" status: 400 len: 100 microversion: 2.1 time: 1.244003 Oct 06 12:49:02.615386 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 125/247] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Oct 6 12:49:01 2022] POST /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935/action => generated 100 bytes in 1245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:49:02.625031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e78f1aa7-21bb-4950-89bf-296653c57bca tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:02.683538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e78f1aa7-21bb-4950-89bf-296653c57bca tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.069819 Oct 06 12:49:02.686570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 126/248] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:02 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:02.698338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-68b970e7-204f-4aad-b3ad-e71d1a6e3f98 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:02.700712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-68b970e7-204f-4aad-b3ad-e71d1a6e3f98 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:02.880339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-68b970e7-204f-4aad-b3ad-e71d1a6e3f98 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:02.892727 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-68b970e7-204f-4aad-b3ad-e71d1a6e3f98 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1219 microversion: 2.1 time: 0.204489 Oct 06 12:49:02.894036 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 127/249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:02 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:02.900949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:02.902626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:02.912019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:02.913290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:02.914393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:02.915311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:02.915999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:02.916763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:02.940280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a1aa2dd-adcf-40e3-9960-053e02f5f982 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 371 microversion: 2.1 time: 0.688581 Oct 06 12:49:02.940882 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 123/250] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 12:49:02 2022] GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 371 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:02.964622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-612548be-3766-4869-a76a-cd2f86cac627 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-521414657"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:02.981038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-612548be-3766-4869-a76a-cd2f86cac627 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid cb965332-6b09-4acb-b622-2914fee9cfc9 for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:03.053921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-612548be-3766-4869-a76a-cd2f86cac627 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.111328 Oct 06 12:49:03.058152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 124/251] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:03.066432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fe32940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:03.352992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:03.355397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:03.356031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:03.360885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:03.375695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:03.376367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:03.463807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71bbe341-ea86-4b2f-9537-a364e54590a6 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 328 microversion: 2.1 time: 0.404086 Oct 06 12:49:03.466422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 125/252] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:03 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 328 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:03.472015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ade659d7-f8c9-4ca1-99f0-5fc0ec9f1fdb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:03.508278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ade659d7-f8c9-4ca1-99f0-5fc0ec9f1fdb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:03.508779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ade659d7-f8c9-4ca1-99f0-5fc0ec9f1fdb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:03.509217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ade659d7-f8c9-4ca1-99f0-5fc0ec9f1fdb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:03.530305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:03.748126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ade659d7-f8c9-4ca1-99f0-5fc0ec9f1fdb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.279604 Oct 06 12:49:03.749030 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 126/253] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:49:03 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:03.757147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1293954820", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:03.860271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:03.867498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:03.872419 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cd54ae0-da2a-458f-87bb-ce3a65c7b37b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1468 microversion: 2.1 time: 0.976945 Oct 06 12:49:03.873437 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 128/254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:02 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1468 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:03.881227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30e4be79-2ea0-416c-91f3-7e1698deb554 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:03.908848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30e4be79-2ea0-416c-91f3-7e1698deb554 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.031309 Oct 06 12:49:03.917682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 129/255] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:49:03 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:03.922909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:03.924003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:03.931720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:03.933382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:03.934242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:03.935155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:03.935809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:03.936420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:04.135034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:04.166846 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b8d0fb38-cf0c-4852-b808-e8d17c8018b8 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1271 microversion: 2.1 time: 0.246875 Oct 06 12:49:04.170606 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:03 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:04.181820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f558716e-7002-4cec-bbeb-f5623edf22bf tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:04.221693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f558716e-7002-4cec-bbeb-f5623edf22bf tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:04.222562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f558716e-7002-4cec-bbeb-f5623edf22bf tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:04.226506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f558716e-7002-4cec-bbeb-f5623edf22bf tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:04.427863 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f558716e-7002-4cec-bbeb-f5623edf22bf tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.254705 Oct 06 12:49:04.431401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 131/257] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Oct 6 12:49:04 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:04.447558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-534410747", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:04.461794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:04.462271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:04.462714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:04.463125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:04.463541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:04.507271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:04.511870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:04.513283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:04.521192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:04.521713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:04.522870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:04.527563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:04.609798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:04.619002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for user 108225920675413ab73453ab44dcd5b9 and project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:04.645169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.utils [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] instances quota exceeded for f7bc1df1ebae44d98e36ccd117ac30b9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129614) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 06 12:49:04.646276 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Request method failure captured: Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 145 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs64EEVA9P5jw4GAd5K6NB88PU0PsVEYDUynjiNV-OpU7qVesLopLHaGMiXqr1Yps7DA6uu44YLF9w0H3tkjJl_3ETRkVUaM8Lc_Vc1aioy__o7cXLouGfB8YFL1_kdTojSd3k-u06b_0NfTVt08sdJQ29tlRUnKwHDJKbN31-J8wLk Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:04.651399 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7bc1df1ebae44d98e36ccd117ac30b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}] Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 108225920675413ab73453ab44dcd5b9 Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1293954820", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} Oct 06 12:49:04.652607 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1293954820', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452'}}} Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 06 12:49:04.653300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:04.654324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.655426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 06 12:49:04.658232 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:04.662009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:04.663876 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6af57ae-e1ce-424a-bea0-62f0c6cac684 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.913730 Oct 06 12:49:04.668316 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 127/258] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:03 2022] POST /compute/v2.1/servers => generated 119 bytes in 918 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:04.674581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9e584e0-ff48-405f-91fc-4237020749eb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:04.714752 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9e584e0-ff48-405f-91fc-4237020749eb tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.043951 Oct 06 12:49:04.717951 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 128/259] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:04.748848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fd92820>, body: {"quota_set": {"instances": 10}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:05.158747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:05.159379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:05.160277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:05.161108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:05.161800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:05.185559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.188113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.191175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.192712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.195831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.197094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.250925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Getting quotas for project 3e96e87780a8414ebbcad917ddf5bdd5. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:05.263203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Getting quotas for user cc17e783f95d40a892c4fb255e315a46 and project 3e96e87780a8414ebbcad917ddf5bdd5. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:05.278880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:05.280117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.280641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.281532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:05.281777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.287992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.289014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.289624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.378113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52c71091-479a-42f7-bd51-56ac1088f6d0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940317 Oct 06 12:49:05.387527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 132/260] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:05.394885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78b089a8-cc50-483a-ab31-6f37f8436341 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1615238112"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:05.403253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-78b089a8-cc50-483a-ab31-6f37f8436341 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 439fd95d-ee15-49da-ac2d-7c50bb016ab4 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:05.420503 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa592b93-e2c0-4ade-847f-11746eaaff82 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 329 microversion: 2.1 time: 0.700841 Oct 06 12:49:05.422198 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 129/261] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:04 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 329 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:05.435764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:05.436750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:05.446802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.447534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.448188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.449112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.449936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.450585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:05.494380 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78b089a8-cc50-483a-ab31-6f37f8436341 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.099487 Oct 06 12:49:05.496533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 133/262] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:05.548566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60392410-a6b9-4379-87d8-99b67a6ae70e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:05.551547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60392410-a6b9-4379-87d8-99b67a6ae70e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:05.561693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:05.583312 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c480378-99e7-4c42-b1e0-69797b300ed2 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1277 microversion: 2.1 time: 0.151860 Oct 06 12:49:05.597782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 130/263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:05 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:05.606298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ca410b1-5afc-490e-90fd-582eb5c89eb9 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Calling method '.version_select at 0x7f7d3fe2b5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:05.707708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60392410-a6b9-4379-87d8-99b67a6ae70e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:05.718251 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60392410-a6b9-4379-87d8-99b67a6ae70e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1218 microversion: 2.1 time: 0.211398 Oct 06 12:49:05.719370 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 134/264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:05 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:05.725948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c7a0469-67b1-41e6-9576-0e7686bffc99 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:05.749534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c7a0469-67b1-41e6-9576-0e7686bffc99 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:05.753397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c7a0469-67b1-41e6-9576-0e7686bffc99 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:05.755923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c7a0469-67b1-41e6-9576-0e7686bffc99 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.083620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c7a0469-67b1-41e6-9576-0e7686bffc99 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.362994 Oct 06 12:49:06.085487 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 135/265] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:06.104521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-05040473-6a8b-4648-8714-bd1bbbace4d4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:06.141725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-05040473-6a8b-4648-8714-bd1bbbace4d4 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.041417 Oct 06 12:49:06.143215 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 136/266] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:49:06 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:06.154670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13f8bfaf-b3ea-4c07-bf15-bfe91a3f42a7 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:06.179492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f8bfaf-b3ea-4c07-bf15-bfe91a3f42a7 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.180341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f8bfaf-b3ea-4c07-bf15-bfe91a3f42a7 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.180341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f8bfaf-b3ea-4c07-bf15-bfe91a3f42a7 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.387966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ca410b1-5afc-490e-90fd-582eb5c89eb9 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 371 microversion: 2.1 time: 0.802537 Oct 06 12:49:06.405344 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 131/267] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 12:49:05 2022] GET /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:06.427843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fd8f9d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:06.498718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13f8bfaf-b3ea-4c07-bf15-bfe91a3f42a7 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.348210 Oct 06 12:49:06.502574 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 137/268] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:06 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:06.519917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77b0cd5f-9d93-4da4-b264-b6bbadc8b0bd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:06.572456 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77b0cd5f-9d93-4da4-b264-b6bbadc8b0bd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.063542 Oct 06 12:49:06.576424 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 138/269] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:06.593996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb6448e6-af6b-42fe-9619-7fb62cffc835 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-129276914"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:06.604892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-fb6448e6-af6b-42fe-9619-7fb62cffc835 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid a33fe8d1-cea6-4c6b-8cf0-76e83aaeb1e4 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:06.656888 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb6448e6-af6b-42fe-9619-7fb62cffc835 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070975 Oct 06 12:49:06.659115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 139/270] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:06.675741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:06.676807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:06.693406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.695054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.695712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.696665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.697465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.698130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.838145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:06.846558 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd2556a7-617e-4689-b618-647c74d1d5c6 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1277 microversion: 2.1 time: 0.185442 Oct 06 12:49:06.854010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 140/271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:06 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:06.862760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66dbae35-057e-423f-bd1b-900de0a640b3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:06.878347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66dbae35-057e-423f-bd1b-900de0a640b3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.880154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66dbae35-057e-423f-bd1b-900de0a640b3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.880960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66dbae35-057e-423f-bd1b-900de0a640b3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.921663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:06.948609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.949174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.952047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:06.952879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:06.953364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:06.957859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.104403 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62601fcf-94e0-4c47-af8b-4253aa399f33 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 325 microversion: 2.1 time: 0.690773 Oct 06 12:49:07.116321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 132/272] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:06 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 325 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:07.134951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:07.144745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:07.157191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.158455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.160942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.162550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.164120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.165629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.177113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-66dbae35-057e-423f-bd1b-900de0a640b3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.327531 Oct 06 12:49:07.177818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 141/273] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:07.191599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5388ad2f-fdce-40bf-b3c8-918fed9776be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:07.220905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5388ad2f-fdce-40bf-b3c8-918fed9776be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.222812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5388ad2f-fdce-40bf-b3c8-918fed9776be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.238559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5388ad2f-fdce-40bf-b3c8-918fed9776be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.384812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:07.416586 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99f5bdb1-6569-49f2-8b3e-0a2c49e2ee93 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1270 microversion: 2.1 time: 0.292850 Oct 06 12:49:07.419281 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 133/274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:07 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1270 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:07.432205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1442353716", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:07.489529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5388ad2f-fdce-40bf-b3c8-918fed9776be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.299883 Oct 06 12:49:07.492527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 142/275] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:07.514224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-06118931-df7c-4e65-93bd-a22698ec2311 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:07.556201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:07.572598 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-06118931-df7c-4e65-93bd-a22698ec2311 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.065630 Oct 06 12:49:07.581918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 143/276] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:07 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 06 12:49:07.590315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3094c298-75ff-4061-85fe-542170d862be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1354595514"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:07.599918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-3094c298-75ff-4061-85fe-542170d862be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 69568501-d4d0-446d-9421-0ffa168db2c6 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:07.650423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3094c298-75ff-4061-85fe-542170d862be tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066420 Oct 06 12:49:07.660609 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 144/277] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:07.668903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cdb23dfe-3e25-4ddc-904f-43b122398ee3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:07.713269 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cdb23dfe-3e25-4ddc-904f-43b122398ee3 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.050391 Oct 06 12:49:07.720114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 145/278] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:07.733466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-76202632-6500-42db-8d04-10fa7143a02c tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-259031967"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:07.738383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-76202632-6500-42db-8d04-10fa7143a02c tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 27337726-2d78-453a-8f68-b3cabda711fd for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:07.774725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-76202632-6500-42db-8d04-10fa7143a02c tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052505 Oct 06 12:49:07.780292 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 146/279] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:07.800414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2c00e3c-f82f-4d09-bfe2-1671bef4ae6e tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:07.830739 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b2c00e3c-f82f-4d09-bfe2-1671bef4ae6e tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2c00e3c-f82f-4d09-bfe2-1671bef4ae6e tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Request method failure captured: Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6V94GluEE-AyvdS0KlUqxs5Bp_Z_wF9LQvier4NGbwu3Uvt-zTXrTJBdPLVZjiniWHvfsqzdV7w12i4G_SJM0RGC44-fGIh2jUsNCGzNhOifAX5tSi5onlB-GdpRPW-1UhEMz7CnzhQ_rpXL63q67t06aiub9pZIqCpFScXfRjrjw Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:49:07.832495 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ae30e0dd8e34efb999d9a2b9190368b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}] Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 57f2365ed3d94b3e9472e8e552d39ee7 Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: exception: Aggregate 12 could not be found. Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '12'} Oct 06 12:49:07.833855 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:07.834680 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 06 12:49:07.835782 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:07.836865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2c00e3c-f82f-4d09-bfe2-1671bef4ae6e tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:07.836865 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2c00e3c-f82f-4d09-bfe2-1671bef4ae6e tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.039656 Oct 06 12:49:07.843923 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 147/280] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:07 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:07.854817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10375815-9272-4b94-9827-81583570e616 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:07.906974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10375815-9272-4b94-9827-81583570e616 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.907476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10375815-9272-4b94-9827-81583570e616 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.907914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10375815-9272-4b94-9827-81583570e616 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.968017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:07.968665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:07.969091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:07.969704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:07.970346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:07.987673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.989594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.990256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:07.991781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:07.992419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:07.993006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.016844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:08.029674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Getting quotas for user 108225920675413ab73453ab44dcd5b9 and project f7bc1df1ebae44d98e36ccd117ac30b9. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:08.054214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:08.063386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.utils [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] ram quota exceeded for f7bc1df1ebae44d98e36ccd117ac30b9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129614) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 06 12:49:08.064401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Request method failure captured: Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 145 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs64EEVA9P5jw4GAd5K6NB88PU0PsVEYDUynjiNV-OpU7qVesLopLHaGMiXqr1Yps7DA6uu44YLF9w0H3tkjJl_3ETRkVUaM8Lc_Vc1aioy__o7cXLouGfB8YFL1_kdTojSd3k-u06b_0NfTVt08sdJQ29tlRUnKwHDJKbN31-J8wLk Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:08.067124 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7bc1df1ebae44d98e36ccd117ac30b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}] Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 108225920675413ab73453ab44dcd5b9 Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1442353716", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} Oct 06 12:49:08.068495 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1442353716', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452'}}} Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 06 12:49:08.069184 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.070693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.071831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 06 12:49:08.074257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.077162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:08.078469 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3162a06-324b-484c-9f91-76cef5649931 tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.657586 Oct 06 12:49:08.083144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 134/281] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 663 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:08.089426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c705e15-ab37-4511-aa2b-5b6a7006ac61 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.106415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5c705e15-ab37-4511-aa2b-5b6a7006ac61 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c705e15-ab37-4511-aa2b-5b6a7006ac61 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Request method failure captured: Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6V94GluEE-AyvdS0KlUqxs5Bp_Z_wF9LQvier4NGbwu3Uvt-zTXrTJBdPLVZjiniWHvfsqzdV7w12i4G_SJM0RGC44-fGIh2jUsNCGzNhOifAX5tSi5onlB-GdpRPW-1UhEMz7CnzhQ_rpXL63q67t06aiub9pZIqCpFScXfRjrjw Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:08.108596 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ae30e0dd8e34efb999d9a2b9190368b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}] Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 57f2365ed3d94b3e9472e8e552d39ee7 Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate 12 could not be found. Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '12'} Oct 06 12:49:08.109886 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:08.110629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.111688 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.112801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c705e15-ab37-4511-aa2b-5b6a7006ac61 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:08.121532 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c705e15-ab37-4511-aa2b-5b6a7006ac61 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.036895 Oct 06 12:49:08.122349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 135/282] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:08 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:08.129805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.130749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:08.143521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.144249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.144983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.146197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.147086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.148066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.191632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10375815-9272-4b94-9827-81583570e616 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.346524 Oct 06 12:49:08.192238 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 148/283] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:07 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:08.199096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fd338b0>, body: {"quota_set": {"ram": 51200}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:08.337470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:08.351931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bea4f425-32cd-4287-b8bf-9ecbe05d684c tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.228126 Oct 06 12:49:08.352907 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 136/284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:08 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:08.359881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5fcbe45-090f-4517-9939-31ae52ef76ea tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-310403665", "name": "tempest-test_aggregate-1345970579"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:08.385854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-a5fcbe45-090f-4517-9939-31ae52ef76ea tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 64d6e86f-4129-4193-8494-e97064c356aa for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:08.456465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5fcbe45-090f-4517-9939-31ae52ef76ea tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.102146 Oct 06 12:49:08.458047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 137/285] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Oct 6 12:49:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:08.467032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60294219-7b82-4af2-ab05-4ee40e370a7e tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:08.474832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60294219-7b82-4af2-ab05-4ee40e370a7e tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '51115fa1d08d432cb6b47403ed2dfec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b9035064ff420a8d8d601f9ff859a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60294219-7b82-4af2-ab05-4ee40e370a7e tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Request method failure captured: Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 42 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6S9NfqaBeTNAc_SVfxSFknipYNXlOQqzeB8HTiXkHO4wZDcy3lAJAlyvgPSSmYqYKmboL-EDpWHHYxMXjK_taCOIrBoyqXDCoON8TlxGNuZEHVHssyKSEmWBJBzKEj7sO70jQg55zgEzLgrKjrp2Fm6T91wJrfpAMJc5-0wN2jRPE Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:08.477887 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b9035064ff420a8d8d601f9ff859a5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b9035064ff420a8d8d601f9ff859a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b9035064ff420a8d8d601f9ff859a5"}]}] Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89b9035064ff420a8d8d601f9ff859a5 Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-178820409 Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 51115fa1d08d432cb6b47403ed2dfec6 Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-178820409-project Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: {"remove_host": {"host": "n-h1-860556-1"}} Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:08.479097 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-860556-1'}}} Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:08.480045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 06 12:49:08.481102 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.484281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60294219-7b82-4af2-ab05-4ee40e370a7e tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:08.485375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60294219-7b82-4af2-ab05-4ee40e370a7e tempest-AggregatesAdminNegativeTestJSON-178820409 tempest-AggregatesAdminNegativeTestJSON-178820409-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.026187 Oct 06 12:49:08.486546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 138/286] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:08 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:08.496153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.497237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:08.517902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.521933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.522955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.524220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.525362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.526079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.635620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:08.647436 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a0050938-68a4-4e8c-b75f-ad3e5e1b7bc0 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1276 microversion: 2.1 time: 0.159582 Oct 06 12:49:08.649557 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 139/287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:08 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:08.666773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11899593-a285-4ae9-a8dd-6173918633cd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.703755 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11899593-a285-4ae9-a8dd-6173918633cd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.052735 Oct 06 12:49:08.712210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 140/288] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:08.717120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-974c4f36-b1f6-4276-bec9-e36f540d1cc2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:08.731476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-974c4f36-b1f6-4276-bec9-e36f540d1cc2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.731982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-974c4f36-b1f6-4276-bec9-e36f540d1cc2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.732431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-974c4f36-b1f6-4276-bec9-e36f540d1cc2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.851536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.853322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.854060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.855426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:08.855788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:08.856224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:08.907068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-974c4f36-b1f6-4276-bec9-e36f540d1cc2 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.194677 Oct 06 12:49:08.907896 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 141/289] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:08 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:08.918552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be9cc7a7-89fe-46ab-89c6-a0f6f25ea247 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.926221 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-be9cc7a7-89fe-46ab-89c6-a0f6f25ea247 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be9cc7a7-89fe-46ab-89c6-a0f6f25ea247 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Request method failure captured: Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6V94GluEE-AyvdS0KlUqxs5Bp_Z_wF9LQvier4NGbwu3Uvt-zTXrTJBdPLVZjiniWHvfsqzdV7w12i4G_SJM0RGC44-fGIh2jUsNCGzNhOifAX5tSi5onlB-GdpRPW-1UhEMz7CnzhQ_rpXL63q67t06aiub9pZIqCpFScXfRjrjw Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:08.927796 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ae30e0dd8e34efb999d9a2b9190368b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}] Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 57f2365ed3d94b3e9472e8e552d39ee7 Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate 14 could not be found. Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '14'} Oct 06 12:49:08.929655 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.930525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 06 12:49:08.932195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.934756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be9cc7a7-89fe-46ab-89c6-a0f6f25ea247 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:08.934756 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be9cc7a7-89fe-46ab-89c6-a0f6f25ea247 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.021190 Oct 06 12:49:08.934756 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 142/290] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:08 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:08.935350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-650126c5-8db6-473f-a6f2-e136a0002c11 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.941720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:08.964702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-650126c5-8db6-473f-a6f2-e136a0002c11 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.032785 Oct 06 12:49:08.965709 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 143/291] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:08.971769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aef4a7d4-b2e3-496b-9dd0-b9b0758ae86b tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:08.985684 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ac49d10-346a-4317-b382-e3c96308cbc4 tempest-QuotasAdminNegativeTest-1935502720 tempest-QuotasAdminNegativeTest-1935502720-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 200 len: 329 microversion: 2.1 time: 0.792283 Oct 06 12:49:08.986607 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 149/292] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:08 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 329 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:08.990501 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-aef4a7d4-b2e3-496b-9dd0-b9b0758ae86b tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aef4a7d4-b2e3-496b-9dd0-b9b0758ae86b tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Request method failure captured: Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6V94GluEE-AyvdS0KlUqxs5Bp_Z_wF9LQvier4NGbwu3Uvt-zTXrTJBdPLVZjiniWHvfsqzdV7w12i4G_SJM0RGC44-fGIh2jUsNCGzNhOifAX5tSi5onlB-GdpRPW-1UhEMz7CnzhQ_rpXL63q67t06aiub9pZIqCpFScXfRjrjw Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:08.992521 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ae30e0dd8e34efb999d9a2b9190368b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ae30e0dd8e34efb999d9a2b9190368b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ae30e0dd8e34efb999d9a2b9190368b"}]}] Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3ae30e0dd8e34efb999d9a2b9190368b Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-251622922 Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 57f2365ed3d94b3e9472e8e552d39ee7 Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminTestJSON-251622922-project-admin Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: exception: Aggregate 14 could not be found. Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '14'} Oct 06 12:49:08.994020 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 281, in get_by_id Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:08.994752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:08.995766 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aef4a7d4-b2e3-496b-9dd0-b9b0758ae86b tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aef4a7d4-b2e3-496b-9dd0-b9b0758ae86b tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.026607 Oct 06 12:49:08.996930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 144/293] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:08.997728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f72a9c95-4df2-4a55-9b0a-fcbb4717c6fe tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-723857170"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:08.999432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-f72a9c95-4df2-4a55-9b0a-fcbb4717c6fe tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Generated uuid 5e8d7f56-990f-4aad-9ab0-1f6e8fdde13c for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:09.003102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fe32ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.023348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.024854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.024854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.034410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.035261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.035886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.043734 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f72a9c95-4df2-4a55-9b0a-fcbb4717c6fe tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055714 Oct 06 12:49:09.044977 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 150/294] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.045908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:09.052560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9961d8f-feeb-4809-ad6c-f134e7d7cd1a tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Action: 'update', calling method: .version_select at 0x7f7d3fbc8280>, body: {"quota_set": {"ram": 0}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.059199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9961d8f-feeb-4809-ad6c-f134e7d7cd1a tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '108225920675413ab73453ab44dcd5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc1df1ebae44d98e36ccd117ac30b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9961d8f-feeb-4809-ad6c-f134e7d7cd1a tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Request method failure captured: Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 HTTP/1.1 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 25 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs64EEVA9P5jw4GAd5K6NB88PU0PsVEYDUynjiNV-OpU7qVesLopLHaGMiXqr1Yps7DA6uu44YLF9w0H3tkjJl_3ETRkVUaM8Lc_Vc1aioy__o7cXLouGfB8YFL1_kdTojSd3k-u06b_0NfTVt08sdJQ29tlRUnKwHDJKbN31-J8wLk Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:09.063581 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7bc1df1ebae44d98e36ccd117ac30b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7bc1df1ebae44d98e36ccd117ac30b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7bc1df1ebae44d98e36ccd117ac30b9"}]}] Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f7bc1df1ebae44d98e36ccd117ac30b9 Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-588085947 Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 108225920675413ab73453ab44dcd5b9 Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-QuotasAdminNegativeTest-588085947-project Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: {"quota_set": {"ram": 0}} Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 06 12:49:09.065859 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f7bc1df1ebae44d98e36ccd117ac30b9', 'body': {'quota_set': {'ram': 0}}} Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:09.066873 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.067933 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 06 12:49:09.069100 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.071526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9961d8f-feeb-4809-ad6c-f134e7d7cd1a tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:09.073249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9961d8f-feeb-4809-ad6c-f134e7d7cd1a tempest-QuotasAdminNegativeTest-588085947 tempest-QuotasAdminNegativeTest-588085947-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9" status: 403 len: 116 microversion: 2.1 time: 0.025616 Oct 06 12:49:09.075070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 151/295] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:49:09 2022] PUT /compute/v2.1/os-quota-sets/f7bc1df1ebae44d98e36ccd117ac30b9 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:09.081936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e20aa37d-41dd-454c-9621-69851c77e80b tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.086076 Oct 06 12:49:09.082466 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 12:49:08 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.089755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-03c8cf55-5c2c-4b80-ab86-fe0ae660ebad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1075787208"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.093678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.101033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-03c8cf55-5c2c-4b80-ab86-fe0ae660ebad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid ca8154a9-2694-4a60-99eb-074c8349d739 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:09.116507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.117077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.117630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.127419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.127908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.130131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.145211 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-03c8cf55-5c2c-4b80-ab86-fe0ae660ebad tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068774 Oct 06 12:49:09.145828 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 152/297] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.150843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.compute.aggregates [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 06 12:49:09.151358 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Request method failure captured: Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 42 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6VVqVTI3ENvssQfV5Yh-50j3-0AX4aYGvJw29FkXumpJY-KYlbI_3CSqhdItrJXMbunMsYAVVcBVio3_xusV7WB7U7gu7spCrc7LDnMhrIXwWvvInYuFEiiz2aowKn6ee_zdyC3BRXTxu0kiy2kdqjGPqTRhiNV_aDi81Zd89eYck Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:09.153435 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db5d086d9a0c453a8b9431e45ef5c1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db5d086d9a0c453a8b9431e45ef5c1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db5d086d9a0c453a8b9431e45ef5c1ed"}]}] Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: db5d086d9a0c453a8b9431e45ef5c1ed Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-544397577 Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: e846e72ed3f8405d8498a7e672ae3392 Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: {"remove_host": {"host": "nonexist_host"}} Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:09.154782 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 06 12:49:09.155496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 06 12:49:09.156750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.157901 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 06 12:49:09.159021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:09.163541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fbe91f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.163785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:09.163785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-907f2434-0147-4cde-998b-fa7b1db33a7a tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.074755 Oct 06 12:49:09.163785 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 146/298] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:09 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:09.164091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.164091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.165567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a235b73-1922-4268-bea1-d13383a32652 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.170270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.171129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.171605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.172033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.192191 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a235b73-1922-4268-bea1-d13383a32652 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.032059 Oct 06 12:49:09.199889 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 147/299] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.199889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c87786b0-5d53-4019-9a98-b00f1f8ce086 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.219326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-019bd950-ef47-4400-8a92-572425eb838e tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.072084 Oct 06 12:49:09.226336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 153/300] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.243267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86cd1b72-3adf-4ebd-91c9-f4562d301cfd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.266199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c87786b0-5d53-4019-9a98-b00f1f8ce086 tempest-AggregatesAdminNegativeTestJSON-544397577 tempest-AggregatesAdminNegativeTestJSON-544397577-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.071223 Oct 06 12:49:09.266813 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 148/301] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:09 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:09.292410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86cd1b72-3adf-4ebd-91c9-f4562d301cfd tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.064615 Oct 06 12:49:09.300336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 154/302] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 12:49:09 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.300578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fe32820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.312377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bcd2ca6-4571-4469-9615-b013a8fe3b55 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.323028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.324112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8bcd2ca6-4571-4469-9615-b013a8fe3b55 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.021727 Oct 06 12:49:09.325407 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:49:09.326486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.328589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.330350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.330860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.331302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.342629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3ec07fd-a671-42ad-9fab-459607aab415 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.364249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f09e7843-b117-47a9-9170-850f29f08910 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.095421 Oct 06 12:49:09.373531 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.391357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fd8f940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.403922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.404207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3ec07fd-a671-42ad-9fab-459607aab415 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.070005 Oct 06 12:49:09.404906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 156/305] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:09 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:09.409333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.409333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.424700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.425288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.425880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.426387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.426716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:09.445878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.446527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.447193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.450058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.452548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.453621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.488655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa9827cf-b42d-4b66-ae58-556514128f27 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h1-860556-1" status: 200 len: 467 microversion: 2.1 time: 0.113297 Oct 06 12:49:09.498808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 150/306] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-hosts/n-h1-860556-1 => generated 467 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.506274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e73e1182-bdc9-45ea-9dbd-fb96a4947cbe tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348356241", "availability_zone": "tempest-test_az-188217898"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.513640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.aggregate [None req-e73e1182-bdc9-45ea-9dbd-fb96a4947cbe tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 720349dd-f4dd-4fa4-b65b-e3b263efd6c6 for aggregate {{(pid=129614) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:09.564156 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e73e1182-bdc9-45ea-9dbd-fb96a4947cbe tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.061231 Oct 06 12:49:09.567252 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 151/307] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Oct 6 12:49:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.575752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Calling method '.version_select at 0x7f7d3fe323a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.592327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.592836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.594202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.633983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.634526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.634985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.688965 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca51f0b9-b390-4b01-bddc-c4a825579fe1 tempest-HostsAdminTestJSON-473906945 tempest-HostsAdminTestJSON-473906945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h2-860556-1" status: 200 len: 467 microversion: 2.1 time: 0.121978 Oct 06 12:49:09.689875 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 152/308] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/os-hosts/n-h2-860556-1 => generated 467 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:09.699127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5b8c954-62ed-4def-9101-86ee25ed68c0 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348356241_new", "availability_zone": "tempest-test_az-188217898_new"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:09.755009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:09.781844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4b59f0c3-082f-4fc4-9f41-47cbee89db2f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.366832 Oct 06 12:49:09.783985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 157/309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:09.795367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:09.796999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:09.830012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.830679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.832836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.833712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.836822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.837439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.878235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:09.948065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5b8c954-62ed-4def-9101-86ee25ed68c0 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:09.953936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5b8c954-62ed-4def-9101-86ee25ed68c0 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:09.955841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5b8c954-62ed-4def-9101-86ee25ed68c0 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:09.985693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:09.996464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3578e08f-b792-4360-8a41-104f5cfcf01c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1276 microversion: 2.1 time: 0.211134 Oct 06 12:49:09.998654 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 158/310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:09 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:10.045231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5b8c954-62ed-4def-9101-86ee25ed68c0 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.350768 Oct 06 12:49:10.060491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a8d1d87-995e-4e8c-9f78-fa3164fed8ae tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.070209 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 153/311] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 12:49:09 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:10.073051 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a8d1d87-995e-4e8c-9f78-fa3164fed8ae tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.016767 Oct 06 12:49:10.086627 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 159/312] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:49:10 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:10.087393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07e9bb5d-1868-4ce6-9225-0ea940212443 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.128369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07e9bb5d-1868-4ce6-9225-0ea940212443 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.045479 Oct 06 12:49:10.129624 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 154/313] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:10 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:10.145488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-613ea04c-c4fb-493e-8a0f-821164e9dd37 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1405671659"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:10.150894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-613ea04c-c4fb-493e-8a0f-821164e9dd37 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Generated uuid 6218f6ec-a73e-4e52-b830-0cab5fe0eaa4 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 12:49:10.188367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-613ea04c-c4fb-493e-8a0f-821164e9dd37 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048010 Oct 06 12:49:10.189938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 160/314] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 12:49:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:10.202233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-440dad50-550a-4f9f-a871-ed1778e39e72 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.213482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-440dad50-550a-4f9f-a871-ed1778e39e72 tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.015507 Oct 06 12:49:10.220784 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 155/315] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:49:10 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:10.228470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5bdbb131-317d-49f4-9210-76a794c8f61f tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.279313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5bdbb131-317d-49f4-9210-76a794c8f61f tempest-AggregatesAdminTestJSON-251622922 tempest-AggregatesAdminTestJSON-251622922-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.056199 Oct 06 12:49:10.280513 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 12:49:10 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:10.290377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.291295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:10.300043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.300536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.301030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.301777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.302243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.302672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.319192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] HTTP exception thrown: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Request method failure captured: Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a HTTP/1.1 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TRKMymEFYiILtgCkKiVYkdMIxczfCdHWH9btT7vdihQxWio-5bUFdroaxPOWSmdj34f125U7V6tLdA-mScKQPHzr3f6jUTcvVIfa6IlZUhID1aSDlL6N-a7XCvc6pU8W09urQLn8Wdh0YXODg1gOldlrVGDGNA3PsKUH4F_6DwTU Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:10.320925 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_353737503ced45bb922a941eeb0364a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/353737503ced45bb922a941eeb0364a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}] Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 057e318935274d4ebc5c50b3fd73d43c Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.322547 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '677117e7-d4ff-4cb0-9303-ca7d9b70e59a'} Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:10.323314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.324442 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.326024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Returning 404 to user: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:10.326024 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c202f20-3ffd-4caa-be22-0cea55e99233 tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "DELETE /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 404 len: 111 microversion: 2.1 time: 0.036815 Oct 06 12:49:10.326024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 156/317] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:10 2022] DELETE /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:10.332292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.332964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] [instance: 677117e7-d4ff-4cb0-9303-ca7d9b70e59a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:10.339384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.339883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.340340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.341065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.341556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.342010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.358747 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] HTTP exception thrown: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Request method failure captured: Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a HTTP/1.1 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6TRKMymEFYiILtgCkKiVYkdMIxczfCdHWH9btT7vdihQxWio-5bUFdroaxPOWSmdj34f125U7V6tLdA-mScKQPHzr3f6jUTcvVIfa6IlZUhID1aSDlL6N-a7XCvc6pU8W09urQLn8Wdh0YXODg1gOldlrVGDGNA3PsKUH4F_6DwTU Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:10.360299 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_353737503ced45bb922a941eeb0364a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/353737503ced45bb922a941eeb0364a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/353737503ced45bb922a941eeb0364a4"}]}] Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 353737503ced45bb922a941eeb0364a4 Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-364444656 Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 057e318935274d4ebc5c50b3fd73d43c Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AggregatesAdminTestJSON-364444656-project Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.361681 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '677117e7-d4ff-4cb0-9303-ca7d9b70e59a'} Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:10.362420 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. Oct 06 12:49:10.363580 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:10.364573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] Returning 404 to user: Instance 677117e7-d4ff-4cb0-9303-ca7d9b70e59a could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:10.364573 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-565e02ae-0021-43c6-bc25-492f43660d6a tempest-AggregatesAdminTestJSON-364444656 tempest-AggregatesAdminTestJSON-364444656-project] 10.222.0.26 "GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a" status: 404 len: 111 microversion: 2.1 time: 0.033550 Oct 06 12:49:10.364573 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 162/318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:10 2022] GET /compute/v2.1/servers/677117e7-d4ff-4cb0-9303-ca7d9b70e59a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:10.822264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:10.823137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:10.831988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.834526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.835090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.838264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.840395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.840847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:10.941275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6264c2-bff2-4461-8ede-2d269d1376bc", "tag": "142c449c-6983-4470-a69e-89034e442703"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:10.959703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:10.964354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:10.964832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:10.965263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:11.023577 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] Creating event network-changed:142c449c-6983-4470-a69e-89034e442703 for instance 1a6264c2-bff2-4461-8ede-2d269d1376bc on n-h1-860556-1 Oct 06 12:49:11.044299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-58f5a3b4-c50a-4775-b94f-372f5929f978 req-5746b112-d211-4046-87f3-2db1e0fb8653 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109195 Oct 06 12:49:11.045206 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 163/319] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:49:11.059897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:11.061481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:11.087884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:11.090480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:11.091576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:11.095032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:11.095898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:11.097554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:11.571800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:11.579935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0beabfca-78e2-48ca-808c-4b2a133e2f24 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.764701 Oct 06 12:49:11.580533 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:10 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:11.640245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:11.654362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48825f5a-2845-4856-9c20-369cdc6589f9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.607782 Oct 06 12:49:11.655625 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 164/321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:11 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:12.603868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:12.604486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:12.616422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:12.616938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:12.617390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:12.618152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:12.618612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:12.619044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:12.681370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:12.682052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:12.693090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:12.693090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:12.693423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:12.698046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:12.698395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:12.701529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:13.107039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:13.127738 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b8e8058-b7bb-4d62-b5bf-7d9f4c2adbd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.522927 Oct 06 12:49:13.130065 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 158/322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:12 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:13.191155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:13.223907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a093c0b-2314-40c1-bebb-d1566c989cfa tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.545795 Oct 06 12:49:13.239628 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 165/323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:12 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:14.166107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:14.166723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:14.181074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:14.181569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:14.182035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:14.182748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:14.183205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:14.185894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:14.255208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:14.255810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:14.270090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:14.270585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:14.271091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:14.272817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:14.273546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:14.274051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:14.586446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:14.600301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f75caaa2-2daa-4c50-a60a-a7769f8da8fe tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.434386 Oct 06 12:49:14.602745 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 159/324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:14 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:14.620394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8912eb-87c0-472c-8bb3-dbb27c96292a", "tag": "fbbc3155-9baf-41e8-932a-bdd2efac8c45"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:14.675122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:14.676211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:14.676653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:14.723681 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] Creating event network-changed:fbbc3155-9baf-41e8-932a-bdd2efac8c45 for instance cd8912eb-87c0-472c-8bb3-dbb27c96292a on n-h2-860556-1 Oct 06 12:49:14.739484 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9f3c881d-6ac5-4192-9aa8-f8f9f3b5c090 req-6f418dbb-cfd3-4fde-bae9-259c547bd1ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135004 Oct 06 12:49:14.742609 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 160/325] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:14.757547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:14.770509 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f2f9dd5-134d-434c-93ec-f53044e8dbd7 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.518845 Oct 06 12:49:14.771860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 166/326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:14 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:15.638082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:15.638827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:15.662743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:15.665924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:15.668594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:15.670021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:15.674349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:15.676064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:15.797818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:15.798446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:15.811219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:15.811736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:15.815366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:15.816300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:15.816983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:15.821005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:16.013050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:16.037215 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d213244d-9ce1-45c7-916e-fe591c8131f9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.403266 Oct 06 12:49:16.042839 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 161/327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:15 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:16.162035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:16.175705 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61cdd423-6bf6-4025-972e-d14ab462f5d9 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.382415 Oct 06 12:49:16.176683 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:15 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:17.067683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:17.068772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:17.094229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:17.096023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:17.096732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:17.098986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:17.100452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:17.101324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:17.211468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:17.219444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:17.223500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:17.223697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:17.226097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:17.227277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:17.227745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:17.228501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:17.368441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:17.378208 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5f171a9-8b75-40d0-a5ff-1dc67bbd37db tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.317255 Oct 06 12:49:17.380473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 162/329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:17 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:17.427640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:17.438674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e9451b6-2b5d-48e8-a73d-12765d8a7d92 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.232013 Oct 06 12:49:17.440318 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 168/330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:17 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:18.398328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6264c2-bff2-4461-8ede-2d269d1376bc", "name": "network-vif-plugged", "status": "completed", "tag": "142c449c-6983-4470-a69e-89034e442703"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:18.400771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:18.401499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:18.408953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:18.413301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:18.414401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:18.415789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:18.416692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:18.420905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:18.432103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:18.434264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:18.435332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:18.470261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] Creating event network-vif-plugged:142c449c-6983-4470-a69e-89034e442703 for instance 1a6264c2-bff2-4461-8ede-2d269d1376bc on n-h1-860556-1 Oct 06 12:49:18.485553 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-19c8a6dd-050a-452b-9b9c-a05e70b7fed8 req-84f82010-88f9-4cfd-90ae-456fd9dcbb09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097819 Oct 06 12:49:18.491648 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 163/331] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:18.505221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:18.510196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:18.530689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:18.534964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:18.535961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:18.538735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:18.541699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:18.542880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:18.827320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:18.844284 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10e660dc-9cc7-40f3-99ed-dedebd47ed85 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1319 microversion: 2.1 time: 0.446442 Oct 06 12:49:18.845173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:18 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:18.891182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:18.903178 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb4d0ddf-f84c-4214-a781-9935e87edb36 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.408827 Oct 06 12:49:18.907434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 164/333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:18 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:18.954169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=50 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:19.184127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=18 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:19.593088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-91596828", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:19.676485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:19.852590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=26 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:20.133058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:20.133908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:20.136413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:20.137198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:20.138416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:20.188696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.198599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.199551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:20.203717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.207927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.208810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:20.337270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:20.374871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:20.439114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:20.446774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:20.558145 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-419992a7-537e-417e-8f52-0265e87a25ac tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709583 Oct 06 12:49:20.560348 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 170/334] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:20.566364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:20.567756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:20.575790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.577330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.579563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:20.580586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.581384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.582014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:20.819641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98cf6d61-198f-470f-88fe-1b1fa9e6e505 tempest-AZAdminNegativeTestJSON-373220844 tempest-AZAdminNegativeTestJSON-373220844-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:20.822363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-98cf6d61-198f-470f-88fe-1b1fa9e6e505 tempest-AZAdminNegativeTestJSON-373220844 tempest-AZAdminNegativeTestJSON-373220844-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c28916a0d4e443cc82080ef9f9804f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0132eb94fbdd40d98c39583f444df0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98cf6d61-198f-470f-88fe-1b1fa9e6e505 tempest-AZAdminNegativeTestJSON-373220844 tempest-AZAdminNegativeTestJSON-373220844-project] Request method failure captured: Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7Mjx0durPNTdrxDq-VrSYwiVPHaZlq40UhIpz6o2CS57Rl0HmLq8JlIgKpMrgv3-DlatxAYMy4TJ2xNBosQcVTfVn_ni8Lg_Mvc6ccrDQUztCiWj7YxdooroFfA8S4BfhiEJPusOaG_52TfHVDlao344ThDKyBowsPp7vGq1kuUtQ Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0132eb94fbdd40d98c39583f444df0ec Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AZAdminNegativeTestJSON-373220844 Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:20.828930 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0132eb94fbdd40d98c39583f444df0ec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0132eb94fbdd40d98c39583f444df0ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0132eb94fbdd40d98c39583f444df0ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0132eb94fbdd40d98c39583f444df0ec"}]}] Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AZAdminNegativeTestJSON-373220844 Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0132eb94fbdd40d98c39583f444df0ec Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-373220844 Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AZAdminNegativeTestJSON-373220844-project Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c28916a0d4e443cc82080ef9f9804f0e Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AZAdminNegativeTestJSON-373220844-project Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 06 12:49:20.830308 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:20.831048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:20.832252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98cf6d61-198f-470f-88fe-1b1fa9e6e505 tempest-AZAdminNegativeTestJSON-373220844 tempest-AZAdminNegativeTestJSON-373220844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:20.833248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98cf6d61-198f-470f-88fe-1b1fa9e6e505 tempest-AZAdminNegativeTestJSON-373220844 tempest-AZAdminNegativeTestJSON-373220844-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.990638 Oct 06 12:49:20.833248 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 165/335] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:49:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 992 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:20.857703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:20.864958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:20.890141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.894575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.897227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:20.903086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:20.908671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:20.911152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:21.164473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:21.182479 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5666342a-8f73-47dc-b44a-1076528efc8b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1468 microversion: 2.1 time: 0.612107 Oct 06 12:49:21.183142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:20 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1468 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:21.454834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:21.499361 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0c801983-a3ca-41e4-99a9-5cacd0a5bc1f tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.649565 Oct 06 12:49:21.504391 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 166/337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:20 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:21.524037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-841e77f4-e159-461d-8d6b-2e4acf470d32 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:21.527547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-841e77f4-e159-461d-8d6b-2e4acf470d32 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:21.633201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-841e77f4-e159-461d-8d6b-2e4acf470d32 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:21.650612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-841e77f4-e159-461d-8d6b-2e4acf470d32 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1215 microversion: 2.1 time: 0.141452 Oct 06 12:49:21.670902 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 167/338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:21 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:21.797475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:21.801337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:21.812487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:21.821433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:21.825000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:21.828584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:21.829229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:21.876195 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52753981-a644-4b5e-960b-9bf68cb17d27 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.690075 Oct 06 12:49:21.877044 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 172/339] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Oct 6 12:49:21 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:21.881878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:21.884812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:21.891213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:21.891701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:21.892162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:21.893123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:21.893576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:21.894026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.071270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0af5818-81b6-4e0c-985f-a7de0fe862af tempest-InstanceUsageAuditLogTestJSON-167422704 tempest-InstanceUsageAuditLogTestJSON-167422704-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:22.117626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6fad38c0-5a21-4504-af15-1fce7c8b045c tempest-DeleteServersAdminTestJSON-1202919675 tempest-DeleteServersAdminTestJSON-1202919675-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc/action" status: 202 len: 0 microversion: 2.1 time: 0.237314 Oct 06 12:49:22.120969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 173/340] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:49:21 2022] POST /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:22.131910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:22.133841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.134407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.134875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.135646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.136106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.136540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.142135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0af5818-81b6-4e0c-985f-a7de0fe862af tempest-InstanceUsageAuditLogTestJSON-167422704 tempest-InstanceUsageAuditLogTestJSON-167422704-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-06 12:49:20" status: 200 len: 318 microversion: 2.1 time: 0.469174 Oct 06 12:49:22.144188 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 168/341] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 12:49:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-06%2012%3A49%3A20 => generated 318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:22.198812 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12f6f598-ddcd-44cc-810e-29b0147bfe82 tempest-AZAdminV2TestJSON-2142929166 tempest-AZAdminV2TestJSON-2142929166-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.077051 Oct 06 12:49:22.200173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 174/342] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:49:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:22.206717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:22.207663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:22.216639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.217374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.218008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.218910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.219717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.220372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.265285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.266151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.266796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.268262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lazy-loading 'fault' on Instance uuid 1a6264c2-bff2-4461-8ede-2d269d1376bc {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:22.318677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2106673725", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:22.407726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:22.587576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:22.596556 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-937b3e54-98d0-4871-b80a-0c6c22ba4968 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1451 microversion: 2.1 time: 0.394390 Oct 06 12:49:22.597147 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 175/343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:22 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1451 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:22.605233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28b927b8-e07a-4dff-9a41-d3d42c9e37b5 tempest-InstanceUsageAuditLogTestJSON-167422704 tempest-InstanceUsageAuditLogTestJSON-167422704-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:22.627169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28b927b8-e07a-4dff-9a41-d3d42c9e37b5 tempest-InstanceUsageAuditLogTestJSON-167422704 tempest-InstanceUsageAuditLogTestJSON-167422704-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.028627 Oct 06 12:49:22.641954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 176/344] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:49:22 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:22.648555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:22.649538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:22.656578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.657399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.658280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:22.661350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:22.662155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:22.665343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.041152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:23.041574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:23.042098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:23.042503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:23.043921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:23.059300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.063323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.064720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.069490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.073640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.079113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.136811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:23.137253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Getting quotas for project f4229fd0e5604202b89a9514f5408ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:23.149336 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b82a38f-7d56-44d1-890a-e753f9ea2262 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.504867 Oct 06 12:49:23.154542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 177/345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:22 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:23.162910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:23.166384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:23.174714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Getting quotas for user cfb0c32000ad4877851a4ba36ee1eef3 and project f4229fd0e5604202b89a9514f5408ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:23.182873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.185500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.186268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.187307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.203674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.204280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.205605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:23.211335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:23.292012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:49:23.332323 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2979dcff-a211-445a-9cee-f2b179eb7811 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186171 Oct 06 12:49:23.344002 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 169/346] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:23.361075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:23.361704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:23.386450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.386965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.387415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.388146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.388609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.389042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.499157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:23.589613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9a42376-5696-43d4-8276-2807794ccb26 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 204 len: 0 microversion: 2.1 time: 0.430096 Oct 06 12:49:23.601574 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 178/347] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:23 2022] DELETE /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:49:23.635366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3101a712-77de-4b05-b88d-c55b55f61dbd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:23.639514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3101a712-77de-4b05-b88d-c55b55f61dbd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:23.814640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3101a712-77de-4b05-b88d-c55b55f61dbd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:23.824960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3101a712-77de-4b05-b88d-c55b55f61dbd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1222 microversion: 2.1 time: 0.223519 Oct 06 12:49:23.826806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 179/348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:23 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:23.829560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:23.837401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e2a13a27-339f-43b5-8048-164df164b397 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1273 microversion: 2.1 time: 0.497300 Oct 06 12:49:23.837521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8912eb-87c0-472c-8bb3-dbb27c96292a", "name": "network-vif-plugged", "status": "completed", "tag": "fbbc3155-9baf-41e8-932a-bdd2efac8c45"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:23.846161 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 170/349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:23 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:23.851715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:23.852483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:23.854494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:23.870466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.871842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.873180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.874291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.875024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.875717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.886052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:23.886629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:23.887029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:23.922934 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] Creating event network-vif-plugged:fbbc3155-9baf-41e8-932a-bdd2efac8c45 for instance cd8912eb-87c0-472c-8bb3-dbb27c96292a on n-h2-860556-1 Oct 06 12:49:23.935857 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-753e5ebf-3c67-4f67-b319-95b0bb3a2dae req-eb16bf5f-6d60-47ec-90a4-b560c076b59a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105987 Oct 06 12:49:23.938968 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 180/350] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:23.999914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.001100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.002130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.002794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lazy-loading 'fault' on Instance uuid 1a6264c2-bff2-4461-8ede-2d269d1376bc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:24.200336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:24.202530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:24.214754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.216634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.217382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.219255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.220034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.220687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.251969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:24.271891 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e0a37ac-4ed8-43aa-bbb2-53eaa51cfd3f tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1457 microversion: 2.1 time: 0.423807 Oct 06 12:49:24.273465 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 171/351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:23 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1457 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:24.520791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:24.531770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e88c0aec-255e-4c6f-93f2-c0a353cf7177 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 0.341963 Oct 06 12:49:24.532744 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 181/352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:24 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:24.863024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:24.863803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:24.864358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:24.865236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:24.874591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.875616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.876989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.877519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.878541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.880402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.880891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.881905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:24.883924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.884596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:24.884702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:24.885318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:25.153260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:25.172359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b37b9ed-5a68-45f1-b308-28af09edb5f4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1273 microversion: 2.1 time: 0.313212 Oct 06 12:49:25.201927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 172/353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:24 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:25.230111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:25.244375 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f35e65b-9b2a-42f5-9245-0ffd783f46d4 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1274 microversion: 2.1 time: 0.384212 Oct 06 12:49:25.250359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 182/354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:24 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1274 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:25.310095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:25.311655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:25.323644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:25.324556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:25.325231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:25.326147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:25.326765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:25.327408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:25.392744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:25.393174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:25.393612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:25.395546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lazy-loading 'fault' on Instance uuid 1a6264c2-bff2-4461-8ede-2d269d1376bc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:25.555366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:25.556344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:25.575255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:25.582732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:25.585581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:25.588890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:25.596976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:25.599802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:26.567795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:26.573442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:26.580662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ca4c324-ab4a-4105-9645-58e7dc3482b7 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1457 microversion: 2.1 time: 1.277830 Oct 06 12:49:26.581264 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 173/355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:25 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1457 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:26.582166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-756b3dc8-b5e8-4e68-9663-7bfc7f60ba8c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1318 microversion: 2.1 time: 1.031184 Oct 06 12:49:26.582754 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 183/356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:25 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:26.608419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:26.609582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:26.611419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:26.612296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:26.620961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:26.621881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:26.621984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:26.623452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:26.624373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:26.624970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:26.625851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:26.625956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:26.626361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:26.627100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:26.627697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:26.628147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:26.659659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:26.844716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:26.863500 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b85fb23d-98a6-4ce5-813f-6654bb620801 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1292 microversion: 2.1 time: 0.260749 Oct 06 12:49:26.866420 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 184/357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:26 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:27.325910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6264c2-bff2-4461-8ede-2d269d1376bc", "name": "network-vif-deleted", "tag": "142c449c-6983-4470-a69e-89034e442703"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:27.402105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:27.421894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.422802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.423521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.454980 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-130c08ad-219b-4296-baa5-8f7841498d95 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.851763 Oct 06 12:49:27.458155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 174/358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:26 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:27.490447 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] Creating event network-vif-deleted:142c449c-6983-4470-a69e-89034e442703 for instance 1a6264c2-bff2-4461-8ede-2d269d1376bc on n-h1-860556-1 Oct 06 12:49:27.507315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a9078190-8742-4327-b1a4-c1f04cbf93a3 req-b971dd35-4821-4cdb-9723-d54c2730ce36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187788 Oct 06 12:49:27.508536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 185/359] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:27.618408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:27.621392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:27.627377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:27.636157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:27.658671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.659432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.660424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.661719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.662542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.663190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.679543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.680110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.684237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.698716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.701219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.703941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.862780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.864056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.864963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.866515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lazy-loading 'fault' on Instance uuid 1a6264c2-bff2-4461-8ede-2d269d1376bc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:27.948807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c371ba92f49edbb4032d48ee7cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1c2db877744d78cb8a66ba14c9dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:27.959848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:27.961395 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ea577fd-063e-4a40-9cd9-7164b64b42c3 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 200 len: 1309 microversion: 2.1 time: 0.358469 Oct 06 12:49:27.962093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 175/360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:27 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:27.969321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:27.975378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:27.985081 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa79f114-71b2-4e93-86f5-dc44799865f5 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1468 microversion: 2.1 time: 0.378515 Oct 06 12:49:27.985662 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 186/361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:27 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1468 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:27.987758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.988496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.990529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:27.992192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:27.993141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:27.994165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.009119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:28.010172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:28.016967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.019214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.019899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.020789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.021412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.023586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.050294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lazy-loading 'flavor' on Instance uuid cd8912eb-87c0-472c-8bb3-dbb27c96292a {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:28.138139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:28.153576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba65416c-c41c-48f4-9f80-6ed1d8835175 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1280 microversion: 2.1 time: 0.189707 Oct 06 12:49:28.156626 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 176/362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:27 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:28.211359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-285f9352-03b6-4edf-8388-bbd31c8dc41c tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a/action" status: 202 len: 0 microversion: 2.1 time: 0.207208 Oct 06 12:49:28.215037 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 187/363] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:49:28 2022] POST /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:49:28.227414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:28.228520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:28.241990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.242612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.244835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.245648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.247030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.247671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.454408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:28.466223 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac53ea44-a663-4c4f-9c90-3fbcca62f211 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1476 microversion: 2.1 time: 0.244528 Oct 06 12:49:28.467345 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 177/364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:28 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:28.505803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:28.507077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:28.513790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.514653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.515155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.515783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:28.516521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:28.517014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:28.758422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:28.772206 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-985a7cd5-eac4-4913-ace8-12d7356e933e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.272367 Oct 06 12:49:28.773045 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 188/365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:28 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:28.989506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:28.992237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.016834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.026533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.027659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.029633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.033494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.038073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.050751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cff8881-bbb7-4c80-9b45-f822d708aba0", "tag": "7ba22c43-a15b-4673-af97-c4c8c706813c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:29.078462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.081072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.082121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.099907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.111804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] Creating event network-changed:7ba22c43-a15b-4673-af97-c4c8c706813c for instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 on n-h1-860556-1 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc HTTP/1.1 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:29.112837 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.114393 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1a6264c2-bff2-4461-8ede-2d269d1376bc'} Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:29.115394 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.116745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.118171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:29.127335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ccd9b32-666c-4215-998f-2517c20b3bd1 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 404 len: 111 microversion: 2.1 time: 0.137781 Oct 06 12:49:29.128819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 178/366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:28 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:29.138139 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fc09dadc-62bb-4b59-85be-8a0f42c65cc9 req-31ffc55b-620e-4450-9451-bbb85b0fb09f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084457 Oct 06 12:49:29.141503 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 189/367] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:49:29.152023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.153767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.186403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.187247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.197523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.198997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.199808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.200310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.200824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.202507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.203786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.204253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.205201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.205487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.206856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.212966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.291324 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc HTTP/1.1 Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:29.310721 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.312034 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1a6264c2-bff2-4461-8ede-2d269d1376bc'} Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:29.312705 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.313832 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.317147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:29.317147 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42ae2de3-c0d4-4c8e-93fc-5783b2da7478 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 404 len: 111 microversion: 2.1 time: 0.176314 Oct 06 12:49:29.319207 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 179/368] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:29 2022] DELETE /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:29.336829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.337621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 1a6264c2-bff2-4461-8ede-2d269d1376bc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.355031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.355882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.356345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.357083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.357538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.358024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.396166 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc HTTP/1.1 Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:29.409587 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.411033 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1a6264c2-bff2-4461-8ede-2d269d1376bc'} Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:29.411865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. Oct 06 12:49:29.413250 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.416670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 1a6264c2-bff2-4461-8ede-2d269d1376bc could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:29.419660 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb03c45d-e429-4358-8ae9-b69d4ad90cd9 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc" status: 404 len: 111 microversion: 2.1 time: 0.094910 Oct 06 12:49:29.430352 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 180/369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:29 2022] GET /compute/v2.1/servers/1a6264c2-bff2-4461-8ede-2d269d1376bc => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:29.435401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.435896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.448924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:29.462914 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b97530b-62de-422b-bc68-08c2a51ae2f1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1280 microversion: 2.1 time: 0.282940 Oct 06 12:49:29.465788 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 190/370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:29 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:29.479213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.480433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.481594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.482700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.483296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.483853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.492090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.493024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.507282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.510006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.511857 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.512495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c HTTP/1.1 Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:29.514267 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.515637 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '78c2d490-619c-43e6-a4f2-b69d5a1dc34c'} Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:29.516420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.518116 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.519450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.520367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:29.521366 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7359a8c-b2b0-4c6b-95f5-ff9627359496 tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 404 len: 111 microversion: 2.1 time: 0.090023 Oct 06 12:49:29.522881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.525601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.527317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 181/371] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:29 2022] DELETE /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:29.534035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.534895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] [instance: 78c2d490-619c-43e6-a4f2-b69d5a1dc34c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.542495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.543789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.544406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.545529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.546207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.546959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.570994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] HTTP exception thrown: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Request method failure captured: Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c HTTP/1.1 Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6TbJj77WOzQbKkETHBbzziDK3BMJbIf3pMd_GmXJIQu30VdPCPy1KeP0bWZafIgQ7imyhfYjJLg5rwc02D9mzHyDn3PDPFv5_aXvtpyERBcE18mImmejk3XoRZI0VUHwaqyLQkNOBfmx4BzSy9cf_KsQoA2DhFoP7mrIDZOPpTRTg Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:29.577346 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94a1c2db877744d78cb8a66ba14c9dcc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94a1c2db877744d78cb8a66ba14c9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94a1c2db877744d78cb8a66ba14c9dcc"}]}] Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 94a1c2db877744d78cb8a66ba14c9dcc Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1988931983 Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b5c371ba92f49edbb4032d48ee7cf9f Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersAdminTestJSON-1988931983-project Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.579267 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '78c2d490-619c-43e6-a4f2-b69d5a1dc34c'} Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:29.580352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. Oct 06 12:49:29.581814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:29.584031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] Returning 404 to user: Instance 78c2d490-619c-43e6-a4f2-b69d5a1dc34c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:29.587063 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc2aa776-8a78-4f74-9a33-300ba0a42e2b tempest-DeleteServersAdminTestJSON-1988931983 tempest-DeleteServersAdminTestJSON-1988931983-project] 10.222.0.26 "GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c" status: 404 len: 111 microversion: 2.1 time: 0.058500 Oct 06 12:49:29.592107 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 182/372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:29 2022] GET /compute/v2.1/servers/78c2d490-619c-43e6-a4f2-b69d5a1dc34c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:29.804821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:29.805451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:29.817670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.821172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.823905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:29.826990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:29.827634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:29.828831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:30.233657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:30.262422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9be599a9-6233-4abb-8fbb-9f03da64a05c tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1459 microversion: 2.1 time: 0.774309 Oct 06 12:49:30.272758 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 191/373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:29 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1459 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:30.592232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:30.616972 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b803419b-2ee9-4958-8ac1-648a9b980bab tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.817671 Oct 06 12:49:30.619052 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 183/374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:29 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:30.632097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:30.633266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:30.644615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:30.645429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:30.646209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:30.647425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:30.648234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:30.649044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:30.696089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36bc5559-dc6b-4a03-95b5-fb2e9c790552 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-455455065", "id": 480760932, "os-flavor-access:is_public": "False"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:30.772151 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36bc5559-dc6b-4a03-95b5-fb2e9c790552 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.497148 Oct 06 12:49:30.774087 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 192/375] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:30 2022] POST /compute/v2.1/flavors => generated 435 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:30.797494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:30.798793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:30.816254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:30.817521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:30.819249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:30.820938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:30.822549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:30.823414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.112211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:31.123461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-abe8b05c-d7e2-4b8f-80db-ac91dac91f23 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.346539 Oct 06 12:49:31.124808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 193/376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:30 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:31.127744 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdf2473b-a7f3-4c83-af9e-3a14ed87ee5b tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1610 microversion: 2.1 time: 0.505112 Oct 06 12:49:31.128484 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 184/377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:30 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1610 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:31.129488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7be7ec7a-c5e2-4177-88a8-d0f7d69009f3 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:31.181257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:31.187640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.188684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.189812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.191460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.192424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.193872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.244019 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28ea78c0-11da-422b-afc9-2fa08a77fb68 tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068479 Oct 06 12:49:31.256625 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 185/378] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:49:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:31.264364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:31.268384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:31.279367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.280391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.281386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.283199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.284262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.285240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.700546 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7be7ec7a-c5e2-4177-88a8-d0f7d69009f3 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/480760932/action" status: 200 len: 96 microversion: 2.1 time: 0.574547 Oct 06 12:49:31.701558 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 194/379] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:49:31 2022] POST /compute/v2.1/flavors/480760932/action => generated 96 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:31.707514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:31.708759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:31.731753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.732264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.732713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:31.735224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:31.735714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:31.736156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:32.020081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:32.033629 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cebdbf7-4b89-42e5-ab11-315afd0e94aa tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.330273 Oct 06 12:49:32.039226 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 195/380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:31 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:32.070791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67f98b43-0ee3-4f34-9bac-5b8e10dbd775 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:32.175581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:32.476455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Lazy-loading 'flavor' on Instance uuid cd8912eb-87c0-472c-8bb3-dbb27c96292a {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:32.643000 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance cd8912eb-87c0-472c-8bb3-dbb27c96292a while it is in vm_state suspended Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Request method failure captured: Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a/action HTTP/1.1 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 97 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs6f6t2BVh10dLmJonUvAKqrkZqJlFMwolVjnCJeZ9-j4qdeW8h5kZg0UmgLfmTqGXeU7jaq6AQ_XFaQb86kqzlOgLBWDl23y7Ay93RFscdW2uqJ6shEXGTcuzCEAr7ivqzai3CL_qmF3rxLmbyMfgA3PvtYVcoQ0orYMjx4TRxIAaQ Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: bee0835e44954e7287415ed88c56b690 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:32.654192 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bee0835e44954e7287415ed88c56b690", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee0835e44954e7287415ed88c56b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bee0835e44954e7287415ed88c56b690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bee0835e44954e7287415ed88c56b690"}]}] Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: bee0835e44954e7287415ed88c56b690 Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947167202 Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveMigrationNegativeTest-947167202-project-admin Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b153887d48dc4f3e8b792ae665b72ab5 Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveMigrationNegativeTest-947167202-project-admin Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": true, "disk_over_commit": false}} Oct 06 12:49:32.655560 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'os-migrateLive' instance cd8912eb-87c0-472c-8bb3-dbb27c96292a while it is in vm_state suspended Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'cd8912eb-87c0-472c-8bb3-dbb27c96292a', 'body': {'os-migrateLive': {'host': 'n-h1-860556-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 06 12:49:32.656409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:32.657527 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance cd8912eb-87c0-472c-8bb3-dbb27c96292a while it is in vm_state suspended Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance cd8912eb-87c0-472c-8bb3-dbb27c96292a while it is in vm_state suspended Oct 06 12:49:32.658698 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:32.661051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance cd8912eb-87c0-472c-8bb3-dbb27c96292a while it is in vm_state suspended {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:32.664033 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79c7ed6b-fa11-4dd1-92fc-9c0d30d9de1a tempest-LiveMigrationNegativeTest-947167202 tempest-LiveMigrationNegativeTest-947167202-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a/action" status: 409 len: 155 microversion: 2.1 time: 1.405689 Oct 06 12:49:32.667286 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 186/381] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:49:31 2022] POST /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a/action => generated 155 bytes in 1410 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:32.677276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c3d91b-a212-403e-a006-070e838f3735", "tag": "9e859e9f-8f11-4ca8-b91c-f82f0a467670"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:32.701044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:32.702047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:32.702833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:32.732986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] Creating event network-changed:9e859e9f-8f11-4ca8-b91c-f82f0a467670 for instance f8c3d91b-a212-403e-a006-070e838f3735 on n-h2-860556-1 Oct 06 12:49:32.741052 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4699d383-f4e7-4b82-a394-831e690bfc2e req-c5c63e82-4536-4518-bc15-5bcc5e961596 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071310 Oct 06 12:49:32.742206 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 187/382] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:32.753608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:32.756894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:32.764636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:32.765277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:32.766428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:32.767399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:32.768555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:32.769195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.008057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:33.017044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:33.031707 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-67f98b43-0ee3-4f34-9bac-5b8e10dbd775 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. Oct 06 12:49:33.038076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1242fe6d-8e87-431c-b220-76622ef1ae39 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.288935 Oct 06 12:49:33.042487 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 188/383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:32 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67f98b43-0ee3-4f34-9bac-5b8e10dbd775 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Request method failure captured: Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/flavors/480760932/action HTTP/1.1 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 67 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7Ybc20vfJXnzTOgLc6ze5rvg1PMK9yhC8nzSS9YH-eX8u7A76B-qXgCVIGdKj0xtEEta50pl4Xlk7wXD46aTcSMARTi9ErHPfvVHfUXcstQpTHU9EctLEiGaSWzW6-joGPKzGN0x02scwvwJm0BXvSen4lIptrA28vMu8l_zzMBic Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:49:33.047582 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f9877bc9f5d40589d30dbd312fab2a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}] Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: bb952e5b23ce4e6b8454ada8d2b1edb6 Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} Oct 06 12:49:33.049867 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: exception: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '480760932', 'body': {'addTenantAccess': {'tenant': 'd85c902b03e1453bb81ed87f142b9240'}}} Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result.read() Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:49:33.051094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-d85c902b03e1453bb81ed87f142b9240' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi session.flush() Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 12:49:33.054380 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 12:49:33.056343 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:49:33.058247 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result.read() Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-d85c902b03e1453bb81ed87f142b9240' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 6, 12, 49, 33, 13685), 'updated_at': None, 'flavor_id': 31, 'project_id': 'd85c902b03e1453bb81ed87f142b9240'}] Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:33.060082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 419, in add_access Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 412, in _add_access Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 405, in _flavor_add_project Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:33.061879 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:33.068036 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:33.071233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. Oct 06 12:49:33.071233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:33.071233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67f98b43-0ee3-4f34-9bac-5b8e10dbd775 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project d85c902b03e1453bb81ed87f142b9240 combination. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:33.072999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67f98b43-0ee3-4f34-9bac-5b8e10dbd775 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/480760932/action" status: 409 len: 152 microversion: 2.1 time: 1.025193 Oct 06 12:49:33.074898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 196/384] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:49:32 2022] POST /compute/v2.1/flavors/480760932/action => generated 152 bytes in 1034 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:49:33.107319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:33.112302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:33.137980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.138827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.139284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.140048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.140693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.141437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.195383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:49:33.196916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:33.341814 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96bf085a-0bb4-4ce0-90a6-551aac2c4b81 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 204 len: 0 microversion: 2.1 time: 0.264871 Oct 06 12:49:33.344438 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 197/385] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:33 2022] DELETE /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:49:33.362388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:33.364132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:33.375402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.376138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.377439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.378562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.379562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.380832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.388534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:33.465234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1152048275", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:33.595019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:33.699511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:33.712170 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9798dcbf-9973-4a9c-a5c7-f488d969c236 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.360920 Oct 06 12:49:33.713485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 198/386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:33 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:33.731872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa0bdc65-30e4-4e6e-98db-47c2dd5287ca tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:33.819865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:33.977106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:33.978036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:33.978689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:33.979408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:33.980024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:33.993470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.994270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.994888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:33.995872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:33.997273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:33.997912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.020402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:34.027068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:34.043860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:34.047628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:34.117289 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44000153-a075-4c9e-88f4-f51c6f8ac3eb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072576 Oct 06 12:49:34.117994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 189/387] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:34.133408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.137365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:34.148710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.149384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.150372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.151427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.152049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.152812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.345070 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa0bdc65-30e4-4e6e-98db-47c2dd5287ca tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/480760932/action" status: 200 len: 21 microversion: 2.1 time: 0.630168 Oct 06 12:49:34.347050 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 199/388] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:49:33 2022] POST /compute/v2.1/flavors/480760932/action => generated 21 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:34.360362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.368111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:34.387818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.391193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.391961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.393426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.395726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.397623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.629277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:34.654479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-401f21ba-4bc4-488b-b91e-f0ecec55563b tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1465 microversion: 2.1 time: 0.535453 Oct 06 12:49:34.660567 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 190/389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:34 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1465 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:34.680214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9e2d055-6313-4b37-8b95-e5ca740bdbb9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.681187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9e2d055-6313-4b37-8b95-e5ca740bdbb9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:34.825377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e2d055-6313-4b37-8b95-e5ca740bdbb9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:34.833608 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9e2d055-6313-4b37-8b95-e5ca740bdbb9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1213 microversion: 2.1 time: 0.162394 Oct 06 12:49:34.836727 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 191/390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:34 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:34.854152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03f845dd-d9ac-485d-9f8e-53c1c51fcda8 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.896108 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03f845dd-d9ac-485d-9f8e-53c1c51fcda8 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/480760932" status: 202 len: 0 microversion: 2.1 time: 0.057441 Oct 06 12:49:34.898293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 192/391] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:49:34 2022] DELETE /compute/v2.1/flavors/480760932 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:34.899569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:34.911604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59098c3c-a5da-4679-ae33-b0bfa4037601 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.557753 Oct 06 12:49:34.914581 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 200/392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:34 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:34.922155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.923405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44559a49-2169-49de-b62d-70f93e666fdc tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:34.924712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:34.958222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.961719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.962776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.966298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:34.969258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:34.971909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:34.983090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44559a49-2169-49de-b62d-70f93e666fdc tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064263 Oct 06 12:49:34.998843 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 201/393] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:35.010401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3408f78e-2238-4781-ac9d-0b66daa395b9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1125988707", "id": 676879940, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:35.057539 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3408f78e-2238-4781-ac9d-0b66daa395b9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.053321 Oct 06 12:49:35.060802 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 202/394] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:35 2022] POST /compute/v2.1/flavors => generated 435 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:49:35.071797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ed41ee2-ca44-421b-964b-2e8c9d9275e9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:35.086144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-4ed41ee2-ca44-421b-964b-2e8c9d9275e9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ed41ee2-ca44-421b-964b-2e8c9d9275e9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Request method failure captured: Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/flavors/676879940/os-flavor-access HTTP/1.1 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7Ybc20vfJXnzTOgLc6ze5rvg1PMK9yhC8nzSS9YH-eX8u7A76B-qXgCVIGdKj0xtEEta50pl4Xlk7wXD46aTcSMARTi9ErHPfvVHfUXcstQpTHU9EctLEiGaSWzW6-joGPKzGN0x02scwvwJm0BXvSen4lIptrA28vMu8l_zzMBic Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:49:35.087908 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f9877bc9f5d40589d30dbd312fab2a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}] Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: bb952e5b23ce4e6b8454ada8d2b1edb6 Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: exception: Access list not available for public flavors. Oct 06 12:49:35.089090 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'flavor_id': '676879940'} Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 06 12:49:35.089789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.092650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ed41ee2-ca44-421b-964b-2e8c9d9275e9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:35.093858 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ed41ee2-ca44-421b-964b-2e8c9d9275e9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/676879940/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026600 Oct 06 12:49:35.095545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 203/395] 10.222.0.26 () {58 vars in 1206 bytes} [Thu Oct 6 12:49:35 2022] GET /compute/v2.1/flavors/676879940/os-flavor-access => generated 91 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 06 12:49:35.133536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c9fe547-e6d8-4c62-ad11-2d6f3e8ea9a6 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:35.205316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c9fe547-e6d8-4c62-ad11-2d6f3e8ea9a6 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/676879940" status: 202 len: 0 microversion: 2.1 time: 0.088129 Oct 06 12:49:35.206914 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 204/396] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:49:35 2022] DELETE /compute/v2.1/flavors/676879940 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:35.222868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8228fec3-4477-4818-8c97-a74cd9e2d51a tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:35.307821 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8228fec3-4477-4818-8c97-a74cd9e2d51a tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095101 Oct 06 12:49:35.312742 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 205/397] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:35.351942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3324736-85c9-41dd-bf32-135070764094 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-355416588", "id": 1623066773, "os-flavor-access:is_public": "False"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:35.433695 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3324736-85c9-41dd-bf32-135070764094 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.094181 Oct 06 12:49:35.440688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:35.448039 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 206/398] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:35.452225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50680ff0-7581-432b-8f43-899fced9b4da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.552149 Oct 06 12:49:35.453379 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 193/399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:34 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:35.701170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:35.702072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:35.709758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:35.727083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:35.727723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:35.728926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:35.729425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:35.730010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:35.910080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4bf51b0-789b-4864-aede-109d98fcd9dc tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:35.913793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b4bf51b0-789b-4864-aede-109d98fcd9dc tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ce0b2279f8db4e6f90ff2c39a54c23ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85c902b03e1453bb81ed87f142b9240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4bf51b0-789b-4864-aede-109d98fcd9dc tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Request method failure captured: Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/flavors/1623066773/action HTTP/1.1 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 67 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7W8UFcdxvaUP-sf-Z6BSIgoTNZHm0fnpxF-B2vyxbsawcK0waXeuAiyLZcoyLuawmVIpQw_vyFlhU0EZ30GO0Q_jxyAvg0ZESnNMinwBeu8BBcQpFTs7KZOak4RLRobBlv0Q0PTpHJa9JyzMIWN7-4cDSGVaT3fedlFY8DTkobpEU Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: d85c902b03e1453bb81ed87f142b9240 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:35.927391 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d85c902b03e1453bb81ed87f142b9240", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d85c902b03e1453bb81ed87f142b9240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d85c902b03e1453bb81ed87f142b9240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d85c902b03e1453bb81ed87f142b9240"}]}] Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: d85c902b03e1453bb81ed87f142b9240 Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsAccessNegativeTestJSON-1412105371-project Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ce0b2279f8db4e6f90ff2c39a54c23ee Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371-project Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} Oct 06 12:49:35.929304 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1623066773', 'body': {'addTenantAccess': {'tenant': 'd85c902b03e1453bb81ed87f142b9240'}}} Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:35.930203 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 06 12:49:35.932127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:35.937809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4bf51b0-789b-4864-aede-109d98fcd9dc tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:35.937809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4bf51b0-789b-4864-aede-109d98fcd9dc tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] 10.222.0.26 "POST /compute/v2.1/flavors/1623066773/action" status: 403 len: 130 microversion: 2.1 time: 0.477064 Oct 06 12:49:35.941268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 207/400] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Oct 6 12:49:35 2022] POST /compute/v2.1/flavors/1623066773/action => generated 130 bytes in 492 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:35.960449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:35.961105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:35.986147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:35.987196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:35.989064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:35.993847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:35.994375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:35.994829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:36.136252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:36.144658 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2be39fe4-7701-434b-8c4e-8db6b3402fd1 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1465 microversion: 2.1 time: 0.447424 Oct 06 12:49:36.145245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 194/401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:35 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1465 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:36.156206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:36.156884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:36.171038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:36.175077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:36.175803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:36.177371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:36.178319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:36.180736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:36.204023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:36.238665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cf197c5-9ba3-4d66-b76c-5890717b2127 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1265 microversion: 2.1 time: 0.280688 Oct 06 12:49:36.250281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 208/402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:35 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:36.269151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12244f3e-717f-4a31-b007-aa46478cd01e tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:36.307200 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12244f3e-717f-4a31-b007-aa46478cd01e tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1623066773" status: 202 len: 0 microversion: 2.1 time: 0.059969 Oct 06 12:49:36.308602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 209/403] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:49:36 2022] DELETE /compute/v2.1/flavors/1623066773 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:36.321773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6603a8ef-2085-4301-8c89-66dae73ee1ca tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:36.369307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:36.386200 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47078b26-6c94-4307-a625-be24a8923154 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.236323 Oct 06 12:49:36.387227 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 195/404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:36 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:36.410059 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6603a8ef-2085-4301-8c89-66dae73ee1ca tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095654 Oct 06 12:49:36.411860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 210/405] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:36.447467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b876f072-35f4-4e06-bd9f-7f6b405fa575 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2139376051", "id": 1585906003, "os-flavor-access:is_public": "False"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:36.483356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:36.484131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:36.505906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:36.508293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:36.509342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:36.510399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:36.511165 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b876f072-35f4-4e06-bd9f-7f6b405fa575 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.068815 Oct 06 12:49:36.513626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:36.515090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:36.526070 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 196/406] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:36 2022] POST /compute/v2.1/flavors => generated 439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:36.544125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5e3afb7-f306-4725-902c-27ab54cb9d44 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:36.880540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:36.889458 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27da357f-18f4-45d8-9700-2c5b75c8d7f9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.411247 Oct 06 12:49:36.902505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 211/407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:36 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:37.054663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d726ba4-a934-492f-8c1d-3dde4ba01c4e tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] Calling method '.version_select at 0x7f7d3fd63160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:37.084849 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5e3afb7-f306-4725-902c-27ab54cb9d44 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1585906003/action" status: 200 len: 97 microversion: 2.1 time: 0.556731 Oct 06 12:49:37.086569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 197/408] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Oct 6 12:49:36 2022] POST /compute/v2.1/flavors/1585906003/action => generated 97 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:37.103424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff8881-bbb7-4c80-9b45-f822d708aba0", "name": "network-vif-plugged", "status": "completed", "tag": "7ba22c43-a15b-4673-af97-c4c8c706813c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:37.113366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:37.113887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:37.114328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:37.125731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] Creating event network-vif-plugged:7ba22c43-a15b-4673-af97-c4c8c706813c for instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 on n-h1-860556-1 Oct 06 12:49:37.131355 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6d49dc6a-b854-446f-b5d4-be323fa0d4e4 req-fca2cef0-6d12-4b53-9876-1afab81f285d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041941 Oct 06 12:49:37.132298 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 198/409] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:37.237952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e529bb97-50bd-4960-913c-c7a9034b2e24 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1931793782", "id": 717751482, "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:37.315332 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e529bb97-50bd-4960-913c-c7a9034b2e24 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.180769 Oct 06 12:49:37.318097 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 199/410] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:49:37 2022] POST /compute/v2.1/flavors => generated 465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:37.331069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47a8d435-249a-45b7-ba06-e479e3953fdb tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:37.346149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-47a8d435-249a-45b7-ba06-e479e3953fdb tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ce0b2279f8db4e6f90ff2c39a54c23ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85c902b03e1453bb81ed87f142b9240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47a8d435-249a-45b7-ba06-e479e3953fdb tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Request method failure captured: Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/flavors/1585906003/action HTTP/1.1 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 70 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7W8UFcdxvaUP-sf-Z6BSIgoTNZHm0fnpxF-B2vyxbsawcK0waXeuAiyLZcoyLuawmVIpQw_vyFlhU0EZ30GO0Q_jxyAvg0ZESnNMinwBeu8BBcQpFTs7KZOak4RLRobBlv0Q0PTpHJa9JyzMIWN7-4cDSGVaT3fedlFY8DTkobpEU Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: d85c902b03e1453bb81ed87f142b9240 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:37.352021 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d85c902b03e1453bb81ed87f142b9240", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d85c902b03e1453bb81ed87f142b9240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d85c902b03e1453bb81ed87f142b9240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d85c902b03e1453bb81ed87f142b9240"}]}] Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: d85c902b03e1453bb81ed87f142b9240 Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371 Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FlavorsAccessNegativeTestJSON-1412105371-project Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ce0b2279f8db4e6f90ff2c39a54c23ee Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1412105371-project Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: {"removeTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} Oct 06 12:49:37.354119 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1585906003', 'body': {'removeTenantAccess': {'tenant': 'd85c902b03e1453bb81ed87f142b9240'}}} Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can( Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:37.355222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 06 12:49:37.357063 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:37.361945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47a8d435-249a-45b7-ba06-e479e3953fdb tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:37.363487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47a8d435-249a-45b7-ba06-e479e3953fdb tempest-FlavorsAccessNegativeTestJSON-1412105371 tempest-FlavorsAccessNegativeTestJSON-1412105371-project] 10.222.0.26 "POST /compute/v2.1/flavors/1585906003/action" status: 403 len: 133 microversion: 2.1 time: 0.043314 Oct 06 12:49:37.365865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 200/411] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Oct 6 12:49:37 2022] POST /compute/v2.1/flavors/1585906003/action => generated 133 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:37.375167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:37.380031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:37.394350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:37.395433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:37.397580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:37.399184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:37.400390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:37.402353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:37.890692 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d726ba4-a934-492f-8c1d-3dde4ba01c4e tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 0.985740 Oct 06 12:49:37.893668 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 212/412] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:49:36 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:37.917277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:37.918801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:37.933794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:37.935210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:37.937000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:37.939171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:37.940413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:37.942711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:38.364701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:38.373401 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d96338d-5ad8-41c3-a15e-219ba08a833a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1271 microversion: 2.1 time: 0.477416 Oct 06 12:49:38.389797 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 213/413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:37 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1271 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:38.511027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bdf0306d-f3f9-440b-91d8-f38cd4822d80 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:38.527430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bdf0306d-f3f9-440b-91d8-f38cd4822d80 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] 10.222.0.26 "GET /compute/v2.1/flavors/717751482" status: 200 len: 465 microversion: 2.61 time: 0.135204 Oct 06 12:49:38.542006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:38.546558 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 214/414] 10.222.0.26 () {60 vars in 1196 bytes} [Thu Oct 6 12:49:38 2022] GET /compute/v2.1/flavors/717751482 => generated 465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:38.560062 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee325b35-acc6-4f54-9f41-2230fcd28c55 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1465 microversion: 2.1 time: 1.190774 Oct 06 12:49:38.560670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 201/415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:37 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1465 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:38.591484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc14ba93-12a2-40d5-96af-1f9bb045df3f tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d85c902b03e1453bb81ed87f142b9240"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:38.597912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:38.598851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:38.615916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:38.621596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:38.623448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:38.627089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:38.627932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:38.628529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:38.760697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc14ba93-12a2-40d5-96af-1f9bb045df3f tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1585906003/action" status: 200 len: 21 microversion: 2.1 time: 0.210076 Oct 06 12:49:38.762327 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 215/416] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Oct 6 12:49:38 2022] POST /compute/v2.1/flavors/1585906003/action => generated 21 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:38.780574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5fd6c03-35f2-4d7d-a432-db1bfb96dd0d tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] Calling method '.version_select at 0x7f7d3fb0fdc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.042391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5fd6c03-35f2-4d7d-a432-db1bfb96dd0d tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/2f3faab0-bee3-44b8-ae93-6e6bd2454aab" status: 200 len: 652 microversion: 2.1 time: 0.277752 Oct 06 12:49:39.044115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 216/417] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 12:49:38 2022] GET /compute/v2.1/os-networks/2f3faab0-bee3-44b8-ae93-6e6bd2454aab => generated 652 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:39.051425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.052421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:39.060884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.061809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.062550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.063553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.064251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.064900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.075755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:39.108616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:39.138400 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7fb728c7-2e83-484c-9838-5d514a4fa225 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.571529 Oct 06 12:49:39.142136 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 202/418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:38 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:39.155536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38a9c731-241e-49e7-9991-68b7b563900d tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:39.182385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:39.254712 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38a9c731-241e-49e7-9991-68b7b563900d tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/717751482" status: 200 len: 466 microversion: 2.61 time: 0.108417 Oct 06 12:49:39.266376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 203/419] 10.222.0.26 () {62 vars in 1216 bytes} [Thu Oct 6 12:49:39 2022] PUT /compute/v2.1/flavors/717751482 => generated 466 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:39.274293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2270d509-280b-4c72-8c4e-a5e4395603eb tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.307068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2270d509-280b-4c72-8c4e-a5e4395603eb tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1585906003" status: 202 len: 0 microversion: 2.1 time: 0.037557 Oct 06 12:49:39.308071 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 204/420] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:49:39 2022] DELETE /compute/v2.1/flavors/1585906003 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:39.321133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8912eb-87c0-472c-8bb3-dbb27c96292a", "name": "network-vif-deleted", "tag": "fbbc3155-9baf-41e8-932a-bdd2efac8c45"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:39.338678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.342927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.345049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.370172 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] Creating event network-vif-deleted:fbbc3155-9baf-41e8-932a-bdd2efac8c45 for instance cd8912eb-87c0-472c-8bb3-dbb27c96292a on n-h2-860556-1 Oct 06 12:49:39.381312 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-72657e31-785d-43d3-92dc-0421ccc9bc4e req-40609d1c-3519-43dc-8c8f-31db71c40177 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069040 Oct 06 12:49:39.383319 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 205/421] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:39.401780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3158ab32-a43a-4986-bdf0-7df645126d58 tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] Calling method '.version_select at 0x7f7d3fc8d940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.465895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:39.508545 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3c1fb55-6773-4356-a912-a8d1c3d9fad5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1315 microversion: 2.1 time: 0.455549 Oct 06 12:49:39.511070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 217/422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:39.544627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d58a3aa3-aced-485f-94f0-a0497c5162c7 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.723025 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d58a3aa3-aced-485f-94f0-a0497c5162c7 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.205786 Oct 06 12:49:39.733870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 218/423] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:49:39.791769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72d0aacc-35a9-4128-bc85-2141ee73be07 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.888129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3158ab32-a43a-4986-bdf0-7df645126d58 tempest-NetworksTest-775430606 tempest-NetworksTest-775430606-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 0.502443 Oct 06 12:49:39.898488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 206/424] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:39.913490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.916639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:39.917537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-72d0aacc-35a9-4128-bc85-2141ee73be07 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.149544 Oct 06 12:49:39.924701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 219/425] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:39.950033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:39.950945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.952966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:39.954681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.959482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.963780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.964915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.968802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.983396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.987226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:39.987813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:39.990767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:39.998094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.000146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.187082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:40.188975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.190337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.191455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lazy-loading 'fault' on Instance uuid cd8912eb-87c0-472c-8bb3-dbb27c96292a {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:40.352416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:40.368212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a2c3c7b-76b5-4faf-828f-546e063aa06a tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 200 len: 1308 microversion: 2.1 time: 0.439885 Oct 06 12:49:40.369938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 220/426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:40.381470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3760aafc-043a-44fc-9bae-b63807cbdaf6 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:40.459565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3760aafc-043a-44fc-9bae-b63807cbdaf6 tempest-FlavorsV261TestJSON-1191384693 tempest-FlavorsV261TestJSON-1191384693-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.086855 Oct 06 12:49:40.478405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 221/427] 10.222.0.26 () {60 vars in 1166 bytes} [Thu Oct 6 12:49:40 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:49:40.494976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64e714c7-ad47-4701-8880-a206bcdfd7ef tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1801637768", "id": 509861714, "os-flavor-access:is_public": "False"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:40.535092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:40.558426 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64e714c7-ad47-4701-8880-a206bcdfd7ef tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.074320 Oct 06 12:49:40.562542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 222/428] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:40 2022] POST /compute/v2.1/flavors => generated 436 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:40.566177 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b80b6e89-3c88-40f8-9ac0-beca071e96c6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 0.660127 Oct 06 12:49:40.567027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 207/429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:39 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:40.585886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:40.588791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:40.591326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99332a6a-541a-4b54-ade7-a9ae703a97c7 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:40.620258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:40.624262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.625592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.629807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:40.636248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.637452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.685936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99332a6a-541a-4b54-ade7-a9ae703a97c7 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/717751482" status: 202 len: 0 microversion: 2.61 time: 0.117387 Oct 06 12:49:40.686534 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 208/430] 10.222.0.26 () {60 vars in 1199 bytes} [Thu Oct 6 12:49:40 2022] DELETE /compute/v2.1/flavors/717751482 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:49:40.700771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:40.701400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:40.720320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:40.728549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.729396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.734428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:40.746058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:40.747666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:40.988018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:40.999725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-468e20e3-112c-4e20-8831-0d30e7c6ee5d tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.435788 Oct 06 12:49:41.000700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 223/431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:40 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:41.010162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e724f53-737c-4b49-a728-1cdd88ead9c9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9991ffc8ccc64c7784a97390b3201e83"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:41.053603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:41.062881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30509b49-72b1-4df2-a279-9bfcac3acf50 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1465 microversion: 2.1 time: 0.375271 Oct 06 12:49:41.063475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 209/432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:40 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1465 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:41.070550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-903f4643-45ae-4b13-8ce0-beba8cb56485 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:41.120120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-903f4643-45ae-4b13-8ce0-beba8cb56485 tempest-FlavorsV261TestJSON-36922671 tempest-FlavorsV261TestJSON-36922671-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.053298 Oct 06 12:49:41.121415 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 210/433] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:49:41.406785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0e724f53-737c-4b49-a728-1cdd88ead9c9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] HTTP exception thrown: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e724f53-737c-4b49-a728-1cdd88ead9c9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Request method failure captured: Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/flavors/509861714/action HTTP/1.1 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 70 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7Ybc20vfJXnzTOgLc6ze5rvg1PMK9yhC8nzSS9YH-eX8u7A76B-qXgCVIGdKj0xtEEta50pl4Xlk7wXD46aTcSMARTi9ErHPfvVHfUXcstQpTHU9EctLEiGaSWzW6-joGPKzGN0x02scwvwJm0BXvSen4lIptrA28vMu8l_zzMBic Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:49:41.412015 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f9877bc9f5d40589d30dbd312fab2a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f9877bc9f5d40589d30dbd312fab2a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f9877bc9f5d40589d30dbd312fab2a4"}]}] Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5f9877bc9f5d40589d30dbd312fab2a4 Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896863027 Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: bb952e5b23ce4e6b8454ada8d2b1edb6 Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: {"removeTenantAccess": {"tenant": "9991ffc8ccc64c7784a97390b3201e83"}} Oct 06 12:49:41.414864 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: exception: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '509861714', 'body': {'removeTenantAccess': {'tenant': '9991ffc8ccc64c7784a97390b3201e83'}}} Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 431, in remove_access Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 424, in _remove_access Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 409, in _flavor_del_project Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 06 12:49:41.415875 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.417061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e724f53-737c-4b49-a728-1cdd88ead9c9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Returning 404 to user: Flavor access not found for 36 / 9991ffc8ccc64c7784a97390b3201e83 combination. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:41.420222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e724f53-737c-4b49-a728-1cdd88ead9c9 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/509861714/action" status: 404 len: 124 microversion: 2.1 time: 0.411631 Oct 06 12:49:41.422966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 224/434] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Oct 6 12:49:41 2022] POST /compute/v2.1/flavors/509861714/action => generated 124 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:41.431651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:41.458075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.461791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.462367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.485959 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] Creating event network-changed:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h1-860556-1 Oct 06 12:49:41.501200 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9369262f-31b0-4b70-a483-7c61f5e8477e req-a014f037-cff7-4fbc-81b8-fd874c48b0d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079425 Oct 06 12:49:41.503884 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 225/435] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:41.517155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:41.519379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: cd8912eb-87c0-472c-8bb3-dbb27c96292a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:41.536549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.537263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.537865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.538864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.539594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.542874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.569111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:41.570100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:41.576435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] HTTP exception thrown: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Request method failure captured: Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a HTTP/1.1 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6bxr5VdAZXAeHi9zVFhYKM0Hi8eiUTCGrWrUmO8TOtUhLjZtb5dWlDPqN00t05JqnceE0kPmcv3CHFhwVZFrOcLxNMXu2IfoaobjoPMhgltZN8D2BbIVJxN-C_wr6brT3YgmFs9cyz-NjqZ974Q3B_NkVr9-e5E-RqGdUoZIdl7wU Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3e96e87780a8414ebbcad917ddf5bdd5 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:41.579083 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e96e87780a8414ebbcad917ddf5bdd5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e96e87780a8414ebbcad917ddf5bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e96e87780a8414ebbcad917ddf5bdd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e96e87780a8414ebbcad917ddf5bdd5"}]}] Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3e96e87780a8414ebbcad917ddf5bdd5 Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveMigrationNegativeTest-50154769-project Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cc17e783f95d40a892c4fb255e315a46 Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveMigrationNegativeTest-50154769-project Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. Oct 06 12:49:41.580481 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'cd8912eb-87c0-472c-8bb3-dbb27c96292a'} Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:41.581273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. Oct 06 12:49:41.582620 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:41.583665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Returning 404 to user: Instance cd8912eb-87c0-472c-8bb3-dbb27c96292a could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:41.583665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f14a2d9-b34c-4b0e-99f8-deb6fcc04674 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a" status: 404 len: 111 microversion: 2.1 time: 0.076311 Oct 06 12:49:41.590013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 226/436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:41 2022] GET /compute/v2.1/servers/cd8912eb-87c0-472c-8bb3-dbb27c96292a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:41.594305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d18aba7-98fd-495a-8a83-3f3173c80fb3 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:41.605772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.607849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.611394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.615958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.618341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.621588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.652056 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d18aba7-98fd-495a-8a83-3f3173c80fb3 tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/509861714" status: 202 len: 0 microversion: 2.1 time: 0.064318 Oct 06 12:49:41.666109 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 227/437] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:49:41 2022] DELETE /compute/v2.1/flavors/509861714 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:41.676472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:41.676989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:41.690430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.691195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.691897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.692882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:41.693587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:41.694234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:41.733847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:49:41.975284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:41.984680 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-300e4cc2-201a-427f-a81c-812245d12bc8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 204 len: 0 microversion: 2.1 time: 0.313574 Oct 06 12:49:41.989443 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 228/438] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:49:41 2022] DELETE /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:49:42.002511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:42.005359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:42.029132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.029707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.030185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.030928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.031388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.031808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.391863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-acedf7f5-97b6-4321-9f02-0c0785d7a874 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1616 microversion: 2.1 time: 1.268915 Oct 06 12:49:42.417129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 211/439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:41 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1616 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:42.423718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-82ad2b32-9d5e-4841-84f7-04fee2a2492e tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:42.455719 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-82ad2b32-9d5e-4841-84f7-04fee2a2492e tempest-FlavorsAccessNegativeTestJSON-896863027 tempest-FlavorsAccessNegativeTestJSON-896863027-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037005 Oct 06 12:49:42.465678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 212/440] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:42.476349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:42.477555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:42.492633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.495069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.497217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.498127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.499942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.501003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.552604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:42.564379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e886a320-8495-46af-8bc2-5cb72427e35f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 0.571866 Oct 06 12:49:42.566699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 229/441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:41 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:42.579782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:42.580803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:42.595718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.596435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.597309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.598811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:42.600340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:42.601640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:42.962174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:42.981494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f83ad14c-b06a-465c-a53c-3c75a2efa272 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1474 microversion: 2.1 time: 0.512189 Oct 06 12:49:42.984787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 213/442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:42 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:43.005154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c3d91b-a212-403e-a006-070e838f3735", "name": "network-vif-plugged", "status": "completed", "tag": "9e859e9f-8f11-4ca8-b91c-f82f0a467670"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:43.016409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:43.030805 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67c70141-74da-4211-8309-b37c677884c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.461053 Oct 06 12:49:43.032132 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 230/443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:42 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:43.037724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: .version_select at 0x7f7d3fa8b0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1569951531", "policies": ["affinity"]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:43.055786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:43.058128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:43.059434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:43.073101 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] Creating event network-vif-plugged:9e859e9f-8f11-4ca8-b91c-f82f0a467670 for instance f8c3d91b-a212-403e-a006-070e838f3735 on n-h2-860556-1 Oct 06 12:49:43.083304 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-dce47757-89a1-4709-b2ab-62332555b218 req-cf0019ff-bf84-44c2-9a43-715ee582f075 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095698 Oct 06 12:49:43.085385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 214/444] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:43.085658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:43.095254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:43.201196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:43.208016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:43.249674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a78112b2-af92-40ce-b9c2-5f2206fc1040 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.216100 Oct 06 12:49:43.254007 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 231/445] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Oct 6 12:49:43 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:43.595373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:43.596805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:43.614027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:43.617691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:43.618428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:43.621004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:43.624282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:43.628369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:43.682162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-516124908", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "15718a84-c605-46a3-a3b3-13ee0a8a920d"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:43.758305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:44.010932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:44.044646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:44.059750 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-93cd29f3-ebf7-422d-85e7-061ab323966f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 0.469147 Oct 06 12:49:44.063108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 215/446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:43 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:44.076638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:44.078356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:44.089484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.090008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.095526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.097790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.100578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.101348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.239840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:44.241012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:44.241511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:44.241948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:44.242529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:44.304190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.306159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.308648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.311342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.312595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.318276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.367408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:44.384467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:44.418915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 2 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:44.423294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:44.506122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:44.520281 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb772a94-7805-4b4d-97c7-e6006058c6a8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1474 microversion: 2.1 time: 0.455783 Oct 06 12:49:44.522102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 216/447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:44 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1474 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:44.526772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129615) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 06 12:49:44.531923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:44.535057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:44.550792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.551661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.553414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.554438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:44.555141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:44.555791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:44.582662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:44.594245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:44.693781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:44.712795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:44.745051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=0a8c895c-c5a5-4e01-91ab-f375d1f564d5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:44.830049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:44.886879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:44.893634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:44.970013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:44.983148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:44.989006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:45.004242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:45.018472 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8607908-82e5-4c21-8ae8-fc8a0e25f762 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1322 microversion: 2.1 time: 0.494461 Oct 06 12:49:45.023681 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 217/448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:44 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:45.043695 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6d2c937-1237-48b1-89d1-8c5948efdb57 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.370247 Oct 06 12:49:45.048560 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 232/449] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1376 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 06 12:49:45.056717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:45.067554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:45.069608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Searching by: {'deleted': False, 'project_id': '9ca94e746fcb426887d292336801aa0d'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:49:45.091595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:45.092372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:45.103473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.104158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.104811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.105834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.106465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.106972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.126866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.127269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.127716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.128454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.128908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.129341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.275664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:49:45.533039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f18d01d-2fa5-4156-b0c5-d2c2c86735c9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.483318 Oct 06 12:49:45.545039 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 218/450] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 12:49:45 2022] GET /compute/v2.1/servers => generated 1000 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:45.559651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:45.565105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:45.602784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.603131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.606345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.607689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:45.609081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:45.609989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:45.698245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:45.713967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-edf2eb5c-24ef-49e9-abee-d24efce99d13 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 0.628564 Oct 06 12:49:45.729700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 233/451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:45 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:45.738735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d85706d-2760-4024-a871-0035f0ce6c48 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:45.739269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d85706d-2760-4024-a871-0035f0ce6c48 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:45.935291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:45.979198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a7000b1-5a5a-46d9-b71d-dc101432d26e tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1432 microversion: 2.1 time: 0.430506 Oct 06 12:49:45.980753 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 219/452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:45 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1432 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:45.993954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f1c7d8-9c49-408e-9c5a-f509210aa935", "name": "network-vif-deleted", "tag": "290c859e-a81e-4159-8284-6e1bc95ad898"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:46.003814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d85706d-2760-4024-a871-0035f0ce6c48 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:46.012725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d85706d-2760-4024-a871-0035f0ce6c48 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1218 microversion: 2.1 time: 0.281821 Oct 06 12:49:46.015591 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 234/453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:45 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:46.048198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:46.049600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:46.060324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:46.061398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:46.062528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:46.070660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:46.072936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:46.073749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:46.076792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:46.077563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:46.080307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:46.121729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] Creating event network-vif-deleted:290c859e-a81e-4159-8284-6e1bc95ad898 for instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 on n-h2-860556-1 Oct 06 12:49:46.151470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bd551e13-9910-4bc7-89f6-8370cb4bf172 req-4af94c5d-c913-4de6-93e2-55958322d4cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165997 Oct 06 12:49:46.153576 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 220/454] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:46.756803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:46.759446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:46.793943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:46.798558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:46.802374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:46.810912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:46.819190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:46.824237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:46.967671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:47.030247 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65cbef62-6269-4991-b340-6b6210542703 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1471 microversion: 2.1 time: 0.984425 Oct 06 12:49:47.041542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 235/455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:46 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1471 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:47.062846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:47.063468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:47.081308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:47.082253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:47.082964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:47.085851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:47.091585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:47.092313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:47.191246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:47.192548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:47.193530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:47.195028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lazy-loading 'fault' on Instance uuid b6f1c7d8-9c49-408e-9c5a-f509210aa935 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:49:47.205550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:47.487132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc17e783f95d40a892c4fb255e315a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e96e87780a8414ebbcad917ddf5bdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:47.495351 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b573aa7a-82ff-46fc-92df-f712aafb73e8 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 200 len: 1308 microversion: 2.1 time: 0.451446 Oct 06 12:49:47.523145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 236/456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:47 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:47.529165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:47.530175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:47.542458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:47.546662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:47.547416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:47.548464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:47.549167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:47.555407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:47.743265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:47.759617 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b395951f-30c7-4ca2-9ce5-a45512ff6de9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 1.009547 Oct 06 12:49:47.761499 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 221/457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:46 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:47.819863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:47.831810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2f04318-ee14-4dd6-bce8-ed5d9107eeee tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1214 microversion: 2.1 time: 0.307185 Oct 06 12:49:47.833760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 237/458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:47 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:48.523734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:48.524929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] [instance: b6f1c7d8-9c49-408e-9c5a-f509210aa935] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:48.553635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.556207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.558848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:48.566102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.569145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.570474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:48.624031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] HTTP exception thrown: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Request method failure captured: Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 HTTP/1.1 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs6bxr5VdAZXAeHi9zVFhYKM0Hi8eiUTCGrWrUmO8TOtUhLjZtb5dWlDPqN00t05JqnceE0kPmcv3CHFhwVZFrOcLxNMXu2IfoaobjoPMhgltZN8D2BbIVJxN-C_wr6brT3YgmFs9cyz-NjqZ974Q3B_NkVr9-e5E-RqGdUoZIdl7wU Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3e96e87780a8414ebbcad917ddf5bdd5 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:49:48.629063 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e96e87780a8414ebbcad917ddf5bdd5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e96e87780a8414ebbcad917ddf5bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e96e87780a8414ebbcad917ddf5bdd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e96e87780a8414ebbcad917ddf5bdd5"}]}] Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3e96e87780a8414ebbcad917ddf5bdd5 Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-50154769 Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveMigrationNegativeTest-50154769-project Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cc17e783f95d40a892c4fb255e315a46 Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveMigrationNegativeTest-50154769-project Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. Oct 06 12:49:48.631190 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b6f1c7d8-9c49-408e-9c5a-f509210aa935'} Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:48.631882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. Oct 06 12:49:48.633025 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.636997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] Returning 404 to user: Instance b6f1c7d8-9c49-408e-9c5a-f509210aa935 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:48.653913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:48.654950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] [instance: 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:48.659116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-343f99a1-2765-464b-a5b0-925eaefee461 tempest-LiveMigrationNegativeTest-50154769 tempest-LiveMigrationNegativeTest-50154769-project] 10.222.0.26 "GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935" status: 404 len: 111 microversion: 2.1 time: 0.117263 Oct 06 12:49:48.666166 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 238/459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:48 2022] GET /compute/v2.1/servers/b6f1c7d8-9c49-408e-9c5a-f509210aa935 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:49:48.672867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] HTTP exception thrown: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Request method failure captured: Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9/action HTTP/1.1 Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 15 Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7RXb7ldWwqMQIw9ak31NbGAHRIxzOQyDxQ1HH8w4Tf5QXOHeZeZ4AWG4fCSCneUj5Dg0vDI9x1I3t-q_ZpxkfvdHhePbqr2JDU5C_35DMW8XAuQ__g9KidugJ99eGfoAdkPz32uz5pC76piA9L7un6BzSrprWfeFcsmN7RJ7x9ebI Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:48.678812 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8424e33304bc4182a46847d49e7755ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}] Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 916e6eca3836487c8d7a436ee0f140ea Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: {"migrate": {}} Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:49:48.680151 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9', 'body': {'migrate': {}}} Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:48.683714 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. Oct 06 12:49:48.685043 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:48.694042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Returning 404 to user: Instance 2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:48.696548 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e087067f-dd65-470a-b117-3c082c63f137 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9/action" status: 404 len: 111 microversion: 2.1 time: 0.933213 Oct 06 12:49:48.697863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 222/460] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:49:47 2022] POST /compute/v2.1/servers/2aa2dcb2-f8dd-45e4-8b59-7af783a8cae9/action => generated 111 bytes in 936 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:48.789388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:48.790645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:48.816864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.817264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.817695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:48.823328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.825038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.825548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:48.884622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:48.890748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:48.923215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.926788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.929713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:48.938745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:48.943184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:48.945659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:49.071317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:49.081095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e132061-fef0-45fe-a9b1-8083040d4eec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 0.296662 Oct 06 12:49:49.100128 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 239/461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:48 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:49.191104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:49.205170 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9700b5ae-db05-4707-8d19-b850caf174f2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1270 microversion: 2.1 time: 0.330402 Oct 06 12:49:49.212067 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 223/462] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:48 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:49.270156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-239910915", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:49.382725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "name": "network-vif-plugged", "status": "completed", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:49.395664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:49:49.402751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:49.403517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:49.404151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:49.431248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] Creating event network-vif-plugged:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h1-860556-1 Oct 06 12:49:49.441731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6bd54f74-2a61-41bc-99a5-f319c9690872 req-5c3f79f6-599f-4cb6-a353-43fc41e9b735 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063131 Oct 06 12:49:49.445086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 224/463] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:49:50.114469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:49:50.116429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:49:50.117092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:49:50.117661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:49:50.118262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:49:50.136085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.137053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.137679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:50.138639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.139250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.139841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:50.183823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Getting quotas for project f4229fd0e5604202b89a9514f5408ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:50.196570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Getting quotas for user cfb0c32000ad4877851a4ba36ee1eef3 and project f4229fd0e5604202b89a9514f5408ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:50.226484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:49:50.231506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:49:50.308900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b14754d2-d71d-416b-9073-34fef6e419ce tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043413 Oct 06 12:49:50.316421 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 240/464] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:49:50.327069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:50.332082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:50.343833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.347398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.348734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:50.351960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.352764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.357142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:50.697632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ae11202-ecfe-4f13-990b-8f7b499a10c2 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-05T12%3A49%3A49.592934&end=2022-10-07T12%3A49%3A49.592934" status: 404 len: 112 microversion: - time: 1.100558 Oct 06 12:49:50.703976 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 225/465] 10.222.0.26 () {58 vars in 1316 bytes} [Thu Oct 6 12:49:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-05T12%3A49%3A49.592934&end=2022-10-07T12%3A49%3A49.592934 => generated 112 bytes in 1102 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 06 12:49:50.713671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:50.713890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:50.733543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.738407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.738889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:50.739659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:50.747318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:50.747860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:51.163803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:51.176953 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5dfe411a-5ea7-488d-b35a-a1951f153575 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1276 microversion: 2.1 time: 0.476955 Oct 06 12:49:51.202238 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 226/466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:50 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1276 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:51.243038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71818935-6a4e-4337-aa43-ccbe557162ae tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:51.243919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71818935-6a4e-4337-aa43-ccbe557162ae tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:51.802721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71818935-6a4e-4337-aa43-ccbe557162ae tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:51.816225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71818935-6a4e-4337-aa43-ccbe557162ae tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1221 microversion: 2.1 time: 0.612699 Oct 06 12:49:51.830917 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 227/467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:51 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1221 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:51.842671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a63f7675-b943-415e-8265-bb2bd8e034b6 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] Calling method '.version_select at 0x7f7d3fcd0a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:51.853971 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a63f7675-b943-415e-8265-bb2bd8e034b6 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a63f7675-b943-415e-8265-bb2bd8e034b6 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] Request method failure captured: Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-simple-tenant-usage/13b8fe8aa82944bbbb2a7bafe7aba3f2?start=2022-10-07T12%3A49%3A49.592934&end=2022-10-05T12%3A49%3A49.592934 HTTP/1.1 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7tILWSqcQF5SGFMLaQRenUOtTSaA1K9znMrMSXou3aHmu285_Bwwwm0IN82eaJjlev0Wxacj2x--QnDrRXV_UVVp2WTqYlxsd210gCDPiSpus-H6LpLJhPTk__nlQt7okAJdA509bRwI-2K2A8xGe0D9puHZJPz49kiJr22ykQG6k Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5643877d13f9414e9e88cc7c5de63095 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-917296170 Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:49:51.862020 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5643877d13f9414e9e88cc7c5de63095", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5643877d13f9414e9e88cc7c5de63095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5643877d13f9414e9e88cc7c5de63095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5643877d13f9414e9e88cc7c5de63095"}]}] Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-917296170 Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5643877d13f9414e9e88cc7c5de63095 Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-917296170 Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TenantUsagesNegativeTestJSON-917296170-project-admin Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e25228afd014b14ac87bc6480b81ba1 Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-917296170-project-admin Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid start time. The start time cannot occur after the end time. Oct 06 12:49:51.863344 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '13b8fe8aa82944bbbb2a7bafe7aba3f2'} Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 06 12:49:51.864080 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 06 12:49:51.865297 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:51.874289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a63f7675-b943-415e-8265-bb2bd8e034b6 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:51.875387 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a63f7675-b943-415e-8265-bb2bd8e034b6 tempest-TenantUsagesNegativeTestJSON-917296170 tempest-TenantUsagesNegativeTestJSON-917296170-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/13b8fe8aa82944bbbb2a7bafe7aba3f2?start=2022-10-07T12%3A49%3A49.592934&end=2022-10-05T12%3A49%3A49.592934" status: 400 len: 111 microversion: 2.1 time: 0.043278 Oct 06 12:49:51.876497 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 228/468] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Oct 6 12:49:51 2022] GET /compute/v2.1/os-simple-tenant-usage/13b8fe8aa82944bbbb2a7bafe7aba3f2?start=2022-10-07T12%3A49%3A49.592934&end=2022-10-05T12%3A49%3A49.592934 => generated 111 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:49:51.933924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:51.948985 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc42e13d-a8ac-4a44-85d6-2d52a6992ab7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1313 microversion: 2.1 time: 1.630074 Oct 06 12:49:51.950120 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 241/469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:50 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1313 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:52.212831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:52.214461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:52.227169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.229614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.230410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:52.231499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.234581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.235304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:52.440442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64eaa8df-937f-4951-9724-7b1d05957da2 tempest-TenantUsagesNegativeTestJSON-199810686 tempest-TenantUsagesNegativeTestJSON-199810686-project] Calling method '.version_select at 0x7f7d3fb0e5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:52.444718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-64eaa8df-937f-4951-9724-7b1d05957da2 tempest-TenantUsagesNegativeTestJSON-199810686 tempest-TenantUsagesNegativeTestJSON-199810686-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5547f557bd9f47a880847c088c7269be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b8fe8aa82944bbbb2a7bafe7aba3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64eaa8df-937f-4951-9724-7b1d05957da2 tempest-TenantUsagesNegativeTestJSON-199810686 tempest-TenantUsagesNegativeTestJSON-199810686-project] Request method failure captured: Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-05T12%3A49%3A49.592934&end=2022-10-07T12%3A49%3A49.592934&detailed=1 HTTP/1.1 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7po2hhc3DBJOWjGmo6uTnDCMr53iW4hgIXThoRbIH77N-QUxQZWZkRExVpnKbdc2ucZ9c1aPUIlFkEJcLHHMiD7fXt18HksjfmbH-wXzR7YLHIfILmqFkWTYgAof81yhR80pax62ShL2UPv0ipPs_Cgf1NkPy0WNg_qFRR2Y6mZlA Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 13b8fe8aa82944bbbb2a7bafe7aba3f2 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-199810686 Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:49:52.446403 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13b8fe8aa82944bbbb2a7bafe7aba3f2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13b8fe8aa82944bbbb2a7bafe7aba3f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13b8fe8aa82944bbbb2a7bafe7aba3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13b8fe8aa82944bbbb2a7bafe7aba3f2"}]}] Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-199810686 Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 13b8fe8aa82944bbbb2a7bafe7aba3f2 Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-199810686 Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TenantUsagesNegativeTestJSON-199810686-project Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5547f557bd9f47a880847c088c7269be Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-199810686-project Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:49:52.447783 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:49:52.448582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:49:52.450155 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:49:52.452802 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 06 12:49:52.452802 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:49:52.452802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64eaa8df-937f-4951-9724-7b1d05957da2 tempest-TenantUsagesNegativeTestJSON-199810686 tempest-TenantUsagesNegativeTestJSON-199810686-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:49:52.452802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64eaa8df-937f-4951-9724-7b1d05957da2 tempest-TenantUsagesNegativeTestJSON-199810686 tempest-TenantUsagesNegativeTestJSON-199810686-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-05T12%3A49%3A49.592934&end=2022-10-07T12%3A49%3A49.592934&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.565145 Oct 06 12:49:52.462205 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 229/470] 10.222.0.26 () {58 vars in 1335 bytes} [Thu Oct 6 12:49:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-05T12%3A49%3A49.592934&end=2022-10-07T12%3A49%3A49.592934&detailed=1 => generated 123 bytes in 580 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:49:52.821894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:52.833557 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cbc3117-8d5d-43dc-9572-7a3846101186 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.624320 Oct 06 12:49:52.844223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:52.845430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:52.853572 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 242/471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:52 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:52.865059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.865923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.866452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:52.867312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.869207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.873569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:52.975570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:52.976186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:52.983344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.984386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.984883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:52.985889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:52.986815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:52.987415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:53.026296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:53.045392 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6db2819-2a6f-47ad-8728-dd2fac6feaa9 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1281 microversion: 2.1 time: 0.200276 Oct 06 12:49:53.046062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 230/472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:52 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:53.360740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:53.370382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e5244613-b72c-45c5-bbcc-34728342dca4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1463 microversion: 2.1 time: 0.398241 Oct 06 12:49:53.374273 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 243/473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:52 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1463 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:53.736787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Calling method '.version_select at 0x7f7d3fc8d940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:53.739286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:53.740195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:53.740918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:53.781443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:53.783561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:53.786276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:53.818383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:53.819619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:53.821571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:53.848666 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f51232e6-6498-4f83-9fb6-1a9b0eda8c82 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.726318 Oct 06 12:49:53.854039 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 231/474] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 12:49:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:53.875390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:53.877365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:53.899273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:53.902414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:53.903160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:53.905979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:53.908881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:53.909576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.076885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:54.078253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:54.088193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.089306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.090246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.091878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.093088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.095139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.709787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:54.724724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:54.743256 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74c45a0d-4a3d-444a-bd99-2e91d40c1953 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.885786 Oct 06 12:49:54.758611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 232/475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:53 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:54.802405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Calling method '.version_select at 0x7f7d3fb0eca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:54.826302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.830128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.831230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.870352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.872518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.873481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.887474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b10b232-5627-4fbd-8056-f4b1274d77b6 tempest-HypervisorAdminV228Test-819035835 tempest-HypervisorAdminV228Test-819035835-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.126049 Oct 06 12:49:54.889243 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 233/476] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 12:49:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:49:54.909176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:54.913524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:54.932480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.933550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.934984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:54.936434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:54.937384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:54.938278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:55.075901 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d4d48f2-ca2f-404e-af33-8edf95f5feec tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1614 microversion: 2.1 time: 1.676843 Oct 06 12:49:55.089950 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 244/477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:53 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1614 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:55.116452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:55.132565 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d55e402-a6e4-49ce-8380-020e96c740c2 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1279 microversion: 2.1 time: 0.241522 Oct 06 12:49:55.134263 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 234/478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:54 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:55.140012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:55.140595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:55.148017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:55.161546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:55.165119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:55.167587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:55.170312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:55.170993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:55.288101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:55.455394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f3d26e6b5cd4af297705e8dd58740c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ed1fff55df4107a47cf37114824631', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:55.460424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] flavor_id is None. Assuming migration. {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 06 12:49:55.461184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 12:49:55.613698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18ebcfdc-701a-402f-b046-cc694fbca687 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1765297099", "ram": 512, "vcpus": 1, "disk": 10, "id": 1764067281, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:55.704306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18ebcfdc-701a-402f-b046-cc694fbca687 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.626408 Oct 06 12:49:55.705446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 245/479] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:49:55 2022] POST /compute/v2.1/flavors => generated 416 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:55.718600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6bcbb52a-93a8-4ac2-b7ee-b98fd4acb705 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:55.795035 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6bcbb52a-93a8-4ac2-b7ee-b98fd4acb705 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080113 Oct 06 12:49:55.796411 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 246/480] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:49:55 2022] POST /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 12:49:55.805055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:55.806114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:55.823291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:55.824902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:55.829472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:55.830837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:55.832860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:55.833564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:56.059917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe9befc2-c176-4119-bce4-8f25cfa026de tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.923877 Oct 06 12:49:56.069175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 235/481] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:49:55 2022] POST /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:56.549662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:56.567182 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8cbcafb5-1968-4b6b-ad71-3ee48912bd8c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.769106 Oct 06 12:49:56.573602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 247/482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:55 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:56.583946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:56.590651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:56.611049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:56.611552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:56.617260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:56.619013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:56.622774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:56.624063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:56.957699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d96615f5-0032-4d01-84f8-b4bb3673cb01 tempest-FlavorsExtraSpecsTestJSON-1947969611 tempest-FlavorsExtraSpecsTestJSON-1947969611-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:56.984566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d96615f5-0032-4d01-84f8-b4bb3673cb01 tempest-FlavorsExtraSpecsTestJSON-1947969611 tempest-FlavorsExtraSpecsTestJSON-1947969611-project] 10.222.0.26 "GET /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.916821 Oct 06 12:49:56.995734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 236/483] 10.222.0.26 () {58 vars in 1203 bytes} [Thu Oct 6 12:49:56 2022] GET /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.017941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d24361e-3af1-4439-959f-991ed131496e", "tag": "55a445c2-3ad7-47c7-8fb2-0f570c1c52cf"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:57.034652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:57.035700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:57.036647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:57.055763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] Creating event network-changed:55a445c2-3ad7-47c7-8fb2-0f570c1c52cf for instance 9d24361e-3af1-4439-959f-991ed131496e on n-h2-860556-1 Oct 06 12:49:57.065140 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-38b54105-8b1f-4c24-bbea-6fd670d3c6ae req-70b6d5d4-a5b1-4dbc-9c3b-3f60ce73f2b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067395 Oct 06 12:49:57.067693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 237/484] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:57.076667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.078264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:57.088739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:57.090014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:57.090993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:57.092496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:57.093520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:57.094539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:57.237098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:57.256365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f907969-e601-4054-b92d-f38f049e9580 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1472 microversion: 2.1 time: 0.679451 Oct 06 12:49:57.257927 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 248/485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:56 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1472 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:57.265543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acca35f1-0f73-4b4a-bde1-afc66980295b tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:57.303594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acca35f1-0f73-4b4a-bde1-afc66980295b tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043359 Oct 06 12:49:57.304577 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 249/486] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:49:57 2022] POST /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.323853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-383cb6a3-ebac-4266-b480-24824f372eec tempest-FlavorsExtraSpecsTestJSON-1947969611 tempest-FlavorsExtraSpecsTestJSON-1947969611-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.341352 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-383cb6a3-ebac-4266-b480-24824f372eec tempest-FlavorsExtraSpecsTestJSON-1947969611 tempest-FlavorsExtraSpecsTestJSON-1947969611-project] 10.222.0.26 "GET /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.031487 Oct 06 12:49:57.342651 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 250/487] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes => generated 22 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 12:49:57.361042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf0383c3-a878-4765-bbbc-68c14b4d9a24 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:57.404014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf0383c3-a878-4765-bbbc-68c14b4d9a24 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054308 Oct 06 12:49:57.411006 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 251/488] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Oct 6 12:49:57 2022] POST /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.434607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6489d81d-df04-43bd-b19c-e4bd4835e7ec tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.469935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6489d81d-df04-43bd-b19c-e4bd4835e7ec tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051976 Oct 06 12:49:57.470973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 252/489] 10.222.0.26 () {58 vars in 1203 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.482135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dab812ca-3625-40b8-9dc4-d2512fe7ff82 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:57.507421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:SAVEPOINT=8,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:57.528612 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dab812ca-3625-40b8-9dc4-d2512fe7ff82 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.051062 Oct 06 12:49:57.537665 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 253/490] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Oct 6 12:49:57 2022] PUT /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes => generated 22 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 12:49:57.549167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-19dcef27-d979-4ca4-87b7-381fcbd61de6 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.577510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-19dcef27-d979-4ca4-87b7-381fcbd61de6 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038611 Oct 06 12:49:57.582761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 254/491] 10.222.0.26 () {58 vars in 1203 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/flavors/1764067281/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.597886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc86e292-7023-4e15-95ce-4e45260eb1d5 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.700204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc86e292-7023-4e15-95ce-4e45260eb1d5 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.111458 Oct 06 12:49:57.701825 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 255/492] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 12:49:57 2022] DELETE /compute/v2.1/flavors/1764067281/os-extra_specs/hw:numa_nodes => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:57.714406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.721629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:57.735028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:57.736807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:57.737597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:57.740777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:57.743529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:57.744353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:57.831077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:57.842042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05a79753-8b44-48e2-9958-2623d1a8d87c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.772287 Oct 06 12:49:57.853781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 238/493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:57.853781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-882c9fe8-fa1b-43c2-a01e-aaa450f43f14 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.909265 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-882c9fe8-fa1b-43c2-a01e-aaa450f43f14 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1764067281/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.064908 Oct 06 12:49:57.909911 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 239/494] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 12:49:57 2022] DELETE /compute/v2.1/flavors/1764067281/os-extra_specs/hw:cpu_policy => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 12:49:57.918632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e37d917-db9b-4e23-8a94-06b076210784 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.929850 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e37d917-db9b-4e23-8a94-06b076210784 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1764067281/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015757 Oct 06 12:49:57.931473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 240/495] 10.222.0.26 () {58 vars in 1203 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/flavors/1764067281/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:57.945831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef0070e4-3982-4c02-9020-dcb4aeeb9db8 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.972480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef0070e4-3982-4c02-9020-dcb4aeeb9db8 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1764067281" status: 202 len: 0 microversion: 2.1 time: 0.032410 Oct 06 12:49:57.974027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 241/496] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:49:57 2022] DELETE /compute/v2.1/flavors/1764067281 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:49:57.987330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d42e7677-9ecf-45cb-9c0b-93233564cc99 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:57.997556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:49:58.033932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d42e7677-9ecf-45cb-9c0b-93233564cc99 tempest-FlavorsExtraSpecsTestJSON-2070634049 tempest-FlavorsExtraSpecsTestJSON-2070634049-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051855 Oct 06 12:49:58.034982 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 242/497] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:58.133859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:58.144673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d01c741-7f0b-49f9-8576-7a126d193ee3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.437760 Oct 06 12:49:58.149436 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 256/498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:57 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:58.187399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6f111e0b-81c6-4d9f-ac82-4893e27ead55 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fa23700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:58.253214 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6f111e0b-81c6-4d9f-ac82-4893e27ead55 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae" status: 200 len: 637 microversion: 2.1 time: 0.075248 Oct 06 12:49:58.254597 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 243/499] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:49:58 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae => generated 637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:58.273727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7b9aa02-4266-4f2f-9152-e7c833c8aae9 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3fa5df70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:58.285914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:58.287250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:58.298772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:58.304612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:58.306715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:58.308223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:58.310122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:58.311160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:58.396409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f7b9aa02-4266-4f2f-9152-e7c833c8aae9 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:58.406239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f7b9aa02-4266-4f2f-9152-e7c833c8aae9 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:49:58.680168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:58.690215 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1c35af6-0ef6-4c27-af1c-8f4d924abd0d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1472 microversion: 2.1 time: 0.409987 Oct 06 12:49:58.690802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 244/500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:58 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:58.868584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:58.869206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:58.876445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:58.876969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:58.877282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:58.880931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:58.883346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:58.883807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:58.937671 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7b9aa02-4266-4f2f-9152-e7c833c8aae9 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.670140 Oct 06 12:49:58.947378 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 257/501] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:49:58 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:58.956276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21de6135-d278-4b88-b905-81dea5962060 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fa5db80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:59.265786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:59.276173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7df4e32e-57d1-4c4f-87e6-38657ba98883 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.412122 Oct 06 12:49:59.287407 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 245/502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:58 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:49:59.292507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:59.293444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:59.307583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:59.308182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:59.308714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:59.310193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:59.311708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:59.312353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:59.516607 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21de6135-d278-4b88-b905-81dea5962060 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "DELETE /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.566176 Oct 06 12:49:59.517193 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 258/503] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Oct 6 12:49:58 2022] DELETE /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_version => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:49:59.527595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8c895c-c5a5-4e01-91ab-f375d1f564d5", "tag": "90b09094-c4b1-4c24-bc58-eb3f87e3e9a2"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:59.574051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:59.574580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:59.575019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:59.594984 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] Creating event network-changed:90b09094-c4b1-4c24-bc58-eb3f87e3e9a2 for instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 on n-h2-860556-1 Oct 06 12:49:59.607085 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a4bfc91e-862a-414f-9027-b5b2707e5dbc req-00066283-fbf6-4ab1-b5e1-2cdc08af436f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083254 Oct 06 12:49:59.608986 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 259/504] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:49:59.623306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f28c6ea6-b758-4871-9ac7-5581d70ce8f4 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fb2a820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:59.689106 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f28c6ea6-b758-4871-9ac7-5581d70ce8f4 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 37 microversion: 2.1 time: 0.077453 Oct 06 12:49:59.695845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 260/505] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:49:59 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:49:59.723301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:49:59.736507 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63b5b8fd-661f-45ea-a745-ffefb660d963 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.446390 Oct 06 12:49:59.740929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 246/506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:59 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:49:59.742409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-843137fb-f6f9-4494-b313-eb47be7d76b6 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3fabcc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:49:59.762074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:49:59.763411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:49:59.778804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:59.779310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:59.779746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:59.790053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:49:59.791537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:49:59.793352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:49:59.846889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-843137fb-f6f9-4494-b313-eb47be7d76b6 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:49:59.869250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-843137fb-f6f9-4494-b313-eb47be7d76b6 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:00.159216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:00.427560 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-843137fb-f6f9-4494-b313-eb47be7d76b6 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.724765 Oct 06 12:50:00.428822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 261/507] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:49:59 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:00.438934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:00.442131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:00.455730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:00.456783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:00.460954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:00.463276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:00.464351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:00.464963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:00.625353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:00.641198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b4083a4d-a4d2-4739-a129-6139b32fdb61 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1472 microversion: 2.1 time: 0.896859 Oct 06 12:50:00.649034 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 247/508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:49:59 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1472 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:00.654343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c1f0dc7-6c96-4226-9140-b757c0b0d013 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fad5c10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:00.727195 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c1f0dc7-6c96-4226-9140-b757c0b0d013 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.076495 Oct 06 12:50:00.728237 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 248/509] 10.222.0.26 () {58 vars in 1290 bytes} [Thu Oct 6 12:50:00 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_distro => generated 33 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:00.990725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70c2ed42-962b-4ec7-a31f-93b18ca7f71f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3fcd0d30>, body: {"keypair": {"name": "tempest-keypair-1117906349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO+bFFCVhV4QjdQ+j6KQFPO3nlOLUWeBuXJOUhlXSJSDY89TqxGpDqutddp3YfA0S6+k57XvTThZHN7NEa+f7vWOdw/BQGr8vPPijDyKG9JsdpntgjnwzDLmZd1A3YIIA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:01.038218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-70c2ed42-962b-4ec7-a31f-93b18ca7f71f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:01.044210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-70c2ed42-962b-4ec7-a31f-93b18ca7f71f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:01.108676 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70c2ed42-962b-4ec7-a31f-93b18ca7f71f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.368611 Oct 06 12:50:01.110355 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 249/510] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:01.116904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30cc785c-a341-4432-8eb7-00642ed93a17 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3fd2d700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:01.186751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-30cc785c-a341-4432-8eb7-00642ed93a17 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:01.194069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-30cc785c-a341-4432-8eb7-00642ed93a17 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:01.359697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:01.371929 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-198be255-1546-4c2b-bd82-31925ed7218a tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.938808 Oct 06 12:50:01.378660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 262/511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:00 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:01.400112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:01.400610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:01.408400 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30cc785c-a341-4432-8eb7-00642ed93a17 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.296032 Oct 06 12:50:01.409543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 250/512] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:50:01 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:01.415863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1efac231-14f0-4965-b7be-d11bbdd84781 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3fd2d3a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:01.426071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1efac231-14f0-4965-b7be-d11bbdd84781 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1117906349" status: 200 len: 497 microversion: 2.1 time: 0.014960 Oct 06 12:50:01.427525 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 251/513] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 12:50:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1117906349 => generated 497 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:01.431005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:01.431522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:01.433451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ae117d0-8d27-4d35-8ed0-305676276bcb tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fa23430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:01.433921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:01.434912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:01.435199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:01.435643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:01.505046 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ae117d0-8d27-4d35-8ed0-305676276bcb tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.074542 Oct 06 12:50:01.506923 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 252/514] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:50:01 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:01.517100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f095067-c9ed-4e03-98b7-d7de756f729d tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3f9fa280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:01.542935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f095067-c9ed-4e03-98b7-d7de756f729d tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117906349" status: 202 len: 0 microversion: 2.1 time: 0.034587 Oct 06 12:50:01.543940 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 253/515] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 12:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117906349 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:01.549147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff6593f2-ce8b-4c79-b133-29dd27b8584d tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3f9878b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:01.640152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ff6593f2-ce8b-4c79-b133-29dd27b8584d tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:01.656210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ff6593f2-ce8b-4c79-b133-29dd27b8584d tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:01.986291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff6593f2-ce8b-4c79-b133-29dd27b8584d tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.440587 Oct 06 12:50:01.987594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 254/516] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:50:01 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:01.993011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e73f1d21-77e7-4965-90ab-18f7f9f33350 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3f9fa8b0>, body: {"keypair": {"name": "tempest-keypair-1254954067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt3CCdk8M6a8pyRwfYQWJ+UteIeVOkZDcgXtreqqaLaxLKGt8kXyiUwtl6eyc9gCOiu0Vhb9CFxZh5U8GmKQLaeIdN9rRp7YXhOXSSuGQ79CNzVH6IjZtzP6Axq5RwmbQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:02.034648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e73f1d21-77e7-4965-90ab-18f7f9f33350 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:02.046753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e73f1d21-77e7-4965-90ab-18f7f9f33350 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:02.114078 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e73f1d21-77e7-4965-90ab-18f7f9f33350 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124910 Oct 06 12:50:02.119507 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 255/517] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:02.132000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:02.134350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:02.177296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:02.180827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:02.184833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:02.185979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:02.186623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:02.187223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:02.232203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:02.242096 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bec94240-81ec-44c8-b459-8b90169e6013 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.846972 Oct 06 12:50:02.242690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 263/518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:01 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:02.250525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439d7e1d-5543-4a29-a765-a24020dcfc19", "tag": "752a21d3-2e35-4916-8fe2-25eebdd4701e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:02.272167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:02.272909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:02.273872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:02.300808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] Creating event network-changed:752a21d3-2e35-4916-8fe2-25eebdd4701e for instance 439d7e1d-5543-4a29-a765-a24020dcfc19 on n-h1-860556-1 Oct 06 12:50:02.315691 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-045dbc07-876b-45aa-be6e-7929a73bd36a req-14e7e0c0-7862-47d6-9871-af6708e08369 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071677 Oct 06 12:50:02.316315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 264/519] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:02.346729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8338d0a-95af-40be-9568-f6d96a08aac8 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3fbe94c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:02.453773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f8338d0a-95af-40be-9568-f6d96a08aac8 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:02.462410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f8338d0a-95af-40be-9568-f6d96a08aac8 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:02.620589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:02.638835 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1d28509f-73f2-451f-8283-238546d6fd10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1472 microversion: 2.1 time: 0.516657 Oct 06 12:50:02.639821 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 256/520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:02 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1472 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:02.658122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a45c9c9b-39e0-4042-bc03-268d6c6b91d6 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3f9d7af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:02.687180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a45c9c9b-39e0-4042-bc03-268d6c6b91d6 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254954067" status: 202 len: 0 microversion: 2.1 time: 0.044960 Oct 06 12:50:02.688778 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 257/521] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 12:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254954067 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:02.696268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:02.697345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:02.709432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:02.710247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:02.710897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:02.711977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:02.712644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:02.713281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:03.069292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:03.080974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-957b40dc-3771-41d2-8c14-58b065218a83 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.390756 Oct 06 12:50:03.098432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 258/522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:02 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:03.103961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-925b1ac8-b41a-4dc2-a1bf-c6652628b00f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3f987e50>, body: {"keypair": {"name": "tempest-keypair-1596067260", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:03.141821 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8338d0a-95af-40be-9568-f6d96a08aac8 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 64 microversion: 2.1 time: 0.824230 Oct 06 12:50:03.143681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 265/523] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:50:02 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 64 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:03.150842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-925b1ac8-b41a-4dc2-a1bf-c6652628b00f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:03.152969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9075c27-8e9c-405c-8dc8-6c73bb43f9d2 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fa5dd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:03.160340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-925b1ac8-b41a-4dc2-a1bf-c6652628b00f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:03.214210 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-925b1ac8-b41a-4dc2-a1bf-c6652628b00f tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.113597 Oct 06 12:50:03.216396 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 259/524] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:03 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:03.216980 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9075c27-8e9c-405c-8dc8-6c73bb43f9d2 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068023 Oct 06 12:50:03.218013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 266/525] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:50:03 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 64 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:03.233457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1a738a9-55f6-4fe1-a835-003e2133f2d4 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3fa8b940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:03.264555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1a738a9-55f6-4fe1-a835-003e2133f2d4 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596067260" status: 202 len: 0 microversion: 2.1 time: 0.038463 Oct 06 12:50:03.265913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 267/526] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 12:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596067260 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:03.274882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75f9211b-ba83-472b-8c59-a1e7027fae91 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3f9ef670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:03.374243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-75f9211b-ba83-472b-8c59-a1e7027fae91 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:03.383686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-75f9211b-ba83-472b-8c59-a1e7027fae91 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:03.733831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-69fb22f8-0986-421e-a0e3-4851c0c5f6c3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:03.757362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-69fb22f8-0986-421e-a0e3-4851c0c5f6c3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.530083 Oct 06 12:50:03.758048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 260/527] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:50:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:03.766922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:03.767582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:03.792621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:03.793116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:03.793550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:03.794479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:03.795231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:03.795810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:03.994103 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75f9211b-ba83-472b-8c59-a1e7027fae91 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.726430 Oct 06 12:50:03.999421 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 268/528] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:50:03 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:04.004579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6176a16-c7ea-41f3-ae02-ecabb99e60aa tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3f9ef790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1831250463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlOHZb/iBv3UiITZS3O9MbxlnG+tIN+LfRUDYSOtDKxZSLc1BoA00y/pNFXeIEL4dcw0TtUPegpaDUt3MwsmnbpHVSH95/oH7iBW7bpojnwwOgALohf/zN1SvSXnym2RQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:04.043091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=55 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:04.044465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f6176a16-c7ea-41f3-ae02-ecabb99e60aa tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:04.067496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f6176a16-c7ea-41f3-ae02-ecabb99e60aa tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:04.128350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:04.137450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d806cf0c-9931-49fa-93b9-1b0d252e4a9d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.378317 Oct 06 12:50:04.154147 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 261/529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:03 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:04.156258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6176a16-c7ea-41f3-ae02-ecabb99e60aa tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.155482 Oct 06 12:50:04.159301 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 269/530] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:04.169285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:04.169763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:04.176585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:04.177444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:04.178108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:04.179508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:04.180120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:04.180814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:04.516670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:04.528199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dff78d54-8b23-4693-9f65-2b8483d3364a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1472 microversion: 2.1 time: 0.372664 Oct 06 12:50:04.528782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 262/531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:04 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:04.534972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ea420a4-1015-4de1-897c-da7a5674d9ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update', calling method: .version_select at 0x7f7d3f9d7b80>, body: {"meta": {"os_version": "alt"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:04.595601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c513535-70e0-4363-be85-01414573848a tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1205990606", "id": 171029855, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:04.612433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3ea420a4-1015-4de1-897c-da7a5674d9ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:04.627185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3ea420a4-1015-4de1-897c-da7a5674d9ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:04.636868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c513535-70e0-4363-be85-01414573848a tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.476228 Oct 06 12:50:04.638146 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 270/532] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:04 2022] POST /compute/v2.1/flavors => generated 422 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:04.656176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:04.657847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:04.672182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:04.673229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:04.673948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:04.675038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:04.675683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:04.676220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:04.984615 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ea420a4-1015-4de1-897c-da7a5674d9ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.454308 Oct 06 12:50:04.985235 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 263/533] 10.222.0.26 () {60 vars in 1313 bytes} [Thu Oct 6 12:50:04 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata/os_version => generated 31 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:04.997201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9f039ef3-3378-4c98-9689-f21bd849a77e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3fcd0d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1138495871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEH+XpAPI2tR5J89Lm3Ja/E4JUgv9sVvIQBoajW68/g0KmJ8U/6xd6II8V08sww/+g/OT+50lJRhDzZbRFZT0ziJqt8UnIKpEw36Xe7GceTO2/tGYc6/anwvkc1FeZsRA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:05.047838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9f039ef3-3378-4c98-9689-f21bd849a77e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:05.053491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:05.058236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9f039ef3-3378-4c98-9689-f21bd849a77e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:05.067666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9c2c2c8-31f0-469e-85d2-1da9809321ac tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.428069 Oct 06 12:50:05.070446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 271/534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:04 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:05.076776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d24361e-3af1-4439-959f-991ed131496e", "name": "network-vif-plugged", "status": "completed", "tag": "55a445c2-3ad7-47c7-8fb2-0f570c1c52cf"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:05.086986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:05.091422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.092280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.092794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.098009 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9f039ef3-3378-4c98-9689-f21bd849a77e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.105845 Oct 06 12:50:05.099037 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 264/535] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:05.104262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dc5d624c-60e1-49af-8ad1-bbe16ef1b783 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:05.115970 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dc5d624c-60e1-49af-8ad1-bbe16ef1b783 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014393 Oct 06 12:50:05.115970 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 265/536] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:05.118006 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] Creating event network-vif-plugged:55a445c2-3ad7-47c7-8fb2-0f570c1c52cf for instance 9d24361e-3af1-4439-959f-991ed131496e on n-h2-860556-1 Oct 06 12:50:05.130051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b681c965-77c3-4015-be36-a0fc1a2961ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fc20790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:05.131192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bda0af8e-7f51-4c1b-b416-0d06ddb7684d req-3554f72a-a290-4da2-a5b2-0ecac7222d61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053746 Oct 06 12:50:05.131828 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 272/537] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:05.206817 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b681c965-77c3-4015-be36-a0fc1a2961ee tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 58 microversion: 2.1 time: 0.089941 Oct 06 12:50:05.207963 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 266/538] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 58 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:05.220445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1eb107d-e703-453f-b3d0-e9bf9d2d01ff tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Action: 'create', calling method: .version_select at 0x7f7d3fa23940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-581764446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz7eZKecYEiAA9dqw79GT2yNvpw7FR7yBJMgxA2EURnxyabY6ub4nNrp7Cl4JQ8o6DzDAy2NNMsC1TiHPj3bV+ujzllMw6MEwLmvRz3PHFcQO5/l05IWhMjwAOHaXzB2A=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:05.241354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b1eb107d-e703-453f-b3d0-e9bf9d2d01ff tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:05.248654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b1eb107d-e703-453f-b3d0-e9bf9d2d01ff tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Getting quotas for user 95cf583868fd49098b50c0e7c026d42c and project be3724f1b2de4be0930b6d90d5164933. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:05.288859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1eb107d-e703-453f-b3d0-e9bf9d2d01ff tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.070053 Oct 06 12:50:05.290894 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 267/539] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:05.308150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bea8d073-4920-4a11-9a64-0d1e9ccec001 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-953043598", "id": 632761852, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:05.347088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bea8d073-4920-4a11-9a64-0d1e9ccec001 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.053602 Oct 06 12:50:05.347975 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 268/540] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:05 2022] POST /compute/v2.1/flavors => generated 421 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:05.353963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:05.355649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:05.363247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.364398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.367224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.368339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.369107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.370011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.386883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9fbb80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:05.389519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.390038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.390475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.434021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.434781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.435388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.460575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:05.464065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:05.465159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:05.481866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3f57ac9f-3e4f-4502-b502-4683072591bd tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.342365 Oct 06 12:50:05.483185 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 273/541] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:05.490220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fbf8a215-fd11-40ab-8ed4-71297452f999 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'update_all', calling method: .version_select at 0x7f7d3f9fbaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:05.565087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fbf8a215-fd11-40ab-8ed4-71297452f999 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:05.573050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fbf8a215-fd11-40ab-8ed4-71297452f999 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:05.948469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fbf8a215-fd11-40ab-8ed4-71297452f999 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 61 microversion: 2.1 time: 0.463706 Oct 06 12:50:05.953638 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 274/542] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:50:05 2022] PUT /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 61 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:05.961304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0b00002-5ef1-4fc8-922b-b14736fdaf7a tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3f9fb310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:05.973343 n-d-860556-1 devstack@n-api.service[129615]: WARNING oslo_db.sqlalchemy.utils [None req-a0b00002-5ef1-4fc8-922b-b14736fdaf7a tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 12:50:05.992254 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0b00002-5ef1-4fc8-922b-b14736fdaf7a tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.041168 Oct 06 12:50:05.995268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 275/543] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:06.006832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48eb03d1-0386-416c-a679-2f85b497dcbb tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:06.024755 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48eb03d1-0386-416c-a679-2f85b497dcbb tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028341 Oct 06 12:50:06.025347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 276/544] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:06.037973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:06.038496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9ef160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:06.040311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:06.040800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:06.041237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:06.051985 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01b82027-ff64-449b-b362-ef63ca79039f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.702644 Oct 06 12:50:06.068091 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 269/545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:05 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:06.077265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:06.078098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:06.079031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:06.082262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:06.082718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:06.096580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:06.097589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:06.098345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:06.099864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:06.100471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:06.101058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:06.107568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:RELEASE=2,nova_api:SELECT=93,nova_api:SAVEPOINT=1,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:06.117051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:06.117602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:06.118078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:06.139892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25544b67-3f41-4579-bc05-9add8a95dcda tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.113427 Oct 06 12:50:06.140674 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 277/546] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 12:50:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:06.157509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e124777-0490-481e-83af-76d515932bb0 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Action: 'create', calling method: .version_select at 0x7f7d3f9fbe50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:06.244441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9e124777-0490-481e-83af-76d515932bb0 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:06.264328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9e124777-0490-481e-83af-76d515932bb0 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Getting quotas for user e0428b0599894e6e8d2f9bbf391b2a1e and project 92886247a164471aaa89ec1426c3de92. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:06.821630 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e124777-0490-481e-83af-76d515932bb0 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "POST /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 85 microversion: 2.1 time: 0.678404 Oct 06 12:50:06.822825 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 278/547] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Oct 6 12:50:06 2022] POST /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 85 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:06.835776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1be7ba67-739c-4baa-8677-f125d3c57b6e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3f9fb040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:06.874024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1be7ba67-739c-4baa-8677-f125d3c57b6e tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581764446" status: 202 len: 0 microversion: 2.1 time: 0.049664 Oct 06 12:50:06.878430 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 279/548] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:50:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581764446 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:06.889655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16bfe74b-8e26-4ff1-abe6-8ceb221691cc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Action: 'create', calling method: .version_select at 0x7f7d3f9ef280>, body: {"keypair": {"name": "tempest-keypair-2103053056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMebICbbG1oO3yFOsPjt4sfwmOh06H8m8KmnT4ola1n4dyDfOxlkcJLqkWIC/Z64FAt36BqSPod/EV/r+nEEkNDM6jCTNt+fS77dbLmVtpKsx+AsoVKv8aI3+C3z2atHw=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:06.944383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-16bfe74b-8e26-4ff1-abe6-8ceb221691cc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:06.950751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-16bfe74b-8e26-4ff1-abe6-8ceb221691cc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for user c26ae4c4eac2418b8df09afc8ab0b5b5 and project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:06.961011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:06.974238 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33e49bd9-1e3c-4fcd-9753-8228220423c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.904767 Oct 06 12:50:06.975505 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 270/549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:06 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:06.984965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:06.987828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:07.011819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.012023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16bfe74b-8e26-4ff1-abe6-8ceb221691cc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131439 Oct 06 12:50:07.012454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.013245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.013541 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 280/550] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:50:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:07.014264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.014959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.015576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.022759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3fa8b8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:07.025291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.025994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.026756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.050655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.052865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.053500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.062347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:07.079107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.080439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.081136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.092784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56772f1b-a94c-4492-bece-41ef2e18f46c tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.077798 Oct 06 12:50:07.093477 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 281/551] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:07.103187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91b69cf3-0672-4c16-815f-51a8b7bf2b03 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] Calling method '.version_select at 0x7f7d3fa8b700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:07.169559 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91b69cf3-0672-4c16-815f-51a8b7bf2b03 tempest-ImagesMetadataTestJSON-6222397 tempest-ImagesMetadataTestJSON-6222397-project] 10.222.0.26 "GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata" status: 200 len: 85 microversion: 2.1 time: 0.071619 Oct 06 12:50:07.170210 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 282/552] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:50:07 2022] GET /compute/v2.1/images/7f2bdc57-77f7-4090-baec-9ebec1e389ae/metadata => generated 85 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:50:07.186645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f98329f-1a7a-43fa-acd6-576baf07b856 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3fb2a820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:07.236210 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f98329f-1a7a-43fa-acd6-576baf07b856 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1138495871" status: 202 len: 0 microversion: 2.1 time: 0.062788 Oct 06 12:50:07.245511 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 283/553] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Oct 6 12:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1138495871 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:07.262179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:07.263080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:07.270196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.270938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.272078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:07.272797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:07.273250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:07.273793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.059124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:08.062909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:08.070399 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e54514d6-b67b-4802-866d-656890315dfd tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 1.093631 Oct 06 12:50:08.075683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 271/554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:06 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:08.103757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3fc8d040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.116335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.126807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.127301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.130466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:08.144955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0ed08ce-b679-47a4-b4d5-1e595dbfe927 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1318 microversion: 2.1 time: 0.885798 Oct 06 12:50:08.148130 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 284/555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:07 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:08.162953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-059a5b50-b3c6-41e3-9188-a363b5b56fb5 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] Calling method '.version_select at 0x7f7d3fa5dee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.184932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.185524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.186014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.212000 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-059a5b50-b3c6-41e3-9188-a363b5b56fb5 tempest-KeyPairsV2TestJSON-1487563829 tempest-KeyPairsV2TestJSON-1487563829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1831250463" status: 202 len: 0 microversion: 2.1 time: 0.060036 Oct 06 12:50:08.212947 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 285/556] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Oct 6 12:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1831250463 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:50:08.223094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.227577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:08.229993 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57e5969d-b1df-4cf9-bb35-c282bfc3eed9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.151659 Oct 06 12:50:08.230630 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 272/557] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:08.245343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.249144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.251498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.253671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.256150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.257787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.258540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-817a9630-d1ed-44a2-930b-4fb42ff99cc3 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9faaf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.265096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-817a9630-d1ed-44a2-930b-4fb42ff99cc3 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.265809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-817a9630-d1ed-44a2-930b-4fb42ff99cc3 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.266430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-817a9630-d1ed-44a2-930b-4fb42ff99cc3 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.300291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-817a9630-d1ed-44a2-930b-4fb42ff99cc3 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.053977 Oct 06 12:50:08.313632 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 273/558] 10.222.0.26 () {58 vars in 1179 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:08.318691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3fb0e160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.326043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.328340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.330472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.358611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.360661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.362676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.379436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.379926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.380393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.397812 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-693fe2dd-4ff5-45cf-abde-118f6d597bd9 tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082670 Oct 06 12:50:08.398658 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 274/559] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:08.419765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9fa940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.423823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.431216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.433883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.472312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.472813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.473356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.490621 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2315b7aa-0b7a-49f2-83c0-192cf62518be tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.083128 Oct 06 12:50:08.491355 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 275/560] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:08.506013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9fa280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.508988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.509796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.510668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.526745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.527962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.530034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.550438 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e1bea7c4-ee2b-42e4-9a96-925e6a5f50cc tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.044142 Oct 06 12:50:08.551110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 276/561] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:08.565569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Calling method '.version_select at 0x7f7d3f9fa8b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:08.567729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.568679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.569391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.593756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.596003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.596981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.628893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:08.631146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:08.634297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:08.673799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:08.681961 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18264136-7db8-4d11-a7c2-753fde4acf6f tempest-HypervisorAdminTestJSON-107653397 tempest-HypervisorAdminTestJSON-107653397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.119441 Oct 06 12:50:08.682715 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 277/562] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:50:08.698161 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0486e8e9-268b-4346-9729-49f4c99805a8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.483065 Oct 06 12:50:08.699896 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 286/563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:08 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:09.107656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:09.110401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:09.136318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.136842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.137296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.143993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.144525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.147094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.173258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:09.173949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:09.190703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.195450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.196475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.201775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.201963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.202409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.914590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:09.925057 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b6ade18-7cf6-404c-9eb7-5375bf46a05b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1468 microversion: 2.1 time: 0.755810 Oct 06 12:50:09.928198 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 287/564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:09 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1468 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:50:09.934114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:09.935021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:09.942599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.944006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.944687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.945652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:09.946745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:09.947512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:09.947863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:09.955777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-173be5c1-1371-42bb-a77b-b32b8fff85e7 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.853064 Oct 06 12:50:09.966258 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 278/565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:09 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:09.971102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d7e1d-5543-4a29-a765-a24020dcfc19", "name": "network-vif-plugged", "status": "completed", "tag": "752a21d3-2e35-4916-8fe2-25eebdd4701e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:09.992547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:10.002809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:10.002809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:10.017596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] Creating event network-vif-plugged:752a21d3-2e35-4916-8fe2-25eebdd4701e for instance 439d7e1d-5543-4a29-a765-a24020dcfc19 on n-h1-860556-1 Oct 06 12:50:10.024672 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1d394369-7da4-49f0-88ad-f4f31d72a662 req-f5d90085-16b3-45cf-a5e4-0834994220be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056465 Oct 06 12:50:10.025294 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 279/566] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:10.032567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:10.035396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:10.043024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:10.043732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:10.044365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:10.046782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:10.047536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:10.049866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:10.824513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:10.831683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d06e1616-feae-4dfa-955d-784cbeacf342 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.902197 Oct 06 12:50:10.832263 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 288/567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:09 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:10.838104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2072322926", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "632761852", "adminPass": "***", "networks": [{"uuid": "2678a938-277f-419d-a5e8-c3914bbe8024"}], "security_groups": [{"name": "tempest-securitygroup--1513720068"}], "key_name": "tempest-keypair-2103053056", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:10.924626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:10.933359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-668e3396-13df-4eba-bf9c-e6ae3f65e6b9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1318 microversion: 2.1 time: 0.906696 Oct 06 12:50:10.934073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 280/568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:10 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:11.010854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:11.011722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:11.033623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:11.033623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:11.033623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:11.042043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:11.042560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:11.043689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:11.109284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] validate_networks() for [('2678a938-277f-419d-a5e8-c3914bbe8024', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:11.734135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:11.747929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8cfaa3ae-5118-4acd-8ceb-44825a3df3e8 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1321 microversion: 2.1 time: 0.756542 Oct 06 12:50:11.761778 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 281/569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:10 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1321 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:11.857162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:11.858040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:11.872411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:11.874014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:11.874564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:11.875295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:11.875901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:11.876554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.613251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:12.623462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be752e81-e11c-4492-ab6a-3d951947df90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.771261 Oct 06 12:50:12.627096 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 282/570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:11 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:12.654090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:12.654944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:12.664997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.670487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.682167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.682755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.683232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.683666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.699234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:50:12.699860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:50:12.700879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:50:12.701713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:50:12.702429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:50:12.722703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.723196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.723631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.724417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.725535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.727136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.779135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:12.795602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for user c26ae4c4eac2418b8df09afc8ab0b5b5 and project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:12.826373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:50:12.828747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:12.922541 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93d2529c-c809-41c2-a480-710a91ca0e35 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.088289 Oct 06 12:50:12.924014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 289/571] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:50:12.934742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c895c-c5a5-4e01-91ab-f375d1f564d5", "name": "network-vif-plugged", "status": "completed", "tag": "90b09094-c4b1-4c24-bc58-eb3f87e3e9a2"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:12.947791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.948822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.949719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.967055 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] Creating event network-vif-plugged:90b09094-c4b1-4c24-bc58-eb3f87e3e9a2 for instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 on n-h2-860556-1 Oct 06 12:50:12.973889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a3d36621-afdf-4f5f-a349-e1cc27cf4066 req-f94add97-f0d5-482f-b893-4c1c41d59023 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048422 Oct 06 12:50:12.975392 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 290/572] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:12.983816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:12.986531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:12.994723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.995566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.996218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:12.997422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:12.998069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:12.998676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.129339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:13.144339 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fae8e2f7-a7d1-4f83-8cff-0f3a6c3d6005 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1318 microversion: 2.1 time: 0.515614 Oct 06 12:50:13.145205 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 283/573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:12 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:13.150916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-246ed333-5a98-422c-9e8e-7344c1b7ca7e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:13.151781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-246ed333-5a98-422c-9e8e-7344c1b7ca7e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:13.576025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-246ed333-5a98-422c-9e8e-7344c1b7ca7e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:13.586818 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-246ed333-5a98-422c-9e8e-7344c1b7ca7e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1263 microversion: 2.1 time: 0.438377 Oct 06 12:50:13.587863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 284/574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:13 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1263 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:13.665142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:13.665781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:13.687462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.688280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.688946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.689902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.690551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.691179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.761398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:13.770837 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cd29734a-97f8-40f3-a15b-ff6126183260 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1470 microversion: 2.1 time: 0.793949 Oct 06 12:50:13.775114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 291/575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:12 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1470 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:13.805558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:13.806328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:13.816251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.820712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.821279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.822129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.822683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.823286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.855568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lazy-loading 'flavor' on Instance uuid 439d7e1d-5543-4a29-a765-a24020dcfc19 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:50:13.950743 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4bbc905e-bb17-41a3-84e5-b1318b3c41e9 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19/action" status: 202 len: 0 microversion: 2.1 time: 0.150368 Oct 06 12:50:13.966328 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 292/576] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:50:13 2022] POST /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:50:13.971717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:13.972623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:13.988313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.988862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.989302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:13.990760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:13.991215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:13.993557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:14.382637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:14.397310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1544ac42-e7ad-4d83-ad93-f2a00e92ecd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.737129 Oct 06 12:50:14.403435 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 285/577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:13 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:14.421163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:14.422229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:14.430839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:14.431703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:14.432915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:14.435414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:14.436135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:14.436707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:15.065366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:15.075458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e3ca222-b5f2-4b65-aca5-daed451e2f1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1318 microversion: 2.1 time: 0.670091 Oct 06 12:50:15.080259 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 286/578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:14 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:15.089234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:15.097619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:15.110982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:15.111505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:15.111962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:15.112698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:15.113150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:15.113585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:15.174289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cde5c9f7-3c0a-4a7f-ba8c-8550417aa5e0 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1629 microversion: 2.1 time: 1.206438 Oct 06 12:50:15.197936 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 293/579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:13 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1629 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:15.303194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:15.340207 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1cd9dbca-4c7f-4338-8f26-bd2a1fd2a0c5 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1323 microversion: 2.1 time: 0.252690 Oct 06 12:50:15.354536 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 287/580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:15 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:15.424564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:15.425520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:15.449776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:15.451949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:15.455155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:15.459260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:15.460257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:15.462189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:15.709468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:15.716737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85c7e2f6-8133-4229-8088-5594c4b32b72 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.298848 Oct 06 12:50:15.721880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 294/581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:15 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:16.107607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:16.108604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:16.117722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.118755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.119672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.120983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.122104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.123121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.209763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:16.210633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:16.220982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.223089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.223670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.238405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.242863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.243498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.419428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:16.430082 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fb78b10e-b23d-40fd-95ca-82d2b59954b5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1468 microversion: 2.1 time: 0.328256 Oct 06 12:50:16.446241 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 288/582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:16 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1468 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:16.644308 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-242cc1b0-a7bb-4e5c-9dd3-4c15cfdb42ad tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1612 microversion: 2.1 time: 0.438442 Oct 06 12:50:16.664264 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 295/583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:16 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1612 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:16.676796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:16.678540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:16.706342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.710283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.711401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.712235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.713161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.716566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.931962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:16.944877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9468b4b3-8a21-4f46-b36a-d8a37b59ecac tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Calling method '.version_select at 0x7f7d3f9d7940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:16.947398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9468b4b3-8a21-4f46-b36a-d8a37b59ecac tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c97587e2d3d542faadc4c73a2fac50d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a886219b38416e9f6b79f0519daea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9468b4b3-8a21-4f46-b36a-d8a37b59ecac tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Request method failure captured: Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8H6hY1phVLc5_3Bj9MBMUfBG5epopH9tx1mCfRF-6rsDu_R88b9pDTuShQUtLh5Xzglu6QtxcqxMiizJMpjIc2EWy-LrKaAsWmD-vTUEgUnNUHeVwwEDv4hpnqxV6yB5zeJAEnWTnotSvA9P6x_qHbybR_UDxIcMXkHICQQW0z7EU Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:50:16.949355 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1a886219b38416e9f6b79f0519daea4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}] Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c97587e2d3d542faadc4c73a2fac50d5 Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:50:16.950812 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:50:16.951615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 06 12:50:16.952763 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:16.958215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9468b4b3-8a21-4f46-b36a-d8a37b59ecac tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:16.960739 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9468b4b3-8a21-4f46-b36a-d8a37b59ecac tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.512891 Oct 06 12:50:16.961473 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ec51e3f-d592-43b0-bed5-aa706655eb3e tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1321 microversion: 2.1 time: 0.292376 Oct 06 12:50:16.963448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 289/584] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 12:50:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 516 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:16.965018 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 296/585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:16 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:16.971544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:16.974242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:16.976514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:16.982493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:16.989033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Searching by: {'reservation_id': 'r-laxhvw1p', 'deleted': False, 'project_id': '9ca94e746fcb426887d292336801aa0d'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:50:16.991775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:16.995554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:16.996476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:16.999325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.002053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.002744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.015174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.016207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.017056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.018772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.019443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.020082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.129465 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] HTTP exception thrown: Cannot 'migrate' instance 439d7e1d-5543-4a29-a765-a24020dcfc19 while it is in vm_state suspended Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Request method failure captured: Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19/action HTTP/1.1 Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 15 Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7RXb7ldWwqMQIw9ak31NbGAHRIxzOQyDxQ1HH8w4Tf5QXOHeZeZ4AWG4fCSCneUj5Dg0vDI9x1I3t-q_ZpxkfvdHhePbqr2JDU5C_35DMW8XAuQ__g9KidugJ99eGfoAdkPz32uz5pC76piA9L7un6BzSrprWfeFcsmN7RJ7x9ebI Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:50:17.132860 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8424e33304bc4182a46847d49e7755ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}] Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 916e6eca3836487c8d7a436ee0f140ea Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: {"migrate": {}} Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:50:17.134294 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'migrate' instance 439d7e1d-5543-4a29-a765-a24020dcfc19 while it is in vm_state suspended Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '439d7e1d-5543-4a29-a765-a24020dcfc19', 'body': {'migrate': {}}} Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 in vm_state suspended. Cannot resize while the instance is in this state. Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.135087 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 439d7e1d-5543-4a29-a765-a24020dcfc19 while it is in vm_state suspended Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.136259 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.137382 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:17.137382 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:17.137382 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 439d7e1d-5543-4a29-a765-a24020dcfc19 while it is in vm_state suspended Oct 06 12:50:17.137382 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.140253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Returning 409 to user: Cannot 'migrate' instance 439d7e1d-5543-4a29-a765-a24020dcfc19 while it is in vm_state suspended {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.141579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-326472cf-975f-4ef1-97d2-a23bdb989935 tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19/action" status: 409 len: 148 microversion: 2.1 time: 0.175047 Oct 06 12:50:17.142753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 297/586] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:50:16 2022] POST /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19/action => generated 148 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:50:17.149626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:17.151571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:17.161009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.162070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.162753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.163772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.164479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.165125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.324030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:50:17.436624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=37 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:17.442079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:17.468054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:17.470567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:17.471516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:17.574071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:17.598781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d77232f3-ec80-452b-84a0-580d80b8d16e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.454258 Oct 06 12:50:17.602849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 298/587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:17 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:17.622874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0093963d-33ea-427f-be9d-9a120d04971d tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Calling method '.version_select at 0x7f7d3fb2adc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:17.625160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0093963d-33ea-427f-be9d-9a120d04971d tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c97587e2d3d542faadc4c73a2fac50d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a886219b38416e9f6b79f0519daea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0093963d-33ea-427f-be9d-9a120d04971d tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Request method failure captured: Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8H6hY1phVLc5_3Bj9MBMUfBG5epopH9tx1mCfRF-6rsDu_R88b9pDTuShQUtLh5Xzglu6QtxcqxMiizJMpjIc2EWy-LrKaAsWmD-vTUEgUnNUHeVwwEDv4hpnqxV6yB5zeJAEnWTnotSvA9P6x_qHbybR_UDxIcMXkHICQQW0z7EU Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:50:17.626809 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1a886219b38416e9f6b79f0519daea4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}] Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c97587e2d3d542faadc4c73a2fac50d5 Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: action_args: {} Oct 06 12:50:17.628313 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:50:17.629076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 06 12:50:17.630273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.637483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0093963d-33ea-427f-be9d-9a120d04971d tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.640100 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0093963d-33ea-427f-be9d-9a120d04971d tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.036181 Oct 06 12:50:17.648472 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 299/588] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:17 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:17.663029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e383382-e833-465b-a37a-0ded826e649d tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e383382-e833-465b-a37a-0ded826e649d tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Request method failure captured: Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action HTTP/1.1 Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 39 Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7RXb7ldWwqMQIw9ak31NbGAHRIxzOQyDxQ1HH8w4Tf5QXOHeZeZ4AWG4fCSCneUj5Dg0vDI9x1I3t-q_ZpxkfvdHhePbqr2JDU5C_35DMW8XAuQ__g9KidugJ99eGfoAdkPz32uz5pC76piA9L7un6BzSrprWfeFcsmN7RJ7x9ebI Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:50:17.683608 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8424e33304bc4182a46847d49e7755ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}] Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 916e6eca3836487c8d7a436ee0f140ea Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: {"os-resetState": {"state": "invalid"}} Oct 06 12:50:17.685506 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f8c3d91b-a212-403e-a006-070e838f3735', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'invalid' Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.686613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:50:17.688813 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 06 12:50:17.690733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.691842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e383382-e833-465b-a37a-0ded826e649d tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.695921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e383382-e833-465b-a37a-0ded826e649d tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action" status: 400 len: 144 microversion: 2.1 time: 0.043138 Oct 06 12:50:17.705848 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 300/589] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:50:17 2022] POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action => generated 144 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:50:17.725434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0df7598-023c-47bc-b193-365f3c091252 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Calling method '.version_select at 0x7f7d3fa8b8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:17.730205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0df7598-023c-47bc-b193-365f3c091252 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c97587e2d3d542faadc4c73a2fac50d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a886219b38416e9f6b79f0519daea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0df7598-023c-47bc-b193-365f3c091252 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Request method failure captured: Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8H6hY1phVLc5_3Bj9MBMUfBG5epopH9tx1mCfRF-6rsDu_R88b9pDTuShQUtLh5Xzglu6QtxcqxMiizJMpjIc2EWy-LrKaAsWmD-vTUEgUnNUHeVwwEDv4hpnqxV6yB5zeJAEnWTnotSvA9P6x_qHbybR_UDxIcMXkHICQQW0z7EU Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:50:17.731925 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1a886219b38416e9f6b79f0519daea4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}] Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c97587e2d3d542faadc4c73a2fac50d5 Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: action_args: {} Oct 06 12:50:17.733279 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:50:17.734069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 06 12:50:17.735314 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.737353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0df7598-023c-47bc-b193-365f3c091252 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.737353 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0df7598-023c-47bc-b193-365f3c091252 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026389 Oct 06 12:50:17.737353 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 301/590] 10.222.0.26 () {58 vars in 1179 bytes} [Thu Oct 6 12:50:17 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:17.759772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2117201a-3ce5-49fe-991b-15ee739eab2a tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2117201a-3ce5-49fe-991b-15ee739eab2a tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Request method failure captured: Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action HTTP/1.1 Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 31 Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7RXb7ldWwqMQIw9ak31NbGAHRIxzOQyDxQ1HH8w4Tf5QXOHeZeZ4AWG4fCSCneUj5Dg0vDI9x1I3t-q_ZpxkfvdHhePbqr2JDU5C_35DMW8XAuQ__g9KidugJ99eGfoAdkPz32uz5pC76piA9L7un6BzSrprWfeFcsmN7RJ7x9ebI Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:50:17.767454 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8424e33304bc4182a46847d49e7755ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}] Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 916e6eca3836487c8d7a436ee0f140ea Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: {"os-resetState": {"state": 1}} Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:50:17.769215 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f8c3d91b-a212-403e-a006-070e838f3735', 'body': {'os-resetState': {'state': 1}}} Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 1 Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.770094 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 06 12:50:17.772004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.773072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2117201a-3ce5-49fe-991b-15ee739eab2a tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.773072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2117201a-3ce5-49fe-991b-15ee739eab2a tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action" status: 400 len: 120 microversion: 2.1 time: 0.034438 Oct 06 12:50:17.775106 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 302/591] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:50:17 2022] POST /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:50:17.921614 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41f1f736-1241-4db8-a6e3-cd7a2a9757b2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-laxhvw1p" status: 200 len: 2929 microversion: 2.1 time: 0.956858 Oct 06 12:50:17.922233 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 290/592] 10.222.0.26 () {58 vars in 1197 bytes} [Thu Oct 6 12:50:16 2022] GET /compute/v2.1/servers/detail?reservation_id=r-laxhvw1p => generated 2929 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:17.938862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:17.943325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Failed to fetch instance by id 999 {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:50:17.944211 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Request method failure captured: Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 37 Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7RXb7ldWwqMQIw9ak31NbGAHRIxzOQyDxQ1HH8w4Tf5QXOHeZeZ4AWG4fCSCneUj5Dg0vDI9x1I3t-q_ZpxkfvdHhePbqr2JDU5C_35DMW8XAuQ__g9KidugJ99eGfoAdkPz32uz5pC76piA9L7un6BzSrprWfeFcsmN7RJ7x9ebI Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:50:17.946220 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8424e33304bc4182a46847d49e7755ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8424e33304bc4182a46847d49e7755ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8424e33304bc4182a46847d49e7755ae"}]}] Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 8424e33304bc4182a46847d49e7755ae Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-614932217 Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 916e6eca3836487c8d7a436ee0f140ea Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-614932217-project-admin Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: {"os-resetState": {"state": "error"}} Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:50:17.947554 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 999 could not be found. Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:50:17.948450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 06 12:50:17.949715 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:17.951957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:17.952924 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0ce45fd0-7734-4138-b9a0-b59c5b6714cb tempest-ServersAdminNegativeTestJSON-614932217 tempest-ServersAdminNegativeTestJSON-614932217-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025028 Oct 06 12:50:17.953584 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 291/593] 10.222.0.26 () {60 vars in 1179 bytes} [Thu Oct 6 12:50:17 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:50:17.987252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.056056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.server_groups [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Querying cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) for 2 instances {{(pid=129614) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 06 12:50:18.058884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.059525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.064161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.157470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50671d0a-3ef8-49e0-a2fd-2dba15dfd33f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/15718a84-c605-46a3-a3b3-13ee0a8a920d" status: 200 len: 266 microversion: 2.1 time: 0.202677 Oct 06 12:50:18.158877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 292/594] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:50:17 2022] GET /compute/v2.1/os-server-groups/15718a84-c605-46a3-a3b3-13ee0a8a920d => generated 266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:18.169163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.170028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:18.181081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.182015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.182718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.183621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.184687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.185763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.220116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Calling method '.version_select at 0x7f7d3fa5dc10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.229727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.230314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.230771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.231945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:18.240541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:50:18.280446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.281235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.281903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.303567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.304508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.305264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.330486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3daeb49-990e-47c9-849c-eee6821aad09 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.538208 Oct 06 12:50:18.331498 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 303/595] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:18.355366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.356490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:18.364649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.365345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.366016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.367028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.367636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.368222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.433864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa3fdfeb-4513-4069-98fd-7730c80c4f2c tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 204 len: 0 microversion: 2.1 time: 0.273243 Oct 06 12:50:18.435240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 293/596] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:50:18 2022] DELETE /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:50:18.444993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.447011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:18.455031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.455818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.456417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.457645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.458390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.459484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.709567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:18.719947 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec6a77e0-4081-40ff-8899-8d285c025829 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.376765 Oct 06 12:50:18.721392 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 304/597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:18 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:18.727761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e10b819-7d98-4451-9cd3-2ceb4e1f4409 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Calling method '.version_select at 0x7f7d3fd338b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.729985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e10b819-7d98-4451-9cd3-2ceb4e1f4409 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c97587e2d3d542faadc4c73a2fac50d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a886219b38416e9f6b79f0519daea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e10b819-7d98-4451-9cd3-2ceb4e1f4409 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Request method failure captured: Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8H6hY1phVLc5_3Bj9MBMUfBG5epopH9tx1mCfRF-6rsDu_R88b9pDTuShQUtLh5Xzglu6QtxcqxMiizJMpjIc2EWy-LrKaAsWmD-vTUEgUnNUHeVwwEDv4hpnqxV6yB5zeJAEnWTnotSvA9P6x_qHbybR_UDxIcMXkHICQQW0z7EU Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:50:18.731926 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1a886219b38416e9f6b79f0519daea4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}] Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c97587e2d3d542faadc4c73a2fac50d5 Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1'} Oct 06 12:50:18.733204 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:50:18.734009 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 06 12:50:18.735180 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:18.740624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e10b819-7d98-4451-9cd3-2ceb4e1f4409 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:18.744025 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e10b819-7d98-4451-9cd3-2ceb4e1f4409 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019330 Oct 06 12:50:18.752604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 305/598] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Oct 6 12:50:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:18.760035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.761324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:18.770335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.771065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.771739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.773333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.774026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.774649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.780071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:18.791945 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c5a3a12-4388-4375-ad11-195446dbf160 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1619 microversion: 2.1 time: 0.346356 Oct 06 12:50:18.793048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 294/599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:18 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1619 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:18.799311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:18.800124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:18.832694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.833524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.840079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:18.841025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:18.841654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:18.842925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.063075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:19.075357 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b97497e-36c7-4da3-bfe4-41b7007a4fdb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1467 microversion: 2.1 time: 0.320262 Oct 06 12:50:19.078383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 306/600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:18 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1467 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:19.101903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13e93c10-234a-4bc4-aa21-02f36c7a7c71 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Calling method '.version_select at 0x7f7d3fa5ddc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.104770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-13e93c10-234a-4bc4-aa21-02f36c7a7c71 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] HTTP exception thrown: Hypervisor with ID 'f6eb3999-2d26-479d-bd86-4cde252be783' could not be found. Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13e93c10-234a-4bc4-aa21-02f36c7a7c71 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Request method failure captured: Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-hypervisors/f6eb3999-2d26-479d-bd86-4cde252be783/uptime HTTP/1.1 Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8ICN5HJm4FhDWsHeu2Pkv7tsbbZwvebuvng0p-K3mZUhHxB5_SZVOkchNDPaVTzX2_om0vUA7LMjahIsXSCuLLo_dAsvJpTtjZsH4HtqjyiFehrBkpviWRw_lFoPP_p05NRVcWkrZYdRlR6dI9JexxNwIJyL0Wb4rCRiDeSYGmitE Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 373490e308f945dd8b2c11603036e52f Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:50:19.115806 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_373490e308f945dd8b2c11603036e52f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/373490e308f945dd8b2c11603036e52f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/373490e308f945dd8b2c11603036e52f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/373490e308f945dd8b2c11603036e52f"}]}] Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 373490e308f945dd8b2c11603036e52f Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 964b783b70a944778c17fd63df735035 Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: exception: Hypervisor with ID 'f6eb3999-2d26-479d-bd86-4cde252be783' could not be found. Oct 06 12:50:19.117203 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f6eb3999-2d26-479d-bd86-4cde252be783'} Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f6eb3999-2d26-479d-bd86-4cde252be783' Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 06 12:50:19.118029 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f6eb3999-2d26-479d-bd86-4cde252be783' could not be found. Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.119912 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f6eb3999-2d26-479d-bd86-4cde252be783' could not be found. Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13e93c10-234a-4bc4-aa21-02f36c7a7c71 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Returning 404 to user: Hypervisor with ID 'f6eb3999-2d26-479d-bd86-4cde252be783' could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:19.121168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13e93c10-234a-4bc4-aa21-02f36c7a7c71 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/f6eb3999-2d26-479d-bd86-4cde252be783/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020144 Oct 06 12:50:19.129619 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 307/601] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/os-hypervisors/f6eb3999-2d26-479d-bd86-4cde252be783/uptime => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:19.134893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.140200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:19.148614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.149935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.150530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.151582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.152213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.152899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.158637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:19.190732 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d426275-edaa-4fb4-aba8-48f409316fd5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.396144 Oct 06 12:50:19.193624 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 295/602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:18 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:19.220302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Calling method '.version_select at 0x7f7d3fdbeaf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.228272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.228998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.229601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.263961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.264528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.264973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.302727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.309545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.313623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.332951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f6a4eb4-0dfa-46bc-b963-b848a581fe30 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.117189 Oct 06 12:50:19.335392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 296/603] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:19.351004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56bcac7a-42e9-48cf-8a8b-29e330d1e754 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Calling method '.version_select at 0x7f7d3f901dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.357887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56bcac7a-42e9-48cf-8a8b-29e330d1e754 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c97587e2d3d542faadc4c73a2fac50d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1a886219b38416e9f6b79f0519daea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56bcac7a-42e9-48cf-8a8b-29e330d1e754 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Request method failure captured: Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8H6hY1phVLc5_3Bj9MBMUfBG5epopH9tx1mCfRF-6rsDu_R88b9pDTuShQUtLh5Xzglu6QtxcqxMiizJMpjIc2EWy-LrKaAsWmD-vTUEgUnNUHeVwwEDv4hpnqxV6yB5zeJAEnWTnotSvA9P6x_qHbybR_UDxIcMXkHICQQW0z7EU Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:50:19.360793 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1a886219b38416e9f6b79f0519daea4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1a886219b38416e9f6b79f0519daea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1a886219b38416e9f6b79f0519daea4"}]}] Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b1a886219b38416e9f6b79f0519daea4 Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071 Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c97587e2d3d542faadc4c73a2fac50d5 Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1735421071-project Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1'} Oct 06 12:50:19.362447 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:50:19.363368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 06 12:50:19.365326 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.367905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56bcac7a-42e9-48cf-8a8b-29e330d1e754 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:19.371246 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56bcac7a-42e9-48cf-8a8b-29e330d1e754 tempest-HypervisorAdminNegativeTestJSON-1735421071 tempest-HypervisorAdminNegativeTestJSON-1735421071-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.029181 Oct 06 12:50:19.372583 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 297/604] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:19.389290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-479bec25-184a-4c8b-9792-e7cd2b729ed9 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Calling method '.version_select at 0x7f7d3fd92a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.396944 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-479bec25-184a-4c8b-9792-e7cd2b729ed9 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] HTTP exception thrown: Hypervisor with ID '0ff916e9-a263-4a08-a703-344e20067407' could not be found. Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-479bec25-184a-4c8b-9792-e7cd2b729ed9 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Request method failure captured: Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-hypervisors/0ff916e9-a263-4a08-a703-344e20067407 HTTP/1.1 Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8ICN5HJm4FhDWsHeu2Pkv7tsbbZwvebuvng0p-K3mZUhHxB5_SZVOkchNDPaVTzX2_om0vUA7LMjahIsXSCuLLo_dAsvJpTtjZsH4HtqjyiFehrBkpviWRw_lFoPP_p05NRVcWkrZYdRlR6dI9JexxNwIJyL0Wb4rCRiDeSYGmitE Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 373490e308f945dd8b2c11603036e52f Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:50:19.402035 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_373490e308f945dd8b2c11603036e52f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/373490e308f945dd8b2c11603036e52f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/373490e308f945dd8b2c11603036e52f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/373490e308f945dd8b2c11603036e52f"}]}] Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 373490e308f945dd8b2c11603036e52f Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641 Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 964b783b70a944778c17fd63df735035 Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: exception: Hypervisor with ID '0ff916e9-a263-4a08-a703-344e20067407' could not be found. Oct 06 12:50:19.403596 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0ff916e9-a263-4a08-a703-344e20067407'} Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0ff916e9-a263-4a08-a703-344e20067407' Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 06 12:50:19.404439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:50:19.406035 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0ff916e9-a263-4a08-a703-344e20067407' could not be found. Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0ff916e9-a263-4a08-a703-344e20067407' could not be found. Oct 06 12:50:19.407370 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:19.410706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-479bec25-184a-4c8b-9792-e7cd2b729ed9 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] Returning 404 to user: Hypervisor with ID '0ff916e9-a263-4a08-a703-344e20067407' could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:19.414238 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-479bec25-184a-4c8b-9792-e7cd2b729ed9 tempest-HypervisorAdminNegativeTestJSON-1206610641 tempest-HypervisorAdminNegativeTestJSON-1206610641-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/0ff916e9-a263-4a08-a703-344e20067407" status: 404 len: 123 microversion: 2.1 time: 0.035755 Oct 06 12:50:19.419125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 298/605] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/os-hypervisors/0ff916e9-a263-4a08-a703-344e20067407 => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:19.506367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f37fcb46-16e1-4014-a06d-dfcbc57173d0 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1619 microversion: 2.1 time: 0.374414 Oct 06 12:50:19.507657 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 308/606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1619 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:19.535181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: .version_select at 0x7f7d3fa23820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1855755535", "policies": ["anti-affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:19.575061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:19.581217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:19.641058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:19.670467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:19.677881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:19.698045 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee620612-965f-41a8-9773-f4998788657a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.166684 Oct 06 12:50:19.699431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 299/607] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Oct 6 12:50:19 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:19.752672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:19.760710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:19.802765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.803477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.803858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:19.819673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:19.820227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:19.820839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:20.112056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:20.112728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:20.148927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:20.149431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:20.155195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:20.162996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:20.163488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:20.163930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:20.483176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:20.523173 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc2f713d-9939-4918-bcb7-5369bce8b4f6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.779178 Oct 06 12:50:20.525826 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 309/608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:19 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:20.533924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1039728294", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b8e77baa-e570-4556-a105-d48bf4ffb7a3"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:20.718908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:20.731031 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8de4b9e-b7cb-46a9-962b-ae1b2fd4d2eb tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1467 microversion: 2.1 time: 0.625065 Oct 06 12:50:20.731902 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 300/609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:20 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1467 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:50:20.749242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:20.751959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:20.759709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:20.781460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:20.781984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:20.782431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:20.783208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:20.783670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:20.784105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:21.906506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:50:21.907721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:50:21.908725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:50:21.909661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:50:21.910501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:50:21.915230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:21.928799 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b79baac4-2525-4c75-b69b-3171a50a535c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 1.189718 Oct 06 12:50:21.929720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 301/610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:20 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:21.938402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:21.939233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:21.952176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:21.953382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:21.953939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:21.955791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:21.956468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:21.957116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:21.977771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:21.978358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:21.979057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:21.983767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:21.984567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:21.986430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:22.014883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:22.034329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:22.043022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:22.063219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 2 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:50:22.074169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:22.170363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:22.183847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:22.252147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:22.259401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:22.277846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:22.303897 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e85aa86-56c2-4ef5-9bc8-631d417b1277 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.367623 Oct 06 12:50:22.304550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 302/611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:21 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:22.311414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=6c740bb1-f8ab-46c0-a1d7-924f83e3a174,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:22.321729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:22.327208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:22.349117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:22.357058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:22.360178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:22.361012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:22.385857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:22.386400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:22.452764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:22.462783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:22.553633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:22.568574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'server_group_members'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:22.639494 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cea9329-0910-4d43-9e52-75ef8985640c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.111472 Oct 06 12:50:22.645197 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 310/612] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2118 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 06 12:50:22.653629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:22.662110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:22.663201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Searching by: {'deleted': False, 'project_id': '9ca94e746fcb426887d292336801aa0d'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:50:22.709560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:22.717099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:22.717642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:22.718502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:22.718972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:22.728402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:22.932596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:50:23.060083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21b4831e-5ffb-420b-931c-c5cdf688d3f5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.413088 Oct 06 12:50:23.061792 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 311/613] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 12:50:22 2022] GET /compute/v2.1/servers => generated 1662 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:23.068726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:23.070405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:23.078935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:23.080541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:23.081143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:23.082253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:23.082886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:23.084258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:23.118984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:23.138200 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1da42d0-03df-4f19-a9e4-8ed2d579068f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1467 microversion: 2.1 time: 0.830851 Oct 06 12:50:23.141930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 303/614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:22 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1467 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:23.184617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-797924b3-222c-4c5b-8db5-898f3a9dc681 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:23.185794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-797924b3-222c-4c5b-8db5-898f3a9dc681 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:23.432409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-797924b3-222c-4c5b-8db5-898f3a9dc681 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:23.442097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-797924b3-222c-4c5b-8db5-898f3a9dc681 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1219 microversion: 2.1 time: 0.274081 Oct 06 12:50:23.447026 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 304/615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:23 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:23.452114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:23.458576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:23.476317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:23.477191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:23.478273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:23.481046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:23.481696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:23.482326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:23.773354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:23.788792 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5a6095bb-8883-429e-9a0e-c901a20ecdd9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.725752 Oct 06 12:50:23.794562 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 312/616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:23 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:24.066238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d7e1d-5543-4a29-a765-a24020dcfc19", "name": "network-vif-deleted", "tag": "752a21d3-2e35-4916-8fe2-25eebdd4701e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:24.098306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.101295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.106658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.141849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] Creating event network-vif-deleted:752a21d3-2e35-4916-8fe2-25eebdd4701e for instance 439d7e1d-5543-4a29-a765-a24020dcfc19 on n-h1-860556-1 Oct 06 12:50:24.164040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-be5eb54f-f92c-4598-8f98-e26b1e89d5db req-d93dc45f-ae22-4ced-9bf3-e9b922d95dbe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107461 Oct 06 12:50:24.166082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 313/617] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:24.192883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:24.200138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:24.217914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.219125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.220150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.222229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.225874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.227626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.230451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:24.240413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3985d28b-df6c-4afc-b9ae-a85f4607ed9c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.791853 Oct 06 12:50:24.241005 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 305/618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:23 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:24.335167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.335656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.339283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.339961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lazy-loading 'fault' on Instance uuid 439d7e1d-5543-4a29-a765-a24020dcfc19 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:50:24.449459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:24.473357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:24.474319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:24.486188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.486687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.487138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.487858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.488313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.494162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.495834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e09b536-cadb-41a5-8925-af1b80e39a2f tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1311 microversion: 2.1 time: 0.320102 Oct 06 12:50:24.499460 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 314/619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:24 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:24.611769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:24.622161 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7de8804d-c871-4d58-a531-b5ce55290413 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1223 microversion: 2.1 time: 0.153838 Oct 06 12:50:24.623475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 306/620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:24 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1223 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:50:24.825364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:24.827737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:24.846670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.847350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.847931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.848660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.849231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.850130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.911091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552a1b4f-82e7-4dc9-8632-5ed09edf69e9", "tag": "c96ea76b-3c5a-4b7a-803d-998872351c2a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:24.940048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:24.940871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:24.945077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:24.977853 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] Creating event network-changed:c96ea76b-3c5a-4b7a-803d-998872351c2a for instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 on n-h1-860556-1 Oct 06 12:50:24.989390 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c5990419-bcd4-4e77-91e1-be30e2537934 req-ddc31200-af31-49df-80bc-ca3692660f3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081778 Oct 06 12:50:24.992317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 307/621] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:25.080938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:25.097510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33b1ccae-73d4-46e0-aa92-8a5febbc9cec tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 0.284583 Oct 06 12:50:25.100265 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 315/622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:24 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:25.267087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:25.269938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:25.283492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:25.285889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:25.290145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:25.291540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:25.292327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:25.293000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:25.529567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:25.530226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:25.540500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:25.540998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:25.541440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:25.555965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:25.556498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:25.558902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:25.672651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:25.673149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:25.689414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:25.689975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lazy-loading 'fault' on Instance uuid 439d7e1d-5543-4a29-a765-a24020dcfc19 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:50:25.988077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:26.001560 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b343a8e3-d15b-4172-acb2-e4edd8f13261 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 200 len: 1311 microversion: 2.1 time: 0.479405 Oct 06 12:50:26.007544 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 316/623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:25 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 1311 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:26.019498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:26.020362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:26.038934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:26.039675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:26.044014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:26.044978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:26.046559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:26.047164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:26.196224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:26.223622 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e90fee5d-a4eb-4cb1-8847-36922b4fd449 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.960568 Oct 06 12:50:26.224626 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 308/624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:25 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:26.236509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:26.240829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:26.265131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:26.266069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:26.266619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:26.267460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:26.270021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:26.272049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:26.368853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:26.380882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6509895-8a8c-46ee-a4f8-b4765c2c7fe6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1271 microversion: 2.1 time: 0.371616 Oct 06 12:50:26.381485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 317/625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:26 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:27.029508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:27.030450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: 439d7e1d-5543-4a29-a765-a24020dcfc19] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:27.046323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.046867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.048075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.051447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.058158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.059119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.109014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] HTTP exception thrown: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Request method failure captured: Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 HTTP/1.1 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7O7OS2yAME-tZXx_DlclKLBDiOnYR3jFeukRpln9_Gob76iukumzFhMzisqNafMklMVj7zcfkc49hC-WKVvbIWHuq6mll08kKL1ENhc6SU4xMtAKUbU9nkoe3XDX3LJUEkemIYY_v-pDpZJyD-DF1S4ajxfVqA-sBa0NibSj_MTM8 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f4229fd0e5604202b89a9514f5408ef3 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:50:27.115257 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f4229fd0e5604202b89a9514f5408ef3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f4229fd0e5604202b89a9514f5408ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f4229fd0e5604202b89a9514f5408ef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f4229fd0e5604202b89a9514f5408ef3"}]}] Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f4229fd0e5604202b89a9514f5408ef3 Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersAdminNegativeTestJSON-2133455706-project Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cfb0c32000ad4877851a4ba36ee1eef3 Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2133455706-project Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. Oct 06 12:50:27.116801 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '439d7e1d-5543-4a29-a765-a24020dcfc19'} Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:27.117724 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. Oct 06 12:50:27.119213 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:27.120959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:27.122260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Returning 404 to user: Instance 439d7e1d-5543-4a29-a765-a24020dcfc19 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:27.139462 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fefb97a2-5bb2-4bdf-b521-c22a076823cc tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19" status: 404 len: 111 microversion: 2.1 time: 0.112871 Oct 06 12:50:27.150181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 318/626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:27 2022] GET /compute/v2.1/servers/439d7e1d-5543-4a29-a765-a24020dcfc19 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:27.169065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:27.169904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:27.196609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.197731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.198475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.206791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.207805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.208491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.328286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:50:27.404292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:27.414862 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d19a733-d78f-484a-bde9-c3f55394cfd7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1477 microversion: 2.1 time: 1.188055 Oct 06 12:50:27.416089 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 309/627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:26 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1477 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:27.435306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:27.437862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:27.462189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.465403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.466263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.467278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.468856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.471450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.604199 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b82aa74f-8705-4a2d-8747-a51a029ca1d1 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 204 len: 0 microversion: 2.1 time: 0.444251 Oct 06 12:50:27.605212 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 319/628] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:50:27 2022] DELETE /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:50:27.611938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:27.612819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:27.620168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.621191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.622041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:27.623026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:27.623723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:27.624702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:28.069161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:28.083046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d1591fc-1dd7-4687-96fe-cdf27a958e06 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1271 microversion: 2.1 time: 0.476256 Oct 06 12:50:28.083801 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 320/629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:27 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1271 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:28.088390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:28.089002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:28.105926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:28.106699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:28.107305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:28.108178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:28.111210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:28.111897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:28.676798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:28.688304 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0fdd2ded-782c-407e-8d3e-343a5d98cd65 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 1.270966 Oct 06 12:50:28.695887 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 310/630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:27 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:28.722588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:28.723218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:28.762284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:28.762806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:28.763262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:28.763997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:28.774063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:28.774764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:28.961182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:28.970007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6440e05a-041b-486f-9ec1-b21e152908f5 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1477 microversion: 2.1 time: 0.885257 Oct 06 12:50:28.970862 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 321/631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:28 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1477 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:29.108281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:29.108915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:29.116367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:29.117071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:29.117692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:29.118673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:29.119341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:29.119991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:29.252777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:29.267162 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b2eacee-651e-4aae-8f15-9f2577b71695 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1277 microversion: 2.1 time: 0.162483 Oct 06 12:50:29.269680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 322/632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:29 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:29.428930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:29.444857 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df6be0fe-3e57-472d-bf7b-90bc717c5004 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1476 microversion: 2.1 time: 0.728835 Oct 06 12:50:29.445553 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 311/633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:28 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1476 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:29.722870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:29.723494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:29.737912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:29.738649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:29.739276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:29.740912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:29.741550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:29.742170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:29.779829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:29.994614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:29.995234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:30.009501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:30.010040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:30.010482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:30.011726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:30.012351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:30.014291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:30.689980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:30.704478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97ee1ae8-fd96-458b-9379-716ae841c6be tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.985409 Oct 06 12:50:30.707164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 323/634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:29 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:30.718851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:30.720643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:30.758902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:30.773719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:30.774515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:30.775135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:30.776016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:30.778796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:30.779578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:31.303895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:31.323911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96fe3c25-01bd-4762-b509-483fb7061993 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1477 microversion: 2.1 time: 1.332941 Oct 06 12:50:31.325561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 312/635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:29 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1477 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:31.332031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:31.332662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:31.340119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:31.340619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:31.341065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:31.342108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:31.342571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:31.343294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:31.357754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:31.412736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:31.423937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8b03e51-9791-4c5c-9c74-fcb3eeba4d22 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1277 microversion: 2.1 time: 0.713050 Oct 06 12:50:31.427874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 324/636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:30 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1277 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:31.733452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:31.735342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:31.752273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:31.753118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:31.753575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:31.755749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:31.757337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:31.758757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:31.814555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:31.840336 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa52633e-525b-491e-b685-c5b0af3a5ce6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1476 microversion: 2.1 time: 0.513384 Oct 06 12:50:31.841021 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 313/637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:31 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:31.977092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "name": "network-vif-unplugged", "status": "completed", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:31.994826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:31.995448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:31.996066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:32.028041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Creating event network-vif-unplugged:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h2-860556-1 Oct 06 12:50:32.047777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:50:32.076763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-21f4a031-0c2f-4fb6-a03a-9ab90bc2cebf req-e84a12d8-ac53-476d-8948-8687db3e7ea6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103551 Oct 06 12:50:32.079264 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 314/638] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:50:32.408058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1932545507", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "0b054633-9dfe-4097-9c8f-362b52a05fe6"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:32.493162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] validate_networks() for [('0b054633-9dfe-4097-9c8f-362b52a05fe6', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:32.493312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:32.508359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-043e140a-830e-499f-ba35-cb0ec90ea2c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.779307 Oct 06 12:50:32.509148 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 325/639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:31 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:32.518292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:32.519412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:32.533804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:32.534680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:32.535393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:32.536924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:32.538262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:32.538994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:32.584229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=43 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:32.846426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb0c32000ad4877851a4ba36ee1eef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4229fd0e5604202b89a9514f5408ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:32.855345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3e3f987-177e-48ac-9b31-6bf10a7b6912 tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 200 len: 1435 microversion: 2.1 time: 0.344934 Oct 06 12:50:32.856005 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 326/640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:32 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 1435 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:32.890249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:32.890877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:32.899683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:32.909767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:32.910393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:32.910837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:32.911576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:32.912379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:32.913996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:33.232308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:33.251040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4fbe225c-ba18-435e-8f59-d6172c614f15 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1277 microversion: 2.1 time: 0.381041 Oct 06 12:50:33.252817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 327/641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:32 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:33.267933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:33.268891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:33.294661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:33.297862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:33.298492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:33.301325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:33.304014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:33.304662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:33.437938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=11 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:34.150122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:34.159369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-becb9e10-a9b3-408a-8cc8-c15495d60635 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1476 microversion: 2.1 time: 0.902874 Oct 06 12:50:34.164842 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 328/642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:33 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1476 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:34.175520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c3d91b-a212-403e-a006-070e838f3735", "name": "network-vif-deleted", "tag": "9e859e9f-8f11-4ca8-b91c-f82f0a467670"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:34.199719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.200455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.201044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.239149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] Creating event network-vif-deleted:9e859e9f-8f11-4ca8-b91c-f82f0a467670 for instance f8c3d91b-a212-403e-a006-070e838f3735 on n-h2-860556-1 Oct 06 12:50:34.256700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-cbc43301-2137-464b-bc2b-20469ebfadf5 req-db1e02ff-8a81-4821-acc0-ebc652677b94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089155 Oct 06 12:50:34.257956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 329/643] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:34.277262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:34.278337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:34.286142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.287440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.288718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.289594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.290285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.290860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.392667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:50:34.395708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:50:34.396821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:50:34.397760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:50:34.400813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:50:34.437916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.439182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.441487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.443316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.444136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.445090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.471884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Getting quotas for project 24ec0eee7b744b7c8cae1dcea6c90dd8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:34.479512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Getting quotas for user c5cad49ba6ed41ce834aad966012179e and project 24ec0eee7b744b7c8cae1dcea6c90dd8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:34.496254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:50:34.500009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:34.582751 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-837a81e6-c827-4b28-8d39-6dc45cf10a47 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408514 Oct 06 12:50:34.591870 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 315/644] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:50:34.598526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:34.600109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] [instance: f8c3d91b-a212-403e-a006-070e838f3735] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:34.614988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.616082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.617686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.626597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.627116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.627574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.661339 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] HTTP exception thrown: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Request method failure captured: Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 HTTP/1.1 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7O7OS2yAME-tZXx_DlclKLBDiOnYR3jFeukRpln9_Gob76iukumzFhMzisqNafMklMVj7zcfkc49hC-WKVvbIWHuq6mll08kKL1ENhc6SU4xMtAKUbU9nkoe3XDX3LJUEkemIYY_v-pDpZJyD-DF1S4ajxfVqA-sBa0NibSj_MTM8 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f4229fd0e5604202b89a9514f5408ef3 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:50:34.664576 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f4229fd0e5604202b89a9514f5408ef3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f4229fd0e5604202b89a9514f5408ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f4229fd0e5604202b89a9514f5408ef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f4229fd0e5604202b89a9514f5408ef3"}]}] Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f4229fd0e5604202b89a9514f5408ef3 Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2133455706 Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminNegativeTestJSON-2133455706-project Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: cfb0c32000ad4877851a4ba36ee1eef3 Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2133455706-project Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. Oct 06 12:50:34.665990 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f8c3d91b-a212-403e-a006-070e838f3735'} Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:34.666945 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. Oct 06 12:50:34.668124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:50:34.674359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] Returning 404 to user: Instance f8c3d91b-a212-403e-a006-070e838f3735 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:34.676280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99db2a72-6302-46d7-8186-dec726544ced tempest-ServersAdminNegativeTestJSON-2133455706 tempest-ServersAdminNegativeTestJSON-2133455706-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735" status: 404 len: 111 microversion: 2.1 time: 0.082971 Oct 06 12:50:34.678055 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 316/645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:34 2022] GET /compute/v2.1/servers/f8c3d91b-a212-403e-a006-070e838f3735 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:50:34.685613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:34.700584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.701393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.703072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.721268 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Creating event network-changed:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h2-860556-1 Oct 06 12:50:34.758013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:50:34.779535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-50d01ce4-432f-4267-b18d-c51c886e27fa req-d02901a2-5bec-4516-b2af-a0863e3b7c5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099787 Oct 06 12:50:34.781024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 317/646] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:34.793701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:34.807361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:34.816004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.819360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.822157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:34.823166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:34.824372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:34.825085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:35.054937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:35.073593 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1e7f0dc-66db-491b-85a5-9c473acf17e2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.811171 Oct 06 12:50:35.076617 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 330/647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:34 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:35.100680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97399f68-2896-4003-a9bc-095c284653a1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:35.107684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97399f68-2896-4003-a9bc-095c284653a1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:35.531527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-97399f68-2896-4003-a9bc-095c284653a1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:35.542121 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97399f68-2896-4003-a9bc-095c284653a1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1216 microversion: 2.1 time: 0.463966 Oct 06 12:50:35.556141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 331/648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:35 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1216 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:35.585054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:35.587860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:35.605522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:35.607442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:35.609857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:35.614331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:35.615510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:35.620469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:36.266650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:36.280412 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bcbe063-968c-4760-8070-7a66da617d1d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 1.497837 Oct 06 12:50:36.281404 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 318/649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:34 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:36.290366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:36.293846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:36.304402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:36.304912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:36.305352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:36.306145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:36.306615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:36.307064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:36.778300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:36.798434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d489689-e8b9-408e-b8dc-daa033badd01 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 0.515874 Oct 06 12:50:36.799263 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 319/650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:36 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:36.807158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:36.810900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:36.828044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:36.829642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:36.831157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:36.833371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:36.835018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:36.837444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:36.945273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:36.964103 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2622bb5e-7a93-4077-95b8-ec94ed9594c2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1474 microversion: 2.1 time: 1.410527 Oct 06 12:50:36.966366 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 332/651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:35 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1474 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:37.072380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:37.089234 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3479b21-370b-42f5-806c-c75bbed7e63a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1220 microversion: 2.1 time: 0.280747 Oct 06 12:50:37.090518 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 320/652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:36 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1220 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:37.308014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:37.308636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:37.324713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:37.325218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:37.325656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:37.326396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:37.326853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:37.327281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:37.632021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c740bb1-f8ab-46c0-a1d7-924f83e3a174", "tag": "19b1cadd-3eaf-4cad-839b-557a3ccf5e01"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:37.648966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:37.657939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:37.658686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:37.679205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] Creating event network-changed:19b1cadd-3eaf-4cad-839b-557a3ccf5e01 for instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 on n-h2-860556-1 Oct 06 12:50:37.694797 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2819a371-dcc6-4288-be5c-5d130a09982c req-2ee93bae-b1ef-4b80-b7af-7048da815ddd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068233 Oct 06 12:50:37.697266 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 321/653] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:37.830117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:37.831587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:37.843713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:37.847192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:37.847946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:37.851531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:37.853781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:37.855678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:38.354136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:38.368950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3f8bd4b7-9db9-470c-bd58-25a7c13c3035 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 1.063680 Oct 06 12:50:38.369583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 333/654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:37 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:38.381261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552a1b4f-82e7-4dc9-8632-5ed09edf69e9", "name": "network-vif-plugged", "status": "completed", "tag": "c96ea76b-3c5a-4b7a-803d-998872351c2a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:38.421344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:38.421861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:38.422299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:38.451487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] Creating event network-vif-plugged:c96ea76b-3c5a-4b7a-803d-998872351c2a for instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 on n-h1-860556-1 Oct 06 12:50:38.485166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-05f75e8a-0f6f-4484-83dd-68866e3a5487 req-d6178404-b94a-4f10-9ad8-3ecd54b43d8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111071 Oct 06 12:50:38.486238 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 334/655] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:38.524888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:38.526103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:38.550314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:38.553834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:38.563712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:38.567213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:38.572080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:38.572630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:39.679568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:39.699399 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-049878a9-1adc-4f0d-8b27-dfcedf6d32a6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1389 microversion: 2.1 time: 1.870300 Oct 06 12:50:39.700422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 322/656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:37 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1389 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:39.712094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:39.718227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:39.733236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:39.737808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:39.738477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:39.742614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:39.743278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:39.744047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:40.228477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:40.237318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0445633-d153-4fa3-80e2-bfda7d0301d2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1474 microversion: 2.1 time: 1.749412 Oct 06 12:50:40.240040 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 335/657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:38 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1474 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:40.249421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:40.274610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4834b013-acf6-4a47-a8cb-70a7d5f49d5c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1268 microversion: 2.1 time: 0.569648 Oct 06 12:50:40.275833 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 323/658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:39 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1268 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:40.283469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:40.289968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:40.300307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:40.304484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:40.305307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:40.306382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:40.308270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:40.308941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:40.859831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-504574613", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "7894d46a-c18d-4a9f-a678-c98a979132b6"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:40.951475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] validate_networks() for [('7894d46a-c18d-4a9f-a678-c98a979132b6', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:41.312010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:41.331681 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a91661a5-5669-4c35-98ea-81eac866f9c5 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 1.051554 Oct 06 12:50:41.332111 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 324/659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:40 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:41.352735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa99544-1e40-4c41-b242-7e4faa4ce620", "tag": "362b2a4f-eda6-43d9-bff2-2b6aaa9bb608"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:41.399120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:41.400615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:41.405414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:41.441637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] Creating event network-changed:362b2a4f-eda6-43d9-bff2-2b6aaa9bb608 for instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 on n-h1-860556-1 Oct 06 12:50:41.460641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d91b506d-411a-444f-8608-deed87fb1f29 req-ead5f5d5-4d25-43cd-b4f7-ed49060b8398 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127034 Oct 06 12:50:41.462326 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 325/660] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:41.475343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:41.476069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:41.501498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:41.502017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:41.502457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:41.503165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:41.503621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:41.504049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:41.990196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:42.008350 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2bb530c-99ad-4998-86af-e4c1237f220a tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1588 microversion: 2.1 time: 0.545579 Oct 06 12:50:42.008955 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 326/661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:41 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1588 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:42.019273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:42.024727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:42.047469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:42.057694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:42.060221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:42.062869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:42.066249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:42.066922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:42.789545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:42.799669 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1715f4d8-5fea-43ff-b29a-f91e445e449a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1471 microversion: 2.1 time: 0.789121 Oct 06 12:50:42.802958 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 327/662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:42 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1471 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:42.814300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:42.814901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:42.836179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:42.836931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:42.837536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:42.838445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:42.839053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:42.839631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:42.978785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:42.987738 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e2962f84-2020-4e0c-a5a4-74d44086b1cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1274 microversion: 2.1 time: 0.183674 Oct 06 12:50:42.988320 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 328/663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:42 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:43.006918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:43.007699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:43.016101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.024446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.025240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.026252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.026730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.027160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.602839 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f868dde9-0896-4e31-858b-8efa4584c77b tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.601217 Oct 06 12:50:43.603637 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 329/664] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:50:43 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9/os-interface => generated 284 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:43.608316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:43.609448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:43.630856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.631576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.632423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.633296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.633985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.634566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.690249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:50:43.699343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:50:43.700749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:50:43.702424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:50:43.703518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:50:43.732778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.733292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.735326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.736353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:43.736862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:43.738052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:43.789326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:43.797858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for user 17892d653b7d461e803f5423cf7191af and project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:43.818577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:50:43.823409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:43.947397 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9317c8f-791a-470b-a3e4-798198c3f43a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.705695 Oct 06 12:50:43.961641 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 336/665] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:50:44.107727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:44.117776 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff1ce93a-5516-48cb-b9a6-3ca9c0a19636 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 0.512910 Oct 06 12:50:44.121346 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 330/666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:43 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:44.139247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:44.140054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:44.168158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.168578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.169024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.169874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.170504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.171084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.315451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d39ac1f-4087-4c2e-951b-41e60ba39b62 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e/action" status: 204 len: 0 microversion: 2.1 time: 0.192520 Oct 06 12:50:44.318126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 331/667] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:50:44 2022] POST /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:50:44.335595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:44.336482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:44.343215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50ab019b-7a6d-4ba3-87de-96c99aadbc7f tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:44.396413 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-50ab019b-7a6d-4ba3-87de-96c99aadbc7f tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.432807 Oct 06 12:50:44.400603 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 337/668] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:44.418082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:44.418850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:44.433326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.443654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.444829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.446743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.451633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.453032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.457268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:44.491261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:44.635939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:44.666736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:44.676751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:44.681380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8d840d1-bf73-456a-affd-7075dd1e5474 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1261 microversion: 2.25 time: 0.360867 Oct 06 12:50:44.697998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 332/669] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:44 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1261 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:44.707988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:44.715014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:44.732718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.735822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.737002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.740518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:44.741090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:44.741538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:44.749392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:44.765116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e238263-488d-436f-a632-0764b036793f tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1274 microversion: 2.1 time: 0.361975 Oct 06 12:50:44.768733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 338/670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:44 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:44.812436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:45.143502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:45.144433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:45.153649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:45.162745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:45.163211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:45.163981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:45.164452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:45.164878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:45.391474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:45.402324 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74ae826b-2687-469e-826c-38d6ac60269b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1471 microversion: 2.1 time: 0.702831 Oct 06 12:50:45.420667 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 333/671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:44 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1471 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:45.712578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:45.713461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:45.728239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:45.754271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:45.757216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:45.757780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:45.758747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:45.759295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:45.759839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:46.010659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:46.024402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:46.031780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:46.038003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-720ce840-c947-4960-b493-48c1ba7a5605 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1265 microversion: 2.25 time: 0.330671 Oct 06 12:50:46.059144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 334/672] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:45 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:46.093918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:46.096213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:46.098445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:46.114508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:46.115223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:46.115824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:46.116749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:46.117364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:46.118033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:46.127046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b8de3830-0176-43d5-8a0d-c91b9e4c52dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 0.987329 Oct 06 12:50:46.134296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 339/673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:45 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:50:46.217233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2039738442", "imageRef": "f17c8c12-87a6-444e-905b-04831af2dbff", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:46.317928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:47.553558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:47.576654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a7643ca4-92c0-4568-8936-3cb95074faaf tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 1.501204 Oct 06 12:50:47.581179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 335/674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:46 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:47.600798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:47.601989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:47.608738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:47.609798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:47.611239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:47.612306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:47.612984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:47.613658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.392835 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] Request method failure captured: Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 143 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8hyIaahbodM4lPAZpF0fW6A7twATqunA7RlKbTzDKUUnJ5SpPjHUCy7KWjqiKav0HvprcSM7rx3RASPnpxLA3xNdz8uJoTGbGjxvT5Z35giWsuXq_bJqkDdgufsxShlDgcUwXesFCtxEK4bw6aaJ_5maiuT4XR387qVRyZ3620xyQ Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3db458a6061e42fab2b44c2c10638f78 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FlavorsV2NegativeTest-571198543 Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:50:48.402750 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3db458a6061e42fab2b44c2c10638f78", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3db458a6061e42fab2b44c2c10638f78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3db458a6061e42fab2b44c2c10638f78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3db458a6061e42fab2b44c2c10638f78"}]}] Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FlavorsV2NegativeTest-571198543 Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3db458a6061e42fab2b44c2c10638f78 Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-571198543 Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FlavorsV2NegativeTest-571198543-project Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c52422759d4a4b7fbdad89728c587cab Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FlavorsV2NegativeTest-571198543-project Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2039738442", "imageRef": "f17c8c12-87a6-444e-905b-04831af2dbff", "flavorRef": "452"}} Oct 06 12:50:48.404709 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: exception: Flavor's memory is too small for requested image. Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2039738442', 'imageRef': 'f17c8c12-87a6-444e-905b-04831af2dbff', 'flavorRef': '452'}}} Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:48.406562 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:48.408335 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 06 12:50:48.409859 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:50:48.414718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:50:48.417155 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f9893b4-cd6e-4cb8-a512-ebc397115514 tempest-FlavorsV2NegativeTest-571198543 tempest-FlavorsV2NegativeTest-571198543-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.205632 Oct 06 12:50:48.418883 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 340/675] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:46 2022] POST /compute/v2.1/servers => generated 93 bytes in 2208 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:50:48.443319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:48.446897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:48.462862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.464811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.465989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.466953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.467558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.468155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.650580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:48.672814 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4042c34e-6995-4573-8f75-44ecfd07998d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1471 microversion: 2.1 time: 1.087372 Oct 06 12:50:48.674047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 336/676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:47 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:48.681405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:48.682313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:48.713887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.713887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.713887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.714912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.716546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.717399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.748291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:48.768732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:48.785857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:48.788031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de913be2-80d5-4b73-94cc-e3f058129e12 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1319 microversion: 2.25 time: 0.367521 Oct 06 12:50:48.788784 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 341/677] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:48 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:48.804070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "name": "network-vif-plugged", "status": "completed", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:48.853499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.857823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.858528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.886328 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Creating event network-vif-plugged:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h2-860556-1 Oct 06 12:50:48.923548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:50:48.949001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-41638d2e-0f74-41bf-ae41-9802e120b687 req-c7b1ac39-eba5-4b0c-ac0b-905dfb3724c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152853 Oct 06 12:50:48.950137 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 342/678] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:48.957402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:48.971207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:48.992368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.992966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.993286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:48.994018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:48.994470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:48.994881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:49.523180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:49.540859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6c12e4b7-3905-4ec6-a105-595bad92f08d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 0.865237 Oct 06 12:50:49.547767 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 337/679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:48 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:49.564363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:49.567816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:49.584072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:49.584925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:49.585618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:49.592783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:49.596393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:49.597254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:49.816554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:49.828351 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51b1ee2c-4a87-4d74-8337-3dabefdb7fb6 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.876730 Oct 06 12:50:49.832240 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 343/680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:48 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:49.853623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552a1b4f-82e7-4dc9-8632-5ed09edf69e9", "tag": "c96ea76b-3c5a-4b7a-803d-998872351c2a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:49.876301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:49.878348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:49.878951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:49.894435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] Creating event network-changed:c96ea76b-3c5a-4b7a-803d-998872351c2a for instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 on n-h1-860556-1 Oct 06 12:50:49.902222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-abd04d18-297f-446e-b665-9fa8cda1de96 req-78644ad5-d3aa-48d8-88c5-7a92dcf20642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066612 Oct 06 12:50:49.903446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 344/681] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:49.910320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:49.911488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:49.921223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:49.922076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:49.922776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:49.924255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:49.926539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:49.927804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:50.653410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:50.668611 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b8593d45-3997-4054-affa-652f4a2bf672 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 200 len: 1588 microversion: 2.1 time: 1.116041 Oct 06 12:50:50.669488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 338/682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:49 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 1588 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:50.684309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:50.687846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:50.706282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:50.708914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:50.712623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:50.714210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:50.715556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:50.718646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:51.182283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:51.186415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:51.201775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ea5c65f-e179-4390-a12a-3955b2b35388 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1471 microversion: 2.1 time: 1.296569 Oct 06 12:50:51.202487 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 345/683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:49 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1471 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:51.235191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:51.235905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:51.243151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:51.243942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:51.244759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:51.245763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:51.246391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:51.247037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:51.671486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:51.694757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:51.701516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:51.703761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d2bc144-c501-414f-afdf-a18b56bf2d83 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.031435 Oct 06 12:50:51.704614 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 339/684] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:50 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:51.711508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521adfae-fbe3-400e-85b3-2462d5db5a10", "tag": "80f7cbcd-ba1d-4966-8548-076f5e64225f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:51.723795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:51.724568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:51.725149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:51.741704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] Creating event network-changed:80f7cbcd-ba1d-4966-8548-076f5e64225f for instance 521adfae-fbe3-400e-85b3-2462d5db5a10 on n-h2-860556-1 Oct 06 12:50:51.747562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-01d8d639-850d-4045-83b8-6089d89322ea req-5a03ded7-8ca9-48de-8114-7c12f27dfa4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041462 Oct 06 12:50:51.748483 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 340/685] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:51.754768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:51.757071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:51.764247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:51.765113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:51.766040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:51.767062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:51.768145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:51.768803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.120730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:52.130857 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c71c5ec9-8030-447b-9c53-91773280169e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1319 microversion: 2.1 time: 0.905946 Oct 06 12:50:52.163457 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 346/686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:51 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1319 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:52.177051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa99544-1e40-4c41-b242-7e4faa4ce620", "name": "network-vif-plugged", "status": "completed", "tag": "362b2a4f-eda6-43d9-bff2-2b6aaa9bb608"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:52.190831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.191566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.192972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.208753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] Creating event network-vif-plugged:362b2a4f-eda6-43d9-bff2-2b6aaa9bb608 for instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 on n-h1-860556-1 Oct 06 12:50:52.215691 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-46ab7ca0-588d-435c-af47-f5b2120ab206 req-a7324499-a343-4feb-ba21-98ddb373e6d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048733 Oct 06 12:50:52.216814 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 347/687] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:52.273560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:52.293501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:52.315135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.318435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.319296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.320471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.323336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.324484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.540738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:52.567937 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55f603de-5ec8-4ae7-b7b7-c44f3faae881 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.816485 Oct 06 12:50:52.583735 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 341/688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:51 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:52.694580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:52.714043 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15939189-2c49-488c-9ee7-c3dd42302b97 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1463 microversion: 2.1 time: 0.477609 Oct 06 12:50:52.716205 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 348/689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:52 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:52.743041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:52.744469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:52.745029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:52.747092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:52.755895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.756399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.758395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.758571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.759556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.759685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.760642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.761018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.761636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:52.762076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:52.762693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:52.763634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:53.749471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:53.810192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:53.886270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cce3be0b-12c0-4a14-8dd1-b594ebafcf57 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1614 microversion: 2.1 time: 1.145406 Oct 06 12:50:53.889177 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 342/690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:52 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1614 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:53.916396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:53.917878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:53.921661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:53.932645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:53.939305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:53.941195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:53.943809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70cfec11-0f88-4142-a655-2f6e6d61a3f6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.205319 Oct 06 12:50:53.944684 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 349/691] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:52 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:53.945239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:53.946124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:53.948376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:53.949928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:53.951114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:53.956151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:53.959810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:53.977371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:53.978481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:53.981750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:53.983427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:53.986087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:53.987206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:54.537635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:54.550926 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a49c0c5c-f325-476b-9d8d-8c332df6d270 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1469 microversion: 2.1 time: 0.658556 Oct 06 12:50:54.553462 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 343/692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:53 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:54.567984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bc741a1-3cdd-41a1-bb51-c7079153493d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '.version_select at 0x7f7d3f7daa60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:54.577952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bc741a1-3cdd-41a1-bb51-c7079153493d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:54.580336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bc741a1-3cdd-41a1-bb51-c7079153493d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:54.581530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bc741a1-3cdd-41a1-bb51-c7079153493d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:54.602934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:54.618112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa5da918-f0ef-4afc-9d1a-f9455297959a tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.665566 Oct 06 12:50:54.618786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 350/693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:53 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:54.632089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d5be5b-600f-4746-9309-4fecd91121bd", "tag": "55c1f1a9-f64c-414b-a61e-6249231b7c35"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:54.633946 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bc741a1-3cdd-41a1-bb51-c7079153493d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.075956 Oct 06 12:50:54.635732 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 344/694] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:50:54 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:54.649507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c740bb1-f8ab-46c0-a1d7-924f83e3a174", "name": "network-vif-plugged", "status": "completed", "tag": "19b1cadd-3eaf-4cad-839b-557a3ccf5e01"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:54.672808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:54.678423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:54.679275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:54.680333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:50:54.684929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:54.686264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:54.687330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:54.722120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] Creating event network-changed:55c1f1a9-f64c-414b-a61e-6249231b7c35 for instance b2d5be5b-600f-4746-9309-4fecd91121bd on n-h2-860556-1 Oct 06 12:50:54.740877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-473c599c-ce14-4634-877c-169351d6879c req-d401b274-4c88-44f4-b6ed-b4a9e08d56cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115387 Oct 06 12:50:54.741766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 351/695] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:54.756979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:54.758005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:54.772855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:54.773546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:54.774227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:54.775081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:54.778843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:54.779531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:55.129194 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] Creating event network-vif-plugged:19b1cadd-3eaf-4cad-839b-557a3ccf5e01 for instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 on n-h2-860556-1 Oct 06 12:50:55.146506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-229aef05-73c7-4404-aeea-ac144dec407d req-685caef0-45db-401f-bb1d-416baab2bb88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508236 Oct 06 12:50:55.151522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 345/696] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:50:55.175987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1942483120", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:50:55.299227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:50:55.330954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:55.354207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0136da92-793d-4109-88c4-27d24fb2ea67 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1319 microversion: 2.1 time: 0.609037 Oct 06 12:50:55.360348 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 352/697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:54 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:55.368857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:55.375214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:55.397932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:55.398753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:55.400565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:55.402635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:55.406428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:55.407209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.094208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:50:56.094628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:50:56.095478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:50:56.096082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:50:56.096690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:50:56.110552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.116025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.116742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.117814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.118479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.126223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.185936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:50:56.199209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:50:56.226469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:50:56.231149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:50:56.235390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:56.272300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:56.278619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:56.290015 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2e5a3a9-f427-4c23-9351-01eef7fe8cb5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 0.926993 Oct 06 12:50:56.293888 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 353/698] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:55 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:56.326528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:56.328153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:56.342368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.346373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.349690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.353406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.355093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8b5423b-7080-48c6-9f8e-8a73a7295cb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201920 Oct 06 12:50:56.358099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.358311 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 346/699] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:50:56.361905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.368702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5eda7a3e-0232-466a-8609-fc82916dd483 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:56.377468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5eda7a3e-0232-466a-8609-fc82916dd483 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:56.494988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5eda7a3e-0232-466a-8609-fc82916dd483 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:56.503796 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5eda7a3e-0232-466a-8609-fc82916dd483 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1213 microversion: 2.1 time: 0.139660 Oct 06 12:50:56.524354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 347/700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:56 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:50:56.529476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:56.536954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:56.558301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.558863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.559483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:56.560746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:56.564657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:56.566210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:57.042624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:57.059097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a03a6737-d15f-4a39-9c05-9cbcc9aee031 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.757230 Oct 06 12:50:57.085808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 354/701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:56 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:57.109697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:57.125949 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9171a3f-3fa9-4b73-a66d-57ba02bc3dce tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1319 microversion: 2.1 time: 0.599766 Oct 06 12:50:57.126673 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 348/702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:56 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:57.318305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:57.320109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:57.349069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:57.358366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:57.358920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:57.361451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:57.363612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:57.364350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:57.530532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:57.531372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:57.545908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:57.546842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:57.547475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:57.548556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:57.550996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:57.558738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:58.148859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:58.168203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:58.179908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d605cb40-47d8-45a2-9fdd-b07d50908756 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1209 microversion: 2.1 time: 0.654952 Oct 06 12:50:58.180497 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 349/703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:57 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1209 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:58.188983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:58.190739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:58.191918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a12824c0-136a-4eb7-9d62-01e4967bba7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 0.878308 Oct 06 12:50:58.197015 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 355/704] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:57 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:50:58.215991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:58.216781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:58.221641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:58.222300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:58.252522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:58.254824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:58.255940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:58.256176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:58.258020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:58.258855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:58.259384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:58.261877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:58.262588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:58.264616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:58.265248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:58.266931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.271936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:59.287859 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-17a74145-26d2-4b4c-8a74-401392ef29da tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1468 microversion: 2.1 time: 1.089628 Oct 06 12:50:59.288465 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 356/705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:58 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1468 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:59.306869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:59.307481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:59.329061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.331878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.333234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.334400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.335032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.335696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.837371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:59.847288 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d710aea2-a650-4bfe-b7a3-83bc50027660 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1271 microversion: 2.1 time: 0.554567 Oct 06 12:50:59.855664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 357/706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:59 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1271 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:59.873665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:59.874314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:50:59.875979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:59.881331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.882939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.883580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.884645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.885369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.886203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.888127 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71b3ff4b-57a3-4a43-b170-7f83dd97f54e tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 1.706582 Oct 06 12:50:59.891987 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 350/707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:50:58 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:50:59.904258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:50:59.918700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:50:59.919308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Searching by: {'reservation_id': 'r-j4h0dp3v', 'deleted': False, 'project_id': '9ca94e746fcb426887d292336801aa0d'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:50:59.933588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.939280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.939985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:50:59.940987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:50:59.941628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:50:59.948549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.155434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:51:00.243084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:00.255383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.256281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.257020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.383899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:00.402586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:00.404228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:00.407897 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f2c0224-63cb-4556-b736-46a978bd3ba3 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 0.550675 Oct 06 12:51:00.409095 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 358/708] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:50:59 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:00.653798 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e364e46c-6103-4dc6-bc71-08fa404cdc3a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-j4h0dp3v" status: 200 len: 2930 microversion: 2.1 time: 0.760614 Oct 06 12:51:00.655004 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 351/709] 10.222.0.26 () {58 vars in 1197 bytes} [Thu Oct 6 12:50:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-j4h0dp3v => generated 2930 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:00.684405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:00.729389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.server_groups [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Querying cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) for 2 instances {{(pid=129615) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 06 12:51:00.730294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.731775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.733674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.844143 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-571a9a01-ed34-4bd3-806e-f920dc880510 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/b8e77baa-e570-4556-a105-d48bf4ffb7a3" status: 200 len: 271 microversion: 2.1 time: 0.149805 Oct 06 12:51:00.844942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 359/710] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:51:00 2022] GET /compute/v2.1/os-server-groups/b8e77baa-e570-4556-a105-d48bf4ffb7a3 => generated 271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:00.860138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:00.860939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:00.877089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.878828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.880567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.881379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.881908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:00.882059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.882582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.882925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:00.895967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:00.897883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.900232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.900768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:00.904949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:00.905945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:00.908738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:01.262490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:01.277215 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1502516f-955d-4e04-952d-f86d97e0323d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1271 microversion: 2.1 time: 0.398183 Oct 06 12:51:01.292811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 360/711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:00 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:51:01.303026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:01.304244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:01.314643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:01.315540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:01.316008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:01.316764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:01.317856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:01.318366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:01.410588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48265bdd-c311-413b-9eaa-7ecd2a20e63c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1619 microversion: 2.1 time: 0.558057 Oct 06 12:51:01.411753 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 352/712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:00 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1619 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:01.676797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:01.700207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bddcfd21-eb7a-4433-83f3-cb525be12aa8 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.404256 Oct 06 12:51:01.702809 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 361/713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:01 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:01.710992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:01.723167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:01.726373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1755769615", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "4f0ce63f-ea60-4427-922a-c32b96edb684"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:01.745629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:01.746469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:01.749906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:01.751152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:01.753610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:01.754466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:01.890680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] validate_networks() for [('4f0ce63f-ea60-4427-922a-c32b96edb684', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:02.600079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:02.620094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:02.621885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:02.623237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a04abae-0d5b-4430-ad72-d55c6acf636d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 0.918091 Oct 06 12:51:02.623801 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 362/714] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:01 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:02.634505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:02.636169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:02.652403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:02.655494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:02.656147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:02.657049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:02.659663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:02.662060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.051241 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85a8db05-1efb-47d0-80c5-4bf2b51ba893 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 200 len: 1620 microversion: 2.1 time: 0.426182 Oct 06 12:51:03.052389 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 363/715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:02 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 1620 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:03.056932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:03.057555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:03.076321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.076906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.077554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.078506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.079128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.079716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.089904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:03.354777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:03.357033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:03.357862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:03.358468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:03.359486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:03.424287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.428333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.436434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.438900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.439977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.440972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.466415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:03.507840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:03.537704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for user 1f58173845e04996a0a5c2497e13d3cc and project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:03.603046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:03.611456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:03.743732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:03.755545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8819b543-d604-4065-ae54-c54ee55efd17 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337404 Oct 06 12:51:03.756949 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 353/716] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:03.768498 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4f08aac-a5c9-42f5-a193-dcf134e0cfb4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.715199 Oct 06 12:51:03.770059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 364/717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:03 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:03.773594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:03.774813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:03.775502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-468960828", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3cff8881-bbb7-4c80-9b45-f822d708aba0"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:03.785551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.787274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.788011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:03.789269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:03.790124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:03.794742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:04.024119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:04.449588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:04.465585 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35d744d6-31bd-4fc7-b9cd-1c7b1184d1e4 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.706804 Oct 06 12:51:04.470270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 354/718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:03 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:04.481160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:04.482467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:04.492529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:04.493628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:04.494398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:04.495049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:04.495704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:04.518337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:04.521444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:04.522017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:04.522608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:04.523427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:04.523973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:04.524519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:04.525005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:04.525551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:04.536528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:04.537150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:04.537650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:04.607150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:04.637050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:04.680498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:04.688533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:04.867455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5f3cb4a-b255-4bb3-8786-16455bbf2033 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095539 Oct 06 12:51:04.868496 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 365/719] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:04.883417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f16a45d0-d006-44c2-8804-d4aa22906d0a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:04.884337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f16a45d0-d006-44c2-8804-d4aa22906d0a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:05.033265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f16a45d0-d006-44c2-8804-d4aa22906d0a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.045218 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f16a45d0-d006-44c2-8804-d4aa22906d0a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1211 microversion: 2.1 time: 0.175436 Oct 06 12:51:05.053765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 366/720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:04 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:05.072706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:05.079222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:05.100023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:05.110707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:05.112585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:05.120715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:05.121768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:05.126999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:05.548181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.572145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.574453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.580402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1926997c-4aa9-4932-8915-17147f1dbeaf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.104952 Oct 06 12:51:05.603665 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 355/721] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:04 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:05.623599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49b9245a-39b0-41fb-9ea9-22ecb990f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:05.627369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49b9245a-39b0-41fb-9ea9-22ecb990f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:05.826633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.837785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49b9245a-39b0-41fb-9ea9-22ecb990f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:05.838580 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c9daff4-5f59-4bf3-bbd5-486be2bd5b91 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.783053 Oct 06 12:51:05.839174 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 367/722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:05 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:05.866788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:05.867293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:05.869498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49b9245a-39b0-41fb-9ea9-22ecb990f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1216 microversion: 2.1 time: 0.262103 Oct 06 12:51:05.888831 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 356/723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:05 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:05.896297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:05.904823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:05.906680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:05.909167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:05.910847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:05.912738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:06.089251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:06.090644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:06.150895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:06.156046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:06.156565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:06.157345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:06.166366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:06.166922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:07.557864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:07.574134 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a1809a26-b096-449c-9f37-971362579cd2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1263 microversion: 2.1 time: 1.489067 Oct 06 12:51:07.580015 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 357/724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:06 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1263 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:51:07.587283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:07.587883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:07.628547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:07.631599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:07.633543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:07.638383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:07.639809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:07.642445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:08.371032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:08.391286 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-130cce09-17b4-4af1-bdad-5312855929b7 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 2.550985 Oct 06 12:51:08.391916 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 368/725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:05 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:08.411897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:08.413712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:08.447163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:08.449528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:08.452658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:08.457624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:08.459133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:08.459745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.264261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:09.285510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:09.288756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:09.290902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-af5ace02-c230-49c6-b153-d754693b73a0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.709583 Oct 06 12:51:09.307697 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 358/726] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:07 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:09.307697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:09.307697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:09.339519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.342428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.343117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.344194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.344835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.345446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.718721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:09.744855 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25cdb82d-9a20-447e-aaac-79aca5474ec3 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1274 microversion: 2.1 time: 0.445292 Oct 06 12:51:09.745561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 359/727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:09 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1274 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:09.760424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:09.798281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.799286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.799980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.822925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] Creating event network-changed:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h1-860556-1 Oct 06 12:51:09.834167 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-51f7c7e5-6611-4e19-b335-92a4a2c6afef req-c4d91240-1282-4a16-9700-a6731a318c60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084013 Oct 06 12:51:09.834934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 360/728] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:09.842458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521adfae-fbe3-400e-85b3-2462d5db5a10", "name": "network-vif-plugged", "status": "completed", "tag": "80f7cbcd-ba1d-4966-8548-076f5e64225f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:09.855857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.856678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.857322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.874119 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] Creating event network-vif-plugged:80f7cbcd-ba1d-4966-8548-076f5e64225f for instance 521adfae-fbe3-400e-85b3-2462d5db5a10 on n-h2-860556-1 Oct 06 12:51:09.880788 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-79ef5a53-e2c2-42a5-986e-35421fb269fe req-53e0787b-09f7-452d-a4c8-5dea9d221c91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044268 Oct 06 12:51:09.882477 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 361/729] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:09.888157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:09.889210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:09.898688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.899509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.900160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.901106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:09.902101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:09.902762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:09.919756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:09.943852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5891b1ce-ed08-4f47-894b-251aef0d1763 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 1.549562 Oct 06 12:51:09.966819 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 369/730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:08 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:10.115754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1320708473", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "1a2b1240-2a88-4422-964d-a75f1d834db8"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:10.132796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:10.145584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c33e07a4-e519-4ea2-b6c8-d48cc5d798b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1269 microversion: 2.1 time: 0.261234 Oct 06 12:51:10.166132 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 362/731] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:09 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1269 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:10.181710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:10.183215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:10.201610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:10.202399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:10.204006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:10.204929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:10.207127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:10.208664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:10.264291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] validate_networks() for [('1a2b1240-2a88-4422-964d-a75f1d834db8', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:10.586910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:10.595344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d21c6ee6-d39d-4043-9da4-9b4e884ec480 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1316 microversion: 2.1 time: 0.428177 Oct 06 12:51:10.598004 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 363/732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:10 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:10.602879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:10.612777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:10.626301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:10.626804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:10.627282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:10.627957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:10.628588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:10.635432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.072499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:11.093714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:11.096199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:11.105283 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f34e9c8-0f56-46f5-afa9-59e3fa07ab6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 0.498598 Oct 06 12:51:11.108246 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 364/733] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:10 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:11.116496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:11.131464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:11.146953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.148188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.149148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.150565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.151612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.152535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.369805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:11.384274 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97030ee4-d05a-4840-a1c6-ca78fdd95f23 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1274 microversion: 2.1 time: 0.274131 Oct 06 12:51:11.388132 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 365/734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:11 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:11.417974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:11.421953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:11.448857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.451310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.453335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.459915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.462135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.465026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.977023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:11.977603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:11.978019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:11.978428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:11.978879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:11.994537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.995225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.998054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:11.998946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:11.999427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:11.999859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:12.033160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Getting quotas for project fa10e59ce18f4619974ab0a08b621423. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:12.041487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Getting quotas for user 5f1f76a37a074e509260ca51b2e6a358 and project fa10e59ce18f4619974ab0a08b621423. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:12.058717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:12.061813 n-d-860556-1 devstack@n-api.service[129615]: WARNING nova.utils [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1320708473 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-132070847 Oct 06 12:51:12.062843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:12.167939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d721b465-0bd0-4942-a390-da5d52b1988c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.196690 Oct 06 12:51:12.177619 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 370/735] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:12.202057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:12.203364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:12.253388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:12.257039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:12.258766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:12.262776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:12.263987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:12.268364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:12.431991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:12.444783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-843cf31b-3167-428e-b1aa-115e4c6e7724 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 1.049236 Oct 06 12:51:12.449074 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 366/736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:11 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:12.457130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:12.461257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:12.476016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:12.480985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:12.481939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:12.483208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:12.484834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:12.486272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:13.434086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:13.462847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:13.469130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e56501ad-42f3-4815-aba0-f0739a5dd659 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 1.289444 Oct 06 12:51:13.470452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 371/737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:12 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:13.494305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:13.500040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:13.522137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:13.523327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:13.524165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:13.525485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:13.526199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:13.527081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:13.717262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:13.740504 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4fbf0756-88a2-4126-be8c-b42260b815e1 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1503 microversion: 2.1 time: 1.288862 Oct 06 12:51:13.742041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 367/738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:12 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1503 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:13.779155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:13.782492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:13.805944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:13.814111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:13.814863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:13.819361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:13.819361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:13.819814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:13.822093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:14.354761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:14.382655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e13ff583-678f-4f8c-86ea-4c70d64a731c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1228 microversion: 2.1 time: 0.634844 Oct 06 12:51:14.386632 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 368/739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:13 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1228 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:14.397043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:14.398480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:14.416330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:14.417628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:14.418675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:14.420187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:14.421279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:14.422331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:14.689007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:14.703990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:14.708160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:14.709633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52961c86-9acd-4a07-aba8-c09a07e9399c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.237641 Oct 06 12:51:14.711006 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 372/740] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:13 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:14.717573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d5be5b-600f-4746-9309-4fecd91121bd", "name": "network-vif-plugged", "status": "completed", "tag": "55c1f1a9-f64c-414b-a61e-6249231b7c35"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:14.734405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:14.735177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:14.736343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:14.758676 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] Creating event network-vif-plugged:55c1f1a9-f64c-414b-a61e-6249231b7c35 for instance b2d5be5b-600f-4746-9309-4fecd91121bd on n-h2-860556-1 Oct 06 12:51:14.767166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3f951581-492b-44de-9493-f952aa0e2245 req-9fe8f8f4-3ba1-42ad-a603-16a8de0a656a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054329 Oct 06 12:51:14.769690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 373/741] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:14.778586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:14.780445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:14.851855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:14.852706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:14.856962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:14.858691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:14.862509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:14.868635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.228889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:15.240670 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3473b57e-ee03-4b39-81e0-783a59e5d36f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.851563 Oct 06 12:51:15.243580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 369/742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:14 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:15.258386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:15.260031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:15.277000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.280331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.282505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.284116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.288023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.289124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.354111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:51:15.557533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4847fd4-5616-4a9b-8320-dc00a2288263 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 204 len: 0 microversion: 2.1 time: 0.312306 Oct 06 12:51:15.558668 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 370/743] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:51:15 2022] DELETE /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:51:15.569327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:15.570082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:15.590726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.591157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.591627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.592847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.593997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.594429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.602412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:15.665511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:15.678344 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0ddb22f-086b-42c8-9320-1c0af27494dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.906926 Oct 06 12:51:15.678930 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 374/744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:14 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:15.687142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:15.687751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:15.701425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.702174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.702400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.703101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:15.703548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:15.703961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:15.862774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=18 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:16.139049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:16.148446 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-877d8b09-480d-4fa2-a951-5ebb3aeecfa6 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1290 microversion: 2.1 time: 0.467703 Oct 06 12:51:16.150924 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 375/745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:15 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1290 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:16.156045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:16.156987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:16.183731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.184793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.185446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:16.186893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.188027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.188697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:16.682424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:16.703311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a1e0c3d7-e324-448c-8a48-617e0e4e3855 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 1.139481 Oct 06 12:51:16.709105 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 371/746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:15 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:16.729967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:16.732046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:16.758515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.762533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.764068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:16.769223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.772387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.773163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:16.780327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:16.795152 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ee98121-2c30-49b6-9556-dee594bbc6cd tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1509 microversion: 2.1 time: 0.642881 Oct 06 12:51:16.795733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 376/747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:16 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1509 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:16.816258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:16.817159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:16.834058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.835121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.835783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:16.836774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:16.837407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:16.838751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:17.274951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:17.293189 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fcb39097-b07a-4d88-8763-bef5b62e3a66 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.492545 Oct 06 12:51:17.307187 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 377/748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:16 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:17.314892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:17.320998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:17.348525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:17.349281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:17.350257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:17.351636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:17.352367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:17.366723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:17.820105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:17.833639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:17.836294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:17.836458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-424adc10-9ce1-42ed-bc72-1ad008de49a8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1361 microversion: 2.25 time: 1.124993 Oct 06 12:51:17.837611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 372/749] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:16 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1361 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:17.863400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5c384d-8090-45ae-944b-d84bbb84359a", "tag": "faa79828-2c68-4f74-9734-527649c3bb24"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:17.881868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:17.882743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:17.884214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:17.906040 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] Creating event network-changed:faa79828-2c68-4f74-9734-527649c3bb24 for instance 2c5c384d-8090-45ae-944b-d84bbb84359a on n-h2-860556-1 Oct 06 12:51:17.921450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-64c5ccae-e42f-4ecb-8f3d-c05f2029217f req-a72d0bd9-889f-4d3a-84ee-13017445d2da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083056 Oct 06 12:51:17.924055 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 373/750] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:17.936959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:17.937966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:17.961692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:17.963181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:17.963854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:17.967274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:17.969691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:17.971291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.040817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:18.052325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4719b3ff-1c0e-4247-986a-559358af4d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.743539 Oct 06 12:51:18.056997 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 378/751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:17 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:18.062114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a2609f-0fe8-44f8-ba65-41a607d79568", "tag": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:18.083955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.084700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.085328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.112227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] Creating event network-changed:1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 for instance 06a2609f-0fe8-44f8-ba65-41a607d79568 on n-h1-860556-1 Oct 06 12:51:18.122192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-86c3fa4b-7cc7-4007-afb1-81cc1a56e4e0 req-5add3f96-17fe-4689-943e-bcbe8394d6c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063424 Oct 06 12:51:18.123127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 379/752] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:18.132630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:18.133566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:18.140442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.141195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.141832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.143212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.144257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.146378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.534578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:18.547240 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a80bfe76-304f-4bcf-a3eb-a2293512cc9c tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1332 microversion: 2.1 time: 0.614649 Oct 06 12:51:18.547845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 374/753] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:17 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1332 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:18.557718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:18.570120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:18.588532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.589051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.589526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.591044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.591738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.592375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.796263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:18.804697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56316f7c-b356-4656-875a-5b51a201a36f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.677014 Oct 06 12:51:18.805288 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 380/754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:18 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:18.816846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "name": "network-vif-plugged", "status": "completed", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:18.845763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.846540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.847124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.883016 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] Creating event network-vif-plugged:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h1-860556-1 Oct 06 12:51:18.890933 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3c089607-3f64-49f6-ab28-fa0090d79f44 req-5952c0eb-e257-4d92-949e-5a472d0426b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077497 Oct 06 12:51:18.892103 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 381/755] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:18.900812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:18.907980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:18.924476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.924983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.925412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.926160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:18.926903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:18.930150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:18.963377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:51:19.105053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a06a8a6-6a5e-43bc-be60-efca01692abc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 204 len: 0 microversion: 2.1 time: 0.211291 Oct 06 12:51:19.105936 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 382/756] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:51:18 2022] DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:51:19.119445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:19.122740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:19.136911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.143508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.148368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:19.149766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.154791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.155579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:19.234117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:19.362560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:19.395620 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-13d3ee78-ada0-4775-9a42-95c3f8d75c89 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1509 microversion: 2.1 time: 0.843543 Oct 06 12:51:19.397616 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 375/757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:18 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1509 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:19.410229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:19.416122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:19.434367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.435392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.436019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:19.437222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.437898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.438653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:19.915831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:19.946009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:19.952339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:19.958983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8407bf4a-851d-4a2c-86e2-add69d692923 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1556 microversion: 2.25 time: 0.554660 Oct 06 12:51:19.959553 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 376/758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:19 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1556 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:19.967139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:19.967761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:19.975513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.976210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.976924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:19.978055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:19.979278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:19.979876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:20.076628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:20.087316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2aebbc75-9ac5-473b-9f81-43712a1cebb2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.979382 Oct 06 12:51:20.088409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 383/759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:19 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:20.094678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1963769045", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "171029855", "adminPass": "***", "networks": [{"uuid": "2678a938-277f-419d-a5e8-c3914bbe8024"}], "security_groups": [{"name": "tempest-securitygroup--1513720068"}], "key_name": "tempest-keypair-2103053056", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:20.286741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:20.296031 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2adc97f-d6da-4f25-94df-55ebc37a91a0 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.334091 Oct 06 12:51:20.297322 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 377/760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:19 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:20.302444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:20.303381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:20.310999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:20.316048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:20.316513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:20.317837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:20.318301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:20.318732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:20.325682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] validate_networks() for [('2678a938-277f-419d-a5e8-c3914bbe8024', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:20.681240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:20.695616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c4d5916-6d9e-4596-b8d6-090b6ac86962 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1332 microversion: 2.1 time: 0.396416 Oct 06 12:51:20.714297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 378/761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:20 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:20.720712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:20.721522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:20.733106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:20.734340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:20.735170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:20.736949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:20.737583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:20.738583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.077093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:21.088424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-523319f5-544e-47b9-9a6a-82c6c54adada tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.372900 Oct 06 12:51:21.089616 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 379/762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:20 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:21.300683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:21.301981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:21.302600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:21.303653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:21.304644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:21.312229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:21.312852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:21.320445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.321294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.321983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.322757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.323652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.324942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.325906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.326034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.326676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.327442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.328025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.328802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.373297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:21.379654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Getting quotas for user c26ae4c4eac2418b8df09afc8ab0b5b5 and project 80e5442d47a34f03a9f0020d55d6d0ff. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:21.396679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:21.399364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:21.433943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:21.471114 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73832927-398d-49e3-8d1e-3e6f80d4c808 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.381443 Oct 06 12:51:21.479240 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 384/763] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:21.484581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60834218-927a-4242-a8ca-d68a62349697", "tag": "62f09810-7e17-45ab-bee4-7bb805cb1ea5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:21.497555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.498098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.498800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.510161 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] Creating event network-changed:62f09810-7e17-45ab-bee4-7bb805cb1ea5 for instance 60834218-927a-4242-a8ca-d68a62349697 on n-h2-860556-1 Oct 06 12:51:21.515558 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-50d5eaef-e0f3-4cae-9397-6a4106fecc5a req-87ec159b-c5cc-452d-b0f6-9643dd239023 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Oct 06 12:51:21.517093 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 385/764] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:21.524344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521adfae-fbe3-400e-85b3-2462d5db5a10", "name": "network-vif-deleted", "tag": "80f7cbcd-ba1d-4966-8548-076f5e64225f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:21.543691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.544452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.545055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.559122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] Creating event network-vif-deleted:80f7cbcd-ba1d-4966-8548-076f5e64225f for instance 521adfae-fbe3-400e-85b3-2462d5db5a10 on n-h2-860556-1 Oct 06 12:51:21.582434 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e0bda3e8-5890-44c1-9318-fdd55f936010 req-4049b5bd-8bd8-4390-8072-f580d5c8e221 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059012 Oct 06 12:51:21.583711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 386/765] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:21.593047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:21.594873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:21.606415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.607683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.608505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.610701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.611832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.612870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.687245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.688281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.693393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.694580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lazy-loading 'fault' on Instance uuid 521adfae-fbe3-400e-85b3-2462d5db5a10 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:21.745514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid b2d5be5b-600f-4746-9309-4fecd91121bd {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:21.764643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:21.781204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-478abe04-328b-474c-962d-2d2c7c9d2b52 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1306 microversion: 2.1 time: 0.192370 Oct 06 12:51:21.783808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 387/766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:21 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:21.792502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:21.793483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:21.812154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.832207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.839371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.843497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.844058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.845884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.917913 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01e960ba-d5f9-410b-a2f6-bfddb353bc8c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 2048 microversion: 2.25 time: 0.807727 Oct 06 12:51:21.918816 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 380/767] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:21 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 2048 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:21.936736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:21.937368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:21.953767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.954274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.954721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:21.955458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:21.955923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:21.956360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.530964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:22.549152 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94e29cf4-1d02-4057-b90a-bd7b823889e4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1313 microversion: 2.1 time: 0.629425 Oct 06 12:51:22.551987 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 381/768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:21 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:22.560963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:22.562185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:22.571550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.572413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.573152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.574179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.574864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.575516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.726101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:22.737132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8c48cf1-d37e-4b72-9bcd-fad171b4993c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1259 microversion: 2.1 time: 0.181297 Oct 06 12:51:22.739011 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 382/769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:22 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:22.744438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:22.745275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:22.753478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.755430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.756174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.757272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.757983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.758625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.810541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:22.820584 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f8102ee-a1ec-49b1-b846-9de4381706a6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 1.035145 Oct 06 12:51:22.821862 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 388/770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:21 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:22.827459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:22.828265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:22.835265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.835982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.836180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:22.837070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:22.837552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:22.838082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.094616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:23.104993 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b4bd40b1-a175-4c23-8289-90d647676f26 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1332 microversion: 2.1 time: 0.364723 Oct 06 12:51:23.132401 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 383/771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:22 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1332 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:23.138980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:23.139886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:23.151639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid b2d5be5b-600f-4746-9309-4fecd91121bd {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:23.164122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.164874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.166807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.167972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.169984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.171214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.296217 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7b08c6f-ee19-4f20-824d-3bae67addf3a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 2048 microversion: 2.25 time: 0.472831 Oct 06 12:51:23.315151 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 389/772] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:22 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 2048 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:23.321057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:23.321982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:23.328473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.329268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.329955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.330885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.331530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.332146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.369138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.370065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.370703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.371373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lazy-loading 'fault' on Instance uuid 521adfae-fbe3-400e-85b3-2462d5db5a10 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:23.439592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cad49ba6ed41ce834aad966012179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ec0eee7b744b7c8cae1dcea6c90dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:23.449885 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2796f76-1997-48ee-93c9-2cafe9ff9b29 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 200 len: 1306 microversion: 2.1 time: 0.133144 Oct 06 12:51:23.454695 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 390/773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:23 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 1306 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:23.464037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:23.480465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.481378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.482162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.483124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.483760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.484357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.553620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a502a586-821b-4a06-9c59-413e1fc659c9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.097539 Oct 06 12:51:23.554281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 391/774] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Oct 6 12:51:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:51:23.562130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:23.568690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": "auto"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:23.571655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:23.596318 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a532a90-6d62-4c72-951c-05088a3fd089 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.458179 Oct 06 12:51:23.600228 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 384/775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:23 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:23.600819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.601491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.602119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.602995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.603666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.604301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.635496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:23.636131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:23.668029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.668371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'flavor' on Instance uuid b2d5be5b-600f-4746-9309-4fecd91121bd {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:23.668531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.678172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.684026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:23.687315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:23.688148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:23.701461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Going to try to live migrate instance to n-h1-860556-1 {{(pid=129615) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:51:24.516676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:24.533519 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e2287e7-563f-47d1-b2d3-0033c4f09006 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1463 microversion: 2.1 time: 0.930533 Oct 06 12:51:24.539332 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 385/776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:23 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1463 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:24.548051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:24.549690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:24.570977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.571477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.571915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:24.575484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.576556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.576556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:24.668349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:24.700430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ab2244d-eff8-4050-8f06-3404e39eb6d8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1321 microversion: 2.1 time: 0.158511 Oct 06 12:51:24.718215 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 386/777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:24 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:24.732689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:24.733417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:24.743173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.744003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.745490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:24.758666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.759210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.759660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:24.962806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:24.974013 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a22ff37-34f4-4f13-8b56-6ebca170a7cf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.253720 Oct 06 12:51:24.975141 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 387/778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:24 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:24.980883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:24.981835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:24.989151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.990161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.990846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:24.991783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:24.993142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:24.993937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.022582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:25.174145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:25.184545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0c22038-75cc-44d6-b586-3d3c9c79bd38 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1332 microversion: 2.1 time: 0.207865 Oct 06 12:51:25.185529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 388/779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:24 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1332 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:25.190787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552a1b4f-82e7-4dc9-8632-5ed09edf69e9", "name": "network-vif-deleted", "tag": "c96ea76b-3c5a-4b7a-803d-998872351c2a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:25.208874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.209993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.211338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.236627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] Creating event network-vif-deleted:c96ea76b-3c5a-4b7a-803d-998872351c2a for instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 on n-h1-860556-1 Oct 06 12:51:25.245877 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3ff80236-0046-464c-8dde-08ad470d5b2b req-ee15679c-f5e5-41d4-a083-d0f3cc86d1fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058357 Oct 06 12:51:25.247375 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 389/780] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:25.258766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a2609f-0fe8-44f8-ba65-41a607d79568", "name": "network-vif-plugged", "status": "completed", "tag": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:25.292929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.294805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.309033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.333498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] Creating event network-vif-plugged:1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 for instance 06a2609f-0fe8-44f8-ba65-41a607d79568 on n-h1-860556-1 Oct 06 12:51:25.340232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-755fbfdd-6835-45ae-96fd-758ed0989bd8 req-ac0d973e-da34-45e3-a634-2e0131f7cabd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090884 Oct 06 12:51:25.346181 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 390/781] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:25.360370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:25.362235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:25.375386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.378313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.378899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.380523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.383475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.385422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.421898 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 HTTP/1.1 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:25.424111 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:25.425864 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '521adfae-fbe3-400e-85b3-2462d5db5a10'} Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:25.427404 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:25.430950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:25.433173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:25.433173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25aed51e-0d82-4e31-8b71-08b97cac990d tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 404 len: 111 microversion: 2.1 time: 0.081346 Oct 06 12:51:25.433173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 391/782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:25 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:25.437284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:25.440333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:25.448716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.450272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.450272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.450569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.451365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.452111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.690766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:25.698866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Old instance type m1.heat2, new instance type m1.heat {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 12:51:25.706217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:25.706634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:25.707108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:25.708129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:25.708744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:25.859157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc464e7a-0cdb-4316-8f74-dfb774889af8 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598/action" status: 202 len: 0 microversion: 2.1 time: 0.426970 Oct 06 12:51:25.864005 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 392/783] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:25 2022] POST /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:51:25.870275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:25.870987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:25.882991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.884106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.884106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:25.891286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:25.891900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:25.892365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.130605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:26.139853 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5782c96c-b5f6-4960-be5c-8812a7595eb6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.274424 Oct 06 12:51:26.140730 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 393/784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:25 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:26.150994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-278450086", "metadata": {"image_type": "test"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:26.150994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:26.166174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.166174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.166174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.166174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.167003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.167003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.181401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10/action HTTP/1.1 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 111 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:26.183215 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-278450086", "metadata": {"image_type": "test"}}} Oct 06 12:51:26.184512 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '521adfae-fbe3-400e-85b3-2462d5db5a10', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-278450086', 'metadata': {'image_type': 'test'}}}} Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:26.185246 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:26.186669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-552e22da-eef1-48aa-98f3-1d82cd7ae0ad tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "POST /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10/action" status: 404 len: 111 microversion: 2.1 time: 0.042985 Oct 06 12:51:26.188079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 394/785] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Oct 6 12:51:26 2022] POST /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:26.194055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:26.194810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:26.203556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.204232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.204826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.205863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.206451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.206975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.409259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:26.425415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-125dbd33-cd19-4c65-a6a4-22ab3f88f9d6 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.235146 Oct 06 12:51:26.434576 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 395/786] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:26 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:26.446154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:26.453444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:26.466771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.471008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.471525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:26.472328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:26.472981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:26.473370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:27.123071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:27.149559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1f50e86-8c4f-4fc3-b484-d65d492b31f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1472 microversion: 2.1 time: 0.713291 Oct 06 12:51:27.154761 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 396/787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:26 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1472 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:27.171584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:27.172207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:27.187775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:27.187775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:27.188547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:27.189131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:27.189581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:27.190039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:27.537154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:27.567262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d271dd9-e976-43fe-8d95-8be71293acd7 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.411079 Oct 06 12:51:27.567885 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 397/788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:27 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:27.590248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1359595308", "metadata": {"image_type": "test"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:27.592705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Failed to fetch instance by id tempest-invalid-576109092 {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:51:27.593310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance tempest-invalid-576109092 could not be found. Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/tempest-invalid-576109092/action HTTP/1.1 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 112 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:27.594972 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1359595308", "metadata": {"image_type": "test"}}} Oct 06 12:51:27.596279 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance tempest-invalid-576109092 could not be found. Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'tempest-invalid-576109092', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1359595308', 'metadata': {'image_type': 'test'}}}} Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-576109092 could not be found. Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:27.597375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-576109092 could not be found. Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-576109092 could not be found. Oct 06 12:51:27.600791 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:27.603411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance tempest-invalid-576109092 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:27.603411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ac2f5fd-a681-4b6e-bdd2-684ad62f375c tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-576109092/action" status: 404 len: 100 microversion: 2.1 time: 0.011199 Oct 06 12:51:27.617222 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 398/789] 10.222.0.26 () {60 vars in 1246 bytes} [Thu Oct 6 12:51:27 2022] POST /compute/v2.1/servers/tempest-invalid-576109092/action => generated 100 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:27.624049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:27.624332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:27.647509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:27.648024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:27.648471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:27.649205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:27.649665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:27.650123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.350889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:28.363839 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd313c07-5393-456d-9291-e3ce8f6657d8 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1536 microversion: 2.1 time: 0.745203 Oct 06 12:51:28.377932 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 399/790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:27 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1536 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:28.386728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93da43fb-b16f-470d-84ce-5fc1868ca3e4", "tag": "612a6aaf-d584-44ad-b9d1-c62b98b9cfd6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:28.420465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.420956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.421401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.436682 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] Creating event network-changed:612a6aaf-d584-44ad-b9d1-c62b98b9cfd6 for instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 on n-h1-860556-1 Oct 06 12:51:28.455685 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8a2484dd-530f-42cb-950e-f6718a733092 req-dee02229-7d07-45ca-b647-71fcdd913be4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089300 Oct 06 12:51:28.462897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 400/791] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:28.472423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:28.474790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:28.485088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.485598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.486300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.487046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.488114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.488611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.915966 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb24935f-2512-4bdd-9542-a35d38daa7ab tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd/action" status: 202 len: 0 microversion: 2.25 time: 5.352365 Oct 06 12:51:28.917571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 392/792] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:51:23 2022] POST /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd/action => generated 0 bytes in 5355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:51:28.923131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:28.923745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:28.925181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:28.931304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.932149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.932596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.933359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.933834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.934446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.936889 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b48e6549-eaf1-465b-be1e-a8f0a9086a66 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.472559 Oct 06 12:51:28.945926 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 401/793] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:28 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:28.956034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1184633580"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:28.956445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:51:28.957137 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 57 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:28.959670 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "tempest-test-snap-1184633580"}} Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:28.960951 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1184633580'}}} Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:28.967659 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:28.968972 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:28.970143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:28.970143 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d75732a4-78b0-44db-b8fd-7badb50ae4a9 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013819 Oct 06 12:51:28.970143 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 402/794] 10.222.0.26 () {60 vars in 1275 bytes} [Thu Oct 6 12:51:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:28.970143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:28.970415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:28.980159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.980990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.981729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:28.983006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:28.983755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:28.984414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:29.142928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:29.183905 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b9bdc7f-7572-4eb9-b52b-a5349d60a31c tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.264841 Oct 06 12:51:29.185908 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 393/795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:28 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:29.210356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aafc0657-f509-4b16-8726-6e6125ea5a29 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'create', calling method: .version_select at 0x7f7d3f6c3310>, body: {"pool": "2f3faab0-bee3-44b8-ae93-6e6bd2454aab"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:29.539629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:29.580525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5242b765-fcbc-467a-9529-549b5bf33350 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1472 microversion: 2.1 time: 0.607154 Oct 06 12:51:29.599364 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 403/796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:28 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1472 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:29.620741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:29.622488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:29.630922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:29.632532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:29.633603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:29.635125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:29.635848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:29.636494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:30.084906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:30.094169 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f04c2fa1-79c2-481a-a2b1-b2eeb085aff6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.488297 Oct 06 12:51:30.097629 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 404/797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:29 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:30.110256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:30.111207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:30.125546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:30.126109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:30.126997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:30.128321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:30.128873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:30.129283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:30.874085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:30.885867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:30.887266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:30.888768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c298f96f-a74a-4ac1-a289-6a9942d8239a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.782563 Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 405/798] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:30 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1166585320"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 57 Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:30.903644 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:30.904722 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "tempest-test-snap-1166585320"}} Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1166585320'}}} Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:30.906140 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:30.907664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9710083-9c25-4657-91f4-0673cc4597ca tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013498 Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 406/799] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Oct 6 12:51:30 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:30.915775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:30.917363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:30.918123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:30.918621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:30.919075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:30.919880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:30.920349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:30.920783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.351828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:31.360093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2b2813c1-388a-4059-824c-ca21ddbc2813 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.453512 Oct 06 12:51:31.360660 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 407/800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:30 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:31.378667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:31.379716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:31.391193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:31.391713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:31.392299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=20 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:31.392803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.393875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:31.394509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:31.395967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.762376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:31.771580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c91aac65-b92d-4a1a-82a5-d770661bda74 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.409747 Oct 06 12:51:31.772544 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 408/801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:31 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:31.777487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60834218-927a-4242-a8ca-d68a62349697", "name": "network-vif-plugged", "status": "completed", "tag": "62f09810-7e17-45ab-bee4-7bb805cb1ea5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:31.804706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:31.806076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:31.806789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.825257 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] Creating event network-vif-plugged:62f09810-7e17-45ab-bee4-7bb805cb1ea5 for instance 60834218-927a-4242-a8ca-d68a62349697 on n-h2-860556-1 Oct 06 12:51:31.830817 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3a476ef6-3639-43a3-8ce6-c5e6c54fd14c req-4a6c10d4-a760-49af-8740-506af813cb1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057080 Oct 06 12:51:31.831664 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 409/802] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:31.840192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:31.841195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:31.849941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:31.850437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:31.850892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.851645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:31.852110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:31.852548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:31.869224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:32.215109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:32.226501 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4bdc19e1-f62c-4780-8551-4d5688ddb146 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.392899 Oct 06 12:51:32.227283 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 410/803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:31 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:32.232944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:32.233450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:32.244132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.244551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.244992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:32.245701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.246389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.247092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:32.265032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 HTTP/1.1 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:32.266978 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:32.268484 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '521adfae-fbe3-400e-85b3-2462d5db5a10'} Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:32.269267 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:32.271463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:32.272686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:32.272686 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c556a0bb-4575-4c4a-a452-c7e1e020a5eb tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 404 len: 111 microversion: 2.1 time: 0.039343 Oct 06 12:51:32.273469 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 411/804] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:51:32 2022] DELETE /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:32.278945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:32.279793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:32.290581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.291448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.291902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:32.292632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.293097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.293533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:32.656798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:32.665931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5fbad59-19ee-4038-80a7-7b49e8f0d4d8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1316 microversion: 2.1 time: 0.391054 Oct 06 12:51:32.666982 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 412/805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:32 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:32.672032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:32.672788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:32.680619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.682305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.682936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:32.683992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:32.684612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:32.685220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.233106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.240278 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aafc0657-f509-4b16-8726-6e6125ea5a29 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.050395 Oct 06 12:51:33.241286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 394/806] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:51:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:33.245351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.246622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:33.247353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] [instance: 521adfae-fbe3-400e-85b3-2462d5db5a10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.249178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.250916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99b950fa-d638-4b3e-ac33-3b46cb0e2f0e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.582654 Oct 06 12:51:33.256157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.257025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.257683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.258645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.260921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.261587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.266425 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 413/807] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:32 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:33.273464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d5be5b-600f-4746-9309-4fecd91121bd", "name": "network-vif-unplugged", "status": "completed", "tag": "55c1f1a9-f64c-414b-a61e-6249231b7c35"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:33.282946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] HTTP exception thrown: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Request method failure captured: Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 HTTP/1.1 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8XNzsus_PfbtoUPoNVrbWAkICTa-E5PXnSjTAenaOoPg8hc5NoVu7iyDX4gXs5nImQsAPxDGxB9sIY0xh4yW67hlXBrN6iS5swleUwMYA0awRDO3aF7TJ-k0zwA4KMZsaVVsm04Hft41rJbP3ruB-pH78VuVUySUxV-z1JDzgx7_8 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:51:33.284986 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24ec0eee7b744b7c8cae1dcea6c90dd8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24ec0eee7b744b7c8cae1dcea6c90dd8"}]}] Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 24ec0eee7b744b7c8cae1dcea6c90dd8 Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1756641207 Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c5cad49ba6ed41ce834aad966012179e Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesNegativeTestJSON-1756641207-project Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:33.286633 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '521adfae-fbe3-400e-85b3-2462d5db5a10'} Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:33.287554 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. Oct 06 12:51:33.288982 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:33.290297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] Returning 404 to user: Instance 521adfae-fbe3-400e-85b3-2462d5db5a10 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:33.290297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2fd3ce2d-747c-4e16-a63b-b14f654f2556 tempest-ImagesNegativeTestJSON-1756641207 tempest-ImagesNegativeTestJSON-1756641207-project] 10.222.0.26 "GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10" status: 404 len: 111 microversion: 2.1 time: 0.044581 Oct 06 12:51:33.292794 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 395/808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:33 2022] GET /compute/v2.1/servers/521adfae-fbe3-400e-85b3-2462d5db5a10 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:51:33.302208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:33.303531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.303775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.305371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.307224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.313893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.314392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.315032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.316113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.317926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.318558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.336264 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] Creating event network-vif-unplugged:55c1f1a9-f64c-414b-a61e-6249231b7c35 for instance b2d5be5b-600f-4746-9309-4fecd91121bd on n-h2-860556-1 Oct 06 12:51:33.348308 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-de8d4a9b-532a-4545-ae7a-a54f8305b971 req-14ab7c50-2030-46e2-82c0-38b3f88055a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080284 Oct 06 12:51:33.349176 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 414/809] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:33.354084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:33.354781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.362017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.362586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.363099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.363917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.364451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.364957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.507546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:33.608611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.613136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.619375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-594b5a66-e070-423a-a3a2-b113fec4f441 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.268933 Oct 06 12:51:33.620385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 415/810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:33 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:33.623727 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfb65ba9-427b-41c0-bae0-f486a9c9bc76 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.329747 Oct 06 12:51:33.625612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:33.626486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.633094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:33.635501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.636347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.637076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.638037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.638705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.639308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.639892 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 396/811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:33 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:33.645995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: .version_select at 0x7f7d45aef8b0>, body: {"addFloatingIp": {"address": "172.25.9.64"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:33.649081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.655535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.656182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.656632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.658026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.658497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.658932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.769422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:51:33.775983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquired lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:51:33.899584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:33.912669 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-363417ac-7b3c-4fd6-8cb0-72e87cc6c2e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.290853 Oct 06 12:51:33.921775 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 416/812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:33 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:33.928109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:33.929120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:33.937304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.938013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.939118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:33.940034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:33.940649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:33.941236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:34.270885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:34.290701 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c97d8add-6bcf-4d96-9467-c63752ee534d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1465 microversion: 2.1 time: 0.367430 Oct 06 12:51:34.291602 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 417/813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:33 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1465 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:34.296158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c384d-8090-45ae-944b-d84bbb84359a", "name": "network-vif-plugged", "status": "completed", "tag": "faa79828-2c68-4f74-9734-527649c3bb24"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:34.324283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:34.324777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:34.338690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:34.349849 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] Creating event network-vif-plugged:faa79828-2c68-4f74-9734-527649c3bb24 for instance 2c5c384d-8090-45ae-944b-d84bbb84359a on n-h2-860556-1 Oct 06 12:51:34.356944 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0a47a6ab-9aa8-4927-8a49-68fe72c11dda req-fbdb9088-f6a4-4cd8-ab44-9626d7bd25c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064023 Oct 06 12:51:34.357564 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 418/814] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:34.364845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:34.365556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:34.372162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:34.372665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:34.373106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:34.373976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:34.375081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:34.375990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:34.758120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:34.766586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:34.768038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:34.769206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c01e0034-8271-4ad1-80c9-d5e34a442f01 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.410338 Oct 06 12:51:34.784056 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 419/815] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:34 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:34.784056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:34.784056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:34.793658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:34.794191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:34.794625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:34.795334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:34.795785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:34.796210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.099810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-984296c3-e5d6-4266-8472-9cb299278e62 tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1616 microversion: 2.1 time: 0.322085 Oct 06 12:51:35.100430 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 420/816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:34 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1616 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:35.108242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:35.118733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:35.126806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.136873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.138041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.139368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.142085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.142689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.476499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:35.486916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ecce0aec-b83e-461b-a2b2-d2e53faca40d tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.385104 Oct 06 12:51:35.487515 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 421/817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:35 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:35.493234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:35.494225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:35.500687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.501387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.502138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.503087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.503541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.504847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.842444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 12:51:35.847751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:35.857940 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf5ef038-f14f-4152-bfb4-6ee4ded83512 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1311 microversion: 2.1 time: 0.368231 Oct 06 12:51:35.870208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 422/818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:35 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1311 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:35.885697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:35.886658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:35.895075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.896518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.897152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:35.898846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:35.900241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:35.901494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:36.164144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:36.182261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2d484fb-de96-44a5-b772-a5f1d683d345 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.307421 Oct 06 12:51:36.195017 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 423/819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:35 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:36.211785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-490060207", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3cff8881-bbb7-4c80-9b45-f822d708aba0"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:36.285995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:37.015829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:37.016984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:37.017715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:37.018284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:37.018801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:37.029962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.030852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.031527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.032494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.033171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.033880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.064358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:37.072890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:37.088301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:37.091202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:37.181386 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-86d36eb0-eaa8-42b8-85da-23803affea18 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984869 Oct 06 12:51:37.182031 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 424/820] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:37.192963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d5be5b-600f-4746-9309-4fecd91121bd", "tag": "55c1f1a9-f64c-414b-a61e-6249231b7c35"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:37.218494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.218984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.219436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.251454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] Creating event network-changed:55c1f1a9-f64c-414b-a61e-6249231b7c35 for instance b2d5be5b-600f-4746-9309-4fecd91121bd on n-h2-860556-1 Oct 06 12:51:37.276945 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-62667978-c314-41c1-91d8-5cbfb54b9711 req-9e487a04-2b2c-45b6-b431-d1991035b7a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083468 Oct 06 12:51:37.278211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 425/821] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:37.292418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:37.293179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:37.305549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.306261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.306692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.307476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.307935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.308364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.902830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:37.913227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Updating instance_info_cache with network_info: [{"id": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51", "address": "fa:16:3e:cf:39:0f", "network": {"id": "1a2b1240-2a88-4422-964d-a75f1d834db8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-982225886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fa10e59ce18f4619974ab0a08b621423", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1fc12505-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 12:51:37.919663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:37.921142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:37.923250 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ef7b9a5-38fd-4b3e-b71c-2d2f510ee303 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.642895 Oct 06 12:51:37.923391 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 426/822] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:37 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:37.934300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93da43fb-b16f-470d-84ce-5fc1868ca3e4", "name": "network-vif-plugged", "status": "completed", "tag": "612a6aaf-d584-44ad-b9d1-c62b98b9cfd6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:37.943806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Releasing lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:51:37.945002 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-415eb9ce-d5a3-4c31-b6ed-36b47367fb34 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 202 len: 0 microversion: 2.1 time: 4.303936 Oct 06 12:51:37.949134 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 397/823] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:33 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 0 bytes in 4309 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 12:51:37.956128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.962309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.962983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.964033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:37.970404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:37.979664 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] Creating event network-vif-plugged:612a6aaf-d584-44ad-b9d1-c62b98b9cfd6 for instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 on n-h1-860556-1 Oct 06 12:51:37.987721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.988211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.988709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:37.989422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:37.989901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:37.990325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.003770 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e67d8371-3d18-42d9-a600-7bc391d47474 req-1e7e4820-1178-47a9-99b2-32a94ed8fa5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072962 Oct 06 12:51:38.005439 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 427/824] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:38.011293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:38.014094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:38.029441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.034528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.035207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.037845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.038649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.041536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.563849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:38.573305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7bc6029b-3f91-498d-859c-ed9ebfcd30c1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1389 microversion: 2.1 time: 0.622751 Oct 06 12:51:38.586830 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 398/825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:37 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1389 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:38.591717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:38.597844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:38.598709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:38.605674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.606402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.607005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.607488 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee28f290-90c6-4331-a9e6-afa9d12d35da tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1493 microversion: 2.1 time: 0.600328 Oct 06 12:51:38.608097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.608716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.609304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.610836 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 428/826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:38 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1493 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:38.625290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:38.631927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:38.648610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.652544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.653013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.653812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:38.654292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:38.658051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:38.762598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:38.776246 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99054c17-5811-4921-99fb-fb24da5de712 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1268 microversion: 2.1 time: 0.187773 Oct 06 12:51:38.777025 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 399/827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:38 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:38.803292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f97318dd-3819-4418-ba19-02ce5b79fd52 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'create', calling method: .version_select at 0x7f7d3f6c35e0>, body: {"pool": "2f3faab0-bee3-44b8-ae93-6e6bd2454aab"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:39.038490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:39.056641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6bd6bb7-74e0-4e46-9418-732f319a1bed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.443465 Oct 06 12:51:39.057265 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 429/828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:38 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:39.196711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:39.197677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:39.209837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:39.210434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:39.213410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:39.216164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:39.228975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:39.229700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:39.740052 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2005663-eef6-49f3-a0eb-865b99e14474 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1644 microversion: 2.1 time: 0.681582 Oct 06 12:51:39.742523 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 430/829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:39 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1644 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:39.758418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:39.760002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:39.773862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:39.774770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:39.775452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:39.776410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:39.777116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:39.779708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:39.786532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:40.107452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:40.128647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:40.131048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:40.132648 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-345301e1-1de7-4407-bb57-009506ff3150 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.388984 Oct 06 12:51:40.134622 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 431/830] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:39 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:40.141980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a2609f-0fe8-44f8-ba65-41a607d79568", "tag": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:40.158743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:40.159231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:40.159672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:40.187919 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] Creating event network-changed:1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 for instance 06a2609f-0fe8-44f8-ba65-41a607d79568 on n-h1-860556-1 Oct 06 12:51:40.200298 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f1ae4b0d-3df6-4cb2-80dc-2d197e2fcf73 req-1ae6fad3-ce6c-491f-ab5d-45ba15c82a99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063218 Oct 06 12:51:40.201871 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 432/831] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:40.231799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:40.234923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:40.249459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:40.250562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:40.251187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:40.252212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:40.253292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:40.254599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:40.773685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:40.782976 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8089adc9-265d-4461-a458-75479ab89032 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1588 microversion: 2.1 time: 0.578949 Oct 06 12:51:40.803506 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 433/832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:40 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1588 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:40.813136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:40.826493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:40.848303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:40.848814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:40.849262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:40.850021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:40.850483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:40.851087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:41.647050 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da90a5b1-3f71-4d2c-bda1-d13d7044d67a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1644 microversion: 2.1 time: 0.838657 Oct 06 12:51:41.648574 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 434/833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:40 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1644 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:41.666557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:41.667460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:41.680961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:41.682017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:41.683901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:41.684756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:41.685238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:41.685672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:42.058983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:42.069552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32b71bf0-d3cf-44fd-b076-4d79a10570dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1274 microversion: 2.1 time: 0.419513 Oct 06 12:51:42.086490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 435/834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:41 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1274 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:42.092097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:42.092892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:42.100732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:42.101429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:42.102074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:42.102947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:42.103555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:42.104348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:42.861608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:42.873189 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9de86dbe-966b-4f7d-9104-46e09d308144 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.785018 Oct 06 12:51:42.874272 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 436/835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:42 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:42.900155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:42.901109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:42.915564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:42.916329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:42.917111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:42.919437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:42.919920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:42.920653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.148824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7261e5d9-3bb6-4531-91d5-c62d9f4ccdc4 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272963 Oct 06 12:51:43.150554 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 437/836] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:51:42 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:43.155538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:43.156372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:43.170323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.170780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.171275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.176877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.177431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.177917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.328418 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f97318dd-3819-4418-ba19-02ce5b79fd52 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.549063 Oct 06 12:51:43.328418 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 400/837] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:51:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:43.340355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:43.355207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.358287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.361198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.365352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.370728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.371467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.427365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c252f574-5606-4a38-8a85-ce6b2473f48f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.098196 Oct 06 12:51:43.428932 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 401/838] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:51:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:43.436263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:43.437917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:43.458568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.459522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.462364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.465726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:43.466531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:43.467565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:43.518069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:44.120918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:44.131191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:44.133538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:44.135018 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3239c5b-f7f8-4be8-9873-10e6b71d4b62 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1566 microversion: 2.25 time: 0.983328 Oct 06 12:51:44.150895 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 438/839] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:43 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1566 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:44.160932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: .version_select at 0x7f7d45069b80>, body: {"addFloatingIp": {"address": "172.25.9.52"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:44.164508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:44.173417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:44.174215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:44.174854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:44.175738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:44.176380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:44.176967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:44.235088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:44.243764 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-931d2cdc-2829-42d4-a827-ed26b229a9dd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1316 microversion: 2.1 time: 0.813008 Oct 06 12:51:44.244337 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 402/840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:43 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:44.258746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:44.261545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:44.281311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:44.281556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:51:44.282073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:44.282464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquired lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:51:44.282588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:44.283209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:44.283672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:44.284101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:44.331076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lazy-loading 'flavor' on Instance uuid 2c5c384d-8090-45ae-944b-d84bbb84359a {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:44.356635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Going to try to live migrate instance to n-h1-860556-1 {{(pid=129615) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:51:45.668217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab.", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:51:45.669109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Releasing lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:51:45.669795 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.669795 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Request method failure captured: Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action HTTP/1.1 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 45 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs89Cr_unCq6l5EB-5aCHJnyqbAcM89zs2aDZkck9lghUTaI_nnyFlbPQJD0bOZpFassJbCzzyBBUyvQ4zR-oyJKOTjcS9aaL6bsl38VqVxYVYs_785XsoQaanO_36_rhCm1FwrHpU_kgkJ6GMdw9Bzx9Sl4I_92HL4psGHzp8x3AWQ Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:45.693550 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fa10e59ce18f4619974ab0a08b621423", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}] Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5f1f76a37a074e509260ca51b2e6a358 Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: {"addFloatingIp": {"address": "172.25.9.52"}} Oct 06 12:51:45.697504 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '06a2609f-0fe8-44f8-ba65-41a607d79568', 'body': {'addFloatingIp': {'address': '172.25.9.52'}}} Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.699331 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:51:45.701395 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.703252 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.706475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] Oct 06 12:51:45.708266 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:45.715486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Returning 400 to user: Cannot associate floating IP 172.25.9.52 (5cf9a2f2-e910-4d69-9db6-2f74d07401c1) with port 1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 2f3faab0-bee3-44b8-ae93-6e6bd2454aab. Oct 06 12:51:45.715486 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-f1a85974-e4ff-4dcf-af40-8303896242d0'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:45.715486 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-548bce8c-0237-4d03-9927-dc2c25ade24b tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 400 len: 381 microversion: 2.1 time: 1.559288 Oct 06 12:51:45.716545 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 439/841] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:44 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 381 bytes in 1565 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:51:45.728276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:45.728972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:45.736619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:45.737664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:45.739222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:45.740068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:45.740528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:45.740957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:46.235566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:46.245483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a246ff12-aee4-4cea-9d04-fdb62773305f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.527603 Oct 06 12:51:46.247782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 440/842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:45 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:46.266643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b081987-222e-44c1-8dbe-bea74eabf2a9", "tag": "eef9ab39-05f3-440a-8917-24810d4ea2b4"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:46.277564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:46.278083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:46.278527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:46.290445 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] Creating event network-changed:eef9ab39-05f3-440a-8917-24810d4ea2b4 for instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 on n-h2-860556-1 Oct 06 12:51:46.296222 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9b653ac9-e601-4baf-b457-15e5c8ae08b7 req-d0fb7a4d-8553-4c63-98c3-23f49419ed9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047001 Oct 06 12:51:46.297398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 441/843] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:46.305424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80e986d0-9079-4aa6-8d65-f6aedda4588e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Action: 'create', calling method: .version_select at 0x7f7d3f50ae50>, body: {"keypair": {"name": "tempest-keypair-1152034318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK6PNvW4bDuyboItTPgkgCMvpAD0iRlwnZQaB+jPsrs6ggnbdHMpswFDUHBFBV5165FuixfhMXZ9qndr0upletfQT3DM3VIJcuU6+mQXfCBz8iqN1nUCTYRhFs2kO3+XQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:46.322172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-80e986d0-9079-4aa6-8d65-f6aedda4588e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Getting quotas for project ee3802f815f54ef4bc1b5debd38086ed. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:46.328117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-80e986d0-9079-4aa6-8d65-f6aedda4588e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Getting quotas for user 1dfe076954e54c1aa8498659a124b7df and project ee3802f815f54ef4bc1b5debd38086ed. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:46.357823 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-80e986d0-9079-4aa6-8d65-f6aedda4588e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.058824 Oct 06 12:51:46.358493 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 442/844] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:51:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:51:46.363485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:46.365534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:46.372517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:46.373012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:46.373454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:46.374188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:46.374846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:46.375441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:46.796860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:46.849321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:46.849321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:46.849321 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ec3d8f6-8e95-444e-bd6d-17e25b0e76f4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1556 microversion: 2.25 time: 0.462887 Oct 06 12:51:46.849681 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 443/845] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:46 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1556 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:46.849681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:46.849681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:46.849681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:46.850072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:46.850072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:46.850072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:46.850072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:46.850400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:47.048767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:47.144829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:47.154128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3811d033-dbeb-4f2e-88b6-31fd9f5ecb45 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1316 microversion: 2.1 time: 0.328623 Oct 06 12:51:47.154712 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 444/846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:46 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:47.161158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0641fff7-b22b-4aa0-b42a-42379538f016 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '.version_select at 0x7f7d3f462dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:49.157715 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0641fff7-b22b-4aa0-b42a-42379538f016 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/5cf9a2f2-e910-4d69-9db6-2f74d07401c1" status: 202 len: 0 microversion: 2.1 time: 2.001131 Oct 06 12:51:49.158979 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 445/847] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:51:47 2022] DELETE /compute/v2.1/os-floating-ips/5cf9a2f2-e910-4d69-9db6-2f74d07401c1 => generated 0 bytes in 2003 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:51:49.170555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1a2baab-6e56-4e5e-9ade-45a1e81e30bb tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '.version_select at 0x7f7d3f50a8b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:49.179912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1a2baab-6e56-4e5e-9ade-45a1e81e30bb tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.181453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1a2baab-6e56-4e5e-9ade-45a1e81e30bb tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.182489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1a2baab-6e56-4e5e-9ade-45a1e81e30bb tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.199261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1a2baab-6e56-4e5e-9ade-45a1e81e30bb tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1898 microversion: 2.25 time: 0.033139 Oct 06 12:51:49.200632 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 446/848] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Oct 6 12:51:49 2022] GET /compute/v2.1/os-migrations => generated 1898 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:49.206466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:49.207869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:49.215273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.216255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.217056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.218393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.219013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.219746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.468002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:49.482863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fed0cbb8-badb-48db-ac80-73032f38a4f1 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1588 microversion: 2.1 time: 0.280472 Oct 06 12:51:49.484068 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 447/849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:49 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1588 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:49.492617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93da43fb-b16f-470d-84ce-5fc1868ca3e4", "tag": "612a6aaf-d584-44ad-b9d1-c62b98b9cfd6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:49.519140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.520635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.521677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.544526 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] Creating event network-changed:612a6aaf-d584-44ad-b9d1-c62b98b9cfd6 for instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 on n-h1-860556-1 Oct 06 12:51:49.550425 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1bf7ad8c-744f-401f-8046-a40d2040c2b7 req-6436a744-316d-449b-af59-2f91d6dc778f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064323 Oct 06 12:51:49.552168 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 448/850] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:49.558987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:49.560007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:49.568397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.569175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.569830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.571328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.572012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.572619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.647390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fc1d12d-4d13-44d0-9f3f-0ecf18bd3bb6 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a/action" status: 202 len: 0 microversion: 2.1 time: 5.392210 Oct 06 12:51:49.652350 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 403/851] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:44 2022] POST /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a/action => generated 0 bytes in 5398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:51:49.661861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:49.665132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:49.682411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.684723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.685405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.686352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:49.687051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:49.687658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:49.942380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:49.952057 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c22add69-b834-42e6-8df6-a4892c10f3aa tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.398266 Oct 06 12:51:49.953623 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 449/852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:49 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:49.973293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-814900634", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f295a2f5-c00c-4396-9681-564e3b6f4784"}, {"port": "24fafca0-69c1-413c-9265-b6bfa98f4998", "tag": "port-1"}, {"port": "79933516-6c72-4e04-9a70-db079e28ac58", "tag": "port-2"}, {"uuid": "52a1300f-dc44-485a-bcfc-da31928ed7fd", "tag": "net-1"}, {"uuid": "52a1300f-dc44-485a-bcfc-da31928ed7fd"}, {"uuid": "50a979c5-27c0-4632-885c-ac135d9ca4c3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "50a979c5-27c0-4632-885c-ac135d9ca4c3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5b406e78-f830-422e-ae07-f997934a0534", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9e20df96-942a-4356-9a19-58d2d1823d3e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3c544348-d1fb-49d3-8614-c9ec85012207", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1159923475"}], "key_name": "tempest-keypair-1152034318", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:50.131567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:50.139306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42ba146b-a42f-447b-b0b9-25b3f1d8486c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1316 microversion: 2.1 time: 0.485629 Oct 06 12:51:50.140858 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 404/853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:49 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:50.159054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: .version_select at 0x7f7d45aef9d0>, body: {"removeFloatingIp": {"address": "172.25.9.64"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:50.374991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] validate_networks() for [('f295a2f5-c00c-4396-9681-564e3b6f4784', None, None, None, None, None), (None, None, '24fafca0-69c1-413c-9265-b6bfa98f4998', None, None, None), (None, None, '79933516-6c72-4e04-9a70-db079e28ac58', None, None, None), ('52a1300f-dc44-485a-bcfc-da31928ed7fd', None, None, None, None, None), ('52a1300f-dc44-485a-bcfc-da31928ed7fd', None, None, None, None, None), ('50a979c5-27c0-4632-885c-ac135d9ca4c3', '10.2.2.100', None, None, None, None), ('50a979c5-27c0-4632-885c-ac135d9ca4c3', '10.2.2.200', None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:50.651843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:50.659498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:50.660011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:50.660506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:50.663321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:50.665067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:50.665553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:51.666283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:51:51.666283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquired lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:51:53.355412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 12:51:53.384166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:54.771823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Updating instance_info_cache with network_info: [{"id": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51", "address": "fa:16:3e:cf:39:0f", "network": {"id": "1a2b1240-2a88-4422-964d-a75f1d834db8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-982225886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fa10e59ce18f4619974ab0a08b621423", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1fc12505-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 12:51:54.799348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Releasing lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:51:54.800246 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cde07e49-e4f0-4549-9b25-b864b6e46751 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 202 len: 0 microversion: 2.1 time: 4.658178 Oct 06 12:51:54.800890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 405/854] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:50 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 0 bytes in 4659 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 12:51:54.805510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:54.808983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:54.810281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=51 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:54.820148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:54.821046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:54.821832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:54.822558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:54.823014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:54.823549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.073182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid b2d5be5b-600f-4746-9309-4fecd91121bd {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:51:55.088391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-003a4077-487a-40f9-8530-2e6463375e08 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 2048 microversion: 2.25 time: 0.286418 Oct 06 12:51:55.089079 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 406/855] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:54 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 2048 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:55.100949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:55.101664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:55.108343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.109378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.110715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.111367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.112009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.112470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.356808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:55.368825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70df6d21-ebea-4df2-b03a-5f9d7252b1f5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.278412 Oct 06 12:51:55.369778 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 407/856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:55 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:55.375323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:55.376028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:55.382931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.383742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.384399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.385511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.386387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.387176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.653072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:55.664491 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86876e0f-032f-4962-9df8-3a9dfd7dffd4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.293297 Oct 06 12:51:55.665189 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 408/857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:55 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:55.679659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:55.681418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:55.689035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.689918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.690367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.691094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.692340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.692822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.776519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:55.777622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:55.778368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:55.779029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:55.779548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:55.805570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.806238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.806786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.807662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:55.808229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:55.808925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:55.841197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Getting quotas for project ee3802f815f54ef4bc1b5debd38086ed. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:55.849772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Getting quotas for user 1dfe076954e54c1aa8498659a124b7df and project ee3802f815f54ef4bc1b5debd38086ed. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:55.865231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:55.877043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:55.888097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28a4edf5-5c47-4dbf-921c-6e7be1507bb9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1316 microversion: 2.1 time: 0.221577 Oct 06 12:51:55.893426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 409/858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:55 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:55.968150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b82e8330-3735-4779-8215-532757cb16f8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Action: 'create', calling method: .version_select at 0x7f7d3fbc89d0>, body: {"keypair": {"name": "tempest-keypair-2102570659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkhdnRf1c0Cvo0vSDVPWjKkojqDeKepWL3cpxpHyMJDtshcNDddSs3nrxGGxav599SKgtUcLE6zgkprtXLtFFgcaLrbXy31ZKEquwcY5sIWA/tpwewXRAOaAI62r/Q4+A=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:55.985178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b82e8330-3735-4779-8215-532757cb16f8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for project b5e65e5d9c2149da907088d119b9dcdb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:55.991027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b82e8330-3735-4779-8215-532757cb16f8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for user 0058f985bc07499bb7b961d586a1410a and project b5e65e5d9c2149da907088d119b9dcdb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:56.015761 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b82e8330-3735-4779-8215-532757cb16f8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121057 Oct 06 12:51:56.016461 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 410/859] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:51:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:56.021920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b081987-222e-44c1-8dbe-bea74eabf2a9", "name": "network-vif-plugged", "status": "completed", "tag": "eef9ab39-05f3-440a-8917-24810d4ea2b4"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:56.034359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:56.034992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:56.035971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:56.047133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] Creating event network-vif-plugged:eef9ab39-05f3-440a-8917-24810d4ea2b4 for instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 on n-h2-860556-1 Oct 06 12:51:56.056127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-11187cf8-cc61-4325-9c10-95fb8f4bb94e req-9e17b21d-a800-4a8b-a857-ffda6b594d12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036315 Oct 06 12:51:56.056858 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 411/860] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:56.063546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c384d-8090-45ae-944b-d84bbb84359a", "name": "network-vif-unplugged", "status": "completed", "tag": "faa79828-2c68-4f74-9734-527649c3bb24"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:56.068571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:56.071936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5b406e78-f830-422e-ae07-f997934a0534',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9e20df96-942a-4356-9a19-58d2d1823d3e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c544348-d1fb-49d3-8614-c9ec85012207',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:56.076080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:56.077010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:56.077607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:56.091955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] Creating event network-vif-unplugged:faa79828-2c68-4f74-9734-527649c3bb24 for instance 2c5c384d-8090-45ae-944b-d84bbb84359a on n-h2-860556-1 Oct 06 12:51:56.097361 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3715d015-c6db-40fe-8b10-51b4d9ebd8f9 req-2b369525-b4ed-4257-94f9-bcc81474fc4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038937 Oct 06 12:51:56.098936 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 412/861] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:56.104502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2587ca08-7b6a-4ffe-bf97-f7af9a009e41 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '.version_select at 0x7f7d3f6c9820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:56.590287 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e4f36d7-b0bd-44bd-b916-96625d52fe04 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.635107 Oct 06 12:51:56.591264 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 450/862] 10.222.0.26 () {62 vars in 1189 bytes} [Thu Oct 6 12:51:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 6637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:51:56.597085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1540329264", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "7894d46a-c18d-4a9f-a678-c98a979132b6"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:56.670357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] validate_networks() for [('7894d46a-c18d-4a9f-a678-c98a979132b6', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:57.448963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2587ca08-7b6a-4ffe-bf97-f7af9a009e41 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/7899c8b0-12ac-48fb-b805-482e9d688cd1" status: 202 len: 0 microversion: 2.1 time: 1.348736 Oct 06 12:51:57.449925 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 413/863] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:51:56 2022] DELETE /compute/v2.1/os-floating-ips/7899c8b0-12ac-48fb-b805-482e9d688cd1 => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:51:57.457570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:57.459042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:57.475675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.476181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.476923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.480015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.480532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.480980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.518949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:57.520405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:57.520982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:57.521696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:57.522908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:57.547979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.548786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.549229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.550504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.551024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.551732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.574822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:57.581764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for user 17892d653b7d461e803f5423cf7191af and project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:57.602176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:57.604422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:57.669105 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31c7db80-eff7-48e6-bb27-f058e02d5a57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.076487 Oct 06 12:51:57.670431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 451/864] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:51:57.672686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:57.680802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:57.681684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:57.688503 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2946a5bb-3fdd-45fb-aaf7-d047e9669f4e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.237392 Oct 06 12:51:57.689230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.689726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.690409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.691157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.692155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.692653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.705378 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 414/865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:57 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:57.714900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:57.715884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:57.724841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.726015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.726704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.729474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.730359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.731499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.869383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:57.883755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:57.885431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:57.886631 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-273475bb-513d-4823-a08a-49a003875aac tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1527 microversion: 2.42 time: 0.215065 Oct 06 12:51:57.887367 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 452/866] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:57 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:57.893366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:57.894194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:57.901969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.902418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.903169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:57.904077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:57.904712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:57.905307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.002909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:58.014730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31c6952b-e6e1-4e22-84dd-f6c0e949964e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.307657 Oct 06 12:51:58.015690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 415/867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:57 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:58.022359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-671b61c7-7cc9-494f-bbee-80cc80402a2e tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-671b61c7-7cc9-494f-bbee-80cc80402a2e tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Request method failure captured: Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action HTTP/1.1 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 34 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs89Cr_unCq6l5EB-5aCHJnyqbAcM89zs2aDZkck9lghUTaI_nnyFlbPQJD0bOZpFassJbCzzyBBUyvQ4zR-oyJKOTjcS9aaL6bsl38VqVxYVYs_785XsoQaanO_36_rhCm1FwrHpU_kgkJ6GMdw9Bzx9Sl4I_92HL4psGHzp8x3AWQ Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:51:58.027057 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fa10e59ce18f4619974ab0a08b621423", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}] Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 5f1f76a37a074e509260ca51b2e6a358 Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: {"addFloatingIp": {"address": ""}} Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:51:58.028791 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '06a2609f-0fe8-44f8-ba65-41a607d79568', 'body': {'addFloatingIp': {'address': ''}}} Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '' Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:58.029714 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:51:58.031452 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:51:58.032810 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 06 12:51:58.032810 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.036381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-671b61c7-7cc9-494f-bbee-80cc80402a2e tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:58.038290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-671b61c7-7cc9-494f-bbee-80cc80402a2e tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 400 len: 142 microversion: 2.1 time: 0.021182 Oct 06 12:51:58.045898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 416/868] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:58 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 142 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:51:58.053297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:58.054213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:58.143000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:58.146884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:58.158007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:58.159292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:58.159423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da9f33d6-c531-48f0-b1a9-228d0285b350 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1316 microversion: 2.1 time: 0.270763 Oct 06 12:51:58.159967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 453/869] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:57 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:58.170045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-57c21e10-fa3b-42bb-ab8c-be42db8c3444 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1262 microversion: 2.25 time: 0.112532 Oct 06 12:51:58.170045 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 417/870] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:58 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:58.170045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1592915103", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4432ed4b-45dc-4207-8000-c101ca025c12"}], "security_groups": [{"name": "tempest-securitygroup--714291474"}], "key_name": "tempest-keypair-2102570659", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:58.199332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:58.201989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:58.210807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.211316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.211764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.212643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.213136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.213572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.250546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:51:58.266678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 12:51:58.267185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquired lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 12:51:58.343716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] validate_networks() for [('4432ed4b-45dc-4207-8000-c101ca025c12', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:51:58.438409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Releasing lock "refresh_cache-06a2609f-0fe8-44f8-ba65-41a607d79568" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 12:51:58.439458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] HTTP exception thrown: floating IP not found Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Request method failure captured: Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action HTTP/1.1 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 41 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs89Cr_unCq6l5EB-5aCHJnyqbAcM89zs2aDZkck9lghUTaI_nnyFlbPQJD0bOZpFassJbCzzyBBUyvQ4zR-oyJKOTjcS9aaL6bsl38VqVxYVYs_785XsoQaanO_36_rhCm1FwrHpU_kgkJ6GMdw9Bzx9Sl4I_92HL4psGHzp8x3AWQ Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:58.441330 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fa10e59ce18f4619974ab0a08b621423", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}] Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5f1f76a37a074e509260ca51b2e6a358 Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:51:58.442783 n-d-860556-1 devstack@n-api.service[129614]: exception: floating IP not found Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '06a2609f-0fe8-44f8-ba65-41a607d79568', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.443620 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 06 12:51:58.444818 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.448289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Returning 404 to user: floating IP not found {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:58.448289 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10f1bf47-435d-4b2b-bdde-43935f5ac9cf tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 404 len: 67 microversion: 2.1 time: 0.252872 Oct 06 12:51:58.450416 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 454/871] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:58 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 67 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:51:58.455060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a2609f-0fe8-44f8-ba65-41a607d79568", "tag": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51"}, {"name": "network-changed", "server_uuid": "2c5c384d-8090-45ae-944b-d84bbb84359a", "tag": "faa79828-2c68-4f74-9734-527649c3bb24"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:58.468747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.469234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.469731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.498564 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Creating event network-changed:1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 for instance 06a2609f-0fe8-44f8-ba65-41a607d79568 on n-h1-860556-1 Oct 06 12:51:58.499409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] Creating event network-changed:faa79828-2c68-4f74-9734-527649c3bb24 for instance 2c5c384d-8090-45ae-944b-d84bbb84359a on n-h2-860556-1 Oct 06 12:51:58.515835 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d21d6761-9b3e-4a69-8a0f-985ae096b145 req-bdcf7708-ed01-4cb3-972e-b53a33e7d736 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064071 Oct 06 12:51:58.516996 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 455/872] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:51:58.527185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3f8450b-aa1a-4e38-9c6d-badd95e43123 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Action: 'action', calling method: .version_select at 0x7f7d45aefa60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:51:58.626473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d3f8450b-aa1a-4e38-9c6d-badd95e43123 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3f8450b-aa1a-4e38-9c6d-badd95e43123 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Request method failure captured: Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action HTTP/1.1 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 44 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs89Cr_unCq6l5EB-5aCHJnyqbAcM89zs2aDZkck9lghUTaI_nnyFlbPQJD0bOZpFassJbCzzyBBUyvQ4zR-oyJKOTjcS9aaL6bsl38VqVxYVYs_785XsoQaanO_36_rhCm1FwrHpU_kgkJ6GMdw9Bzx9Sl4I_92HL4psGHzp8x3AWQ Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:51:58.628283 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fa10e59ce18f4619974ab0a08b621423", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}] Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5f1f76a37a074e509260ca51b2e6a358 Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:51:58.629660 n-d-860556-1 devstack@n-api.service[129614]: exception: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '06a2609f-0fe8-44f8-ba65-41a607d79568', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:51:58.630502 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 06 12:51:58.632480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:51:58.635024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3f8450b-aa1a-4e38-9c6d-badd95e43123 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:51:58.635024 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3f8450b-aa1a-4e38-9c6d-badd95e43123 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action" status: 404 len: 88 microversion: 2.1 time: 0.111405 Oct 06 12:51:58.635024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 456/873] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:51:58 2022] POST /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568/action => generated 88 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:51:58.640012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:58.640661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:58.648552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.649141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.649661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.650714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.651184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.651625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.687418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:51:58.819221 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db2ef54b-564a-4bcc-b3fe-6c52a5140a3d tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "DELETE /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 204 len: 0 microversion: 2.1 time: 0.182188 Oct 06 12:51:58.821275 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 457/874] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:51:58 2022] DELETE /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:51:58.827979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:58.829876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:58.838175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.839115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.839803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:58.840581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:58.841120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:58.846210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.418860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.429284 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7961bbf-e33c-489c-9278-fd2eb2484f73 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.606272 Oct 06 12:51:59.430398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 458/875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:58 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:59.436071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:59.436891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:59.452790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for project b5e65e5d9c2149da907088d119b9dcdb. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:59.468776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.469162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for user 0058f985bc07499bb7b961d586a1410a and project b5e65e5d9c2149da907088d119b9dcdb. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:59.473680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.475139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.478212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.481513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.482318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.507774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:51:59.508574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:51:59.509277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:51:59.509940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:51:59.510606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:51:59.521731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.522553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.523100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.523956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.524606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.525311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.545497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for project b5e65e5d9c2149da907088d119b9dcdb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:51:59.552066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Getting quotas for user 0058f985bc07499bb7b961d586a1410a and project b5e65e5d9c2149da907088d119b9dcdb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:51:59.574505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:51:59.577319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:51:59.644437 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-612aa08c-4f52-4190-ba0d-ff55f3abb193 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.481694 Oct 06 12:51:59.653388 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 418/876] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:51:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:51:59.659187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:59.660061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:59.680907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.681510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.682077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.683027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.683597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.684149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.775357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.793802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b22cdc1c-713c-446d-a8d0-15c6226f9657 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1542 microversion: 2.1 time: 0.362013 Oct 06 12:51:59.794822 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 459/877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:59 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1542 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:51:59.799762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:59.800374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:59.816880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.817579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.818702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.820045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.820827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.821408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.844715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.854545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.856023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.857187 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36982d27-76a3-4371-8e7c-b78cee68325b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1593 microversion: 2.42 time: 0.202549 Oct 06 12:51:59.857986 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 419/878] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:59 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1593 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:59.877631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:59.878300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:59.885670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.886246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.886621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.887507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.887936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.888331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.966543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.976028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.977642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:51:59.979056 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ffd6ac8-3802-42ea-9d0d-2176eee1e8e4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1314 microversion: 2.25 time: 0.106042 Oct 06 12:51:59.979938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 420/879] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:51:59 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:51:59.984743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:51:59.985541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:51:59.992572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.993347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.994042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:51:59.994985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:51:59.995665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:51:59.996333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:00.013661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:00.026075 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e3e8cf8-15ab-4597-8376-9f4c6aabb69c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.229857 Oct 06 12:52:00.042699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 460/880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:59 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:00.048128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a4b6d49-6ecf-46ad-9397-09fdf600ea3c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:00.049033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a4b6d49-6ecf-46ad-9397-09fdf600ea3c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:00.224633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a4b6d49-6ecf-46ad-9397-09fdf600ea3c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:00.238457 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a4b6d49-6ecf-46ad-9397-09fdf600ea3c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1270 microversion: 2.1 time: 0.193409 Oct 06 12:52:00.242698 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 461/881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:00 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:00.453854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:00.454477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:00.455031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:00.463327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:00.463532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:00.464604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:00.465243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:00.466187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:00.466771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff8393a3-35a8-4156-b04e-d2c9254f3474 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1466 microversion: 2.1 time: 0.485592 Oct 06 12:52:00.466902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:00.467316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:00.468247 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 421/882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:51:59 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1466 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:00.491452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:00.492389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:00.507247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:00.507761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:00.508204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:00.509032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:00.509500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:00.509962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.162729 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e55d53e7-c982-4673-b76b-7ba792f003cb tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1617 microversion: 2.1 time: 0.676462 Oct 06 12:52:01.163350 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 422/883] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:00 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1617 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:01.174868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:01.187017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:01.193930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.194735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.195367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.196525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.204370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.205139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.245808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.262471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a8aaa9e-7c02-4de6-a3bb-5904d07aec1c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.813091 Oct 06 12:52:01.265799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 462/884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:00 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:01.272092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:01.273021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:01.284993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.285830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.286447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.287399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.288020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.289379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.527512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.541004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.542928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.544435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9943bf80-55dc-4fe1-a2b6-218f7269b888 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1593 microversion: 2.42 time: 0.277277 Oct 06 12:52:01.545625 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 463/885] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:01 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1593 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:01.553880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:01.554969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:01.563433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.564343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.565309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.566442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.567453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.568960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.768610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.777629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.779115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:01.780253 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45453bb8-6e85-468b-b286-72defba22cf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1320 microversion: 2.25 time: 0.233157 Oct 06 12:52:01.780828 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 464/886] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:01 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:01.798076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:01.798894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:01.819699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.820484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.821113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:01.822042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:01.822667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:01.823259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:02.066745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:02.096365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-502d7cd0-2e8e-44a1-bde0-8cb4bbbd08fd tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1542 microversion: 2.1 time: 0.929239 Oct 06 12:52:02.100991 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 423/887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:01 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1542 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:02.108977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:02.109976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:02.124063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:02.126209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:02.128022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:02.129469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:02.131424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:02.132148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:02.632741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:02.657022 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-038e8400-4a53-4c71-89f1-ff49513e6340 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1328 microversion: 2.1 time: 0.553528 Oct 06 12:52:02.660029 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 424/888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:02 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1328 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:02.672418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-322929535", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3cff8881-bbb7-4c80-9b45-f822d708aba0"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:02.753490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:02.764626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cfe5d837-f624-4755-984b-c037f7173829 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1477 microversion: 2.1 time: 0.982630 Oct 06 12:52:02.765212 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 465/889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:01 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1477 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:02.786608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:02.787256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:02.801964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:02.802460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:02.803088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:02.804001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:02.804623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:02.805344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:02.927059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:52:03.373881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:03.390605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d24d725-08a0-4d44-8712-d47fd521fd24 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.624055 Oct 06 12:52:03.397834 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 466/890] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:02 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:03.410760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:03.412676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:03.424851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:03.431324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:03.431910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:03.437057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:03.437770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:03.438395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:03.820763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:03.821313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:03.823143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:03.823811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:03.824888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:03.836861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:03.837785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:03.838445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:03.839517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:03.840200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:03.840844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:03.872053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:03.885876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Getting quotas for user 6bd8e292eca04ea986fc7b82cf196017 and project 9ca94e746fcb426887d292336801aa0d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:03.922777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:52:03.925016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:52:04.018902 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-869f8b8c-6ffb-4ddc-9f51-1bd2a237cd46 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355174 Oct 06 12:52:04.021408 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 425/891] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:52:04.034765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:04.038722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:04.058001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.062523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.063355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.064605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.068245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.068955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.150084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.166820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.184400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.190234 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed5266cd-c16f-407a-82be-0fb0591260f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1661 microversion: 2.42 time: 0.791016 Oct 06 12:52:04.194099 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 467/892] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:03 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1661 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:04.199801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a2609f-0fe8-44f8-ba65-41a607d79568", "name": "network-vif-deleted", "tag": "1fc12505-1cd6-46cd-9d4b-6713ae3d5f51"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:04.255653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.257893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.260762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.291974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] Creating event network-vif-deleted:1fc12505-1cd6-46cd-9d4b-6713ae3d5f51 for instance 06a2609f-0fe8-44f8-ba65-41a607d79568 on n-h1-860556-1 Oct 06 12:52:04.298860 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bd2a7b28-c0d9-4cf6-96df-44c458445a80 req-c1bfa144-739c-4655-94a5-95873d502bb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102833 Oct 06 12:52:04.300010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 468/893] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:04.307276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:04.308725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:04.333475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.338856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.343314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.346117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.349708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.352024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.392129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.406139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.414996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.417360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-307aa52d-9abd-4c1f-a339-ad9562c5d07b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.392868 Oct 06 12:52:04.420702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 426/894] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:04 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:04.435714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:04.436437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:04.450033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.452663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.453432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.455029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.455602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.458168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.462956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.463520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lazy-loading 'fault' on Instance uuid 06a2609f-0fe8-44f8-ba65-41a607d79568 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:04.463964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.464586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.774977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1f76a37a074e509260ca51b2e6a358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10e59ce18f4619974ab0a08b621423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:04.790632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1fc48ec4-20b9-4007-a11a-4919ef592708 tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 200 len: 1322 microversion: 2.1 time: 0.488975 Oct 06 12:52:04.791235 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 469/895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:04 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:04.813571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45994c2d-4076-494a-b0c1-1814a8c350cc", "tag": "c16d7655-1745-479a-90a8-c4a6bf167cdb"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:04.884233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.885442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.886046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.913426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] Creating event network-changed:c16d7655-1745-479a-90a8-c4a6bf167cdb for instance 45994c2d-4076-494a-b0c1-1814a8c350cc on n-h2-860556-1 Oct 06 12:52:04.935668 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-29e45e5d-f486-48cf-819d-915666196e5c req-af635282-998f-4326-b1c6-8ac13a673bd9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124500 Oct 06 12:52:04.936310 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 470/896] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:04.948788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:04.951307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:04.973801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.974964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.976278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:04.977504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:04.978504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:04.991086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.051251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:05.062050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6f738c2-1a96-42b0-b4ae-3f501e791c23 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 0.640205 Oct 06 12:52:05.062652 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 427/897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:04 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:05.069511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:05.077180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:05.089564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.098715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.099208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.099978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.100458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.100889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.310110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:05.328920 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7cbdd2e-2981-4353-a6f3-97d35ee3c8d9 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1220 microversion: 2.1 time: 0.263064 Oct 06 12:52:05.345780 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 428/898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:05 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1220 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:05.371885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:05.372725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:05.379828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.380916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.381523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.382432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.383108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.383722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.602481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:05.611870 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-de65bbd5-5090-4bc6-9367-ffd90648af59 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1476 microversion: 2.1 time: 0.672702 Oct 06 12:52:05.612453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 471/899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:04 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1476 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:05.631005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:05.631991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:05.646050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.646805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.647421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.648956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.649583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.662455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.793313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:05.802533 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa264b3d-a3bc-48ce-b531-befa36ff0a89 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.436454 Oct 06 12:52:05.812154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 429/900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:05 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:05.817709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:05.818542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:05.834596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.835526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.836150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:05.837042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:05.837659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:05.838301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.119132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.136195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.140884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.142368 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ba37758-5a82-47e4-a86c-c9170d504870 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1661 microversion: 2.42 time: 0.521801 Oct 06 12:52:06.171734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 472/901] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:05 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1661 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:06.185505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:06.187272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] [instance: 06a2609f-0fe8-44f8-ba65-41a607d79568] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:06.216348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.217265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.219036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.221776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.225344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.226513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.256358 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] HTTP exception thrown: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Request method failure captured: Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 HTTP/1.1 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs89Cr_unCq6l5EB-5aCHJnyqbAcM89zs2aDZkck9lghUTaI_nnyFlbPQJD0bOZpFassJbCzzyBBUyvQ4zR-oyJKOTjcS9aaL6bsl38VqVxYVYs_785XsoQaanO_36_rhCm1FwrHpU_kgkJ6GMdw9Bzx9Sl4I_92HL4psGHzp8x3AWQ Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:06.264499 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fa10e59ce18f4619974ab0a08b621423", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fa10e59ce18f4619974ab0a08b621423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fa10e59ce18f4619974ab0a08b621423"}]}] Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: fa10e59ce18f4619974ab0a08b621423 Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754 Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5f1f76a37a074e509260ca51b2e6a358 Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:06.267149 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '06a2609f-0fe8-44f8-ba65-41a607d79568'} Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:06.267999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. Oct 06 12:52:06.269523 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:06.278323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] Returning 404 to user: Instance 06a2609f-0fe8-44f8-ba65-41a607d79568 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:06.279562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9b7df5c-bc33-4d10-bc6e-58e13c988b3f tempest-FloatingIPsAssociationNegativeTestJSON-527534754 tempest-FloatingIPsAssociationNegativeTestJSON-527534754-project] 10.222.0.26 "GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568" status: 404 len: 111 microversion: 2.1 time: 0.105544 Oct 06 12:52:06.280364 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 473/902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:06 2022] GET /compute/v2.1/servers/06a2609f-0fe8-44f8-ba65-41a607d79568 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:06.286728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:06.289294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.295054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:06.310559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.311217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.311767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.313643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.315423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.317421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.322200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:06.338367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.340747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.354525 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eeb2f704-3153-404f-b48d-5827ff5b666c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.540381 Oct 06 12:52:06.355621 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 430/903] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:05 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:06.380813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:06.381728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:06.399825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.400622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.401247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.404880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.406085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.408078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.557379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.569006 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9384a639-8681-4e63-9776-93019e0a2320 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1286 microversion: 2.1 time: 0.197830 Oct 06 12:52:06.590201 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 431/904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:06 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:06.637240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:06.638386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:06.646797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.649586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.650298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.651466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.652361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.654447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.655066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.659290 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db5193f2-4b7f-4aec-aaae-abba9d237f76 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 0.377591 Oct 06 12:52:06.659871 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 474/905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:06 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:06.840335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:06.840948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:06.845851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:06.854993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.855491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.855933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:06.856066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2822a23b-4a09-4fba-8b98-efa357d9fd99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1476 microversion: 2.1 time: 0.223123 Oct 06 12:52:06.857370 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 432/906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:06 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:06.866087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:06.873051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:06.874035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.002592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b84d3d-9ee5-4022-aa5e-ee737f6c85e4", "tag": "d8f04d69-1d40-4be5-80b1-59d44f97e399"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:07.011739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:07.030177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:07.030999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:07.031606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.043283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:07.047097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] Creating event network-changed:d8f04d69-1d40-4be5-80b1-59d44f97e399 for instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 on n-h1-860556-1 Oct 06 12:52:07.051700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9868c69f-ec34-4bb4-8a39-438c6fb002b7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1503 microversion: 2.1 time: 0.215127 Oct 06 12:52:07.052306 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 475/907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:06 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:07.053120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f99de3c5-b986-4984-af10-e9d367df0f94 req-6636b473-4743-4362-aeab-e3fe6d279fb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054066 Oct 06 12:52:07.053768 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 433/908] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:52:07.172901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:07.175448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:07.183255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:07.183953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:07.184580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.185472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:07.186168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:07.186760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.386232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:07.387729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:07.401678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:07.405103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:07.406995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.408009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:07.408851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:07.409477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:07.563584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:08.244783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.298378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.313865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.314935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.316164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.316967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.318321 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a220777b-12b8-4a2d-b4de-8f7b968d8931 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1708 microversion: 2.42 time: 1.149261 Oct 06 12:52:08.318455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f453d1a-ee20-41bb-b4d1-b945da25d261 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.936739 Oct 06 12:52:08.318975 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 434/909] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:07 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:08.323659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:08.329860 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 476/910] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:07 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1708 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:08.330949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:08.342628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:08.344530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.345293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.345583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:08.346107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:08.350610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.351398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.352070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:08.358938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.359746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.360822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:08.361769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.362437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.382777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:08.507215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:08.516362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4fe40ff-2b5c-4717-989a-70e8909d2235 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1274 microversion: 2.1 time: 0.196176 Oct 06 12:52:08.522866 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 435/911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:08 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:08.527926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:08.530502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:08.545348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.551450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.552085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:08.552952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:08.553547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:08.554218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:09.388643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:09.405216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d51e873c-4e06-49ac-8e92-34d7673eb095 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 1.072772 Oct 06 12:52:09.423064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:09.433832 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 477/912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:08 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:09.434379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-978a5cb7-8d0b-466c-9551-7fb793794a1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1476 microversion: 2.1 time: 0.910106 Oct 06 12:52:09.437463 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 436/913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:08 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1476 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:09.440263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:09.441166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:09.448226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "name": "network-vif-unplugged", "status": "completed", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:09.450265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:09.451329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:09.452127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:09.453653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:09.454402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:09.455211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:09.473421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:09.473946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:09.474390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:09.505834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Creating event network-vif-unplugged:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h2-860556-1 Oct 06 12:52:09.515307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:52:09.529317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f1778809-aa49-4028-9c96-883e628683e6 req-f5b0ba6e-9713-47ae-a527-cb7470cfab12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090410 Oct 06 12:52:09.530711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 437/914] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:09.537414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:09.540182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:09.565909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:09.567761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:09.570177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:09.571287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:09.572914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:09.574358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:10.235004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=24 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:10.556126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:10.572540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:10.574396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:10.575896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:10.577066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-738d6331-67e2-4144-9335-4e7dca130afc tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1755 microversion: 2.42 time: 1.044823 Oct 06 12:52:10.580931 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 438/915] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:09 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1755 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:10.592705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:10.594792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:10.611691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:10.612499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:10.612904 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abcce00c-4bb7-4bda-a58f-954607acd5aa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1493 microversion: 2.1 time: 1.176721 Oct 06 12:52:10.613911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:10.614864 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 478/916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:09 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1493 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:10.622437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:10.623149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:10.623607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:10.645731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:10.646555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:10.653871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:10.655555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:10.656217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:10.657191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:10.657965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:10.658797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:11.031439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:11.048978 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84f646df-9af7-46dd-ac16-04e6b1374049 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 0.429149 Oct 06 12:52:11.049979 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 479/917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:10 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:11.079898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:11.083691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:11.109804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:11.111906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:11.112377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:11.118179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:11.135651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:11.142418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:11.366343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:11.384286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:11.385876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:11.387010 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddb2ab0f-b836-4436-88db-b034ab7e5821 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.804674 Oct 06 12:52:11.387836 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 439/918] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:10 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:11.398698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:11.403750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:11.416703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:11.421425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:11.422076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:11.422984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:11.423611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:11.424214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:11.429492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:12.455904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:12.475688 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82b9903b-c86b-4d0c-b673-f9d62d541da5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1476 microversion: 2.1 time: 1.084620 Oct 06 12:52:12.477075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 440/919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:11 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1476 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:12.483211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59e05208-9330-4e14-92c6-1dc9af9cc733 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '.version_select at 0x7f7d3f78c940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:12.487085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59e05208-9330-4e14-92c6-1dc9af9cc733 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.487785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59e05208-9330-4e14-92c6-1dc9af9cc733 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.489313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59e05208-9330-4e14-92c6-1dc9af9cc733 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:12.522576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:12.530435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59e05208-9330-4e14-92c6-1dc9af9cc733 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1575 microversion: 2.1 time: 0.035382 Oct 06 12:52:12.531250 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 441/920] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:52:12 2022] GET /compute/v2.1/os-migrations => generated 1575 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:12.534430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a31ef721-6741-4fbf-988e-e18653e61cbc tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 1.469932 Oct 06 12:52:12.542923 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 480/921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:11 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:12.550385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:12.552846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:12.553995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:12.583832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.584909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.587861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:12.595563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.607803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.609105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:12.614779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.615542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.616604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:12.646829 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Creating event network-changed:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h2-860556-1 Oct 06 12:52:12.660302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:52:12.685938 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-69f90e21-912f-4a20-b2de-9cb90bfb9d9f req-11becd53-1e43-48b5-b31c-b66d4c41faed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138837 Oct 06 12:52:12.690493 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 481/922] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:12.701512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:12.702242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:12.712508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.713176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.713790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:12.714792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:12.715401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:12.715979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.278674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:13.301947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:13.303634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:13.304910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6759379-5893-444f-a1ca-7e029bb9cca7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1755 microversion: 2.42 time: 0.771939 Oct 06 12:52:13.305609 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 442/923] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:12 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1755 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:13.344750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45994c2d-4076-494a-b0c1-1814a8c350cc", "name": "network-vif-plugged", "status": "completed", "tag": "c16d7655-1745-479a-90a8-c4a6bf167cdb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:13.377779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:13.382895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:13.383513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.384852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:13.398287 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d22346f0-aabf-4a13-a346-c6513d9ff159 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 0.705593 Oct 06 12:52:13.413422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] Creating event network-vif-plugged:c16d7655-1745-479a-90a8-c4a6bf167cdb for instance 45994c2d-4076-494a-b0c1-1814a8c350cc on n-h2-860556-1 Oct 06 12:52:13.424310 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 482/924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:12 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:13.429873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9f161e2d-9288-4ade-80e2-cd109f9803ac req-2d9588e2-c91e-4f92-92d0-3cc8ad60177e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105491 Oct 06 12:52:13.432574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:13.441689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:13.442694 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 443/925] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:13.451179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:13.451760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:13.452457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:13.458167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:13.458752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.459830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:13.460329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:13.460753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.464216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:13.465342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:13.466034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.467058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:13.470572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:13.471295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:13.853295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:13.906045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=22 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:14.088334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:14.100953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:14.108103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:14.118416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97b0ff35-87e0-4e44-bc0f-bd8766d56e31 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.686579 Oct 06 12:52:14.146118 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 483/926] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:13 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:14.168475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:14.172356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:14.178695 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9de6978-3953-4423-8ae1-e65c81469918 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1644 microversion: 2.1 time: 0.733985 Oct 06 12:52:14.183315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:14.184064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:14.184715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:14.185683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:14.187206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:14.187790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:14.201901 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 444/927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:13 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1644 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:14.215331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:14.216166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:14.247502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:14.248226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:14.262559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:14.263453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:14.264000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:14.264535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:14.930015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:14.940330 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8208b11-b5dd-4eaa-80b8-f71b7ca5b746 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1474 microversion: 2.1 time: 0.792938 Oct 06 12:52:14.940938 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 484/928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:14 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1474 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:14.962124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:14.963145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:14.993121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:14.993683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:14.994685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:14.996851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:14.998450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.000033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.000894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.002415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d68c4f77-d377-49db-852f-030dd457c2e1 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 0.799191 Oct 06 12:52:15.008956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 445/929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:14 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:15.016361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:15.016996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:15.033394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.034030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.034470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.046691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.047197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.047787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.509225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.513124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.535979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c28f7f3-f655-4c01-9d3e-d2fbaec21b64 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 0.522523 Oct 06 12:52:15.538780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.552178 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 446/930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:15 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:15.560779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.565777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62d399d0-6a7e-46f9-9e56-c20c81827ad9 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1802 microversion: 2.42 time: 0.620145 Oct 06 12:52:15.569255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 485/931] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:14 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1802 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:15.572648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1293577913", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "4f0ce63f-ea60-4427-922a-c32b96edb684"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:15.580539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771dc7a0-e96c-4fc0-b3a2-4a121364bdfa", "tag": "657e502a-3938-4a0f-933e-261aea11e921"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:15.609633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.610182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.610630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.632041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] Creating event network-changed:657e502a-3938-4a0f-933e-261aea11e921 for instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa on n-h1-860556-1 Oct 06 12:52:15.637528 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fa9e1c35-0461-4fb2-a265-a5b73eab138b req-217f884a-924c-45fe-9f7f-8ef56266dbba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066782 Oct 06 12:52:15.638434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 486/932] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:15.645045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:15.646673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:15.658043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:15.659884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.660384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.660913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.661548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:15.662036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:15.662471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:15.674609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] validate_networks() for [('4f0ce63f-ea60-4427-922a-c32b96edb684', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:52:15.956054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.965399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.967567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:15.969221 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eefcc59b-e2d1-409d-8710-df29a44fcc5c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1362 microversion: 2.25 time: 0.329463 Oct 06 12:52:15.985954 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 487/933] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:15 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:15.994053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b84d3d-9ee5-4022-aa5e-ee737f6c85e4", "name": "network-vif-plugged", "status": "completed", "tag": "d8f04d69-1d40-4be5-80b1-59d44f97e399"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:16.004979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.005776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.006547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.022632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] Creating event network-vif-plugged:d8f04d69-1d40-4be5-80b1-59d44f97e399 for instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 on n-h1-860556-1 Oct 06 12:52:16.028261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-10ff4da3-1664-4841-839a-246edbf61f0f req-e915aebc-cc9f-4854-b205-3c98b816068d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040701 Oct 06 12:52:16.028883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 488/934] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:16.034384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:16.035623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:16.043172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.043671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.044116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.044827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.045290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.045721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.458721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:16.475070 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88b1fe25-7e1e-4564-bd10-807ec02f3f99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1474 microversion: 2.1 time: 0.444768 Oct 06 12:52:16.476290 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 489/935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:16 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1474 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:16.488222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:16.490863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:16.505899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.506661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.507370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.508536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.509363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.511527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.558439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:16.559031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:16.559446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:16.559954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:16.560436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:16.570905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.571510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.571947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.572674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:16.573129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:16.573550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:16.593771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:16.600495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for user 1f58173845e04996a0a5c2497e13d3cc and project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:16.620031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:52:16.622823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:52:16.737119 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a49dcf2e-a76d-46d4-80c5-16736fe7bdaa tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183447 Oct 06 12:52:16.739454 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 447/936] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:52:16.933023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1844340080", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:16.970694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:16.979241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d33e406-786e-4905-8c9c-35c1504ffd89 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1395 microversion: 2.1 time: 0.501677 Oct 06 12:52:16.979832 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 490/937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:16 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1395 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:17.021141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:17.026557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:17.037904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:17.040293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:17.040973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:17.041930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:17.042561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:17.043142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:17.071755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:52:18.073439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:18.092191 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d768cc7f-f812-429d-98fa-6557c728dfa4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 1.075560 Oct 06 12:52:18.094332 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 491/938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:17 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:18.104081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:18.114483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:18.126604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.127986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.129151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.130145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.130793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.131501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.166540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:18.230616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:18.231064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:18.231255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:18.232064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:18.232639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:18.245023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.245802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.246409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.247490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.248140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.249446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.271209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Getting quotas for project 8f2ce23729f346c2a3a76dca9d70a3e8. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:18.277909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Getting quotas for user cc7a26b1618b4642b9873eb308f6db33 and project 8f2ce23729f346c2a3a76dca9d70a3e8. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:18.294990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:52:18.298040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:52:18.364811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b89929c-fb55-45ef-a3ba-724f45abd26f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623638 Oct 06 12:52:18.366328 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 448/939] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:52:18.372510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:18.373437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:18.381943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.382694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.384365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.385346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.386148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.386786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.661877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:18.683013 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a081ab6a-5cc6-417a-b569-76643ac2ec94 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1263 microversion: 2.1 time: 0.315082 Oct 06 12:52:18.683629 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 449/940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:18 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1263 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:18.707811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:18.708857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:18.721456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:18.742727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.743234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.747030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:18.750418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.751024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:18.752255 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6d36b0b-a9af-4a80-a69e-cf87789e407c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1802 microversion: 2.42 time: 0.656133 Oct 06 12:52:18.752828 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 492/941] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:18 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1802 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:18.753346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.754376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.758204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.775212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:18.778000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:18.799316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.801438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.802872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:18.805432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:18.806840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:18.807889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.177814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:19.188401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52ea1b08-7707-47b3-9b73-04558abddf4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1471 microversion: 2.1 time: 0.434340 Oct 06 12:52:19.190162 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 493/942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:18 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:19.200781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:19.206725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:19.219672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.223332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.224040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.230912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.241540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:19.246608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.247144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.255616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:19.257077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:19.258325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab007498-a1e9-4cc6-8090-d615afb143b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1558 microversion: 2.25 time: 0.573730 Oct 06 12:52:19.262277 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 450/943] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:18 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1558 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:19.274479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:19.275276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:19.290947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.291742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.292362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.293961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.296892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.297548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.417723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:19.434440 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a2867a5-353b-4f91-84cc-b0175acf0ad9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1221 microversion: 2.1 time: 0.165099 Oct 06 12:52:19.451358 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 451/944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:19 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:19.481110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:19.483402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:19.491547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.492452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.494217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:19.495149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:19.495930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:19.497048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.093394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:20.100872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:20.102689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdb7a801-2c26-416d-9fb7-59d78dcc194d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1575 microversion: 2.1 time: 0.910403 Oct 06 12:52:20.112355 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11451b06-2e7b-4e38-8ff0-dc5d2aa02ec1 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 0.659662 Oct 06 12:52:20.117932 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 452/946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:19 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:20.126747 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 494/946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:19 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1575 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:20.133669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:20.134855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:20.141968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.142749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.143375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.144297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.144911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.145902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.153075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:20.154324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:20.163867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.164700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.165536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.166988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.167951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.169162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.289530 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f5bd1e2-4eff-44d4-be65-ed320ccfba99 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598/action" status: 204 len: 0 microversion: 2.1 time: 0.166548 Oct 06 12:52:20.291672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 453/947] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:52:20 2022] POST /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:20.316689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:20.319052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:20.352718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.353671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.354380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.355385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.356180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.357084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.743459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:20.774049 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9852ab12-3154-4254-af92-7a687836f022 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 2051 microversion: 2.25 time: 0.645592 Oct 06 12:52:20.781442 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 495/948] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:20 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 2051 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:20.802037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:20.803719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:20.832711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.833473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.835435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:20.836826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:20.838715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:20.839351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.010452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:21.032252 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-487f2cc8-4c65-4b5a-93a4-9501b58e9390 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.737647 Oct 06 12:52:21.034319 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 454/949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:20 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:21.043235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "name": "network-vif-plugged", "status": "completed", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:21.067676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.068500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.069141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.105576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Creating event network-vif-plugged:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h2-860556-1 Oct 06 12:52:21.124750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:52:21.152285 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-cf19284f-f485-4207-8ce0-d2511481ad5d req-2b709c0e-838b-4a57-b3b9-eef16b352dcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114790 Oct 06 12:52:21.154811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 455/950] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:21.166428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:21.167416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:21.183899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.185717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.187003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.189059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.189881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.190680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.453037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:21.464335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:21.466426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:21.467641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78d040a3-700e-4595-a73c-5fa4daa15e41 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1849 microversion: 2.42 time: 0.684561 Oct 06 12:52:21.468206 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 496/951] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:20 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1849 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:21.473527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:21.474161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:21.481231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.481960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.482602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.483834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.484493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.485112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.520085 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-198236b8-d928-4cce-b2f1-26b0d9f4bbae tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358488 Oct 06 12:52:21.520085 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 456/952] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:52:21 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4/os-interface => generated 284 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:21.526061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:21.526763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:21.542258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.542443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.542896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.543792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.544346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.544800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.817468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:21.825692 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10633d4c-ff73-4e51-9d83-866ca2dddff5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1275 microversion: 2.1 time: 0.308151 Oct 06 12:52:21.826315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 457/953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:21 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:21.845246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:21.851756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:21.860083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.861091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.861702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:21.862686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:21.863970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:21.864566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:22.234883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:22.247429 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-114ab791-103e-4153-84ec-c919a52da75a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1471 microversion: 2.1 time: 0.777596 Oct 06 12:52:22.271809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 497/954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:21 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1471 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:22.287039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:22.288368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:22.301785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:22.303026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:22.303949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:22.305306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:22.306379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:22.307332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:22.978354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:22.989173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:23.013391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef9c32e0-6c83-421e-8bde-ba52dadc017d tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 2051 microversion: 2.25 time: 1.174385 Oct 06 12:52:23.015275 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 458/955] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:21 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 2051 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:23.027152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "80777c32-8243-4ac0-bbc6-1c12abb3139a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:23.050981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.051873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.052566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.066039 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] Creating event network-changed:80777c32-8243-4ac0-bbc6-1c12abb3139a for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:23.072625 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c74055bd-cc07-4dab-b056-95b493dad2f2 req-c586f5f5-068d-4a09-972f-8202d3f69119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055499 Oct 06 12:52:23.074236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 459/956] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:23.080141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:23.081340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:23.098298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.098806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.099253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.099978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.100443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.100880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.474266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:23.494508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-016696e3-0b5d-43fa-949d-b5f4dd1ff33e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 1.220720 Oct 06 12:52:23.500137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 498/957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:22 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:23.521329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7633a7-c49a-4734-9ea8-1644557f8f6d", "tag": "a2f55cdb-4b8b-4548-b0c6-f91447ebcd68"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:23.531835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.532329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.532771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.546577 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] Creating event network-changed:a2f55cdb-4b8b-4548-b0c6-f91447ebcd68 for instance cb7633a7-c49a-4734-9ea8-1644557f8f6d on n-h1-860556-1 Oct 06 12:52:23.553412 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f6177709-0a54-4e09-a0a8-4529d76743bb req-359fd794-30be-4229-86f3-3cb6a2a40259 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036109 Oct 06 12:52:23.554608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 499/958] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:23.560149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:23.561086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:23.568337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.569088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.569759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.570485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.571118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.571719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.839156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:23.852956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea661a2b-f281-4efd-81ef-ab9e91cd4bcd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.775017 Oct 06 12:52:23.853846 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 460/959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:23 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:23.864474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:23.866697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:23.883380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.888042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.889093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:23.890499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:23.891144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:23.891582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.241930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:24.251579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:24.254421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:24.255780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-26844bc7-8669-40ca-a08e-39ae8b5dd465 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1849 microversion: 2.42 time: 0.699778 Oct 06 12:52:24.270374 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 500/960] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:23 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1849 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:24.286775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:24.292594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.293446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.294849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.295886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.296557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.297244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.329148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05e31a52-889e-4608-b20f-fee13ce751d4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.056904 Oct 06 12:52:24.330165 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 501/961] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Oct 6 12:52:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:52:24.336452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771dc7a0-e96c-4fc0-b3a2-4a121364bdfa", "name": "network-vif-plugged", "status": "completed", "tag": "657e502a-3938-4a0f-933e-261aea11e921"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:24.347110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.348005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.348644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.362729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] Creating event network-vif-plugged:657e502a-3938-4a0f-933e-261aea11e921 for instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa on n-h1-860556-1 Oct 06 12:52:24.368453 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2c942d54-b051-4c5d-99aa-5dddd63dc14a req-db72c412-feeb-4274-8a29-0a55f7e5c773 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036883 Oct 06 12:52:24.369457 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 502/962] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:24.374990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:24.375701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:24.384169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.384916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.385518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.387017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.387660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.388237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.489939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:24.517510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad9c6be5-db5e-449f-b509-41f8536dce8c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.656592 Oct 06 12:52:24.519017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 461/963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:23 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:24.526523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:24.527470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:24.535661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.536396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.537039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.538130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.539313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.539909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.630527 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-29d4c28d-1fd0-4938-b5e8-5e3a56109027 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc/action" status: 202 len: 0 microversion: 2.25 time: 0.107805 Oct 06 12:52:24.644477 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 462/964] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:52:24 2022] POST /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:24.654645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:24.656082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:24.667046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.668330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.669199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:24.671147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:24.671920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:24.672395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.265910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:25.275141 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6ea6ee9-1037-4a8f-9b86-b0af02972cf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1471 microversion: 2.1 time: 0.904231 Oct 06 12:52:25.275947 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 503/965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:24 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1471 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:25.281607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:25.282700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:25.289914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.290788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.291456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.292395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.293089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.293621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.462080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:25.472239 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9a50151b-cea7-4afd-b001-919109ecdb33 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1316 microversion: 2.1 time: 0.824954 Oct 06 12:52:25.473678 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 463/966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:24 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:25.478746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:25.479434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:25.487336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.488496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.489170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.490032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.491231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.491670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.644971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:25.660352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77a943ff-642d-4e5e-84b4-871808d4734c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 2036 microversion: 2.25 time: 0.382375 Oct 06 12:52:25.661163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 504/967] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:25 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 2036 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:25.671668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:25.672296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:25.680825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.681590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.682062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.682782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.683243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.683675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.890933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:25.899575 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-309c8b82-dfed-419c-a639-a558fb8bb153 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.424445 Oct 06 12:52:25.915055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 464/968] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:25 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:25.921310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:25.922234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:25.931832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.932333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.932767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:25.933477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:25.933960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:25.934594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.104336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:26.119388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:26.121508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:26.122949 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5bd0ac8-d492-4c29-8703-183b27954123 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1858 microversion: 2.42 time: 0.455273 Oct 06 12:52:26.123520 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 505/969] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:25 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1858 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:26.128584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:26.139117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.139910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.140546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.156260 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] Creating event network-changed:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:52:26.171112 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-eaef81bd-18bd-4319-8cfa-fc9ebba081d3 req-84225b8f-fb79-4f1b-b5cc-cd593d5caa2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040922 Oct 06 12:52:26.173384 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 506/970] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:26.190224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": "auto"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:26.197506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:26.211833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.212537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.213088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.213944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.214504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.215048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.244934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'flavor' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:26.264320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Going to try to live migrate instance to n-h1-860556-1 {{(pid=129614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:52:26.284277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:26.294959 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0677cd0e-62e3-4b39-8dd3-ab1a04bf007a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.378287 Oct 06 12:52:26.296519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 465/971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:25 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:26.301305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:26.301949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:26.313991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.314550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.315058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.315842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.316342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.316780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.636279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:26.648667 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07b9ffca-b976-4f50-8e5e-b72b57f4b666 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1575 microversion: 2.1 time: 0.351066 Oct 06 12:52:26.669369 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 466/972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:26 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1575 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:26.683353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b84d3d-9ee5-4022-aa5e-ee737f6c85e4", "tag": "d8f04d69-1d40-4be5-80b1-59d44f97e399"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:26.711622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.712125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.712562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.736173 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] Creating event network-changed:d8f04d69-1d40-4be5-80b1-59d44f97e399 for instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 on n-h1-860556-1 Oct 06 12:52:26.752712 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a971101b-b6ee-4eac-bd35-fea95b35d129 req-85489228-662c-4024-816b-e6381866089f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078006 Oct 06 12:52:26.754234 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 467/973] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:26.762915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:26.763950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:26.772471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.773119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.773433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:26.774324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:26.775367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:26.775800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.052071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:27.066974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ac1b3bd-01e4-477f-ab10-90c76106bb17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1463 microversion: 2.1 time: 0.310497 Oct 06 12:52:27.068059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 468/974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:26 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:27.074378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:27.075410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:27.086232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.091741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.092199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.093388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.094171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.094800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.142614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:27.276865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:27.300105 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c7ab4be-8a3b-4a40-847c-abc83bf8cb83 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 204 len: 0 microversion: 2.1 time: 0.230460 Oct 06 12:52:27.301768 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 469/975] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:27 2022] DELETE /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:27.309708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:27.310565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:27.318103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.318674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.319343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.320114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.320634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.321126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.484699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:27.498762 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-248b1661-6e1b-407b-9135-c9c9d579f488 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1466 microversion: 2.1 time: 0.195304 Oct 06 12:52:27.500292 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 470/976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:27 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:27.505622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:27.506452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:27.512955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.514086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.514729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.515441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.515898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.516493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.654453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:27.662454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec3a687b-7ae4-4eaf-a3a3-0a52494b3c6e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.160776 Oct 06 12:52:27.663016 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 471/977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:27 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:27.667601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:27.668135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:27.673547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.674050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.674974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.675836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.676291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.676722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.809090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:27.817644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44e70ec8-6a1b-4619-aae2-fc00ad5c3170 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1463 microversion: 2.1 time: 0.153518 Oct 06 12:52:27.818238 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 472/978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:27 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:27.822626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:27.823227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:27.828926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.829412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.829885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:27.830607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:27.831065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:27.831597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.002708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:28.011836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:28.013306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:28.014484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e1f3d31-d5df-4ecd-83b0-3c7f0d007480 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1858 microversion: 2.42 time: 0.195310 Oct 06 12:52:28.015063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 473/979] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:27 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1858 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:28.019665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:28.020333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:28.026942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.027559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.028003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.028702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.029155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.029580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.033656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:28.239422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:28.248325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5307324b-1ac2-44d1-9a2f-3e84ce260d55 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1712 microversion: 2.1 time: 0.232227 Oct 06 12:52:28.263844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 474/980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:28 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1712 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:28.263844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:28.263844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:28.263844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:28.263844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.264986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.264986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.264986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.264986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.265427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.290107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:28.616749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:28.625293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3dd3020c-1c42-4743-98fc-4e4eff5ce0de tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.375246 Oct 06 12:52:28.626080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 475/981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:28 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:28.631316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:28.632217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:28.638959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.639796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.640483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:28.641438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:28.642166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:28.642817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:29.082450 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd71f635-ffc3-4456-86be-a801f87cd24c tempest-ServersOnMultiNodesTest-1151995353 tempest-ServersOnMultiNodesTest-1151995353-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1617 microversion: 2.1 time: 0.453959 Oct 06 12:52:29.085441 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 476/982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:28 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1617 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:29.092744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc91110c-574e-4095-a323-603d1b6a2f80 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'create', calling method: .version_select at 0x7f7d3f62dca0>, body: {"keypair": {"name": "tempest-keypair-974890092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPirz5fZqsFQpEl7lIWcWOVVd9Yhxjn6cc3anNjfGg9IiQrZQxxaqpcZVsI1zbkgE9rRlCwsJKYv2yV3ogITiwpkT7NLasHGG3+BV1M/k/u/z54uZ3yuBbq5G9xiZ29QcQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:29.118252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bc91110c-574e-4095-a323-603d1b6a2f80 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:29.124459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bc91110c-574e-4095-a323-603d1b6a2f80 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:29.159766 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc91110c-574e-4095-a323-603d1b6a2f80 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072849 Oct 06 12:52:29.161030 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 477/983] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:52:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:29.169057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7633a7-c49a-4734-9ea8-1644557f8f6d", "name": "network-vif-plugged", "status": "completed", "tag": "a2f55cdb-4b8b-4548-b0c6-f91447ebcd68"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:29.184735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:29.185186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:29.185870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:29.199001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] Creating event network-vif-plugged:a2f55cdb-4b8b-4548-b0c6-f91447ebcd68 for instance cb7633a7-c49a-4734-9ea8-1644557f8f6d on n-h1-860556-1 Oct 06 12:52:29.204780 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e0d180ba-aac0-4416-9147-f443f93fad7f req-17684bb3-dd51-45ec-b055-5afdef566f0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041956 Oct 06 12:52:29.205581 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 478/984] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:29.217985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:29.218889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:29.227498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:29.228473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:29.228915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:29.229633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:29.230126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:29.230865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.001942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:30.015205 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2886b8a-78d5-48b6-9f89-fbe694214719 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.803129 Oct 06 12:52:30.020364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 479/985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:29 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:30.022565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "24fafca0-69c1-413c-9265-b6bfa98f4998"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:30.036508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.037244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.037691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.053543 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] Creating event network-changed:24fafca0-69c1-413c-9265-b6bfa98f4998 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:30.062047 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b32317f1-a1ef-46bb-bd3d-11f70f189bb2 req-c305b133-ec54-48ae-92b7-178ce4d43a2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044181 Oct 06 12:52:30.062834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 480/986] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:30.070109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:30.071460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:30.079584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.079995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.080437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.081351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.082462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.083009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.382233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ee93d70-5457-4cc9-ac7c-eff8b8bdf997 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc/action" status: 202 len: 0 microversion: 2.25 time: 4.203526 Oct 06 12:52:30.385902 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 507/987] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:52:26 2022] POST /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc/action => generated 0 bytes in 4209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:30.399154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:30.399407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:30.420707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.421630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.422356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.423298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.424026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.424700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.490016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:30.509726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:30.637089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91d9a480-718d-4435-83cd-a549745b66c6 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 204 len: 0 microversion: 2.1 time: 0.249263 Oct 06 12:52:30.638809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 508/988] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:30 2022] DELETE /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:30.644578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:30.645511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:30.664025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.664516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.664957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.665672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.666151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.666970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.715158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:30.727722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:30.733421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:30.740367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40005e9e-e3de-4070-b449-77c89ad2f8ba tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.676472 Oct 06 12:52:30.741140 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 481/989] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:30 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:30.745983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:30.746450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.747072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.747633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.748954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lazy-loading 'fault' on Instance uuid 93da43fb-b16f-470d-84ce-5fc1868ca3e4 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:30.761183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:30.768500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.769131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.769643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.771432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.772141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.772862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:30.893906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:30.910458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0334463-d7b3-439a-9157-0dfe257cead8 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1353 microversion: 2.1 time: 0.269400 Oct 06 12:52:30.911971 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 509/990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:30 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:30.954037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93da43fb-b16f-470d-84ce-5fc1868ca3e4", "name": "network-vif-deleted", "tag": "612a6aaf-d584-44ad-b9d1-c62b98b9cfd6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:30.971146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:30.971970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:30.974215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.003975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] Creating event network-vif-deleted:612a6aaf-d584-44ad-b9d1-c62b98b9cfd6 for instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 on n-h1-860556-1 Oct 06 12:52:31.013410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ed819cf0-9f4e-4594-942a-7ce2e3bafd94 req-c52bcd32-5f93-4d6b-8369-df1699fd4209 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088959 Oct 06 12:52:31.014932 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 510/991] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:31.024769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:31.026007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:31.037476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.038642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.039661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.042147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.043250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.044290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.235539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.247900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5cda1286-f885-4049-903c-dfa2261479ff tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.505444 Oct 06 12:52:31.265396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 482/992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:30 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:31.270003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:31.270430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:31.277469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.278006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.278455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.279183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.279647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.280074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.408402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.422571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.424620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.428896 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8119a743-c855-4b36-b7ab-41e71673fe38 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.411079 Oct 06 12:52:31.430064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 511/993] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:31 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:31.435314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:31.436154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:31.444043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.444784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.445377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.446423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.447154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.447778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.657099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.680072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4925b3ed-1f31-484d-a2fe-3fa1ecf70755 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1472 microversion: 2.1 time: 0.415944 Oct 06 12:52:31.682813 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 483/994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:31 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:31.754192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:31.763908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a1615fe-d10d-41fa-a5da-897ebf6a8a00 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1311 microversion: 2.1 time: 0.332198 Oct 06 12:52:31.764500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 512/995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:31 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1311 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:31.788237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:31.788857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:31.795239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.795736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.796205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.796910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.797546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.798165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.955588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:31.956434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:31.962913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.963660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.964237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:31.965013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:31.965771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:31.966329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.003006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.003415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.003862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.004324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lazy-loading 'fault' on Instance uuid 93da43fb-b16f-470d-84ce-5fc1868ca3e4 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:32.108227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26ae4c4eac2418b8df09afc8ab0b5b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e5442d47a34f03a9f0020d55d6d0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.120764 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17a1537c-42a4-4d85-91b5-c87a18220e29 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 200 len: 1353 microversion: 2.1 time: 0.168165 Oct 06 12:52:32.137967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 513/996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:31 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 1353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:32.144104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-26533acd-5ede-42c2-91e1-62582d8d6d99 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '.version_select at 0x7f7d3f3f6430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.148400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.149264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26533acd-5ede-42c2-91e1-62582d8d6d99 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.149781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26533acd-5ede-42c2-91e1-62582d8d6d99 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.151145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26533acd-5ede-42c2-91e1-62582d8d6d99 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.160871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.162881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.164431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ffe448f-f5a1-4a59-9998-44c9bb1b6aeb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.380904 Oct 06 12:52:32.165496 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 484/997] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:31 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:32.170367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "79933516-6c72-4e04-9a70-db079e28ac58"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:32.171893 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-26533acd-5ede-42c2-91e1-62582d8d6d99 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.032829 Oct 06 12:52:32.173601 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 514/998] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:32.183715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.184460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.185048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.209874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73ef36ec-f18e-499e-af88-756f0e30e661 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.215217 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] Creating event network-changed:79933516-6c72-4e04-9a70-db079e28ac58 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:32.220746 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73ef36ec-f18e-499e-af88-756f0e30e661 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019448 Oct 06 12:52:32.221330 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 515/999] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:32.229663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-196f55d5-4dd0-4912-9738-1d4ffd993a5c req-1bee42e7-dba9-4a50-b889-c29f0bac1e9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059738 Oct 06 12:52:32.229663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 485/1000] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:32.234240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b77d7fd-27e3-4921-a553-e9f3e658195d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-696612148", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:32.261387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b77d7fd-27e3-4921-a553-e9f3e658195d tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.031034 Oct 06 12:52:32.268883 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 486/1001] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Oct 6 12:52:32 2022] POST /compute/v2.1/flavors => generated 498 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:32.277178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1da58676-68ea-429b-8129-1959ae19b2c4 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.277424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.290367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:32.291839 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1da58676-68ea-429b-8129-1959ae19b2c4 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018999 Oct 06 12:52:32.298671 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 516/1002] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:52:32.311933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.312733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.313180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.313938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.314399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.314842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.340375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-plugged", "status": "completed", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:32.375388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.376136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.377305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.408380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] Creating event network-vif-plugged:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:52:32.415301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-be133ca6-a3df-4a8a-b5e8-8ab9ec92e658 req-3878e238-92e8-4902-96ed-6952c6c63573 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090272 Oct 06 12:52:32.416997 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 517/1003] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:32.463062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.463709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:32.482494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.483092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.483552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.486568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.489777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.490234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.867473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.876564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.877867 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a5f8471b-50f7-4419-b5fe-8db1efe61a8a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.604688 Oct 06 12:52:32.889415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.893372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:32.897025 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d5fad089-1b19-4c45-87a1-e77e674ae128 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.440777 Oct 06 12:52:32.898658 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 518/1004] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:52:32.906672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-998251857", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "a56f90d5-164c-4711-9297-c6c49ea47bcb"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:32.909013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 487/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:32.936091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:32.937012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:32.949449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.952735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.954097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.955273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:32.961716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:32.962413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:32.971830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:52:33.589225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:33.608936 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-140ac79f-224b-4cf1-abff-55cda81618fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 200 len: 1472 microversion: 2.1 time: 0.696135 Oct 06 12:52:33.611401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 488/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:32 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 1472 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:33.617898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:33.618816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:33.625804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.626472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.627136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.629352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.630193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.630864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.749022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:33.750712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:33.751469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:33.752710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:33.753305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:33.764035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.764768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.765541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.766773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.767344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.767845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.786925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:33.793274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:33.808699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:52:33.812702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:52:33.880032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-530b9fcb-95e1-4590-9b53-437781bfd8ab tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979055 Oct 06 12:52:33.881272 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 519/1007] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:52:33.887017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:33.888030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:33.894887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.896555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.897266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.898253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.898910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.899531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.922364 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 HTTP/1.1 Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:33.924423 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:33.926486 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '93da43fb-b16f-470d-84ce-5fc1868ca3e4'} Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:33.927295 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:33.928603 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:33.932482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:33.933580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca36cc46-d421-4a07-8bd8-5ebcb7aba2a2 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 404 len: 111 microversion: 2.1 time: 0.050907 Oct 06 12:52:33.934704 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 520/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:33 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:33.940588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:33.942248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:33.954408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.955040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.955571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:33.956521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:33.958767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:33.959329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.047383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.057226 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02a77351-fd35-4a46-a1b8-aeca13b04215 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1493 microversion: 2.1 time: 0.443442 Oct 06 12:52:34.058849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 489/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:33 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1493 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:34.064070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771dc7a0-e96c-4fc0-b3a2-4a121364bdfa", "name": "network-vif-deleted", "tag": "657e502a-3938-4a0f-933e-261aea11e921"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:34.081044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.082318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.082887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.099842 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] Creating event network-vif-deleted:657e502a-3938-4a0f-933e-261aea11e921 for instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa on n-h1-860556-1 Oct 06 12:52:34.108228 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dcb55cbf-162f-42f2-8068-0d83586cdd19 req-d8a6267d-4b27-4596-9607-9455a1d51645 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047786 Oct 06 12:52:34.114910 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 490/1010] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:34.122865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c475d91-f929-4288-9ac4-5c0ce7680a92 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:34.123665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c475d91-f929-4288-9ac4-5c0ce7680a92 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:34.276162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c475d91-f929-4288-9ac4-5c0ce7680a92 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.286082 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c475d91-f929-4288-9ac4-5c0ce7680a92 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1278 microversion: 2.1 time: 0.168398 Oct 06 12:52:34.286689 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 491/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:34 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:34.292685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:34.293300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:34.299774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.300580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.301020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.302320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.302924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.303676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.462193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.471933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.474025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.475183 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4dca8594-89a6-4daa-9e07-d5e88a4e1caa tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.539352 Oct 06 12:52:34.475741 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 521/1012] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:33 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:34.481096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:34.482040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:34.489097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.490500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.491570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.492556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.493090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.493595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.658719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:34.667337 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d58122f-e4dd-4b40-bbbe-256cb35691b7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1317 microversion: 2.1 time: 0.378290 Oct 06 12:52:34.669188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 492/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:34 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:34.674135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:34.674946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:34.685299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.686458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.687220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.688398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.689381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.690246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.707036 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 HTTP/1.1 Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:52:34.708658 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:34.711093 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '552a1b4f-82e7-4dc9-8632-5ed09edf69e9'} Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:34.712065 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:34.714207 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:34.716157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:34.716157 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7a6ba83-5c52-4812-b71a-b55691133afc tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 404 len: 111 microversion: 2.1 time: 0.039943 Oct 06 12:52:34.716157 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 493/1014] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:34 2022] DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:34.718485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:34.719392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:34.726444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.726928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.727364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:34.728060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:34.728689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:34.729279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.133694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:35.146309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:35.147812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:35.149039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-557a52ae-4b03-430b-9241-4625adda1f0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.671481 Oct 06 12:52:35.149611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 522/1015] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:34 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:35.154594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "5f6472fc-7c42-4457-9902-abe844e957e9"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:35.165313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.165838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.166283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.177997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] Creating event network-changed:5f6472fc-7c42-4457-9902-abe844e957e9 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:35.182672 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ad08193e-baf3-463f-8f99-977bd3a779d7 req-ae76585d-6c6a-4002-b74f-aa0d27a7fc5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Oct 06 12:52:35.183297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 523/1016] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:35.188566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.189274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.191272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:35.196842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.197331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.197802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.198524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.198986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.199421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.214708 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa HTTP/1.1 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:35.216423 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. Oct 06 12:52:35.217971 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '771dc7a0-e96c-4fc0-b3a2-4a121364bdfa'} Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:35.223389 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. Oct 06 12:52:35.224780 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.225992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 771dc7a0-e96c-4fc0-b3a2-4a121364bdfa could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:35.225992 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57347759-27f8-4e9b-bde4-cf856cea64e4 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa" status: 404 len: 111 microversion: 2.1 time: 0.033467 Oct 06 12:52:35.225992 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 524/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/771dc7a0-e96c-4fc0-b3a2-4a121364bdfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:35.225992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.225992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.238913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.240298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.240749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.241709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.242373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.242813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.258782 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 HTTP/1.1 Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:35.260118 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:35.261804 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '552a1b4f-82e7-4dc9-8632-5ed09edf69e9'} Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:35.262639 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:35.264224 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:35.265859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:35.265859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18912058-d755-4545-a96e-73fc9d96f725 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 404 len: 111 microversion: 2.1 time: 0.041853 Oct 06 12:52:35.265859 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 525/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:35.268784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.269861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.276824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.277320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.277801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.278710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.279181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.279618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.310239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:35.365657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9fbfa55-4833-455d-9c05-82718126f7af tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1644 microversion: 2.1 time: 0.651546 Oct 06 12:52:35.368197 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 494/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:34 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1644 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:35.374604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d91d2313-35dd-4c66-bc2d-41b14db7ce48 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '.version_select at 0x7f7d3f82bca0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.402725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d91d2313-35dd-4c66-bc2d-41b14db7ce48 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103053056" status: 202 len: 0 microversion: 2.1 time: 0.033198 Oct 06 12:52:35.404124 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 495/1020] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 12:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103053056 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:35.415508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.416262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.431389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.431897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.432344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.433782 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5115a17f-f3ce-48b2-ad91-3dadae99566d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 204 len: 0 microversion: 2.1 time: 0.170228 Oct 06 12:52:35.433942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.434318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.434810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.437889 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 526/1021] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:35 2022] DELETE /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:35.448818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.456297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.467703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.468385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.468945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.469927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.471427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.474358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.553147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:35.563256 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d67f0bef-eb6a-4713-8e7c-bd342ab2291b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1330 microversion: 2.1 time: 0.157809 Oct 06 12:52:35.564356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 496/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:35.578205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.580215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.587349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.588077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.588868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.589815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.590428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.591008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.872580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d6ed3b2-2195-4504-a0e0-b6ad762e786a tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1644 microversion: 2.1 time: 0.430685 Oct 06 12:52:35.873311 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 527/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1644 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:35.881965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:35.895127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ef70215-bda3-4e7b-b57b-e2de8e125ecc tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1472 microversion: 2.1 time: 0.329692 Oct 06 12:52:35.897069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.897712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.901257 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 497/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:35.908775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:35.910397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.910901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.911329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.912033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.912483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.913293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:35.915503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.924696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.926098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.937270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.938311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:35.938854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:35.939286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:35.944768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:36.321649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.328106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.333046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7c20c46-d8f9-4d09-8f95-9b37f98c92e5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1466 microversion: 2.1 time: 0.430438 Oct 06 12:52:36.333960 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 498/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1466 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:36.340242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:36.344349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.345829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.346585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.348526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.349177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.349836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.365651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.368768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.370459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f46ae6b4-8c9a-4a58-98f2-917262237f67 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.495995 Oct 06 12:52:36.381679 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fab766f-043c-4b26-94ad-53a636453e36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046019 Oct 06 12:52:36.382941 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 499/1026] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:52:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:36.383286 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 528/1027] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:35 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:36.389920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:36.390811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:36.397717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-189003090", "metadata": {"image_type": "test"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:36.398273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.399138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.399581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.400501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.401205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.401821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.403526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:36.411389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.412209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.412962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.413939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.414618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.415300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.420742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:36.469602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Getting quotas for project 8f2ce23729f346c2a3a76dca9d70a3e8. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:36.475661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Getting quotas for user cc7a26b1618b4642b9873eb308f6db33 and project 8f2ce23729f346c2a3a76dca9d70a3e8. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:36.705846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.717094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.718603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.720636 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0fd49cb7-21cf-4904-bcc6-bcdf9c5da4d7 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "POST /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de/action" status: 202 len: 0 microversion: 2.1 time: 0.335846 Oct 06 12:52:36.720782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f24a9e47-5168-4f1d-b0ba-ce0ecc902e5a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.336401 Oct 06 12:52:36.721211 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 500/1028] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:36 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:36.727061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:36.727610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:36.734036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.734812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.735108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 529/1029] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:52:36 2022] POST /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:52:36.735608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.736498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.737285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.737947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.748793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:36.749600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:36.757194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.758093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.758602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.759381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.760233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.761607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.860192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:36.872610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8fbef9aa-8253-4f3d-b673-ba5aad2aafb7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1336 microversion: 2.1 time: 0.135737 Oct 06 12:52:36.876513 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b36d66e5-7244-48e4-8d17-799851ddb4d0 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.153754 Oct 06 12:52:36.877793 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 501/1030] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:52:36 2022] POST /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:36.883657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a29b8234-5493-4940-884e-f9f55e463ae5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f82b940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:36.895505 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 530/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:36 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1336 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:36.902063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:36.903115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:36.910251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.911002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.911607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:36.912476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:36.913135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:36.913713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.026329 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a29b8234-5493-4940-884e-f9f55e463ae5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.146564 Oct 06 12:52:37.027489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 502/1032] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:36 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:37.032731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.033669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:37.043107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.043847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.044482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.045381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.046364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.046962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.166892 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43281efb-bffd-465b-9355-494fdb7fdb97 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1649 microversion: 2.1 time: 0.269329 Oct 06 12:52:37.172155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 531/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:36 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1649 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:37.214091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "eb894875-9f93-44b5-ae4f-1c2b78742953"}, {"server_uuid": "45994c2d-4076-494a-b0c1-1814a8c350cc", "name": "network-vif-unplugged", "status": "completed", "tag": "c16d7655-1745-479a-90a8-c4a6bf167cdb"}, {"name": "network-changed", "server_uuid": "45994c2d-4076-494a-b0c1-1814a8c350cc", "tag": "c16d7655-1745-479a-90a8-c4a6bf167cdb"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:37.235814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.236700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.237341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.254011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Creating event network-changed:eb894875-9f93-44b5-ae4f-1c2b78742953 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:37.254880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Creating event network-vif-unplugged:c16d7655-1745-479a-90a8-c4a6bf167cdb for instance 45994c2d-4076-494a-b0c1-1814a8c350cc on n-h2-860556-1 Oct 06 12:52:37.255581 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] Creating event network-changed:c16d7655-1745-479a-90a8-c4a6bf167cdb for instance 45994c2d-4076-494a-b0c1-1814a8c350cc on n-h2-860556-1 Oct 06 12:52:37.259733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:37.268413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e8398bab-e2bc-40ad-bc72-472e8840e79f req-66c79524-b669-42aa-8ff7-d3c68d25e34a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.066907 Oct 06 12:52:37.272443 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90e68989-78c4-4354-95b6-1441cf33ee1a tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1472 microversion: 2.1 time: 0.243691 Oct 06 12:52:37.274227 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 532/1034] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:52:37.274825 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 503/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:37.404001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.405133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:37.411650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.412049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.412491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.413195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.413708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.414115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.438703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "8e4f3006-44c1-4ddd-ba7f-49775d91bd45"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:37.449159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.449948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.450517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.463151 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] Creating event network-changed:8e4f3006-44c1-4ddd-ba7f-49775d91bd45 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:37.468891 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c8434c20-e822-487e-b246-e154d550089e req-7c2f4765-abab-45ec-b7b5-bd4f1fc641ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034556 Oct 06 12:52:37.470146 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 504/1036] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:52:37.622319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:37.632571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:37.634060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:37.635220 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39e720c9-7023-4648-87ee-40fe594133fb tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.235918 Oct 06 12:52:37.635955 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 533/1037] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:37.670496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ca65d44-738c-4d7e-8ee9-a2abafda1b41 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.687956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ca65d44-738c-4d7e-8ee9-a2abafda1b41 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/632761852" status: 202 len: 0 microversion: 2.1 time: 0.021612 Oct 06 12:52:37.688551 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 505/1038] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:52:37 2022] DELETE /compute/v2.1/flavors/632761852 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:37.696661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23b15ae0-dcbe-46b6-ae71-27af36062e61 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.736775 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23b15ae0-dcbe-46b6-ae71-27af36062e61 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5891 microversion: 2.1 time: 0.043627 Oct 06 12:52:37.738546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 534/1039] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/flavors/detail => generated 5891 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:37.757302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70f5a997-ce3d-44b7-8a03-74312d128e81 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.764541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.765451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:37.771866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:37.775737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.779981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.780666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.781959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.783678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.786571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.816069 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70f5a997-ce3d-44b7-8a03-74312d128e81 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/171029855" status: 202 len: 0 microversion: 2.1 time: 0.062511 Oct 06 12:52:37.820202 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 506/1040] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:52:37 2022] DELETE /compute/v2.1/flavors/171029855 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:37.826720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f8541bc-8084-42d5-ac66-84852782de66 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.852522 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f8541bc-8084-42d5-ac66-84852782de66 tempest-ServersWithSpecificFlavorTestJSON-1287498158 tempest-ServersWithSpecificFlavorTestJSON-1287498158-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.030911 Oct 06 12:52:37.867088 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 507/1041] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:37.883541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.885652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:37.894958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.896366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.897044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.898036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.898709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.899400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.916354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 HTTP/1.1 Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:52:37.918559 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:37.920824 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '93da43fb-b16f-470d-84ce-5fc1868ca3e4'} Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:37.921900 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:37.923131 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:37.926602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:37.929176 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a91ed94-b8f5-4630-b3ef-b2dab29bc6e3 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 404 len: 111 microversion: 2.1 time: 0.049520 Oct 06 12:52:37.939977 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 508/1042] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:37 2022] DELETE /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:52:37.945693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:37.946445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:37.953552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.955118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.956483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:37.957428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:37.958104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:37.958714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.216852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:38.227661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:38.229166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:38.230373 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3429e180-2596-44c2-b8dc-0d9becef5c6d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.469943 Oct 06 12:52:38.230934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 535/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:38.250776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.251870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 93da43fb-b16f-470d-84ce-5fc1868ca3e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.261325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.262162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.262604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.263317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.263935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.264961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.280789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 HTTP/1.1 Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:38.282912 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:38.284297 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '93da43fb-b16f-470d-84ce-5fc1868ca3e4'} Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:38.285145 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. Oct 06 12:52:38.286517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.289469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 93da43fb-b16f-470d-84ce-5fc1868ca3e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:38.289469 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b10be23-6ef2-4f1c-ad0a-8320042a1706 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4" status: 404 len: 111 microversion: 2.1 time: 0.052122 Oct 06 12:52:38.289469 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 536/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/servers/93da43fb-b16f-470d-84ce-5fc1868ca3e4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:38.291342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c4d70a08-cb38-4d15-96d7-bfe7d3f2ffd5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f294a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.359655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c4d70a08-cb38-4d15-96d7-bfe7d3f2ffd5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.073016 Oct 06 12:52:38.360517 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 537/1045] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:38.370741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:38.382119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.383048 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0acfc4c-e99a-4961-b173-223708a479f3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.441284 Oct 06 12:52:38.383537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.398399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.398399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.398399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.398399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.399189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.399189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.400112 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 509/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:37 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:38.407191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.407927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.416855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.417519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.418272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.418897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.419355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.419786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.438903 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 HTTP/1.1 Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:52:38.440390 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.441964 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '552a1b4f-82e7-4dc9-8632-5ed09edf69e9'} Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:38.442730 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.444083 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.446330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:38.446330 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c5d8af4-78fb-4d16-8c4e-6c9f49945957 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 404 len: 111 microversion: 2.1 time: 0.040650 Oct 06 12:52:38.447537 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 510/1047] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:38 2022] DELETE /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:38.455380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.455905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.462684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.463204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.463840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.464550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.465011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.465438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.874180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f14f1f5-f088-4b9e-b9b6-394dca1da190 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1629 microversion: 2.1 time: 0.512344 Oct 06 12:52:38.883656 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 538/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1629 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:38.901135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.907812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] [instance: 552a1b4f-82e7-4dc9-8632-5ed09edf69e9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.921631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.922781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.923453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.924398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.925672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.926510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.956487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] HTTP exception thrown: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Request method failure captured: Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 HTTP/1.1 Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7mTWaOBJSE5ueoNV4tke4Kpv_fC4SYJU-K-Jgxi27asYz-OJGGIJLos3kVdezVi_KJ-h1aYs_07yooJrXBHSny7UlhHJVpMoD_X3wv5OLqnhwFZAqq5kz-tTGG7tf0-oiNgAHRodMMtNaor4CddxNXqNDMkQ2umXNs6CQ22G79FNQ Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:38.959330 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_80e5442d47a34f03a9f0020d55d6d0ff", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/80e5442d47a34f03a9f0020d55d6d0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/80e5442d47a34f03a9f0020d55d6d0ff"}]}] Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 80e5442d47a34f03a9f0020d55d6d0ff Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274 Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c26ae4c4eac2418b8df09afc8ab0b5b5 Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-975884274-project Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.960704 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '552a1b4f-82e7-4dc9-8632-5ed09edf69e9'} Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:38.961775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. Oct 06 12:52:38.963399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:38.966972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] Returning 404 to user: Instance 552a1b4f-82e7-4dc9-8632-5ed09edf69e9 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:38.967992 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d366371-d255-4cbb-a8d8-5c7577a9b623 tempest-ServersWithSpecificFlavorTestJSON-975884274 tempest-ServersWithSpecificFlavorTestJSON-975884274-project] 10.222.0.26 "GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9" status: 404 len: 111 microversion: 2.1 time: 0.082815 Oct 06 12:52:38.968598 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 539/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/servers/552a1b4f-82e7-4dc9-8632-5ed09edf69e9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:38.973525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:38.974369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:38.980938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.981763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.982441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:38.983398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:38.984069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:38.984725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.013981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.031301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a00a7d5a-b8c3-41b4-a1f2-9a1298bbc083 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1472 microversion: 2.1 time: 0.581147 Oct 06 12:52:39.032676 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 511/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:39.055820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860556-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:39.075193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:39.084788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.085631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.086314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.087961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.090317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.091896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.139025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lazy-loading 'flavor' on Instance uuid cb7633a7-c49a-4734-9ea8-1644557f8f6d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:39.156457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Going to try to live migrate instance to n-h2-860556-1 {{(pid=129615) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:52:39.373962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.388241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.391372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.394785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b05a7c77-e0e7-4763-85ab-48692967e610 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.425204 Oct 06 12:52:39.400613 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 540/1051] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:38 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:39.408391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:39.409357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:39.435429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.437594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.438096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.438847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.442093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.460886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.853729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.863374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.864840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:39.866158 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e270f2c6-2b1a-479b-92a7-a3c4738d93fb tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.464350 Oct 06 12:52:39.866733 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 541/1052] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:39 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:39.871438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-215e98d4-c3d7-495f-88ce-60269c0d0e2f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f294790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:39.938019 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-215e98d4-c3d7-495f-88ce-60269c0d0e2f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.069977 Oct 06 12:52:39.939682 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 542/1053] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:39 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:39.945107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:39.945714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:39.952190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.952918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.953510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:39.954389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:39.954998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:39.955579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.103517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:40.112587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71b4307b-77a0-43e9-8b7f-0f2f2dc49102 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.171598 Oct 06 12:52:40.114182 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 543/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:39 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:40.121099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b081987-222e-44c1-8dbe-bea74eabf2a9", "name": "network-vif-deleted", "tag": "eef9ab39-05f3-440a-8917-24810d4ea2b4"}, {"name": "network-changed", "server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:40.136013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.136939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.137805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.154013 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Creating event network-vif-deleted:eef9ab39-05f3-440a-8917-24810d4ea2b4 for instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 on n-h2-860556-1 Oct 06 12:52:40.154538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] Creating event network-changed:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:52:40.164138 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e876f0f4-a8c9-4153-bd92-7378354748bb req-23a027ba-9200-4cd5-a76f-a0fd4a8ed62b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048604 Oct 06 12:52:40.164910 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 544/1055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:40.170533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "df88f105-458a-4f4e-91ed-3f7f6cdf34ee"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:40.185909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.186388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.186824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.199844 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] Creating event network-changed:df88f105-458a-4f4e-91ed-3f7f6cdf34ee for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:52:40.205208 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3ccea5ef-2ce5-4729-a85f-75cc75355f61 req-13c21e13-e43b-4d3c-91e9-38499fec0317 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038629 Oct 06 12:52:40.206058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 545/1056] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:40.212126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:40.212833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:40.219606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.220104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.220547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.221292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.221775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.222756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.263934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.264600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.265149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.265731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 0b081987-222e-44c1-8dbe-bea74eabf2a9 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:40.318014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:40.327151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ed12351-de4f-41c3-8477-ff49b5881fa2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 200 len: 1306 microversion: 2.1 time: 0.119850 Oct 06 12:52:40.328454 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 546/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:40 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:40.427388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:40.428102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:40.435184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.435905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.436345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.437054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.437688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.438142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.744518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:40.760517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:40.762369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:40.764184 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5073c3b0-77dd-43aa-9ef8-b1de454c86f7 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.340848 Oct 06 12:52:40.765144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 547/1058] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:40 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:52:40.894501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:40.895281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:40.903238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.903814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.904258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:40.905116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:40.905851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:40.906289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:41.213558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:41.225174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:41.226889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:41.228213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a9feeb59-c22b-44e4-9109-ac70d91b956e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.338243 Oct 06 12:52:41.229013 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 548/1059] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:40 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:41.234046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf2fe075-aea5-4be6-852f-41af08d37f1f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2ed820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:41.286692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf2fe075-aea5-4be6-852f-41af08d37f1f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.056406 Oct 06 12:52:41.287507 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 549/1060] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:41 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:41.305668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:41.306472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:41.313597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:41.314070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:41.315067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:41.315981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:41.316569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:41.317343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:41.934855 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddfb882e-2c89-4251-b672-51d9e75577ca tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d/action" status: 202 len: 0 microversion: 2.1 time: 2.898523 Oct 06 12:52:41.936971 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 512/1061] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:52:39 2022] POST /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d/action => generated 0 bytes in 2904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:41.947963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:41.949910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0b081987-222e-44c1-8dbe-bea74eabf2a9] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:41.963379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:41.964182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:41.965095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:41.966345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:41.967131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:41.967784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:41.975463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:41.981514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:41.990577 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 HTTP/1.1 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:52:41.992513 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. Oct 06 12:52:41.994056 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0b081987-222e-44c1-8dbe-bea74eabf2a9'} Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:41.994821 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. Oct 06 12:52:41.996074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:52:42.001544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 0b081987-222e-44c1-8dbe-bea74eabf2a9 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:42.003567 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69bc5b9e-c660-47fe-abda-8596cc629f08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9" status: 404 len: 111 microversion: 2.1 time: 0.062703 Oct 06 12:52:42.004733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 513/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:41 2022] GET /compute/v2.1/servers/0b081987-222e-44c1-8dbe-bea74eabf2a9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:42.012419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.013200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:42.027487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.029346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.030077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.032304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.033104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.035250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.040025 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a29f97be-af73-4773-a96e-bdea9685bc67 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.739221 Oct 06 12:52:42.040675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 550/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:41 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:42.050961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.053579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:42.068633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.069133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.074728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.076353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.076906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.077356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.617872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:42.632075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:42.633916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-267fedd3-5dba-4b9b-a9b6-5f898ba2a677 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.589024 Oct 06 12:52:42.635561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 551/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:42 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:42.645100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.646752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:42.648141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:42.649841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:42.651893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6221e854-7c5c-4745-b857-25ab64e4d303 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.645210 Oct 06 12:52:42.661380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.665212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.667162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.667380 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 514/1065] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:42 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:42.669120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.670334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.671417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.680135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.681077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:42.691088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.691875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.692493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.693403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.694153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.694745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.737483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:42.868425 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-674f22fc-2b91-45fd-9453-2513ce2dde08 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 204 len: 0 microversion: 2.1 time: 0.230739 Oct 06 12:52:42.869373 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 552/1066] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:42 2022] DELETE /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:42.876869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ca64945-6cdb-4c68-9274-28c2ecebb675 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f26b670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.947088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ca64945-6cdb-4c68-9274-28c2ecebb675 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.076084 Oct 06 12:52:42.956071 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 553/1067] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:42 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:42.956071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:42.957569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:42.965752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.966385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.967397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:42.968555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:42.969038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:42.969481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.035830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:43.046854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:43.048497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:43.050008 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a4d7947-a329-4716-96dd-5334cd0e537c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.381759 Oct 06 12:52:43.051938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 515/1068] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:42 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:43.072323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:43.073122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:43.079421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.080236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.081415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.082803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.083418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.084028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.395178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:43.404869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cacee6e1-cd4f-4002-abfc-13bd473686f8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1471 microversion: 2.1 time: 0.453918 Oct 06 12:52:43.405773 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 554/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:42 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:43.501233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:43.509369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23d5d160-6663-4a11-8b1c-f24f315822bb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.441437 Oct 06 12:52:43.510012 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 516/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:43 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:43.663687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:43.664387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:43.671455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.672043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.672551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.673396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.673978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.674483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.685156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:43.685898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:43.694038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.698305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.698892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.699635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:43.700100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:43.700527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:43.778600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:43.804257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:44.067498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.078098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-46e62771-8448-45bd-8a9d-b5248e3095bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.419230 Oct 06 12:52:44.078863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 555/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:43 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:44.084564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-129d282e-5def-4d2e-8bb6-e0c154b5f209 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2b44c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:44.114592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.125324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.127486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.129597 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b58e442-2bb1-48a2-8df3-6842658222de tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.448206 Oct 06 12:52:44.130787 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 517/1072] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:43 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:44.137329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:44.138170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:44.148778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.149566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.150221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.151753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.152424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.153495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.167474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-129d282e-5def-4d2e-8bb6-e0c154b5f209 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.087143 Oct 06 12:52:44.177419 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 556/1073] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:44 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:44.282001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:44.429037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:44.430174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:44.437947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.438600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.439134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.439984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.440536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.442248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.617572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.639364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.649378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:44.656091 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-306eb545-29f7-4ffc-8c78-e7afeba2c7dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.521677 Oct 06 12:52:44.660729 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 518/1074] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:44 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:44.695314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:44.697106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:44.752902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.759224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.760596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.763372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:44.767055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:44.770318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:44.850448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:45.034770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:45.048255 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37b6e56d-0175-471c-a0f7-89a6e78cfb91 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1471 microversion: 2.1 time: 0.623560 Oct 06 12:52:45.049489 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 557/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:44 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1471 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:45.111129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:45.111759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:45.113822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:45.131383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:45.133247 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88158058-ed04-4f7d-be6f-8943627055c7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.470135 Oct 06 12:52:45.134523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:45.135028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:45.153200 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 519/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:44 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:45.160092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:45.160612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:45.161347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:45.162184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:45.168109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:45.183775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:45.184529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:45.185097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:45.185891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:45.186972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:45.186972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.030598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.041707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.043699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.045092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40a6647d-c4c8-47f5-b5f9-76e21528dbf0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.889410 Oct 06 12:52:46.058612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 520/1077] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:45 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:46.071481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e24a3417-d434-4329-a1bd-7dd258904fd1 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f599790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:46.086415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.100831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8cf5724-296b-4f38-9a97-145d832666e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.993473 Oct 06 12:52:46.101976 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 558/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:45 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:46.114526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:46.115446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:46.133181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.134240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.134854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.137129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.137798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.139753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.143489 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e24a3417-d434-4329-a1bd-7dd258904fd1 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.083349 Oct 06 12:52:46.144139 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 521/1079] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:46 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:46.161291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:46.170067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:46.188720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.189780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.191755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.194489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.195094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.199260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.360469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:46.625788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.642237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.645017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.647532 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df967549-8cc6-4917-8434-2d88cf80e0b8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1568 microversion: 2.25 time: 0.541466 Oct 06 12:52:46.648947 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 559/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:46 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1568 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:46.655001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:46.655967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:46.665938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.666779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.667623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.669060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.670087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.670826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.798995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:46.810275 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a7ea5dad-aafe-44f6-9981-2de660b75daf tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1471 microversion: 2.1 time: 0.663962 Oct 06 12:52:46.815319 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 522/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:46 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1471 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:46.836829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-plugged", "status": "completed", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:46.856113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:46.856611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:46.857061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:46.888371 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] Creating event network-vif-plugged:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:52:46.899594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2d5ebff4-4c63-4683-b3b2-8e360e1eb597 req-d3c45f12-f4e1-40a0-b1f1-aefea20cc272 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082389 Oct 06 12:52:46.900468 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 523/1082] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:47.015874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60834218-927a-4242-a8ca-d68a62349697", "name": "network-vif-deleted", "tag": "62f09810-7e17-45ab-bee4-7bb805cb1ea5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:47.040262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:47.042633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:47.046532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:47.078891 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] Creating event network-vif-deleted:62f09810-7e17-45ab-bee4-7bb805cb1ea5 for instance 60834218-927a-4242-a8ca-d68a62349697 on n-h2-860556-1 Oct 06 12:52:47.098030 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-78aa7208-4891-4207-9162-00900006c194 req-44548ceb-c0cf-48d8-91f0-1ec74ad7434f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086195 Oct 06 12:52:47.099245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 524/1083] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:47.104809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:47.105855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:47.124019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:47.124809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:47.125489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:47.130127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:47.131235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:47.132019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:47.361077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:47.386261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-824c5aaa-ba02-4b8c-981d-c0b5f6288b4d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.732996 Oct 06 12:52:47.406431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 560/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:46 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:47.433848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:47.441022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:47.504450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:47.506836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:47.509026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:47.511797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:47.514499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:47.516250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:47.982888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:47.995587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:47.999150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.005024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6b714c6-63b5-4ca7-b545-1388a832ed54 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.904257 Oct 06 12:52:48.006306 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 525/1085] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:47 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:48.014147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39dec543-2de2-4845-9d03-72bc0c292222 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f5820d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.116661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39dec543-2de2-4845-9d03-72bc0c292222 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.108546 Oct 06 12:52:48.118132 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 526/1086] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:48.131256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.132045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:48.179457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.179968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.180412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.200060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.201428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.206169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.215375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9bc1a247-091f-45b2-a430-087971cd92af tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.807592 Oct 06 12:52:48.225369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.225592 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 561/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:47 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:48.225592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.225592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:48.234227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.238100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.238775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.239747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.246520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.247520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.306101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.306917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.308174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.309114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 60834218-927a-4242-a8ca-d68a62349697 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:48.428871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.437649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67cd2e35-7522-43b3-b0ce-f353888f6496 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 200 len: 1306 microversion: 2.1 time: 0.219998 Oct 06 12:52:48.438561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 562/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:48.459194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.459728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:48.467640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.468462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.469100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.470036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.470674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.471280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.797502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.808198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.815814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:48.823305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40a5f8a8-e295-4086-910d-7be871e74e85 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1543 microversion: 2.25 time: 0.700482 Oct 06 12:52:48.824224 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 527/1089] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1543 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:48.854207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64594237-3330-4973-8cc4-9d9ab56e8c99 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '.version_select at 0x7f7d3f5f31f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.860535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64594237-3330-4973-8cc4-9d9ab56e8c99 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.872029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64594237-3330-4973-8cc4-9d9ab56e8c99 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.872867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64594237-3330-4973-8cc4-9d9ab56e8c99 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.901435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64594237-3330-4973-8cc4-9d9ab56e8c99 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3031 microversion: 2.25 time: 0.052829 Oct 06 12:52:48.910096 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 528/1090] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/os-migrations => generated 3031 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:52:48.929223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:48.931205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:48.951050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.951808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.952446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:48.953331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:48.953988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:48.954583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.135827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:49.161204 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5b86632d-ba7a-4cd7-a3c8-8e26ee46b658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.706232 Oct 06 12:52:49.167548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 563/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:49.188673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-plugged", "status": "completed", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:49.200062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.200824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.201459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.217670 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] Creating event network-vif-plugged:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:52:49.225168 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6e6093ba-2d25-4a92-b85e-04c18a8ef186 req-4856457a-4da5-416a-9edc-4c1cedb017a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056045 Oct 06 12:52:49.226805 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 564/1092] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:49.233617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:49.235658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:49.245607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.246469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.247139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.248045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.249461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.250098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.673415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:49.696140 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e3fba99-71d7-437c-9f3c-4a5948db40bc tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 2036 microversion: 2.25 time: 0.773279 Oct 06 12:52:49.736512 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 529/1093] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:48 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 2036 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:49.745151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ab75a1e-ef97-4569-bf4c-dcd8bc01629b tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f66ea60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:49.814249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ab75a1e-ef97-4569-bf4c-dcd8bc01629b tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.076191 Oct 06 12:52:49.816953 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 530/1094] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:49 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:49.826683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7633a7-c49a-4734-9ea8-1644557f8f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "a2f55cdb-4b8b-4548-b0c6-f91447ebcd68"}, {"name": "network-changed", "server_uuid": "cb7633a7-c49a-4734-9ea8-1644557f8f6d", "tag": "a2f55cdb-4b8b-4548-b0c6-f91447ebcd68"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:49.852578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.855340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.855340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.886795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Creating event network-vif-unplugged:a2f55cdb-4b8b-4548-b0c6-f91447ebcd68 for instance cb7633a7-c49a-4734-9ea8-1644557f8f6d on n-h1-860556-1 Oct 06 12:52:49.888079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] Creating event network-changed:a2f55cdb-4b8b-4548-b0c6-f91447ebcd68 for instance cb7633a7-c49a-4734-9ea8-1644557f8f6d on n-h1-860556-1 Oct 06 12:52:49.897518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d24227d1-7a20-490d-a64c-7082b409e916 req-39c8fcae-fb57-4be4-9e9f-24cd93513be2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.078365 Oct 06 12:52:49.898857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 531/1095] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:49.907430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:49.912475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:49.926041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:49.929082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.930390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.931143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.932049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.932840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.933441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.955013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:49.957487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:49.959403 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04be1672-b6e0-4f77-876e-0a7f7aeadc80 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.731013 Oct 06 12:52:49.963143 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 565/1096] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:49 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:49.971080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:49.973072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 60834218-927a-4242-a8ca-d68a62349697] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:49.980993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.981935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.983087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:49.984124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:49.985215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:49.985939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.005416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 HTTP/1.1 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:52:50.015459 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. Oct 06 12:52:50.018296 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '60834218-927a-4242-a8ca-d68a62349697'} Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:52:50.019758 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. Oct 06 12:52:50.024569 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:52:50.027627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 60834218-927a-4242-a8ca-d68a62349697 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:52:50.027627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea40abaa-e897-42af-85b7-f851dec91c05 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697" status: 404 len: 111 microversion: 2.1 time: 0.043739 Oct 06 12:52:50.027627 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 566/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:49 2022] GET /compute/v2.1/servers/60834218-927a-4242-a8ca-d68a62349697 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:52:50.027627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-225dc88b-2786-480f-968c-c5032475fd98 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: .version_select at 0x7f7d3f276af0>, body: {"keypair": {"name": "tempest-keypair-1741199981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeJDmEm+PDlvZBBNzOcSQ4wMF/ugyexcCPjUCy0vIRK8Vk0ekCpeu0aQyg0JLbLH417oHs9YHogNsltMvQa0K9+89tjbkKYQeoBoqU18GsYX1Kc1D9+hdDp+8LZXg5aSQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:50.033253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:50.047164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-225dc88b-2786-480f-968c-c5032475fd98 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for project 3b283101c4674072a49a14df6acb56bb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:50.052977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-225dc88b-2786-480f-968c-c5032475fd98 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for user 17892d653b7d461e803f5423cf7191af and project 3b283101c4674072a49a14df6acb56bb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:50.096157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-225dc88b-2786-480f-968c-c5032475fd98 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.085371 Oct 06 12:52:50.105570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 567/1098] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:52:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:52:50.127213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:50.127880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:50.145472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.153137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.153729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.154542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.155029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.155469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.214749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:50.293310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:50.392049 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-906d23af-c656-4966-bbf8-a994850e93fd tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 204 len: 0 microversion: 2.1 time: 0.286204 Oct 06 12:52:50.393378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 568/1099] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:50 2022] DELETE /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:50.405675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:50.407155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:50.423743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.425232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.426307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.428052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.429095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.430640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.664909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:50.692230 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0edf2e08-3e00-495f-ac01-de2fa210b5e7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.791616 Oct 06 12:52:50.694245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 532/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:49 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:50.701617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:50.718493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:50.733389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.734764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.737594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.741629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:50.744864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:50.745833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:50.821444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:52:50.943947 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e8bc93d-0cd8-449d-92fd-09b600e85c69 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 204 len: 0 microversion: 2.1 time: 0.247133 Oct 06 12:52:50.945513 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 533/1101] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:50 2022] DELETE /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:52:50.950647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:50.955217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f19e261f-a9f0-4ea6-afd4-18bf962646cf tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f592820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:50.985462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca17b53f-5d7d-43e4-88df-941eba5e55dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1378 microversion: 2.1 time: 0.581286 Oct 06 12:52:50.986297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 569/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:50 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1378 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:51.003095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:51.004368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:51.017802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.018507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.019678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.023547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.024483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.025201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.032343 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f19e261f-a9f0-4ea6-afd4-18bf962646cf tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.084573 Oct 06 12:52:51.043149 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 534/1103] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:50 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:51.052584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:51.054278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:51.062041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.062846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.063896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.064818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.065591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.066282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.608906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:51.620139 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec66f625-6d40-410f-b46c-3d9ccf0e9103 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1474 microversion: 2.1 time: 0.632445 Oct 06 12:52:51.620819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 570/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:50 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1474 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:51.661590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:51.716500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:51.717515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:51.719322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:51.726336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:51.729190 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ba9721d-a705-4c74-a47f-b011fe509078 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.683602 Oct 06 12:52:51.731299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.735394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.736369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.739059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:51.740699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:51.742871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:51.773682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 535/1105] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:51 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:52.020156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:52.021936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:52.037779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.041434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.042183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.046533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.047367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.048925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.071883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:52.088331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-831f34ba-19fc-4a23-9cd6-60f4f8d6719a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.375495 Oct 06 12:52:52.103225 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 571/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:51 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:52.120029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-721df9a1-70b7-41c7-8468-a501d45940a6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f206a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:52.172394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-721df9a1-70b7-41c7-8468-a501d45940a6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.067585 Oct 06 12:52:52.173798 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 572/1107] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:52 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:52.452453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:52.466331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71ea235d-9e29-4f34-8593-eb232d04a338 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1528 microversion: 2.1 time: 0.460801 Oct 06 12:52:52.467424 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 536/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:52 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1528 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:52.509564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:52.510318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:52.518585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.520018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.520661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.521876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.522657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.523259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.657846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:52.658551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:52.673299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.676579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.679100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.681182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.682479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.683713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.832134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:52.845121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac7a446c-7950-421f-9270-9be8be9070cc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1528 microversion: 2.1 time: 0.339576 Oct 06 12:52:52.847644 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 573/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:52 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:52.865982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:52.866967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:52.896205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.902778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.904774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:52.912567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:52.914249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:52.915812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:53.333583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.344673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.354468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.357316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7283bf04-cdf8-4ca0-a60e-db2762f3924f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.508476 Oct 06 12:52:53.374144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 574/1110] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:52 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:53.383721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-828f02b6-03ef-4e16-96c9-2ddd8cbc6323 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:53.433651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-828f02b6-03ef-4e16-96c9-2ddd8cbc6323 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/a56f90d5-164c-4711-9297-c6c49ea47bcb" status: 202 len: 0 microversion: 2.1 time: 0.058016 Oct 06 12:52:53.435914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 575/1111] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:52:53 2022] DELETE /compute/v2.1/flavors/a56f90d5-164c-4711-9297-c6c49ea47bcb => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:52:53.442974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:53.443960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:53.451708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:53.452374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:53.452961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:53.453856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:53.454493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:53.455086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:53.536009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.554210 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae3d89a4-ff9b-459d-bb81-84df6931184b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1474 microversion: 2.1 time: 0.901869 Oct 06 12:52:53.569506 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 537/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:52 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1474 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:53.590440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da810fc9-c012-420d-bb8f-7056daa33750 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f66ed30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:53.689520 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da810fc9-c012-420d-bb8f-7056daa33750 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.117050 Oct 06 12:52:53.709374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 538/1113] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:53 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:53.720726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e99a73a-a196-469c-80a4-5fb345a335aa tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:53.756339 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e99a73a-a196-469c-80a4-5fb345a335aa tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045572 Oct 06 12:52:53.766349 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 539/1114] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:52:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:53.785811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:53.788523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:53.807882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:53.808499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:53.809009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:53.809842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:53.813955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:53.814799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:53.941589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.961512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:53.962996 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4250f7d6-aee5-4d31-af59-27b1487b07ca tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.523627 Oct 06 12:52:53.964102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 576/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:53 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:53.968752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Old instance type tempest-test_resize_flavor_-696612148, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 12:52:53.976601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:53.977261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:53.977936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:53.978680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:53.979308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:54.138695 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33508fa3-cb42-4438-9c5f-adb1fe272f0e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981/action" status: 202 len: 0 microversion: 2.1 time: 0.355494 Oct 06 12:52:54.140664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 540/1116] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:52:53 2022] POST /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:52:54.151718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:54.153567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:54.168122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.169009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.169708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:54.170689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.171415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.172056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:54.388864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:54.389541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:54.403439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.406378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.407025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:54.408015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.410391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.411014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:54.420724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:54.847123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:54.856419 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8efdb5f9-c2f8-4d81-b0cf-e2213bac6f46 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1537 microversion: 2.1 time: 0.711491 Oct 06 12:52:54.869082 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 577/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:54 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1537 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:52:54.874438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:54.886548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:54.905654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.907332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.908132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:54.909095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:54.910245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:54.910842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:55.368683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:55.382012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:55.383486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:55.384687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-19d94e74-b290-4827-93ab-c9949e2ac007 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 1.001002 Oct 06 12:52:55.393295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 541/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:54 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:55.410620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bb1b5bc-fb81-4610-ac9e-3fdc40d90f2e tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f582e50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:55.491897 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8bb1b5bc-fb81-4610-ac9e-3fdc40d90f2e tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.096323 Oct 06 12:52:55.492886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 542/1119] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:55 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:55.506887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2038782968", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "7894d46a-c18d-4a9f-a678-c98a979132b6"}], "security_groups": [{"name": "tempest-securitygroup--268299029"}], "key_name": "tempest-keypair-1741199981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:56.668338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:56.673328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] validate_networks() for [('7894d46a-c18d-4a9f-a678-c98a979132b6', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:52:56.686089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-deec6727-a02e-47ad-b15f-a4e216b31f81 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1474 microversion: 2.1 time: 1.814991 Oct 06 12:52:56.703497 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 578/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:54 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1474 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:56.709544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:56.710437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:56.733297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:56.733831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:56.734360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:56.735101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:56.735566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:56.736003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:57.168945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:57.182871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c3e87c0-4164-49e9-b69c-026401f157bb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.477757 Oct 06 12:52:57.199787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 579/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:56 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:57.209616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:57.210391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:57.221371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:57.222714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:57.223569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:57.224486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:57.225501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:57.227547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:57.733840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:57.748925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1d45a02f-4234-4326-9144-f7850a94660c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1537 microversion: 2.1 time: 0.547141 Oct 06 12:52:57.749561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 580/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:57 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1537 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:57.771409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa99544-1e40-4c41-b242-7e4faa4ce620", "name": "network-vif-deleted", "tag": "362b2a4f-eda6-43d9-bff2-2b6aaa9bb608"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:52:57.781547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:57.782333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:57.782991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:57.820753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] Creating event network-vif-deleted:362b2a4f-eda6-43d9-bff2-2b6aaa9bb608 for instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 on n-h1-860556-1 Oct 06 12:52:57.827466 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2e9dd092-3990-419e-9e9a-f87e3eabca07 req-9e214b18-a062-457f-983c-0aeffcf94db6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076427 Oct 06 12:52:57.828668 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 581/1123] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:52:57.835187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:57.836149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:57.843064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:57.843567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:57.844017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:57.844760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:57.845229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:57.845665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.255076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:52:58.255578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:52:58.256629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:52:58.257262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:52:58.258144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:52:58.284009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.288063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.288753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.289726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.292207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.292990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.339057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:52:58.350771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for user 17892d653b7d461e803f5423cf7191af and project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:52:58.355647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:58.388727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:52:58.394414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:58.395976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:58.396524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:52:58.415536 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8e1e06f-b35e-491c-97ef-8d7ca869f06a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.585138 Oct 06 12:52:58.429759 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 582/1124] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:57 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:58.452919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a9055a5a-a78b-4f14-b0b4-b6626ec26c1e tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2200d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:58.531236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2809f787-a809-494e-9987-72b866adb1b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 3.035703 Oct 06 12:52:58.535609 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 543/1125] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:52:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:52:58.547297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:58.547999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:58.553542 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a9055a5a-a78b-4f14-b0b4-b6626ec26c1e tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.132568 Oct 06 12:52:58.564830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.565378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 583/1126] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:58 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:58.566384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.566384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.568761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.569264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.570920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.574835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:58.583937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:58.608834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.625913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.635121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.636672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.638683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.642439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.684183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:58.685221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:58.685696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:58.686195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:52:58.855997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:58.871708 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be911207-4139-4ca2-8738-ee904281c06d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1309 microversion: 2.1 time: 0.333833 Oct 06 12:52:58.892043 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 544/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:58 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:58.931987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:58.931987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:58.931987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:52:59.083651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:59.110177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:59.113869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:59.119431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed59ef60-664d-4766-97aa-e8decd8a1748 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1286 microversion: 2.25 time: 0.239753 Oct 06 12:52:59.120334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 545/1128] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:58 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1286 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:52:59.127140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:59.129114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:59.158138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:59.158609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:59.160177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:59.160520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:59.160995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:59.161430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:59.337487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:59.354215 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b33c888-9f14-4ac6-9954-901f71c9112a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.787340 Oct 06 12:52:59.361560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 584/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:58 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:59.447693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:59.448353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:52:59.475151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:59.478548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:59.482259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:59.486845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:52:59.487432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:52:59.495760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:52:59.838401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:52:59.856265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2371bcb6-1503-4e3a-8d29-96b693c6bbf6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1537 microversion: 2.1 time: 0.734679 Oct 06 12:52:59.862411 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 546/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:52:59 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1537 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:59.871134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8e8fcb9-a8cf-47af-9303-2ae91a14744d tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f582ee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:52:59.969646 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8e8fcb9-a8cf-47af-9303-2ae91a14744d tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.105433 Oct 06 12:52:59.971137 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 547/1131] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:52:59 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:52:59.989952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:00.016104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.017207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Searching by: {'deleted': False, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:53:00.039588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.041541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.042482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.043625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.044519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.045375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.062006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:00.111208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:53:00.170760 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8691e60-39fe-4b87-81bc-4fb3f4270a9e tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.194431 Oct 06 12:53:00.196823 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 548/1132] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 12:52:59 2022] GET /compute/v2.1/servers => generated 334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:00.212528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:00.213407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:00.220983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.222347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.222957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.223849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.224592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.225187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.297527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.301128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.301448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.302589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.304093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:53:00.348746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.355038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.359338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-302e4676-b389-4483-b006-6f25a4357012 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.917267 Oct 06 12:53:00.374010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 585/1133] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:52:59 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:00.419171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c740bb1-f8ab-46c0-a1d7-924f83e3a174", "name": "network-vif-deleted", "tag": "19b1cadd-3eaf-4cad-839b-557a3ccf5e01"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:00.439002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.440068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.441111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.465586 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] Creating event network-vif-deleted:19b1cadd-3eaf-4cad-839b-557a3ccf5e01 for instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 on n-h2-860556-1 Oct 06 12:53:00.473651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.476736 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e1751cb5-9fe3-4c00-96ba-a51a0009fda9 req-35cc9731-8cbf-4a6f-8633-f94866ecfcc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096224 Oct 06 12:53:00.479339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 586/1134] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:00.493144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af53d05b-50d0-4eb7-9a6f-0d12ac24f55d tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 200 len: 1309 microversion: 2.1 time: 0.289384 Oct 06 12:53:00.507138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:00.508636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 549/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:00 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 1309 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:00.508959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:00.524260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:00.528889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.529646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Searching by: {'deleted': False, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:53:00.537139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.537648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.538214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.539020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.539417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.539848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.544612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.545761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.546922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.548084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.553315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.554763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.821658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:53:00.921821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.924381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.933565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.934164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.934628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.935381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.939730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:00.940952 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55dc6719-c7ac-44c0-852a-1366df067df2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1282 microversion: 2.25 time: 0.459740 Oct 06 12:53:00.947001 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 587/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:00 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1282 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:00.952162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:00.957183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:00.976183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.976912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.977696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:00.978685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:00.979351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:00.979980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:01.780370 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b913d9bd-f5b6-4410-baac-912add37165f tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.270402 Oct 06 12:53:01.781426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 550/1137] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:53:00 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:01.787923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:01.788831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:01.817892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:01.819127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:01.822419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:01.825107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:01.828466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:01.830028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:01.872034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:01.892453 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b7e37298-1ef2-42fb-864d-5f5c53263a50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1503 microversion: 2.1 time: 0.943766 Oct 06 12:53:01.895358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 588/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:00 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1503 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:01.902431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83d55250-4dd4-44a7-815b-cfea09cdfbf9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f277d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.018280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-83d55250-4dd4-44a7-815b-cfea09cdfbf9 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.120710 Oct 06 12:53:02.027615 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 589/1139] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:01 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:02.029072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.029981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.038352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.038877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.039559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.040649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.041472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.042453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.046217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:02.090464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.114619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b882bf31-4573-47ff-90bf-c27c236cca65 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1537 microversion: 2.1 time: 0.332012 Oct 06 12:53:02.119584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 551/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:01 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1537 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:02.125145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.126464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 6c740bb1-f8ab-46c0-a1d7-924f83e3a174] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.135732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.147103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.148268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.149285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.150085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.151189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.187986 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 HTTP/1.1 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:53:02.192894 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. Oct 06 12:53:02.194506 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '6c740bb1-f8ab-46c0-a1d7-924f83e3a174'} Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:02.195235 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. Oct 06 12:53:02.196455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.197524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 6c740bb1-f8ab-46c0-a1d7-924f83e3a174 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:02.197524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56e40c4f-7b78-419c-bf27-ef943b403190 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174" status: 404 len: 111 microversion: 2.1 time: 0.076108 Oct 06 12:53:02.203295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 552/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/6c740bb1-f8ab-46c0-a1d7-924f83e3a174 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:02.218728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-572b7074-a289-4098-8021-3e5d4ce0d08c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.243195 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-572b7074-a289-4098-8021-3e5d4ce0d08c tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038403 Oct 06 12:53:02.244194 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 553/1142] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:02.250700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.254046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.292924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.294457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.314325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.315439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.316133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.316857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.419836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.444914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.453146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.460003 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac828486-1858-45b1-94cf-b61baa21078b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1344 microversion: 2.25 time: 0.214611 Oct 06 12:53:02.463679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 554/1143] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:02.485263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.486974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 8aa99544-1e40-4c41-b242-7e4faa4ce620] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.489158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.506758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.511216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:02.512091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.512753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.513783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.513971 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eaada141-a328-41b5-83aa-2594a283826e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.489812 Oct 06 12:53:02.514550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.515137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.515580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 590/1144] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:02.533612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.556399 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 HTTP/1.1 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:53:02.559396 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. Oct 06 12:53:02.560835 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8aa99544-1e40-4c41-b242-7e4faa4ce620'} Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:02.561619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. Oct 06 12:53:02.563241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:02.566163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 8aa99544-1e40-4c41-b242-7e4faa4ce620 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:02.567408 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69052d4a-086e-4223-8594-df23ef8c0821 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620" status: 404 len: 111 microversion: 2.1 time: 0.102029 Oct 06 12:53:02.568242 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 555/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/8aa99544-1e40-4c41-b242-7e4faa4ce620 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:02.573142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.573660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.583480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.583987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.584439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.585161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.585626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.586096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.589414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-08e16439-892b-485c-99aa-62e66b978cd2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.670716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:02.674495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-08e16439-892b-485c-99aa-62e66b978cd2 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/b8e77baa-e570-4556-a105-d48bf4ffb7a3" status: 204 len: 0 microversion: 2.1 time: 0.098013 Oct 06 12:53:02.680529 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 556/1146] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 12:53:02 2022] DELETE /compute/v2.1/os-server-groups/b8e77baa-e570-4556-a105-d48bf4ffb7a3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:02.688455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.689288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.696038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.697561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.698261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.701042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.701764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.703808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.760042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:02.886936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a80b9058-1cc6-4dde-836f-42548bd6156d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 204 len: 0 microversion: 2.1 time: 0.322060 Oct 06 12:53:02.887699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 591/1147] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:02 2022] DELETE /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:02.915602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.920849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.931782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d69dcbb-008e-4086-875f-1eaf621b1101 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 204 len: 0 microversion: 2.1 time: 0.249388 Oct 06 12:53:02.935519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 557/1148] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:02 2022] DELETE /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:02.940181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:02.941059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:02.948636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.949146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.949643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.950402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.951032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.951657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.963341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.964423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.965288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:02.966651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:02.967489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:02.968407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.359558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:03.389832 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8fd7b44b-8e40-4a68-89c9-f418564c516e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1478 microversion: 2.1 time: 0.456298 Oct 06 12:53:03.390350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:03.391661 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 558/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1478 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:03.413497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.416627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:03.422411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0dcc423c-acf8-4371-b8e0-7889492ecd70 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1699 microversion: 2.1 time: 0.529749 Oct 06 12:53:03.430643 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 592/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:02 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1699 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:53:03.437329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.438703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.439167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.439888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.440345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.440826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.446100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-015174ca-8ed0-4094-b035-8c2250584db0 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f3f59d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.521629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:03.543990 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-015174ca-8ed0-4094-b035-8c2250584db0 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.110874 Oct 06 12:53:03.544591 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 593/1151] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:03 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:03.567211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.576252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:03.585375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.586189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.586810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.596896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.597871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.598571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.660969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:03.746037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24fec6ef-71c3-4ad6-8a54-217de3bc3d84 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 204 len: 0 microversion: 2.1 time: 0.352405 Oct 06 12:53:03.752170 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 559/1152] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:03 2022] DELETE /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:03.759790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a810ab0-1b89-4bea-93d3-fde0f6db9143 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '.version_select at 0x7f7d3f5b6b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.765523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a810ab0-1b89-4bea-93d3-fde0f6db9143 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.766349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a810ab0-1b89-4bea-93d3-fde0f6db9143 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.766851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a810ab0-1b89-4bea-93d3-fde0f6db9143 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.779961 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a810ab0-1b89-4bea-93d3-fde0f6db9143 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.025248 Oct 06 12:53:03.792973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 560/1153] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:53:03 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:03.797820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.798545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:03.809232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.809753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.810330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.811035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.811744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.812173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.883913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:03.897123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f42df380-9a6a-489f-98a7-0111452a888d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.342061 Oct 06 12:53:03.901721 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 594/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:03 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:03.911992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:03.912791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:03.923598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.926268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.926902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:03.928478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:03.929287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:03.929898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.193208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.204255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.205830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.208771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a676655-f6cb-4925-bd28-74a219c43335 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.413582 Oct 06 12:53:04.209655 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 561/1155] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:03 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:04.215869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:04.216480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:04.228164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.228680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.229123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.229870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.230326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.230739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.367447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.411268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.418848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.420884 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbf62d80-a2a1-45f8-a9dd-c93e008d760e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.517908 Oct 06 12:53:04.437529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 595/1156] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:03 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:04.451140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:04.452395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:04.479418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.479901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.480358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.484530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.485598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.486098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.638148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:04.661428 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9eebac3-a12a-42b1-ba62-da57b15ee117 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1474 microversion: 2.1 time: 0.450095 Oct 06 12:53:04.669432 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 562/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:04 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1474 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:04.674697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:04.675988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:04.703714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.704275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.708043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:04.708898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:04.709404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:04.712098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:05.100533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2aff702b-d7b8-46fd-ae00-feea38d08f5f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1629 microversion: 2.1 time: 0.661152 Oct 06 12:53:05.101531 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 596/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:04 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1629 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:05.136104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c7e5d81-98ac-4b54-850b-ef8dbb6b0bdf tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f1d1dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:05.204766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c7e5d81-98ac-4b54-850b-ef8dbb6b0bdf tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.096142 Oct 06 12:53:05.206986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 597/1159] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:05 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:05.224057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:05.224971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:05.243668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:05.244455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:05.245077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:05.246140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:05.246769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:05.247365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:05.309550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:05.319331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85e0c8e2-303c-4254-a1e3-1dff8a6b2ed8 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1699 microversion: 2.1 time: 0.648733 Oct 06 12:53:05.338390 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 563/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:04 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1699 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:05.350933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-445e37ad-8797-4191-85e3-63098e258910 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: .version_select at 0x7f7d3f3b6b80>, body: {"keypair": {"name": "tempest-keypair-138794812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqas1YQdhGsy9OA5M3SEAmr3cvh9i/WgyMMXtOFTIIlyfst8aZ3U/WjspbE/JXeq2+d3tt9WlwqeaTuVFObyjzcqEL8Ft5H+55ngzTc3ZbkWka8acxiKadEu1S46KR94Q=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:05.373667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-445e37ad-8797-4191-85e3-63098e258910 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:05.380592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-445e37ad-8797-4191-85e3-63098e258910 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for user 1f58173845e04996a0a5c2497e13d3cc and project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:05.439677 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-445e37ad-8797-4191-85e3-63098e258910 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099816 Oct 06 12:53:05.442045 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 564/1161] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:05.455726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:05.457463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:05.468507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:05.469071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:05.469545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:05.470470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:05.471277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:05.472023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:05.993379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.004710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-513c665a-2e0c-4787-9690-dc8df93d894c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.794060 Oct 06 12:53:06.022243 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 598/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:05 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:06.082532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.103861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.105806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.107009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-789d18ab-c6be-4390-a8a1-b8329edc0dce tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.663700 Oct 06 12:53:06.107585 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 565/1163] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:05 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:06.112296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:06.116143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:06.139858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.140448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.140894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.141621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.142116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.143023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.304555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Calling method '.version_select at 0x7f7d3f33cb80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:06.306450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.306931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.307579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.327966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.329890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.330935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.347120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.347930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.348573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.358304 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e7e9fd6-4465-451c-afc6-a906b630ec1a tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.334492 Oct 06 12:53:06.365230 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 599/1164] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:53:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:06.370364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:06.382064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.384876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.387761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.401604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] Creating event network-changed:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h2-860556-1 Oct 06 12:53:06.411734 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1f10302c-b9a3-4627-a676-432961550a6a req-632afc2f-a93d-4c5d-9892-61be3a025c04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044865 Oct 06 12:53:06.412547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 600/1165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:06.417511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:06.418272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:06.432280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.432962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.433861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.435180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.435842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.440876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.808542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.824703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.829458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.830721 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da776223-c385-4c58-b0e4-a0117338b8ce tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.722182 Oct 06 12:53:06.831317 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 566/1166] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:06 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:06.874315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b025a196-d37d-4154-9fef-9b45ed82f324 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f5b6a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:06.887504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:06.900506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc2de443-0d31-4c30-b078-e208b467bb42 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1474 microversion: 2.1 time: 0.486914 Oct 06 12:53:06.901136 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 601/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:06 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1474 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:06.915219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:06.915219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:06.916170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.916170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.916606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.917321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:06.917796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:06.918430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:06.996407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b025a196-d37d-4154-9fef-9b45ed82f324 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1421 microversion: 2.1 time: 0.135310 Oct 06 12:53:07.003352 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 567/1168] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:06 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1421 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:07.016262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Calling method '.version_select at 0x7f7d3f34caf0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.018041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.018589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.019042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.046636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:07.065187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.066004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.066639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.068071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2a0fd7e4-8ca0-4a86-b966-c5b2a8a1f6fb tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1632 microversion: 2.1 time: 0.163491 Oct 06 12:53:07.068691 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 602/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:06 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1632 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:07.087510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.094345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:07.109952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.112139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.113438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.116721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.117476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.118133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.173695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.185031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.185781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.194289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-050b573d-8e8d-4055-a73b-5a286f907cb1 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-860556-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.181706 Oct 06 12:53:07.202601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 568/1170] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-860556-1/servers => generated 591 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:07.208622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.209543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:07.216970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.217816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.218484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.219410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.220703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.221377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.421431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:07.431556 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f63a6ca4-6d70-4180-99d2-41bb0505ca10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.361777 Oct 06 12:53:07.432953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 603/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:07.442936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Calling method '.version_select at 0x7f7d3f3ae3a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.445281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.446359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.447563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.474079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.474802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.475572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.491517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.492221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.492747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.499485 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2e4b409-1009-4b7e-acb6-92fb56a78754 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063377 Oct 06 12:53:07.500814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 604/1172] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:07.512240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Calling method '.version_select at 0x7f7d3f206940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.517593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.518249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.518807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.541134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.541817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.542332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.549279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30e50907-3315-42a4-8bc2-e8e27d048094 tempest-HypervisorAdminUnderV252Test-1650779737 tempest-HypervisorAdminUnderV252Test-1650779737-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-860556-1/search" status: 200 len: 104 microversion: 2.1 time: 0.040983 Oct 06 12:53:07.550865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 605/1173] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-860556-1/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:07.682446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b84d3d-9ee5-4022-aa5e-ee737f6c85e4", "name": "network-vif-deleted", "tag": "d8f04d69-1d40-4be5-80b1-59d44f97e399"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:07.695325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:07.713512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.714296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.714846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.716566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:07.738416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] Creating event network-vif-deleted:d8f04d69-1d40-4be5-80b1-59d44f97e399 for instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 on n-h1-860556-1 Oct 06 12:53:07.748808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f596b637-a8bd-4dd7-ac04-38f0944d4ab8 req-613a25f1-2bd9-485a-8d02-638d08f8eed5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078879 Oct 06 12:53:07.751913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 606/1174] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:07.752685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:07.773563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:07.780687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53215579-aad0-4b33-aac5-833ef3091bd2 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.576122 Oct 06 12:53:07.795084 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 569/1175] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:07.861916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.862884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:07.870803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.871687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.872362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.873335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.874062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.874715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.933099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:07.934232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:07.941095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.941878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.942541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:07.943809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:07.944482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:07.945461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.169079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:08.182585 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1b47b46-2f5d-4745-98f1-7fba3c600d9e tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1432 microversion: 2.1 time: 0.254739 Oct 06 12:53:08.200957 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 570/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1432 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:08.214143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-05fd1a9b-c8bb-41e3-a140-3b17f73ad8df tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f34ce50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:08.290353 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-05fd1a9b-c8bb-41e3-a140-3b17f73ad8df tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1430 microversion: 2.1 time: 0.086118 Oct 06 12:53:08.294514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 571/1177] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:08 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1430 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:08.305656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:08.309062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:08.324408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.325460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.326296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.327271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.331528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.333179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.380993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:08.399948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:08.401489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:08.402735 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df5efc1c-8c47-4c29-8834-b6ac24846300 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.545876 Oct 06 12:53:08.403307 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 607/1178] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:07 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:08.416981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e34e60b1-3ff6-4ebc-9127-0b980f89a29c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f206d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:08.427835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.429819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.432972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.433760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lazy-loading 'fault' on Instance uuid 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:53:08.516129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e34e60b1-3ff6-4ebc-9127-0b980f89a29c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 200 len: 1430 microversion: 2.1 time: 0.110928 Oct 06 12:53:08.517026 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 608/1179] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:08 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 1430 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:08.523097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0058f985bc07499bb7b961d586a1410a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e65e5d9c2149da907088d119b9dcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:08.525665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c895c-c5a5-4e01-91ab-f375d1f564d5", "name": "network-vif-deleted", "tag": "90b09094-c4b1-4c24-bc58-eb3f87e3e9a2"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:08.539158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13e39891-de71-4649-8421-4731fce42c9d tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 200 len: 1360 microversion: 2.1 time: 0.243202 Oct 06 12:53:08.540355 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 572/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:08 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:08.552465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:08.553563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:08.556164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.558039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.558039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.571599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] Creating event network-vif-deleted:90b09094-c4b1-4c24-bc58-eb3f87e3e9a2 for instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 on n-h2-860556-1 Oct 06 12:53:08.574063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.579451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9c0987db-cecd-4487-8101-3c10417bd623 req-68dd02c2-79b8-4632-8b98-0c6097165064 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061099 Oct 06 12:53:08.580600 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 609/1181] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:08.586837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:08.587817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:08.589026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.590859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.595371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.596271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.596941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.597083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.598848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:08.599509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.600109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.603070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:08.604230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:08.625195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:09.310437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:09.320466 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed992c28-9e9f-41f4-b0f1-d89a43387484 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1479 microversion: 2.1 time: 0.737736 Oct 06 12:53:09.323693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 610/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:08 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1479 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:09.333492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:09.334237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:09.349384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.349870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.350323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.351044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.351624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.351924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.458941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:09.474617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6521cbce-a037-41a5-ab81-7096be5419cf tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.932956 Oct 06 12:53:09.487095 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 573/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:08 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:09.492468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:09.493483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:09.500420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.501213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.501847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.502732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.504050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.504646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.552676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.553163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.553806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.554424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:53:09.704678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:09.712507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96466aa8-8267-4dd1-9cf5-b6ea6e0a24c8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 200 len: 1308 microversion: 2.1 time: 0.223808 Oct 06 12:53:09.732104 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 574/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:09 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:09.741323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:09.741963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:09.757008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.758716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.759504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:09.761049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:09.762048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:09.763514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.087422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.108460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.111901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.113354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdf90334-683c-4fe3-b17c-e69272f5338c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.788660 Oct 06 12:53:10.125949 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 611/1185] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:09 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:10.142741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:10.148426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] [instance: 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:10.170238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.171137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.171867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.173049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.173944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.174570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.199587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] HTTP exception thrown: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Request method failure captured: Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 HTTP/1.1 Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs9nsN0I8vElI6wytjkS04BabngsoilCvNi_vdEtkRmkdMgSni_cPY5IdDtQfaoKJWFwRrQup_oF3IhDCuKggMpla0sONqQdXtdtzQRVLQRPCA6xc_JAbpzLIdCeGsKLLh89kGaSO78nXiwUKafzobUEREH6AqWfEUNMJfXF-l5_v-c Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b5e65e5d9c2149da907088d119b9dcdb Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-873441283 Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:53:10.203283 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b5e65e5d9c2149da907088d119b9dcdb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b5e65e5d9c2149da907088d119b9dcdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b5e65e5d9c2149da907088d119b9dcdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b5e65e5d9c2149da907088d119b9dcdb"}]}] Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-873441283 Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b5e65e5d9c2149da907088d119b9dcdb Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-873441283 Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-873441283-project Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0058f985bc07499bb7b961d586a1410a Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-873441283-project Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. Oct 06 12:53:10.206803 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '40b84d3d-9ee5-4022-aa5e-ee737f6c85e4'} Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:10.208475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. Oct 06 12:53:10.211230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:10.214829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Returning 404 to user: Instance 40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:10.216146 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2d98a44-5b1b-448d-88e0-9f8eadf2181a tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4" status: 404 len: 111 microversion: 2.1 time: 0.094131 Oct 06 12:53:10.217000 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 612/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:10 2022] GET /compute/v2.1/servers/40b84d3d-9ee5-4022-aa5e-ee737f6c85e4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:10.230825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eae2a799-fbc8-426d-b376-d725abb80892 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] Calling method '.version_select at 0x7f7d3f276c10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:10.260782 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eae2a799-fbc8-426d-b376-d725abb80892 tempest-ServersTestJSON-873441283 tempest-ServersTestJSON-873441283-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102570659" status: 202 len: 0 microversion: 2.1 time: 0.038262 Oct 06 12:53:10.262224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 613/1187] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 12:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102570659 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:10.355341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:10.356252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:10.367836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.368530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.369200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.370907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.371471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.372007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.611998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:10.811618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.834276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.835987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:10.837196 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff3eff2a-bd16-4f49-9214-3544a26f6117 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 1.103282 Oct 06 12:53:10.850199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 575/1188] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:09 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:10.871349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:10.871961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:10.884497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.885072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.885564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:10.886531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:10.887189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:10.887834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.239580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:11.247997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0402bd33-ded4-4e38-a91c-95abb7004987 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1466 microversion: 2.1 time: 0.902560 Oct 06 12:53:11.266216 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 614/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:10 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1466 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:53:11.273340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:11.274325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 0a8c895c-c5a5-4e01-91ab-f375d1f564d5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:11.280741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.281230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.281889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.282777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.283394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.283989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.301338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 HTTP/1.1 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:53:11.303327 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. Oct 06 12:53:11.304734 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0a8c895c-c5a5-4e01-91ab-f375d1f564d5'} Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:11.305507 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. Oct 06 12:53:11.306755 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:11.309331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 0a8c895c-c5a5-4e01-91ab-f375d1f564d5 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:11.310479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33aaf03c-b55e-43f7-a151-c406e241fd6b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5" status: 404 len: 111 microversion: 2.1 time: 0.042863 Oct 06 12:53:11.315057 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 615/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:11 2022] GET /compute/v2.1/servers/0a8c895c-c5a5-4e01-91ab-f375d1f564d5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:11.320055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d24361e-3af1-4439-959f-991ed131496e", "name": "network-vif-unplugged", "status": "completed", "tag": "55a445c2-3ad7-47c7-8fb2-0f570c1c52cf"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:11.330471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.331334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.331980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.346698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] Creating event network-vif-unplugged:55a445c2-3ad7-47c7-8fb2-0f570c1c52cf for instance 9d24361e-3af1-4439-959f-991ed131496e on n-h2-860556-1 Oct 06 12:53:11.352313 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1a16436c-1239-4c6b-ad0e-1320baabcec9 req-26cc9254-1f9a-4a62-a113-7f9d88137853 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036566 Oct 06 12:53:11.353257 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 616/1191] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:11.360228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:11.361251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:11.368706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.369555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.370301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.371332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.372280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.372922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.646155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:11.662501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dcb58cea-02bc-45e8-995a-7c48af222efb tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.811095 Oct 06 12:53:11.663780 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 576/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:10 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:11.671837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dde11c7a-1650-40c3-82ac-32cf6534536f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f4b39d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:11.757354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dde11c7a-1650-40c3-82ac-32cf6534536f tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2" status: 200 len: 784 microversion: 2.1 time: 0.092105 Oct 06 12:53:11.758361 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 577/1193] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:11 2022] GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2 => generated 784 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:11.771543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:11.772351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:11.802105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.802606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.803043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:11.813332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:11.814438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:11.815290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.032859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.046357 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d25dd809-02d1-4795-b0e9-12dde94bdd47 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1432 microversion: 2.1 time: 0.286667 Oct 06 12:53:12.046962 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 578/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:11 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1432 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:12.053119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-221d4775-009d-4d2c-825d-8ea6bae1aed5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:12.053621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.061893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.063318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.067000 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-221d4775-009d-4d2c-825d-8ea6bae1aed5 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018180 Oct 06 12:53:12.067681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 579/1195] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:53:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:12.075761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ebd6f36-d0ad-40e2-89d4-424ba3314638 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.714444 Oct 06 12:53:12.075761 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 617/1196] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:11 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:12.076003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:12.076003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:12.079731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d24361e-3af1-4439-959f-991ed131496e", "name": "network-vif-deleted", "tag": "55a445c2-3ad7-47c7-8fb2-0f570c1c52cf"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:12.082097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.082664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.083179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.083967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.084512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.085008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.104256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.105679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.105679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.130664 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] Creating event network-vif-deleted:55a445c2-3ad7-47c7-8fb2-0f570c1c52cf for instance 9d24361e-3af1-4439-959f-991ed131496e on n-h2-860556-1 Oct 06 12:53:12.147958 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ededf5c4-795b-47b1-93c4-a04c18357fe1 req-026b5407-9222-4cd0-80d6-9f2bfa39933d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076821 Oct 06 12:53:12.148481 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 618/1197] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:12.154716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce2e3dfc-686f-4d92-b6d3-2038eedcf966 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2f4670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:12.575858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.591903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.597708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:12.600688 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cabb5996-f7aa-4be3-b089-860cf285d0fe tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.531084 Oct 06 12:53:12.601695 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 580/1198] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:12 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:12.803984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Calling method '.version_select at 0x7f7d3f3ac940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:12.810067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.810932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.811627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.821722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:12.830193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:12.835569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.836226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.836784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.870967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.871525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.872183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.887618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.888397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.889075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.926176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.926977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.927561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.935882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-659a0a94-e490-443c-b90c-c9becbc2e5c0 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2546 microversion: 2.53 time: 0.332494 Oct 06 12:53:12.936214 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 581/1199] 10.222.0.26 () {60 vars in 1243 bytes} [Thu Oct 6 12:53:12 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2546 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:12.941580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:12.942460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:12.948636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.949137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.949579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:12.950322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:12.950786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:12.951222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.059151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce2e3dfc-686f-4d92-b6d3-2038eedcf966 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "DELETE /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 204 len: 0 microversion: 2.1 time: 0.909262 Oct 06 12:53:13.059775 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 619/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:12 2022] DELETE /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:13.068451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-267429827", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "4f0ce63f-ea60-4427-922a-c32b96edb684"}], "security_groups": [{"name": "tempest-securitygroup--1875307175"}], "key_name": "tempest-keypair-138794812", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:13.123783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:13.134311 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-738bc098-6d52-4e0d-9fe7-2064d0fa3def tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.196812 Oct 06 12:53:13.134949 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 582/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:12 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:13.140678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Calling method '.version_select at 0x7f7d3f34cd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:13.144945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.145431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.146030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.171454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.171971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.172594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.210028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.210762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.212065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.226360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] validate_networks() for [('4f0ce63f-ea60-4427-922a-c32b96edb684', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:53:13.238930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.239420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.239856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.277144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.277657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.278334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.285882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-232b9aa2-f667-4adc-b35b-25773c580198 tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1239 microversion: 2.53 time: 0.149545 Oct 06 12:53:13.295500 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 583/1202] 10.222.0.26 () {60 vars in 1222 bytes} [Thu Oct 6 12:53:13 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1239 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:13.313128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f046119-34a9-4e02-8361-18faab5542d6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f78c940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:13.344388 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6f046119-34a9-4e02-8361-18faab5542d6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] HTTP exception thrown: Image not found. Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f046119-34a9-4e02-8361-18faab5542d6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Request method failure captured: Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 HTTP/1.1 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs-A0UbRCXPxZnQcLpqW9imz6uYSiBGsHifIVDLCUj7sewlFu9YFqTYMm6tBFGcsqY6CHgbvsXpXSmX5RyUsD2tcR07hGo6GiSYzCpVpVBc1qdnHKQBRHhNdZTqlQeoz27W7Xn3YGyhizI6l2LURyoJgmSVbqwMZ3zlgDGGCLHxfZKU Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:53:13.367019 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f2ce23729f346c2a3a76dca9d70a3e8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}] Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cc7a26b1618b4642b9873eb308f6db33 Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '50953999-62cf-445c-9a0c-53ec8c770862'} Oct 06 12:53:13.368566 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:53:13.369408 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50953999-62cf-445c-9a0c-53ec8c770862 Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:53:13.370727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50953999-62cf-445c-9a0c-53ec8c770862 could not be found. Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:53:13.372046 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f046119-34a9-4e02-8361-18faab5542d6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:13.373193 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f046119-34a9-4e02-8361-18faab5542d6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 404 len: 62 microversion: 2.1 time: 0.071801 Oct 06 12:53:13.375415 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 584/1203] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:13 2022] GET /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:53:13.390596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:13.391533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:13.410894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.415022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.416387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.417388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.418328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.419014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.552960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:13.561990 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31f39936-83ad-469a-89e9-e0233503cc5f tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1432 microversion: 2.1 time: 0.185067 Oct 06 12:53:13.565147 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 585/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:13 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1432 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:13.577007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:13.577629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:13.592558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.594241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.595247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.595997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.598590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.600498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.900078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:13.914494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:13.918988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:13.920165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb10e9bb-e0b2-4e81-840f-017bd5719190 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.351790 Oct 06 12:53:13.924405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 586/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:13 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:13.937351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Calling method '.version_select at 0x7f7d3f3ac5e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:13.943576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.944070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.945131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:13.988889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:13.989179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:13.989836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.009605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-498c24a1-e881-49f9-8b5e-ea2c1ba766dc tempest-HypervisorAdminV253TestBase-2137993912 tempest-HypervisorAdminV253TestBase-2137993912-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/e48d905e-9fb7-4d7a-8edb-a8dc095ff99e" status: 200 len: 792 microversion: 2.53 time: 0.082410 Oct 06 12:53:14.011381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 587/1206] 10.222.0.26 () {60 vars in 1298 bytes} [Thu Oct 6 12:53:13 2022] GET /compute/v2.1/os-hypervisors/e48d905e-9fb7-4d7a-8edb-a8dc095ff99e => generated 792 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:53:14.011922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:53:14.012642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:53:14.013326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:53:14.014213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:53:14.015034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:53:14.016616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-308999209"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:14.019668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:14.026990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.027479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.027925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.028652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.029244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.029763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.038441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.041892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.043680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.045640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.046608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.047058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.098842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:14.115034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for user 1f58173845e04996a0a5c2497e13d3cc and project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:14.135667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:53:14.139009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:53:14.232008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac2a661f-8773-4455-8bd1-e2e05196e687 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.169507 Oct 06 12:53:14.235152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 620/1207] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:53:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:53:14.250210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:14.252608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:14.263352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.264946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.265938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.267164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.268222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.269095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.447999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6cc946ef-b503-411a-af9b-8f816feee405 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "POST /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de/action" status: 202 len: 0 microversion: 2.1 time: 0.435220 Oct 06 12:53:14.457424 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 588/1208] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:53:14 2022] POST /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:53:14.463014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "80777c32-8243-4ac0-bbc6-1c12abb3139a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:14.498184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.499382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.500293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.527247 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] Creating event network-vif-plugged:80777c32-8243-4ac0-bbc6-1c12abb3139a for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:14.541801 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-354c55e7-ce9d-4eae-b570-563775e39431 req-e3b9f78a-6c78-43a6-97a2-fc39dd4386ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082701 Oct 06 12:53:14.546716 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 589/1209] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:14.559118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:14.562172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:14.587054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.587937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.588707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.590419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:14.593490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:14.595694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:14.954909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:14.970816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:14.978477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:14.980086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e3d1cd0-e966-4351-a856-4daf3db06d13 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.742027 Oct 06 12:53:14.980859 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 621/1210] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:14 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:15.008878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8c1f582-06d3-4ab8-9905-7cebdf045a36 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:15.015895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8c1f582-06d3-4ab8-9905-7cebdf045a36 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:15.167035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8c1f582-06d3-4ab8-9905-7cebdf045a36 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:15.176874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8c1f582-06d3-4ab8-9905-7cebdf045a36 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1233 microversion: 2.1 time: 0.173622 Oct 06 12:53:15.196036 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 622/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:14 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1233 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:15.230865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c85c47e5-2c43-4fd4-b737-bfa58d364a32 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f1fb280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:15.307905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:15.327145 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c667d92-fd20-43f8-b7e6-c8b0902bbe6d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.778752 Oct 06 12:53:15.330013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 590/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:14 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:15.348716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:15.349342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:15.355372 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c85c47e5-2c43-4fd4-b737-bfa58d364a32 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.157339 Oct 06 12:53:15.361638 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 623/1213] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:15 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:15.372452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:15.373676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:15.377571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:15.378699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:15.379207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:15.379867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:15.380326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:15.380749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:15.388125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:15.390757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:15.392175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:15.394455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:15.398712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:15.440006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:15.454142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:15.480803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:15.481299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:15.481758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:15.487071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lazy-loading 'fault' on Instance uuid 9d24361e-3af1-4439-959f-991ed131496e {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:53:16.179362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.199884 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d155ee3-3965-43d2-a35d-253fb668f7a8 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 200 len: 1308 microversion: 2.1 time: 0.868542 Oct 06 12:53:16.201142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 591/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:15 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 1308 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:16.210964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:16.212003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:16.222470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.226328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.231485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:16.233644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.236448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.238378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:16.722199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.730953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.732379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.733869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cc0802b-f012-4509-a202-7515f59b443a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 1.370891 Oct 06 12:53:16.734463 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 624/1215] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:15 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:16.740245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:16.740862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:16.765476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.766013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.766461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:16.767381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.768035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.769084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:16.880512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.895429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.898752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:16.899959 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6406048-5d3f-4a39-ac7e-2822b2493b17 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.697383 Oct 06 12:53:16.922417 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 592/1216] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:16 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:16.930026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:16.930873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:16.937953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.938644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.939290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:16.940714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:16.941506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:16.942156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.030074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:17.047995 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bca88b0d-87da-4fe1-a223-2c6adc01e54b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1291 microversion: 2.1 time: 0.312403 Oct 06 12:53:17.050434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 625/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:16 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1291 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:17.072709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38537540-bb4c-480d-a4aa-367d68835221 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f190160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.144951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38537540-bb4c-480d-a4aa-367d68835221 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.077537 Oct 06 12:53:17.154129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 626/1218] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:17 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:17.159708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "24fafca0-69c1-413c-9265-b6bfa98f4998"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:17.172431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.172924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.173646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.207919 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] Creating event network-vif-plugged:24fafca0-69c1-413c-9265-b6bfa98f4998 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:17.220156 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1ad597c7-9866-4c34-a422-f4674323f9fd req-0d042b0f-ae01-402f-bf79-9e41644f8f11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064632 Oct 06 12:53:17.223234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 627/1219] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:17.240825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.242292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 9d24361e-3af1-4439-959f-991ed131496e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:17.252079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.252591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.253673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.254433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.254959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.256562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.257643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:17.267109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ebdfe5ab-0f9e-48cb-b4e8-880d570641e5 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.343134 Oct 06 12:53:17.270450 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 593/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:16 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:17.281771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e HTTP/1.1 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:53:17.283834 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. Oct 06 12:53:17.285514 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '9d24361e-3af1-4439-959f-991ed131496e'} Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:17.286513 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. Oct 06 12:53:17.288009 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:53:17.290574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 9d24361e-3af1-4439-959f-991ed131496e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:17.292441 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d339764-6f3a-47ab-a938-831653e0759b tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e" status: 404 len: 111 microversion: 2.1 time: 0.064431 Oct 06 12:53:17.293629 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 628/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:17 2022] GET /compute/v2.1/servers/9d24361e-3af1-4439-959f-991ed131496e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:17.302540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d1a93bb-5e8c-47f2-b135-8a7bc8a9ad82 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.368404 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d1a93bb-5e8c-47f2-b135-8a7bc8a9ad82 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/15718a84-c605-46a3-a3b3-13ee0a8a920d" status: 204 len: 0 microversion: 2.1 time: 0.070778 Oct 06 12:53:17.370536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 594/1222] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 12:53:17 2022] DELETE /compute/v2.1/os-server-groups/15718a84-c605-46a3-a3b3-13ee0a8a920d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:17.379907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.380583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:17.388500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.389003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.389438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.390617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.391507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.392222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.455520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:17.580806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5771818-8538-4e4b-a186-40d9d1496d5c tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 204 len: 0 microversion: 2.1 time: 0.206001 Oct 06 12:53:17.585822 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 629/1223] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:17 2022] DELETE /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:53:17.592100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.592768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:17.602307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.603166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.603616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.604336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.604796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.605230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.767001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.767787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:17.774665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.775435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.775895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.776617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.777083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:17.777517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:17.954104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:17.967290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ffcdbc1-4ef4-40f6-8279-65ed9fafd1db tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1471 microversion: 2.1 time: 0.376593 Oct 06 12:53:17.968584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 595/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:17 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:17.977363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:17.978140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:17.998361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:17.999195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.001952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:18.004673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:18.005763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.007819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:18.042423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:18.098773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.111445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.113075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.114267 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2b617ab-2949-4bb4-98e1-18e878a0c089 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.357381 Oct 06 12:53:18.114819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 630/1225] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:17 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:53:18.125301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:18.125851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:18.135692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:18.140098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.140797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:18.141636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:18.142222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.144085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:18.462883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.472725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.474208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.475508 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1febdb3-0594-4bd2-95f2-8cb616509120 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.505587 Oct 06 12:53:18.490143 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 596/1226] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:17 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:18.499298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4bf04b5-1af1-411f-8f51-0d97a3d35726 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2e8280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:18.621202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:18.623078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4bf04b5-1af1-411f-8f51-0d97a3d35726 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.131755 Oct 06 12:53:18.624294 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 597/1227] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:18 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:18.630531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:18.634153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:18.640558 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2b875079-0390-4acf-991c-32ef4fdd92ea tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.517257 Oct 06 12:53:18.641201 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 631/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:18 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:18.654944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:18.655974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.656762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:18.669983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:18.670590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:18.671037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.069074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:19.085598 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fcf0178c-f633-4a8c-a00c-70f2c735ef4b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.459115 Oct 06 12:53:19.087569 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 598/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:18 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:19.095035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:19.097625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:19.114466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.115016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.115354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.116079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.116540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.116969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.231931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-209dae9f-e1dc-4c3d-9596-b4f2913d2e71 tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] Action: 'create', calling method: .version_select at 0x7f7d3f1fc670>, body: {"security_group": {"name": "tempest-securitygroup-1280113099", "description": "tempest-description-1182001549"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:19.467091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd8e292eca04ea986fc7b82cf196017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca94e746fcb426887d292336801aa0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:19.477499 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0ea9c86-9618-40c2-8e9b-4336b271fa89 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 200 len: 1471 microversion: 2.1 time: 0.388423 Oct 06 12:53:19.481401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 599/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:19 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:19.487752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:19.490526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:19.504436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.505186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.507067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.508969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.509558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.510244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.879627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:19.893076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:19.896119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:19.898240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25479604-339d-45c4-b338-739696b09125 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.413915 Oct 06 12:53:19.899133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 600/1231] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:19 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:19.905135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-unplugged", "status": "completed", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:19.916715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.917530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.918337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.932221 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] Creating event network-vif-unplugged:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:53:19.938439 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-215a6e6a-8547-4b77-8295-95591f11fea5 req-7aa9751f-7b68-42d8-a091-bf7b0dfb9434 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037285 Oct 06 12:53:19.940088 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 601/1232] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:19.948003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:19.948709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:19.955517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.956111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.956732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:19.957673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:19.958320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:19.958914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.054407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-209dae9f-e1dc-4c3d-9596-b4f2913d2e71 tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.138712 Oct 06 12:53:20.055934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 632/1233] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:53:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:53:20.068159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64e618cd-2533-4645-9670-d730eeebc2be tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f228e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:20.139343 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64e618cd-2533-4645-9670-d730eeebc2be tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.081927 Oct 06 12:53:20.148672 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 633/1234] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:20 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:20.153759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:20.154589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:20.162653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.163431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.164099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.165515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.166597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.167194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.404960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:20.424387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:20.428172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:20.429836 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83efe0df-309d-4b55-a4aa-d403de799721 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.487867 Oct 06 12:53:20.431390 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 602/1235] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:19 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:20.439084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff8881-bbb7-4c80-9b45-f822d708aba0", "name": "network-vif-deleted", "tag": "7ba22c43-a15b-4673-af97-c4c8c706813c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:20.452539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.453372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.453855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.472414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] Creating event network-vif-deleted:7ba22c43-a15b-4673-af97-c4c8c706813c for instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 on n-h1-860556-1 Oct 06 12:53:20.479319 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-03115ec8-b46a-4ab1-ad72-9b8d310ddd55 req-8bcaa37e-3426-407c-a667-7a1b3a2e7d47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046030 Oct 06 12:53:20.480228 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 603/1236] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:20.491247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae564ddc-415f-41f8-a305-c04f50678b56 tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] Action: 'create', calling method: .version_select at 0x7f7d3f2e81f0>, body: {"security_group": {"name": "tempest-securitygroup-2144901790", "description": "tempest-description-100264594"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:20.518550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:20.529619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89872b9a-066d-4008-bb34-e640983ffa5b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.379727 Oct 06 12:53:20.531170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 634/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:20 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:20.538714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:20.540448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:20.549158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.551057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.551539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.552383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.553430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.553913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.902318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae564ddc-415f-41f8-a305-c04f50678b56 tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.419905 Oct 06 12:53:20.911836 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 604/1238] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:53:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:20.916975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:20.919564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] [instance: 3cff8881-bbb7-4c80-9b45-f822d708aba0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:20.933370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.933903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.934402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.935065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:20.935529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:20.935961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:20.956525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:20.964772 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] HTTP exception thrown: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Request method failure captured: Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 HTTP/1.1 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7LiM027oh0mhnF6lHPvQzomfPLPYUVumpsa3byXW8hsr0fPIfVRVCQqrbNcV5l4vNk1TezgNPHj6dBA8wuPQIublg-Xlgo9e6MwPT8Pz_qUAuuYt0IQ4-C1bLSSTtTvcQ-5lVninWqDBGCeY7WP3rkxjmxvSp2sZJtSHLmLpMvw54 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:53:20.966582 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ca94e746fcb426887d292336801aa0d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ca94e746fcb426887d292336801aa0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ca94e746fcb426887d292336801aa0d"}]}] Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9ca94e746fcb426887d292336801aa0d Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1927851491 Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6bd8e292eca04ea986fc7b82cf196017 Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersOnMultiNodesTest-1927851491-project Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. Oct 06 12:53:20.968180 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3cff8881-bbb7-4c80-9b45-f822d708aba0'} Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:20.969095 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. Oct 06 12:53:20.970678 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:20.972256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] Returning 404 to user: Instance 3cff8881-bbb7-4c80-9b45-f822d708aba0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:20.972256 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a134854c-5888-40d5-b603-e0ce8ad88d61 tempest-ServersOnMultiNodesTest-1927851491 tempest-ServersOnMultiNodesTest-1927851491-project] 10.222.0.26 "GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0" status: 404 len: 111 microversion: 2.1 time: 0.055062 Oct 06 12:53:20.982245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 605/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:20 2022] GET /compute/v2.1/servers/3cff8881-bbb7-4c80-9b45-f822d708aba0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:20.989425 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6832bff-5315-4186-93da-7134e87dc0ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.452096 Oct 06 12:53:20.990785 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 635/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:20 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:20.995501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:21.038076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:21.038573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:21.039018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:21.077363 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] Creating event network-changed:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h1-860556-1 Oct 06 12:53:21.093298 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-288c4d86-dc1d-4e54-94d5-ed7bb1fc01ac req-0c7a50a0-0817-41dd-96a0-3a8ace7afa4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109507 Oct 06 12:53:21.101110 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 606/1241] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:21.115847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:21.117336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:21.132033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:21.137810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:21.139108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:21.140138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:21.142302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:21.144980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:21.362157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07f0ffee-e704-4fd6-8717-6ea196ba8b85 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Action: 'create', calling method: .version_select at 0x7f7d3f2281f0>, body: {"security_group": {"name": "tempest-securitygroup-812367410", "description": "tempest-description-1953101945"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:21.766581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:21.785918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:21.807349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:21.809511 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bac86e5e-2ae5-43b5-a920-2516e60899bc tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.704987 Oct 06 12:53:21.829628 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 607/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:21 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:21.829628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd5a6928-db9c-401c-bf21-5a8f3bd04fb4 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f5b60d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:21.929065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd5a6928-db9c-401c-bf21-5a8f3bd04fb4 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.111841 Oct 06 12:53:21.930806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 608/1243] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:21 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:21.947048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:21.951939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:21.968601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:21.969413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:21.972372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:21.974885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:21.975661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:21.976740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.341240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:22.359545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07f0ffee-e704-4fd6-8717-6ea196ba8b85 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.366706 Oct 06 12:53:22.360426 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 636/1244] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:53:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:22.368049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:22.368387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:22.368779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:22.370273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:22.372179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e51f9c2a-a574-4ba7-b6ce-4137eb06357a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.438857 Oct 06 12:53:22.376327 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 609/1245] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:21 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:22.377478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.378390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.379083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.379932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.380457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.381015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.411647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:22.412393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:22.421676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.422119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.422570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.423825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.424300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.425340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.688167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:22.708398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-de545cf2-a45d-4843-bcaa-44df22116ca3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.346212 Oct 06 12:53:22.710309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 637/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:22 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:22.719781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "79933516-6c72-4e04-9a70-db079e28ac58"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:22.742757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.743720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.744392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.750272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:22.755655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:22.765821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] Creating event network-vif-plugged:79933516-6c72-4e04-9a70-db079e28ac58 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:22.766077 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eca9ee0d-bf42-4be8-8dbf-74ef86127d1b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 0.388225 Oct 06 12:53:22.782716 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 610/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:22 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:22.786351 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4d7bbfc8-9556-4041-b8a0-5d498e0f554e req-69b6e448-f26a-4293-a9f7-671a1a77c341 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072853 Oct 06 12:53:22.787799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 638/1248] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:22.793770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f72868f3-2037-4b59-8288-821176e0bc93 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Action: 'create', calling method: .version_select at 0x7f7d3f34cd30>, body: {"security_group": {"name": "tempest-securitygroup-868877970", "description": "tempest-description-1646350966"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:22.840875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:22.841721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:22.856350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.857184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.857893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:22.858736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:22.861097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:22.861543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:23.005067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f72868f3-2037-4b59-8288-821176e0bc93 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.217148 Oct 06 12:53:23.017336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 611/1249] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:53:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:23.044456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45c0a3e0-7de1-46b1-9692-6b635a3e948c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2f0d30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:23.156238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45c0a3e0-7de1-46b1-9692-6b635a3e948c tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.135817 Oct 06 12:53:23.157619 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 612/1250] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:23 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:23.168025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Calling method '.version_select at 0x7f7d3f2f0160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:23.775555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:23.791649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:23.800672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:23.802249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f6f1f1f6-3344-4c81-aa7e-bff2ceccccd0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 0.966049 Oct 06 12:53:23.803451 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 639/1251] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:22 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:53:23.813289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:23.816464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:23.826891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:23.827622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:23.828227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:23.829107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:23.829712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:23.830408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:24.074206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:24.172528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:24.186201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:24.189625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:24.194519 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e702966-1bde-4f05-b4fe-a8b33b5beda8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.389863 Oct 06 12:53:24.195458 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 640/1252] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:23 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:24.200346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:24.201262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:24.211634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:24.215765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:24.216510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:24.217450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:24.219145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:24.221268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:24.501669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:24.511076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b806fe08-c93d-4999-a52f-c17c16b0c034 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.314226 Oct 06 12:53:24.526308 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 641/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:24 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:24.526565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:24.527378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:24.545126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:24.550517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:24.551334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:24.553223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:24.554100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:24.554931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:25.173974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:25.551112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:25.559369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96475d05-0089-4e9f-b795-53875531b81c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1542 microversion: 2.1 time: 1.040813 Oct 06 12:53:25.559925 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 642/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:24 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1542 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:25.573706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5fa759e5-d27c-49ae-ad32-83ef3bb04b31 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f220af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:25.653902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5fa759e5-d27c-49ae-ad32-83ef3bb04b31 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.086761 Oct 06 12:53:25.655374 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 643/1255] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:25 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:25.665897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:25.666755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:25.687042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:25.687750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:25.688365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:25.689253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:25.689897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:25.690643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:26.939542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:26.965285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:26.972183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:26.973357 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb75926a-d750-421f-adff-b24fdd302641 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1411 microversion: 2.25 time: 1.317038 Oct 06 12:53:26.974357 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 644/1256] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:25 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1411 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:26.993785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "name": "network-vif-plugged", "status": "completed", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:27.009271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:27.014042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:27.015002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:27.042605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] Creating event network-vif-plugged:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h2-860556-1 Oct 06 12:53:27.051592 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cb648059-60cc-4357-8ec3-73b9d2a47a43 req-430bdd44-cf89-4925-9485-40b4a19fecdd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075751 Oct 06 12:53:27.056814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 645/1257] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:27.071739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:27.073085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:27.090886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:27.091603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:27.102294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:27.103111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:27.103598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:27.104037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:27.846487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:27.865643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:27.870069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:27.872723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcf6981b-46b5-4515-a77d-21aaacf18941 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.813601 Oct 06 12:53:27.880538 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 646/1258] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:27 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:27.893376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:27.899947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:27.911021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:27.911564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:27.912012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:27.912994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:27.913641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:27.914125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:28.407368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:28.421378 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e67efe1-bbe6-4a1f-982d-8a0d4dfcae80 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.539388 Oct 06 12:53:28.423231 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 647/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:27 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:28.819405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1132669878", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:28.921389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:53:30.157983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:53:30.160155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:53:30.160973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:53:30.162178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:53:30.162782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:53:30.185761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:30.187655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:30.188310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:30.190376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:30.191140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:30.193655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:30.239636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Getting quotas for project cdaf59749efd48fe91d7c9dc53d849f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:30.245479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:30.246959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Getting quotas for user 94db3edc5f3249458b8c960019c05479 and project cdaf59749efd48fe91d7c9dc53d849f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:30.270431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:53:30.273966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:53:30.367671 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3aa1deb3-22e8-4681-8aed-08053daec9bd tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921842 Oct 06 12:53:30.370550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 648/1260] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:53:30.382419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:30.383320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:30.402087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:30.406233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:30.407111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:30.410071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:30.411797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:30.413689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:31.219618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:31.233759 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a6fe727-a8d4-412e-9cdf-7e6eccb0c16a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1541 microversion: 2.1 time: 0.861364 Oct 06 12:53:31.246500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 649/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:30 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1541 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:31.265625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed62a9ef-135f-4432-b5f4-68b6b266ab7a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f33da60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:31.381180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed62a9ef-135f-4432-b5f4-68b6b266ab7a tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.129139 Oct 06 12:53:31.381686 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 650/1262] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:31 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:31.394125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-unplugged", "status": "completed", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:31.427758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:31.428315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:31.428818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:31.469135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Creating event network-vif-unplugged:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h2-860556-1 Oct 06 12:53:31.483418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:53:31.519626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d17a5cda-79bd-4f5e-b916-a32a2b572905 req-d3ffc496-2a82-4018-adfc-881c130488bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131752 Oct 06 12:53:31.520243 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 651/1263] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:31.540078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:31.540792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:31.553689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:31.554752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:31.555381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:31.561196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:31.562003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:31.562647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:32.130679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.147646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.166498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.178562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5b26378c-705a-4517-a4f9-11eeb1489cda tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1606 microversion: 2.25 time: 0.646177 Oct 06 12:53:32.182355 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 652/1264] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:31 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1606 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:32.200895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:32.206118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:32.225497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7110fc1-f5dd-483d-b534-aea3650960aa does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:53:32.226472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Neutron security group c7110fc1-f5dd-483d-b534-aea3650960aa not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:53:32.227578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.security_groups [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Security Group ID c7110fc1-f5dd-483d-b534-aea3650960aa does not exist {{(pid=129615) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 06 12:53:32.228692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:32.229255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:32.229782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:32.233078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:32.242442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:32.244418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:32.289711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7110fc1-f5dd-483d-b534-aea3650960aa does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:53:32.303391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Neutron security group c7110fc1-f5dd-483d-b534-aea3650960aa not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:53:32.304009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.security_groups [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Security Group ID c7110fc1-f5dd-483d-b534-aea3650960aa does not exist {{(pid=129615) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 06 12:53:32.421380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:32.761186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=53 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:32.970826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.980798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.989882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:32.991411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89c6c11d-65d2-4b70-9526-87d58406a7a8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.804354 Oct 06 12:53:32.994803 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 653/1265] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:32 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:33.003949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:33.007282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:33.022799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.025189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.026494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.030170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.030945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.034707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.345605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32c9e377-ca22-4116-a1e3-a7766137a592 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13773 microversion: 2.1 time: 10.186212 Oct 06 12:53:33.347788 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 613/1266] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Oct 6 12:53:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13773 bytes in 10189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:53:33.353151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "5f6472fc-7c42-4457-9902-abe844e957e9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:33.397979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.398468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.399689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.426860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:33.442867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a6443bc-33f8-4f72-82c9-031ba05a9f58 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.446643 Oct 06 12:53:33.444887 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 654/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:32 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:33.453035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:33.464096 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] Creating event network-vif-plugged:5f6472fc-7c42-4457-9902-abe844e957e9 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:33.465210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:33.478078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f894fe16-f678-4eb3-8323-67246b75120f req-76d6f5ab-65ec-43b7-aebd-d5a4ffb01ab1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128681 Oct 06 12:53:33.480556 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 614/1268] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:33.481611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.482153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.486494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.487845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.488355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.488788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.489062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:33.490202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:33.497906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.498772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.499504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:33.500645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:33.501333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:33.502504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:34.334087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:34.351095 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f778fbc-aa78-45c2-9770-245fa4a5c3f4 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1266 microversion: 2.1 time: 0.904772 Oct 06 12:53:34.352593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 655/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:33 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1266 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:34.357730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:34.360841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:34.371101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:34.378964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:34.379826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:34.381141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:34.381881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:34.383085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:34.628367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8d14ab3-49d4-4631-ba9c-67e9cba84cb8 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-interface" status: 200 len: 284 microversion: 2.25 time: 1.144297 Oct 06 12:53:34.638335 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 615/1270] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 12:53:33 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-interface => generated 284 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:53:34.643690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fdd903f0-86e1-482f-95f0-eb3a36a56624 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f3ac9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:34.724395 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fdd903f0-86e1-482f-95f0-eb3a36a56624 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.084353 Oct 06 12:53:34.730359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 616/1271] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:34 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:34.736182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-057a2911-b32e-48bf-8502-7349f97554fa tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] Calling method '.version_select at 0x7f7d3f4b39d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:35.183348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:35.195516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-af8097d9-77bf-4e64-9764-29d1c5bd0d5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1473 microversion: 2.1 time: 0.841630 Oct 06 12:53:35.200843 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 656/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:34 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1473 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:35.214550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:35.229071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:35.232047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:35.232781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:35.260169 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Creating event network-changed:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h2-860556-1 Oct 06 12:53:35.324664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:53:35.397647 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-70d8fcde-2539-446d-9bb6-6b8a9dd83862 req-586988a3-7f44-4ca3-b87e-1a5aa4bcd7e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194885 Oct 06 12:53:35.398985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 657/1273] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:35.404487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:35.405540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:35.478846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:35.486552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:35.487409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:35.489011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:35.492150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:35.492899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.239414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:36.252799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:36.260226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:36.261803 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-957cc135-eeb5-49f7-9004-b60c88522456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 0.861351 Oct 06 12:53:36.264274 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 658/1274] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:35 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:36.299298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:36.300731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:36.313911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:36.314712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:36.319427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.320674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:36.321387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:36.322028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.372409 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-057a2911-b32e-48bf-8502-7349f97554fa tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.640169 Oct 06 12:53:36.373344 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 617/1275] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Oct 6 12:53:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:36.378568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:36.380077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:36.391286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:36.412284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:36.413294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:36.414120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.415085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:36.415711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:36.421179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.817621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:36.846945 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a93730d-ed13-49be-a1b7-3c08d306fa44 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1272 microversion: 2.1 time: 0.472399 Oct 06 12:53:36.848001 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 618/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:36 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:36.857057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "name": "network-vif-plugged", "status": "completed", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "df88f105-458a-4f4e-91ed-3f7f6cdf34ee"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "eb894875-9f93-44b5-ae4f-1c2b78742953"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-plugged", "status": "completed", "tag": "8e4f3006-44c1-4ddd-ba7f-49775d91bd45"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:36.884308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:36.888339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:36.889056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:36.918742 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Creating event network-vif-plugged:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h1-860556-1 Oct 06 12:53:36.919260 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Creating event network-vif-plugged:df88f105-458a-4f4e-91ed-3f7f6cdf34ee for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:36.919773 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Creating event network-vif-plugged:eb894875-9f93-44b5-ae4f-1c2b78742953 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:36.920277 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] Creating event network-vif-plugged:8e4f3006-44c1-4ddd-ba7f-49775d91bd45 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:36.943785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-643737e6-b7a2-4d08-8045-422778c3a689 req-af6e76f7-2c42-4c3c-bd33-5ee176d94e31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.093933 Oct 06 12:53:36.947396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 619/1277] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:36.959101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7355efd4-f1cb-45f7-b1c0-96efdb53f4c6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2fe670>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:37.044806 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7355efd4-f1cb-45f7-b1c0-96efdb53f4c6 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1426 microversion: 2.1 time: 0.093605 Oct 06 12:53:37.049983 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 620/1278] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:36 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:37.055566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:37.060129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:37.088509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:37.092402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:37.106791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:37.107913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:37.108514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:37.109072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:37.157924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:37.167662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb460e2f-b995-4c56-a695-d292c3584dd1 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1359 microversion: 2.1 time: 0.879390 Oct 06 12:53:37.183645 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 659/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:36 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1359 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:37.202329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98be6dcf-e4db-44cd-84e4-878c3e289a89 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Calling method '.version_select at 0x7f7d3f18f820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:38.150080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:38.164906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eec608b7-71d3-4960-909b-f8c4f50041ef tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1470 microversion: 2.1 time: 1.109307 Oct 06 12:53:38.166285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 621/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:37 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1470 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:38.173474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:38.178137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:38.193265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:38.194090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:38.195418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:38.197538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:38.198430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:38.200812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:39.545896 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98be6dcf-e4db-44cd-84e4-878c3e289a89 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2195f404-8c67-43dd-85ab-c7c25a136e98" status: 202 len: 0 microversion: 2.1 time: 2.357846 Oct 06 12:53:39.546478 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 660/1281] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:53:37 2022] DELETE /compute/v2.1/os-security-groups/2195f404-8c67-43dd-85ab-c7c25a136e98 => generated 0 bytes in 2362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:39.553528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:39.554383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:39.570515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:39.573990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:39.574796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:39.575737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:39.576371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:39.576982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:39.780590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:39.799555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:39.827402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71fe2226-f163-479d-a753-5b6fb13e138b tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1272 microversion: 2.1 time: 0.279819 Oct 06 12:53:39.832145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 661/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:39 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:39.839665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:39.841319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:39.849511 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d9f6814-6496-4c3b-af52-8c989c7b2a21 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1879 microversion: 2.42 time: 1.681934 Oct 06 12:53:39.854034 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 622/1283] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:38 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1879 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:39.872967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:39.874061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:39.889990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0056215d-3f0f-4e45-b0b2-070d76d060d2 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f190ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:39.896968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:39.897482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:39.897961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:39.910923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:39.911516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:39.911962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:40.052505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:40.055594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:40.069477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:40.075654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:40.079517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:40.079963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:40.184600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'cores', 'ram'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:40.200978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'cores', 'ram'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:40.227911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:40.263885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:40.528589 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ffaa2216-eb1c-4fb9-9f06-61f4df9ce33d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981/action" status: 202 len: 0 microversion: 2.1 time: 0.673167 Oct 06 12:53:40.529624 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 623/1284] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:53:39 2022] POST /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:40.536401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:40.540987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:40.577254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:40.578532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:40.579220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:40.580127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:40.580820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:40.582099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:41.126563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:41.147958 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fcd9195f-420d-4e7d-817f-887183b3a8ff tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1542 microversion: 2.1 time: 0.611666 Oct 06 12:53:41.151647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 624/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:40 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1542 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:41.178050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-plugged", "status": "completed", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:41.209218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:41.209706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:41.210392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:41.250481 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] Creating event network-vif-plugged:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:53:41.269678 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c0a28768-daa1-4aa8-8839-382321313b0e req-4b1eb7d4-6ab3-4d8c-a4c1-cd6d3fc82681 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116343 Oct 06 12:53:41.270582 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 625/1286] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:41.277278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e467215-8ba6-46af-9160-1100fcc17365 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] Calling method '.version_select at 0x7f7d3f29d8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:42.275335 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e467215-8ba6-46af-9160-1100fcc17365 tempest-SecurityGroupsTestAdminJSON-1951406132 tempest-SecurityGroupsTestAdminJSON-1951406132-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f0d6c21f-8406-45b5-bffa-3ff7fbf31bb4" status: 202 len: 0 microversion: 2.1 time: 1.003348 Oct 06 12:53:42.279361 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 626/1287] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:53:41 2022] DELETE /compute/v2.1/os-security-groups/f0d6c21f-8406-45b5-bffa-3ff7fbf31bb4 => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:42.284494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:42.306112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:42.310242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:42.310705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:42.332570 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] Creating event network-changed:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h2-860556-1 Oct 06 12:53:42.343544 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-62a0338f-f6ba-4e1d-ae62-1477fa3b3bde req-d8996c47-9e55-4792-a815-356346e504eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062871 Oct 06 12:53:42.350107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 627/1288] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:42.358866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:42.360552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:42.376468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:42.378857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:42.380288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:42.383602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:42.386111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:42.386849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:43.044153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:43.076515 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a2ba60e-8f4f-48a0-a3c4-92adcd5f7c90 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1469 microversion: 2.1 time: 0.723989 Oct 06 12:53:43.087489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 628/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:42 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:43.097629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:43.104008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:43.110458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:43.110721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:43.110991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:43.116694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:43.116988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:43.117729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:43.569999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:43.586681 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7dba3631-37c5-4a34-ac3f-e5b534538e20 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1314 microversion: 2.1 time: 0.498827 Oct 06 12:53:43.588876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 629/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:43 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:43.608704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:43.614936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:43.652732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:43.654026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:43.655358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:43.657046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:43.658250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:43.659654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:44.151988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:44.207647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:44.216909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:44.227358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6d73975-3e40-4a86-b9d0-1474ca94b5d6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2835 microversion: 2.42 time: 0.634535 Oct 06 12:53:44.234112 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 630/1291] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:53:43 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2835 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:44.275312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:44.276508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:44.293452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:44.293970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:44.294401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:44.295745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:44.296198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:44.296619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:44.538564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48690f60-a47c-4ff1-9ea0-d5bc517eb4dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.277716 Oct 06 12:53:44.543155 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 631/1292] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:53:44 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-interface => generated 285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:44.552508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c370182d-0b9a-493d-b77f-415de0157ecc tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] Calling method '.version_select at 0x7f7d3f599280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:44.928270 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c370182d-0b9a-493d-b77f-415de0157ecc tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/cabaaa8c-0416-40f0-89e4-ff3579e2b886" status: 202 len: 0 microversion: 2.1 time: 0.382822 Oct 06 12:53:44.931068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 632/1293] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:53:44 2022] DELETE /compute/v2.1/os-security-groups/cabaaa8c-0416-40f0-89e4-ff3579e2b886 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:44.956264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-plugged", "status": "completed", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:45.005033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:45.006573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:45.007757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:45.042702 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Creating event network-vif-plugged:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h2-860556-1 Oct 06 12:53:45.079331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:53:45.142122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a5131004-3aa5-420b-9352-404912cce1c0 req-0f96e00b-95f1-439e-bfc9-01369736dd0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206577 Oct 06 12:53:45.143710 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 633/1294] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:45.193101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:45.200115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:45.239733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:45.240266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:45.240710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:45.241447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:45.241935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:45.242366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:45.779932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:45.798256 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d83941d9-dc6e-48c6-ab67-25bcb4efdb35 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1469 microversion: 2.1 time: 0.647710 Oct 06 12:53:45.800284 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 634/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:45 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1469 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:45.817594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:45.818474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:45.826718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:45.827532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:45.828889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:45.829832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:45.830618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:45.831796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:46.001979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a967fbfe-ede7-42bd-8740-6a6e098312ed tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.199639 Oct 06 12:53:46.005938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 635/1296] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 12:53:45 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d/os-interface => generated 1829 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:53:46.148580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93100869-47a0-4f45-bd36-10981ab5d6a6", "tag": "f5fabab0-03ec-44cd-852b-09a8e5f4c180"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:46.167776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:46.168430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:46.168962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:46.182938 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] Creating event network-changed:f5fabab0-03ec-44cd-852b-09a8e5f4c180 for instance 93100869-47a0-4f45-bd36-10981ab5d6a6 on n-h1-860556-1 Oct 06 12:53:46.202941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b254582a-faa7-4489-9ae3-1ea7652cc8db req-efd9b1a2-a5a9-4e6d-b93f-d58a77b23780 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189785 Oct 06 12:53:46.209249 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 636/1297] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:46.217656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:46.218735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:46.232622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:46.233440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:46.234005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:46.235615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:46.236538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:46.237516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:46.275690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:47.905135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:47.922477 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-886bddb3-54b0-4e9b-b404-26becb33d611 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1314 microversion: 2.1 time: 1.710171 Oct 06 12:53:47.923710 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 637/1298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:46 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1314 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:47.929090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-543c42e3-8820-4916-9c1a-3ef50d64c3df tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] Calling method '.version_select at 0x7f7d3f444280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:49.569620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:49.606107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-543c42e3-8820-4916-9c1a-3ef50d64c3df tempest-SecurityGroupsTestAdminJSON-947075155 tempest-SecurityGroupsTestAdminJSON-947075155-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2a38e63e-28a2-4a13-9edb-3a52c18e360f" status: 202 len: 0 microversion: 2.1 time: 1.679812 Oct 06 12:53:49.616253 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 638/1299] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:53:47 2022] DELETE /compute/v2.1/os-security-groups/2a38e63e-28a2-4a13-9edb-3a52c18e360f => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:53:49.621568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:49.622465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:49.650303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:49.651118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:49.651813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:49.652729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:49.653388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:49.654042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:49.822521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=9 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:50.130913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:50.511151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:50.520553 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f311ace-1e5d-4417-9130-81a9d88d5c7c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1535 microversion: 2.1 time: 0.903093 Oct 06 12:53:50.526181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 639/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:49 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1535 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:50.728610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0056215d-3f0f-4e45-b0b2-070d76d060d2 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1435 microversion: 2.1 time: 10.894750 Oct 06 12:53:50.739546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 662/1301] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:39 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1435 bytes in 10898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:50.745726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:50.746384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:50.758017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:50.758400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:50.758852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:50.759573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:50.760032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:50.760459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:50.793373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:50.808799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:50.809282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:50.809720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:50.834753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] Creating event network-changed:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h1-860556-1 Oct 06 12:53:50.855835 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d686f22b-075a-4ac0-ba85-c8858b7d18b6 req-f13ac008-4454-4d43-90a5-321d4f1a9c5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313373 Oct 06 12:53:50.856476 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 640/1302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:50.869683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-unplugged", "status": "completed", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:50.903237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:50.903967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:50.905023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:50.957118 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Creating event network-vif-unplugged:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:53:50.967921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:53:50.993840 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dacbaeff-c091-4a08-8d7c-566e3647934d req-e5dace6b-56f8-4b4c-b28f-019d408bc877 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135844 Oct 06 12:53:50.995429 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 641/1303] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:51.001369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97008d3f-b7f9-4abd-947c-3bec9da78b36 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f3b6dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:51.078027 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97008d3f-b7f9-4abd-947c-3bec9da78b36 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 200 len: 1435 microversion: 2.1 time: 0.081019 Oct 06 12:53:51.090760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 642/1304] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:53:50 2022] GET /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 1435 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:51.097360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:51.098856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:51.108218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:51.109157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:51.110089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:51.111197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:51.111661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:51.112313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:52.001722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:52.007491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:52.029331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-462abb44-b092-43f3-b671-2908d7ee46cc tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1479 microversion: 2.1 time: 0.933209 Oct 06 12:53:52.030880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 643/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:51 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1479 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:52.031106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-778ae9ae-2ec0-4cd2-a0c1-09aea5b11fe8 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1314 microversion: 2.1 time: 1.296912 Oct 06 12:53:52.031947 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 663/1306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:50 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1314 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:52.045124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:52.046268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:52.054263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:52.054877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:52.055413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:52.056375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:52.056959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:52.057491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:52.412349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93100869-47a0-4f45-bd36-10981ab5d6a6", "name": "network-vif-plugged", "status": "completed", "tag": "f5fabab0-03ec-44cd-852b-09a8e5f4c180"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:52.425304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:52.426137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:52.426862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:52.444726 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] Creating event network-vif-plugged:f5fabab0-03ec-44cd-852b-09a8e5f4c180 for instance 93100869-47a0-4f45-bd36-10981ab5d6a6 on n-h1-860556-1 Oct 06 12:53:52.451174 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f8b0bc9b-4209-4358-b201-f7138988aec5 req-56efe66a-7187-42c9-94d3-9417175f7995 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416430 Oct 06 12:53:52.457702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 644/1307] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:52.532660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:52.566376 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b57240c-a575-45e1-9033-1f0144b90d25 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1535 microversion: 2.1 time: 0.531140 Oct 06 12:53:52.567012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 664/1308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:52 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1535 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:53.023622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "tag": "80777c32-8243-4ac0-bbc6-1c12abb3139a"}, {"name": "network-changed", "server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:53.035759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.036509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.037122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.054114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:53.055356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:53.067783 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Creating event network-changed:80777c32-8243-4ac0-bbc6-1c12abb3139a for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:53:53.071491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.072186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.073211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.074199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.074819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.076063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.076492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Creating event network-changed:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:53:53.087992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:53:53.107582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0bc33e2e-1af1-4780-8f04-6f754e84d225 req-45181cb0-ac02-4107-a858-e6221d1a9d28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088470 Oct 06 12:53:53.109000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 645/1309] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:53.119510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:53.121136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:53.129592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.130323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.131098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.131825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.132289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.132723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.463766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:53.470273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:53.474946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2af654ea-a0d5-4b9f-ad63-7e9500171ecc tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1314 microversion: 2.1 time: 0.363585 Oct 06 12:53:53.475867 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 646/1310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:53 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:53.481096 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10aeb377-2843-4748-8b95-95fdd9f9d7db tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1466 microversion: 2.1 time: 0.432543 Oct 06 12:53:53.482204 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 665/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:53 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1466 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:53:53.506497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cdede3ee-5d3b-4bb2-878b-17e56338a7da tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f2ae310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:53.592751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:53.594200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:53.607957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.608985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.609905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.610892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:53.611486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:53.612145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:53.857436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:53.872350 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1368a1a0-46d6-4a0a-bceb-6c88b72c13db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1535 microversion: 2.1 time: 0.284827 Oct 06 12:53:53.879171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 666/1312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:53 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1535 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:54.512392 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cdede3ee-5d3b-4bb2-878b-17e56338a7da tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "DELETE /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e" status: 204 len: 0 microversion: 2.1 time: 1.009598 Oct 06 12:53:54.518845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 647/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:53 2022] DELETE /compute/v2.1/images/a779c5b2-1729-408d-b958-348bb31d6b0e => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:54.525273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:54.526184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:54.533240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:54.535161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:54.535787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:54.536555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:54.537045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:54.537500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:54.590707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1087304837", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:54.648800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:53:54.888931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:54.902117 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-155833b8-86ae-4c8e-a184-86e7863e80e2 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1314 microversion: 2.1 time: 0.381316 Oct 06 12:53:54.913822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 648/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:54 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:54.921874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c7cba27-32a3-4d34-99a1-c42b9034e213 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '.version_select at 0x7f7d3f29d3a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:54.991267 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5c7cba27-32a3-4d34-99a1-c42b9034e213 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] HTTP exception thrown: Image not found. Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c7cba27-32a3-4d34-99a1-c42b9034e213 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Request method failure captured: Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 HTTP/1.1 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs-A0UbRCXPxZnQcLpqW9imz6uYSiBGsHifIVDLCUj7sewlFu9YFqTYMm6tBFGcsqY6CHgbvsXpXSmX5RyUsD2tcR07hGo6GiSYzCpVpVBc1qdnHKQBRHhNdZTqlQeoz27W7Xn3YGyhizI6l2LURyoJgmSVbqwMZ3zlgDGGCLHxfZKU Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:53:54.993687 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f2ce23729f346c2a3a76dca9d70a3e8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}] Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cc7a26b1618b4642b9873eb308f6db33 Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '50953999-62cf-445c-9a0c-53ec8c770862'} Oct 06 12:53:54.995222 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50953999-62cf-445c-9a0c-53ec8c770862 to delete Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:54.996084 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50953999-62cf-445c-9a0c-53ec8c770862 could not be found. Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:54.997359 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 12:53:54.998737 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:55.003160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c7cba27-32a3-4d34-99a1-c42b9034e213 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:55.004251 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c7cba27-32a3-4d34-99a1-c42b9034e213 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "DELETE /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862" status: 404 len: 62 microversion: 2.1 time: 0.095082 Oct 06 12:53:55.005286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 649/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:54 2022] DELETE /compute/v2.1/images/50953999-62cf-445c-9a0c-53ec8c770862 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:53:55.011607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:55.012225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:55.020107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.020947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.021614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.022863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.023405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.023960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.241364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:53:55.242787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:53:55.244183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:53:55.245240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:53:55.246408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:53:55.261133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.261964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.263045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.264050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.264935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.265069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:55.265711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.276907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49781636-329a-4f5c-b7fd-99fe5266611d tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1535 microversion: 2.1 time: 0.269536 Oct 06 12:53:55.277567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 650/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:55 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1535 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:55.282710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:55.283560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:55.293018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.293880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.294481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.295397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.296095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.296749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.310226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:55.319685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for user 8276c6052c6a4d31b9f913affd9148f2 and project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:55.333303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:55.338794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:53:55.341771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:53:55.410623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-897421ae-00a2-4246-bb81-3d71e8600ef6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002886 Oct 06 12:53:55.411259 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 667/1317] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:53:55.486348 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a5653d33-2d69-4202-a02e-ed27c412de03 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 204 len: 0 microversion: 2.1 time: 0.206909 Oct 06 12:53:55.487280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 651/1318] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:55 2022] DELETE /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:55.500107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:55.500762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:55.512210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1626513779", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:55.521864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.523029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.524573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.526044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:55.528289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:55.529911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:55.631473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:53:55.967021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:55.980203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9ae742c-3265-45ef-8bf6-4b7d29372040 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1472 microversion: 2.1 time: 0.483517 Oct 06 12:53:55.982889 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 668/1319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:55 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:55.994018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:55.994959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:56.010864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.011815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.012362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.013103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.022602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.023388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.353681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:53:56.354653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:53:56.355301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:53:56.355755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:53:56.356166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:53:56.373431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.373952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.374385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.375118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.375561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.376100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.392598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:56.400954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:56.406824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for user 8276c6052c6a4d31b9f913affd9148f2 and project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:56.410716 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32cf1821-8b37-40be-83ec-7d41203812a3 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1464 microversion: 2.1 time: 0.426500 Oct 06 12:53:56.422121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:53:56.422585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:53:56.423263 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 669/1320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:55 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1464 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:56.442030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-unplugged", "status": "completed", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:56.456276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.456809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.457765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.484035 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] Creating event network-vif-unplugged:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:53:56.484555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0469dc45-e92a-42b7-bd42-a66bcabfcd52 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976818 Oct 06 12:53:56.491820 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 652/1321] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:53:56.498515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-605f7829-c3a2-431e-a548-d028c60c0c79 req-738f32a3-ebd5-4552-a9d8-345a2842a40c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073876 Oct 06 12:53:56.498740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.499254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:56.505693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.506214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.506829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.507543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.508000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.508429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.513950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 670/1322] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:56.690637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Calling method '.version_select at 0x7f7d3f2f4280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.706581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.707073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.707509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.708719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:56.716798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3c178c1-8198-44af-9238-3392da785a39 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1528 microversion: 2.1 time: 0.230122 Oct 06 12:53:56.717662 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 653/1323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:56.723633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc63d1c2-7241-40c1-a89a-a498bfa34d5a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.724818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc63d1c2-7241-40c1-a89a-a498bfa34d5a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:56.733125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.735054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:53:56.735256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.735901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.765232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5558196-2935-490f-9fba-dcabfa733d5c tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/cdaf59749efd48fe91d7c9dc53d849f4?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607" status: 200 len: 695 microversion: 2.1 time: 0.249513 Oct 06 12:53:56.766800 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 671/1324] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/os-simple-tenant-usage/cdaf59749efd48fe91d7c9dc53d849f4?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607 => generated 695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:56.778000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.778778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:56.792848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.794150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc63d1c2-7241-40c1-a89a-a498bfa34d5a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:56.794510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.795036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.795963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.796742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.797452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.802736 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc63d1c2-7241-40c1-a89a-a498bfa34d5a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1214 microversion: 2.1 time: 0.083619 Oct 06 12:53:56.803647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 654/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:56.819382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '.version_select at 0x7f7d3f2e84c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.840659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.841799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.842670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.870732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.871569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.872186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.891554 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31753263-8609-4cf6-a725-dd67c3fce2f1 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/cdaf59749efd48fe91d7c9dc53d849f4?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607" status: 200 len: 695 microversion: 2.1 time: 0.084997 Oct 06 12:53:56.892464 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 655/1326] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/os-simple-tenant-usage/cdaf59749efd48fe91d7c9dc53d849f4?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:56.908193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Calling method '.version_select at 0x7f7d3f29d8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:56.923823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.925152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.925693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:56.945518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:56.946039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:56.946464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.054266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1929bfa1-3da4-469a-813f-20d8e7bf6924 tempest-TenantUsagesTestJSON-1771670918 tempest-TenantUsagesTestJSON-1771670918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607&detailed=1" status: 200 len: 16908 microversion: 2.1 time: 0.149659 Oct 06 12:53:57.055495 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 656/1327] 10.222.0.26 () {58 vars in 1335 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-05T12%3A53%3A56.433607&end=2022-10-07T12%3A53%3A56.433607&detailed=1 => generated 16908 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:53:57.062273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:57.063052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:57.072495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.075751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.079128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.083004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:57.085720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.088085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.090206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.100171 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d251a31-e089-4443-a1a9-19a2ad048b08 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1528 microversion: 2.1 time: 0.328872 Oct 06 12:53:57.104722 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 672/1328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:56 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:57.117323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:57.117882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:57.136568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.138823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.140043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.141076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.144094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.145533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.186305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:53:57.325254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:57.335344 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6148cce4-4390-41ee-bc55-e725983b3047 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1472 microversion: 2.1 time: 0.277690 Oct 06 12:53:57.336843 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 657/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:57 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:57.338640 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e2e5ad13-bcc0-495d-acdf-e3f95b44a67c tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 204 len: 0 microversion: 2.1 time: 0.231483 Oct 06 12:53:57.339268 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 673/1330] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:57 2022] DELETE /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:53:57.342329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-819b4cf8-5f82-4e6a-a289-6bcd7558f87b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:57.349928 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-819b4cf8-5f82-4e6a-a289-6bcd7558f87b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] HTTP exception thrown: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. Oct 06 12:53:57.350354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:57.351341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:57.358069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.358579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.359026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.359754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.360218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-819b4cf8-5f82-4e6a-a289-6bcd7558f87b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Request method failure captured: Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/flavors/a56f90d5-164c-4711-9297-c6c49ea47bcb HTTP/1.1 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7bBWq0gj5asNLZDCo3pNwrTDVXc7-f8hYKf6-yW0arHQYJttwkwEokRuf7PCds5liAbsX2zC7zxhfQZrmW4NzGYrygqWGPKFgjcjcp_IkmE5_pQPbZy8OO8quIrluX9AM_NhyP3p4xvuB5BtLFlVNOYawby2fSQsD0lo-o4x1ZBnU Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 82ed1fff55df4107a47cf37114824631 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-MigrationsAdminTest-2092995360 Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:53:57.360346 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82ed1fff55df4107a47cf37114824631", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82ed1fff55df4107a47cf37114824631"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82ed1fff55df4107a47cf37114824631"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82ed1fff55df4107a47cf37114824631"}]}] Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-MigrationsAdminTest-2092995360 Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 82ed1fff55df4107a47cf37114824631 Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-MigrationsAdminTest-2092995360 Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-MigrationsAdminTest-2092995360-project-admin Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4f3d26e6b5cd4af297705e8dd58740c6 Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-MigrationsAdminTest-2092995360-project-admin Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: exception: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. Oct 06 12:53:57.362440 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a56f90d5-164c-4711-9297-c6c49ea47bcb'} Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 566, in destroy Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 552, in _flavor_destroy Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:57.363341 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. Oct 06 12:53:57.364686 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:53:57.366069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.366326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-819b4cf8-5f82-4e6a-a289-6bcd7558f87b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Returning 404 to user: Flavor a56f90d5-164c-4711-9297-c6c49ea47bcb could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:53:57.366326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-819b4cf8-5f82-4e6a-a289-6bcd7558f87b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/a56f90d5-164c-4711-9297-c6c49ea47bcb" status: 404 len: 109 microversion: 2.1 time: 0.023863 Oct 06 12:53:57.370234 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 658/1331] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:53:57 2022] DELETE /compute/v2.1/flavors/a56f90d5-164c-4711-9297-c6c49ea47bcb => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:53:57.542906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-854742277", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:57.645618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:57.664979 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-06c8094a-aadc-4e32-ae13-2764fb693a5a tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1470 microversion: 2.1 time: 0.320638 Oct 06 12:53:57.666318 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 674/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:57 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:57.670631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:53:57.837589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:57.838658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:57.846020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.849588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.852348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.853779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:57.854404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:57.855080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:57.951683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:57.964711 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d30658ed-7413-4ecc-921d-bcde5d624aa8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1266 microversion: 2.1 time: 0.130961 Oct 06 12:53:57.965865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 675/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:57 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:57.999433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:53:58.001454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:53:58.002576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:53:58.003102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:53:58.003617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:53:58.016152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.017123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.018003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:58.018999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.019694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.020673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:58.042484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:53:58.049850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Getting quotas for user be2535c026dd41458fd9971e14a19010 and project b95526d417ea42d2873f54a772da9695. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:53:58.065898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:53:58.069233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:53:58.156911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1da8498-cedf-47e1-b443-220e49ba1696 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622875 Oct 06 12:53:58.157554 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 659/1334] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:53:58.188759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f10add9-4d24-4960-8f80-285d90b9a91a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:58.192366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f10add9-4d24-4960-8f80-285d90b9a91a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:58.336067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f10add9-4d24-4960-8f80-285d90b9a91a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:58.353067 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f10add9-4d24-4960-8f80-285d90b9a91a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1212 microversion: 2.1 time: 0.177003 Oct 06 12:53:58.353693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 676/1335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:58 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:58.377143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:58.378753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:58.393262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.394951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.396338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:58.397583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.398144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.398906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:58.689875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:58.690804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:58.705912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.708135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.708951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:58.710376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:58.713208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:58.713868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.269251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:59.280219 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-181f5736-5343-4f0a-b167-996ba5e815f8 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1472 microversion: 2.1 time: 0.910590 Oct 06 12:53:59.282064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 660/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:58 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1472 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:59.291858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:59.293214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:59.301268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.302031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.302590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.303491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.304041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.304563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.334431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:59.349353 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01ffa989-47d4-489d-91f8-bbeada68ca88 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1470 microversion: 2.1 time: 0.660153 Oct 06 12:53:59.370644 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 677/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:58 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1470 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:59.394740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-plugged", "status": "completed", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:59.435319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.439518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.441060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.465335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] Creating event network-vif-plugged:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:53:59.477462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6830f693-b44a-4804-96ff-4d24d26d9ab4 req-7f4e476e-fb67-4c65-bfae-17ede2d41323 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104110 Oct 06 12:53:59.479550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 678/1338] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:53:59.493478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:53:59.494747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:53:59.498801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:59.502761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.503487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.504088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.505258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.506385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.507429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.515259 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e56682e6-61ad-404b-85e8-4f0817e6c5ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1272 microversion: 2.1 time: 0.232320 Oct 06 12:53:59.519738 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 661/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:59 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:59.687477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:53:59.707744 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-58091890-1502-4da4-8bba-7e05d49357a9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1264 microversion: 2.1 time: 0.225844 Oct 06 12:53:59.709797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 679/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:53:59 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:53:59.785014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71191151-eb33-4424-85ff-aa2f74a141de", "name": "network-vif-deleted", "tag": "4f30abea-7026-4156-a619-e8c5ab6d0ffc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:53:59.813201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:53:59.814634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:53:59.815995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:53:59.843124 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] Creating event network-vif-deleted:4f30abea-7026-4156-a619-e8c5ab6d0ffc for instance 71191151-eb33-4424-85ff-aa2f74a141de on n-h2-860556-1 Oct 06 12:53:59.849948 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3dfe87b1-5469-42ac-8000-f2b270747ca4 req-90e1b1cd-b034-4fd2-b996-6f011bffb734 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068507 Oct 06 12:53:59.851835 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 662/1341] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:00.310996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:00.311504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:00.329406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.329975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.330455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.331424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.331898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.332637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.380874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:00.381594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:00.419188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.420160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.422177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.425115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.426525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.427315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.427956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.428646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.433645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.434698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lazy-loading 'fault' on Instance uuid 71191151-eb33-4424-85ff-aa2f74a141de {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:54:00.468570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:00.678842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7a26b1618b4642b9873eb308f6db33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2ce23729f346c2a3a76dca9d70a3e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:00.691591 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2882d74-c601-4323-8404-b53b3f6aa228 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 200 len: 1307 microversion: 2.1 time: 0.388161 Oct 06 12:54:00.692715 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 680/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:00 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:00.711859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db3edc5f3249458b8c960019c05479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf59749efd48fe91d7c9dc53d849f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:00.722016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:00.722771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:00.727517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3507beea-2a9c-42f6-991a-5473d78de5f0 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 200 len: 1428 microversion: 2.1 time: 0.352514 Oct 06 12:54:00.729610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 663/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:00 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 1428 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:00.749279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.749821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.750273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.751010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.751480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.751915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.755387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:00.756712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:00.758960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:00.767278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.768610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.769530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.770686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:00.771303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:00.771744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:00.947136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:00.948757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:00.958213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf749345-34fb-44b4-acf3-2707fc616b70 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1272 microversion: 2.1 time: 0.264091 Oct 06 12:54:00.961464 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 681/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:00 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:00.973683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18881667-2b81-430e-a2af-ba11fe41780f tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1270 microversion: 2.1 time: 0.241843 Oct 06 12:54:00.975503 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 664/1345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:00 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:01.718977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:01.719883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] [instance: 71191151-eb33-4424-85ff-aa2f74a141de] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:01.729377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:01.730026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:01.730588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:01.731490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:01.732519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:01.735849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:01.754360 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] HTTP exception thrown: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Request method failure captured: Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de HTTP/1.1 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs-A0UbRCXPxZnQcLpqW9imz6uYSiBGsHifIVDLCUj7sewlFu9YFqTYMm6tBFGcsqY6CHgbvsXpXSmX5RyUsD2tcR07hGo6GiSYzCpVpVBc1qdnHKQBRHhNdZTqlQeoz27W7Xn3YGyhizI6l2LURyoJgmSVbqwMZ3zlgDGGCLHxfZKU Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:54:01.756328 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f2ce23729f346c2a3a76dca9d70a3e8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f2ce23729f346c2a3a76dca9d70a3e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f2ce23729f346c2a3a76dca9d70a3e8"}]}] Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 8f2ce23729f346c2a3a76dca9d70a3e8 Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-551477602 Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: cc7a26b1618b4642b9873eb308f6db33 Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesOneServerTestJSON-551477602-project Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. Oct 06 12:54:01.759061 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '71191151-eb33-4424-85ff-aa2f74a141de'} Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:01.759886 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. Oct 06 12:54:01.761230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.763575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] Returning 404 to user: Instance 71191151-eb33-4424-85ff-aa2f74a141de could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:01.763575 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eba09870-9c96-48e4-9207-795eb07ace81 tempest-ImagesOneServerTestJSON-551477602 tempest-ImagesOneServerTestJSON-551477602-project] 10.222.0.26 "GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de" status: 404 len: 111 microversion: 2.1 time: 0.043535 Oct 06 12:54:01.764244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:01.764244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] [instance: 93100869-47a0-4f45-bd36-10981ab5d6a6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:01.764684 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 682/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:01 2022] GET /compute/v2.1/servers/71191151-eb33-4424-85ff-aa2f74a141de => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:54:01.767509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:01.768636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:01.769083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:01.769836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:01.770507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:01.770948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:01.793840 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] HTTP exception thrown: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Request method failure captured: Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 HTTP/1.1 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_EPdQR1uZYSJduajTXyyUGcax1LtsSbrn73HwFwH3FB1zhh0KxztaaxBdslEvgEHrBqZc-Yo4CI_YExY9L9vs-MSGsPNXN_u_D4OVR1z-7X2YpO0wXYTfxYuxD3ZZsSmhBmvKjvRyu_z2_Bw8qCbvIIlQI0FRjgim6C3QWcuVb2-Q Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: cdaf59749efd48fe91d7c9dc53d849f4 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TenantUsagesTestJSON-1864922665 Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:54:01.796165 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cdaf59749efd48fe91d7c9dc53d849f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cdaf59749efd48fe91d7c9dc53d849f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cdaf59749efd48fe91d7c9dc53d849f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cdaf59749efd48fe91d7c9dc53d849f4"}]}] Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TenantUsagesTestJSON-1864922665 Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: cdaf59749efd48fe91d7c9dc53d849f4 Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1864922665 Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TenantUsagesTestJSON-1864922665-project Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 94db3edc5f3249458b8c960019c05479 Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TenantUsagesTestJSON-1864922665-project Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. Oct 06 12:54:01.797838 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '93100869-47a0-4f45-bd36-10981ab5d6a6'} Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:01.798820 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. Oct 06 12:54:01.800891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:01.802257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] Returning 404 to user: Instance 93100869-47a0-4f45-bd36-10981ab5d6a6 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:01.803369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1be4bc03-5b24-4a44-8a65-533927073e00 tempest-TenantUsagesTestJSON-1864922665 tempest-TenantUsagesTestJSON-1864922665-project] 10.222.0.26 "GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6" status: 404 len: 111 microversion: 2.1 time: 0.048833 Oct 06 12:54:01.807831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 665/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:01 2022] GET /compute/v2.1/servers/93100869-47a0-4f45-bd36-10981ab5d6a6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:54:01.911268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93100869-47a0-4f45-bd36-10981ab5d6a6", "name": "network-vif-deleted", "tag": "f5fabab0-03ec-44cd-852b-09a8e5f4c180"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:01.954978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:01.956969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:01.959365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:01.981231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:01.982321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:02.017176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:02.017680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:02.018696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:02.021880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] Creating event network-vif-deleted:f5fabab0-03ec-44cd-852b-09a8e5f4c180 for instance 93100869-47a0-4f45-bd36-10981ab5d6a6 on n-h1-860556-1 Oct 06 12:54:02.023177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:02.023972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:02.024713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:02.040667 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-41503d90-1b3b-4b6b-ab8d-c054d03b5c52 req-51ebf104-78c4-4450-b12a-735763c8a507 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137573 Oct 06 12:54:02.043861 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 683/1348] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:02.059946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:02.063541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:02.085957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:02.088077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:02.093122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:02.095657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:02.097583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:02.098453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:02.323662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:02.343899 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7142e729-49dd-480b-8c80-bb06ed9cec6e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1270 microversion: 2.1 time: 0.296679 Oct 06 12:54:02.345494 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 684/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:02 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:02.590186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:02.600731 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4d36a53-f4db-4abe-bbd3-ede59b56a328 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.623636 Oct 06 12:54:02.601855 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 666/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:01 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:03.369282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:03.370108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:03.387601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:03.389697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:03.390946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:03.392853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:03.394338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:03.397912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:03.632990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:03.635082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:03.645655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:03.646805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:03.647739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:03.648967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:03.649859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:03.650556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:03.701248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:03.710998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1494dce4-e15a-40c9-8c96-8327b4e06417 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1270 microversion: 2.1 time: 0.345607 Oct 06 12:54:03.717309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 685/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:03 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:04.198011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:04.216207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1d5edd1-d968-4ed9-8793-8fbc766f3d84 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.589549 Oct 06 12:54:04.219011 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 667/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:03 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:04.744572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:04.745200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:04.786680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:04.787546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:04.788384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:04.789360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:04.790082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:04.798635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:05.240514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:05.241198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:05.251305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:05.256754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:05.257363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:05.258310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:05.258863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:05.259425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:05.453237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:05.469693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdb00b0c-38f1-4245-82bd-07d312fe01dc tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.728899 Oct 06 12:54:05.492143 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 686/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:04 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:05.602782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:05.627657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2cf92cbc-a8a5-42e9-b82f-9cbc701d62fc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.390053 Oct 06 12:54:05.628616 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 668/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:05 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:06.071553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e08d3eb-15f4-4604-af5e-59cbe58b7bd4 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.081519 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e08d3eb-15f4-4604-af5e-59cbe58b7bd4 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.587319 Oct 06 12:54:06.082405 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 687/1355] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.102098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac8fa083-1cda-4100-9046-b0542fbab269 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.137001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac8fa083-1cda-4100-9046-b0542fbab269 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.040888 Oct 06 12:54:06.137985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 669/1356] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:06.158920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-467d1bee-c8b4-4499-94f8-ab4813e34249 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.180849 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-467d1bee-c8b4-4499-94f8-ab4813e34249 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026183 Oct 06 12:54:06.181835 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 688/1357] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.198503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9a6ba7c2-2676-43b1-a04d-c07ec32e692a tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.216109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9a6ba7c2-2676-43b1-a04d-c07ec32e692a tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023353 Oct 06 12:54:06.218844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 670/1358] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.235409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1258e2da-8443-4ad1-a249-2ae57e54bd82 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.305423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1258e2da-8443-4ad1-a249-2ae57e54bd82 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.074209 Oct 06 12:54:06.306611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 689/1359] 10.222.0.26 () {58 vars in 1165 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:06.328774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf05a4d7-9086-4b07-b568-5a8309c64ca4 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.342124 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf05a4d7-9086-4b07-b568-5a8309c64ca4 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017788 Oct 06 12:54:06.343783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 671/1360] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.365036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35fe4b3f-1420-4268-9efa-3da1bc7b7752 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.413121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35fe4b3f-1420-4268-9efa-3da1bc7b7752 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.052025 Oct 06 12:54:06.418754 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 690/1361] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:06.451159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dae1d9d-9953-4e69-a146-96239c736b80 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.475367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dae1d9d-9953-4e69-a146-96239c736b80 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037332 Oct 06 12:54:06.482920 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 672/1362] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.493419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d06029fd-5689-48a3-ba17-50b7800726f0 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.502841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.510179 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d06029fd-5689-48a3-ba17-50b7800726f0 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021742 Oct 06 12:54:06.511422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:06.515031 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 691/1363] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.533025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19afbc6c-b9f2-4761-88f9-c9a348def59f tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.534107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:06.540164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:06.540918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:06.541879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:06.543197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:06.543810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:06.624162 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19afbc6c-b9f2-4761-88f9-c9a348def59f tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.096464 Oct 06 12:54:06.625414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 692/1364] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:06.641310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae887a92-7271-4407-af71-b336162ac8d0", "tag": "4e91c917-a2b8-4f7d-80cd-f595deb2831e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:06.671714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:06.672190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:06.672645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:06.700183 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] Creating event network-changed:4e91c917-a2b8-4f7d-80cd-f595deb2831e for instance ae887a92-7271-4407-af71-b336162ac8d0 on n-h2-860556-1 Oct 06 12:54:06.706302 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-060ef612-959e-4390-a9a4-462678e818d0 req-642bf2d8-5131-4887-bef3-6f9d5d7ba862 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079284 Oct 06 12:54:06.707416 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 693/1365] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.726909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36a286f5-2f1d-4d9b-a13b-0943618339e8 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.735262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36a286f5-2f1d-4d9b-a13b-0943618339e8 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026368 Oct 06 12:54:06.736159 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 694/1366] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:06.751104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:06.762450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:06.769680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:06.792752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:06.794146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:06.795234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:06.796158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:06.796818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:06.797588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:07.382527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:07.421980 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bcdcf916-c841-494f-a10d-69876d3ba712 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.923213 Oct 06 12:54:07.431853 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 673/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:07.443000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc2a30e2-c9fa-4f7b-b92b-abe1823b7af0 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.536293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc2a30e2-c9fa-4f7b-b92b-abe1823b7af0 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.100018 Oct 06 12:54:07.540293 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 674/1368] 10.222.0.26 () {58 vars in 1144 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:07.560605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd294677-5505-45e9-98bd-e69f4768af2d tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.583893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd294677-5505-45e9-98bd-e69f4768af2d tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033272 Oct 06 12:54:07.584657 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 675/1369] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:54:07.598684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a58580c-aa70-49ff-bd85-1f613e1ea771 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.664253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:07.685611 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a58580c-aa70-49ff-bd85-1f613e1ea771 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.091389 Oct 06 12:54:07.688133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 676/1370] 10.222.0.26 () {58 vars in 1148 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:07.705523 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a976388-baaa-431b-83fc-3f1b9c0f76ed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.968431 Oct 06 12:54:07.706034 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 695/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:06 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:07.708906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-956e2229-1bb9-4c51-ae3f-dfc607716a48 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.743877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-956e2229-1bb9-4c51-ae3f-dfc607716a48 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.043579 Oct 06 12:54:07.744479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 677/1372] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:54:07.771479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fbce9c4d-58ec-40f7-9e6e-0969390bd299 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.783150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fbce9c4d-58ec-40f7-9e6e-0969390bd299 tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018823 Oct 06 12:54:07.793261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 696/1373] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:07.799887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3844cd6-652e-49b4-8cf2-53b4d3d886ed tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.909775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3844cd6-652e-49b4-8cf2-53b4d3d886ed tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.111263 Oct 06 12:54:07.913822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 678/1374] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:07.929882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-871da95a-a0f6-4b5c-89bb-8bad85dfaa9f tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:07.995433 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-871da95a-a0f6-4b5c-89bb-8bad85dfaa9f tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072077 Oct 06 12:54:07.998419 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 697/1375] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:54:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:08.022777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3566434f-3728-44fb-be22-23d6486ccdfd tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:08.042533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:08.050338 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3566434f-3728-44fb-be22-23d6486ccdfd tempest-FlavorsV2TestJSON-1028846321 tempest-FlavorsV2TestJSON-1028846321-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035301 Oct 06 12:54:08.063810 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 679/1376] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:54:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:08.460992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:08.462101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:08.464595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:08.480398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:08.481355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:08.482942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:08.485069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:08.488144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:08.489117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:08.739979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:08.740616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:08.749127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:08.807656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:08.809210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:08.813145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:08.813977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:08.814671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:08.814918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:10.076732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:10.122629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-587e8968-9544-4712-b33e-36b92dbcb39a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 1.663760 Oct 06 12:54:10.127565 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 698/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:08 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:10.149455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:10.177336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:10.178376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:10.178889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:10.231374 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] Creating event network-changed:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:54:10.258384 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4428a174-c6f4-4d1a-b038-eec038c949dd req-9200a463-5034-45e8-8d1f-bc2131f1c3d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120374 Oct 06 12:54:10.262913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 699/1378] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:10.360355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:10.372557 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5a233df9-508e-45b5-b971-323daee1be9e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 1.641459 Oct 06 12:54:10.373683 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 680/1379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:08 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:11.158679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:11.160080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:11.163752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:11.182535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:11.183350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:11.190360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:11.191682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:11.192557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:11.193409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:11.407758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:11.409589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:11.448861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:11.449422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:11.452006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:11.452866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:11.457023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:11.458688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:11.574939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:11.613806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0001454d-1039-4a39-ae77-5a9981285f10 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.457540 Oct 06 12:54:11.617372 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 700/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:11 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:11.827546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:11.848178 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aeadc669-2e17-4767-86b8-f2083daba3fb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.447903 Oct 06 12:54:11.851125 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 681/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:11 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:12.346152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:12.390979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:12.392395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:12.394988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:12.436845 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] Creating event network-changed:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:54:12.451899 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cd31b102-bacf-46de-b05d-b57620a56c66 req-58a756bc-8ce9-4f2d-a90a-5ab1b9118e99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112492 Oct 06 12:54:12.456297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 701/1382] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:12.645789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:12.646468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:12.660556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:12.661071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:12.666521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:12.667428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:12.669044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:12.669515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:12.884300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:12.885518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:12.898161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:12.907488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:12.911697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:12.912842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:12.915708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:12.916346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:13.372719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:13.388304 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84633c30-abda-4024-9c7c-68882ce3db60 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.748148 Oct 06 12:54:13.394594 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 682/1383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:12 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:13.605160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:13.644472 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49d908de-b4b8-4cc4-8e36-381c5c11a224 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.753577 Oct 06 12:54:13.644472 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 702/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:12 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:14.428867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:14.429646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:14.444601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:14.445941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:14.446389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:14.447136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:14.450360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:14.452243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:14.805690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-340684728", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "5419d21e-2a7d-4337-845b-dcdc25ebc04e"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:14.894586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] validate_networks() for [('5419d21e-2a7d-4337-845b-dcdc25ebc04e', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:54:15.206638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:15.217901 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-470f344d-c848-4f9e-af9f-8bca7f68b8ca tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.793941 Oct 06 12:54:15.218881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 683/1385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:14 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:15.228098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:15.235231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:15.248261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:15.249208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:15.249533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:15.250994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:15.251819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:15.253513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:16.542111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:16.552207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-456afaad-ed82-4a48-9e9e-e32e052048b7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 1.331995 Oct 06 12:54:16.566149 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 684/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:15 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:16.571716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:16.572572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:16.592040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:16.592746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:16.593377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:16.594351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:16.594983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:16.595582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:17.683258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:17.697700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3203f9c6-b8fd-446a-b881-ef0b6a2156ff tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 1.129531 Oct 06 12:54:17.698949 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 685/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:16 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:17.715785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:17.728729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:17.776916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:17.777559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:17.778077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:17.778821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:17.784634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:17.785098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:17.914267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:54:17.914791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:54:17.915258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:54:17.917118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:54:17.917887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:54:17.937187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:17.937669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:17.941051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:17.942549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:17.943033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:17.943474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:17.973396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:54:17.982453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for user 07b0c27e7810471cbb372142ad98f650 and project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:54:18.001026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:54:18.005034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:54:18.139551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28b51428-516e-4160-8e40-2b33567ef86f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.522869 Oct 06 12:54:18.146171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 703/1388] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:54:18.152917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4de7ef8d-a83a-46bc-8f39-fd5fd2985b51 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:18.153925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4de7ef8d-a83a-46bc-8f39-fd5fd2985b51 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:18.303840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4de7ef8d-a83a-46bc-8f39-fd5fd2985b51 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:18.319087 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4de7ef8d-a83a-46bc-8f39-fd5fd2985b51 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1224 microversion: 2.1 time: 0.170360 Oct 06 12:54:18.320168 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 704/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:18 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:18.387260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:18.413805 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9e519d6-dc30-4bef-94b0-2db70955c790 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.713512 Oct 06 12:54:18.418474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 686/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:17 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:18.721775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:18.722905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:18.741925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:18.742604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:18.743364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:18.744022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:18.744666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:18.745262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:18.978343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-plugged", "status": "completed", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:18.994209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:18.994973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:18.997718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.035031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] Creating event network-vif-plugged:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:54:19.045854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3f59b49c-62e4-408e-acfe-f52424228823 req-f8ba0835-d265-47d5-8140-4c6b6a64832f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072704 Oct 06 12:54:19.050574 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 687/1391] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:54:19.347270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:19.348303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:19.361038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.370000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.371151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.373781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.374651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.375264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.463129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:19.489197 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe75e967-60fe-47ad-b809-316000235a69 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.772273 Oct 06 12:54:19.503452 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 705/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:18 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:19.512191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:19.513347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:19.520689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.521607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.522343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.523979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.524725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.525954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.565375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:19.573912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bbbb01be-2062-4b08-94cf-476364dbf3da tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1276 microversion: 2.1 time: 0.232282 Oct 06 12:54:19.576792 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 688/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:19 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:19.583145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:19.584086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:19.594700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.595724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.596575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.597705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:19.598437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:19.599426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:19.971398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47e8bfc3-084c-4dca-9c53-b4454000c454 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1812 microversion: 2.1 time: 0.466579 Oct 06 12:54:19.979962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:19.992771 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 706/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:19 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1812 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:19.998646 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0fd1734-6a44-47dd-beff-0af41753f0e6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.420110 Oct 06 12:54:20.001680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 689/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:19 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:20.016235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:20.023019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.023530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.023982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.024730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.025697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.026351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.067332 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4adbf144-aac1-4abc-86bd-b69469c4237b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054772 Oct 06 12:54:20.082488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 707/1396] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:54:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:20.517125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:20.518586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:20.532686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.534075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.535002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.549982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.553241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.554015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.616471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:20.619153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:20.632149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.632838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.633396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.635185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:20.636047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:20.636787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:20.933898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:20.961182 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1ea88c9-732d-4745-b1ba-139348923f12 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1276 microversion: 2.1 time: 0.360106 Oct 06 12:54:20.966784 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 708/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:20 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1276 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:21.027915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:21.029131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:21.068179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:21.069020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:21.069650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:21.070734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:21.071374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:21.071982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:21.460213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:21.479664 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ef97d92-f82d-41fd-9ab4-7bdc5f8a8d6b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1312 microversion: 2.1 time: 0.966175 Oct 06 12:54:21.480702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 690/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:20 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:21.492715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae887a92-7271-4407-af71-b336162ac8d0", "name": "network-vif-plugged", "status": "completed", "tag": "4e91c917-a2b8-4f7d-80cd-f595deb2831e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:21.517180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:21.518519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:21.519934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:21.541836 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] Creating event network-vif-plugged:4e91c917-a2b8-4f7d-80cd-f595deb2831e for instance ae887a92-7271-4407-af71-b336162ac8d0 on n-h2-860556-1 Oct 06 12:54:21.547931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b56e2c37-ff8b-44cf-af03-cbd49b5e0c21 req-f001eddb-437a-4e32-9104-4f8d1ab7a3fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065807 Oct 06 12:54:21.549493 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 691/1399] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:21.558407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9ce9f7a-1cf8-45e8-94ec-ecaeb84043af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Action: 'create', calling method: .version_select at 0x7f7d3f9fbc10>, body: {"keypair": {"name": "tempest-keypair-724958310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQWNBYk7x60xR/vkd06x9EbxPa842ZvSRaZVld93DO8FQSLJNRHolV6xq1DE8/j6Br4XhAXovkqsBOIdL4UttNd22dl/8WIy7YuOAahAP8S/h/TjqzoncAyiOIlUNcs6w=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:21.582940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b9ce9f7a-1cf8-45e8-94ec-ecaeb84043af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Getting quotas for project f441d9683a1d479bbd90ca094cac3bac. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:54:21.590027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b9ce9f7a-1cf8-45e8-94ec-ecaeb84043af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Getting quotas for user 76bc81cc0db047fe926e1d1c211a2a56 and project f441d9683a1d479bbd90ca094cac3bac. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:54:21.621252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:21.658963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9ce9f7a-1cf8-45e8-94ec-ecaeb84043af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.106010 Oct 06 12:54:21.660850 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 692/1400] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 12:54:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 12:54:21.746739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:21.772196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65ac8d50-8405-4006-be58-d2bb4cd36e44 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.750564 Oct 06 12:54:21.776744 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 709/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:21 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:21.996414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:21.998040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:22.062739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.066361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.066975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:22.068051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.070983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.071713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:22.085624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:22.308234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:22.334261 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da1c2954-3ac3-475d-abac-c51e48d80023 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1282 microversion: 2.1 time: 0.341295 Oct 06 12:54:22.338894 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 693/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:21 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1282 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:22.510807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:22.511777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:22.526672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.527438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.528048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:22.528992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.529641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.530263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:22.803744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:22.804371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:22.821558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.822102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.822577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:22.823291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:22.824321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:22.825245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.108879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:23.129997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0580b4b8-cc1e-4ee0-8e1e-87c15db91d14 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1462 microversion: 2.1 time: 0.625041 Oct 06 12:54:23.154177 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 710/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:22 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1462 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:23.165019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b201ff4-1929-4c49-96d2-609542382e84", "device": "/dev/xvdb"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:23.168630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:23.179835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.180960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.181982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.183420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.184578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.186087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.330708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:23.367249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f22723c-ba66-4fb8-9937-e58d30641397 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1314 microversion: 2.1 time: 0.564683 Oct 06 12:54:23.369588 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 694/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:22 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:23.404811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:23.406321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:23.436941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.437446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.440288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.441177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.445538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.447088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.848770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:23.887607 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac1a9e75-2900-4f0e-bbcc-cebaebdc4e1b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729362 Oct 06 12:54:23.894214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 711/1405] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 12:54:23 2022] POST /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:23.905887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:23.908067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:23.932837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.934866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.935914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:23.936698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:23.938885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:23.940561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:24.357299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81b31a04-6484-4b6d-a091-b9c4d7834bf2 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1613 microversion: 2.1 time: 0.972992 Oct 06 12:54:24.359130 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 695/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:23 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1613 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:24.387085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-plugged", "status": "completed", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:24.407828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:24.409468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:24.409984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:24.459687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] Creating event network-vif-plugged:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:54:24.466542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ce3d750d-d142-472d-af35-901b148b1725 req-79f525f5-1384-4d89-9139-82752634dabf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105973 Oct 06 12:54:24.467701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 696/1407] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:24.474781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:24.475847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:24.484002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:24.484750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:24.485425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:24.487068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:24.487765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:24.488973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:24.532440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f3d26e6b5cd4af297705e8dd58740c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ed1fff55df4107a47cf37114824631', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:24.534555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] flavor_id is None. Assuming migration. {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 06 12:54:24.535399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 12:54:25.099918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36596ab1-d12e-4ab8-b794-dcb9d4227552 tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581/action" status: 202 len: 0 microversion: 2.1 time: 0.630754 Oct 06 12:54:25.103116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 697/1408] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:54:24 2022] POST /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:54:25.122236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:25.123503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:25.141526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:25.146248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:25.147812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:25.150252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:25.152042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:25.154596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:25.452356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:25.461505 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50210edf-5f8f-40f9-a700-be0ea3551660 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1324 microversion: 2.1 time: 1.570672 Oct 06 12:54:25.466672 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 712/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:23 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1324 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:25.486486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1507017735", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7f43f00b-48da-471f-a196-660c84c489ff"}, {"port": "5b42104a-a9d6-4bbd-a480-a2d2a849b73c", "tag": "port-1"}, {"port": "67d910f1-0ac2-4e36-a881-ca9fdb8b28f8", "tag": "port-2"}, {"uuid": "1a39726f-b9d1-431c-b644-969f7e40367e", "tag": "net-1"}, {"uuid": "1a39726f-b9d1-431c-b644-969f7e40367e"}, {"uuid": "03a2380f-2f89-42b1-99c7-a8aff18bcf9a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "03a2380f-2f89-42b1-99c7-a8aff18bcf9a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1464a68a-aba0-4407-9c13-1066f0bd223b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "65e8426f-038d-4fc9-b9b8-ede570aa9ba8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bcfb8cdd-879b-41f9-a5a1-9ca8050be45d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--148749941"}], "key_name": "tempest-keypair-724958310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:26.238316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] validate_networks() for [('7f43f00b-48da-471f-a196-660c84c489ff', None, None, None, None, None), (None, None, '5b42104a-a9d6-4bbd-a480-a2d2a849b73c', None, None, None), (None, None, '67d910f1-0ac2-4e36-a881-ca9fdb8b28f8', None, None, None), ('1a39726f-b9d1-431c-b644-969f7e40367e', None, None, None, None, None), ('1a39726f-b9d1-431c-b644-969f7e40367e', None, None, None, None, None), ('03a2380f-2f89-42b1-99c7-a8aff18bcf9a', '10.2.2.100', None, None, None, None), ('03a2380f-2f89-42b1-99c7-a8aff18bcf9a', '10.2.2.200', None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:54:26.512783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:26.526546 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d754cbb-424d-4cc6-9a9e-064c805fce4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1462 microversion: 2.1 time: 1.418389 Oct 06 12:54:26.546973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 698/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:25 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1462 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:26.557121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:26.558601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:26.568428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:26.569318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:26.570060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:26.572101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:26.573172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:26.573898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:27.249534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:27.263395 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c66de105-f19a-45d5-88e8-dc156585f1dd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1471 microversion: 2.1 time: 0.714853 Oct 06 12:54:27.263963 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 699/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:26 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1471 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:27.285136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:27.286232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:27.296200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:27.296960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:27.309935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:27.313194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:27.313824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:27.314333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:28.319154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:28.794420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:28.825536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-172ab005-1c50-488b-b9b0-d46e486d6d4c tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1324 microversion: 2.1 time: 1.554756 Oct 06 12:54:28.839046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 700/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:27 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1324 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:28.856177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:28.856905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:28.865548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:28.866703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:28.867312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:28.869828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:28.870812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:28.871416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:29.918404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:29.927468 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b11bf7e7-6692-4037-90be-79de4d0dd9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1464 microversion: 2.1 time: 1.085213 Oct 06 12:54:29.928296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 701/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:28 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1464 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:29.933053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:29.934132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:29.941054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:29.942657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:29.943562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:29.945201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:29.945967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:29.946611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:30.038302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:30.557551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:30.567740 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dabf501c-dd55-40f1-9959-a0f7128b922a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1471 microversion: 2.1 time: 0.638137 Oct 06 12:54:30.568483 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 702/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:29 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1471 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:30.670329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04ca3fde-75a6-4cc0-9b75-1fb2b8ac2b1f tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Action: 'create', calling method: .version_select at 0x7f7d3f444310>, body: {"pool": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:31.605520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:33.406731 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04ca3fde-75a6-4cc0-9b75-1fb2b8ac2b1f tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.836981 Oct 06 12:54:33.407333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 703/1415] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:54:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:33.412559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff81df07-d7ab-4b15-ae79-c1ad5e17a79c", "tag": "087741d8-83a4-412e-9637-dc4470a8bdd5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:33.423303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:33.424378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:33.424815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:33.435923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] Creating event network-changed:087741d8-83a4-412e-9637-dc4470a8bdd5 for instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c on n-h1-860556-1 Oct 06 12:54:33.440844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-918410f9-6d3e-4e13-b667-773900eb8b2b req-745dc8b1-bcb8-4761-8352-404cea253de2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032353 Oct 06 12:54:33.441647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 704/1416] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:33.446537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:33.447216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:33.454633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:33.455759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:33.456394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:33.457306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:33.458012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:33.458785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:33.766319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:33.774545 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fd5ce37-3670-4b14-81ea-9a5a0a754679 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1324 microversion: 2.1 time: 0.331843 Oct 06 12:54:33.775138 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 705/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:33 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:33.780009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-958664917", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:33.840361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:54:33.840914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:54:33.841514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:54:33.842072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:54:33.844476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:54:33.858963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:54:33.863882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:33.864522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:33.865073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:33.866119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:33.866586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:33.867025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:33.887147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Getting quotas for project f441d9683a1d479bbd90ca094cac3bac. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:54:33.893469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Getting quotas for user 76bc81cc0db047fe926e1d1c211a2a56 and project f441d9683a1d479bbd90ca094cac3bac. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:54:34.149339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:54:34.154781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1464a68a-aba0-4407-9c13-1066f0bd223b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='65e8426f-038d-4fc9-b9b8-ede570aa9ba8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcfb8cdd-879b-41f9-a5a1-9ca8050be45d',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:54:34.292172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:54:34.292824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:54:34.293365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:54:34.293863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:54:34.294470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:54:34.314605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:34.315628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:34.316407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:34.317624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:34.318902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:34.320053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:34.347271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:54:34.353641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Getting quotas for user 8276c6052c6a4d31b9f913affd9148f2 and project 68a6ecb1c7944a8cba67fb219e2b9f83. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:54:34.369011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:54:34.371379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:54:34.429021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2aabc5b-f8dd-4497-850c-4df966a519fd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652836 Oct 06 12:54:34.433897 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 706/1418] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:54:34.580814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:34.581756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:34.589313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:34.589844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:34.590401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:34.591178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:34.591698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:34.592128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:34.636130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a977929e-ae42-4e4d-9fb8-4966e80df67a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.167190 Oct 06 12:54:34.637257 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 713/1419] 10.222.0.26 () {62 vars in 1189 bytes} [Thu Oct 6 12:54:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 9169 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:54:34.647212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-12e332cd-b8f2-4787-a6de-02d9c83535ee tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f450a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:34.896458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:34.907304 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80c13a73-25d7-4f34-95c5-6b100b50f318 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.471701 Oct 06 12:54:34.908431 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 707/1420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:34 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:34.924959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d0904d2-eb78-4875-8dd6-b1287536f376 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:34.925383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d0904d2-eb78-4875-8dd6-b1287536f376 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:34.960800 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-12e332cd-b8f2-4787-a6de-02d9c83535ee tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/bcfe1fbc-b677-427f-9150-996c2bb2f0b0" status: 200 len: 142 microversion: 2.1 time: 0.322013 Oct 06 12:54:34.970291 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 714/1421] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:54:34 2022] GET /compute/v2.1/os-floating-ips/bcfe1fbc-b677-427f-9150-996c2bb2f0b0 => generated 142 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:34.987100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:34.988970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:35.010296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d0904d2-eb78-4875-8dd6-b1287536f376 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:35.020919 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d0904d2-eb78-4875-8dd6-b1287536f376 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1213 microversion: 2.1 time: 0.110811 Oct 06 12:54:35.026017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 708/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:34 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:35.046496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:35.047239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:35.054162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:35.054925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:35.055810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:35.056961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:35.057396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:35.057943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:35.083877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:35.099376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:35.101563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:35.102698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3cd49ab1-b925-4d6b-bf1a-3936eacb43af tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1285 microversion: 2.32 time: 0.139777 Oct 06 12:54:35.103852 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 715/1423] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:34 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:35.115389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a582017a-46cb-4b6b-9c3f-6c21d2bfc215 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f450310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:35.387951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:35.403165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6de5a242-0820-4433-9a0f-d8a79edb108d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1324 microversion: 2.1 time: 0.360222 Oct 06 12:54:35.404452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 709/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:35 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:35.440055 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a582017a-46cb-4b6b-9c3f-6c21d2bfc215 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.333455 Oct 06 12:54:35.449492 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 716/1425] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:54:35 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:35.456941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07d75423-0218-4982-900a-7d5f933b5a4b tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f18e280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:35.715736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff81df07-d7ab-4b15-ae79-c1ad5e17a79c", "name": "network-vif-plugged", "status": "completed", "tag": "087741d8-83a4-412e-9637-dc4470a8bdd5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:35.734767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:35.735266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:35.735705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:35.773394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] Creating event network-vif-plugged:087741d8-83a4-412e-9637-dc4470a8bdd5 for instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c on n-h1-860556-1 Oct 06 12:54:35.788666 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6c66e7b3-7799-4c96-a2bf-9fd844050d7a req-f0534107-9971-4865-a457-2f135c4b7c88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077296 Oct 06 12:54:35.797606 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 717/1426] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:54:35.997809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:35.998667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:36.007528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.008030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.008527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.009592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.009989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.010427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.324743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.333687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-745c1926-71ba-458e-bb37-4a49ee799e17 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.340119 Oct 06 12:54:36.334593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 718/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:35 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:36.339687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:36.340523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:36.347622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.348577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.349595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.350589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.351276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.351929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.500427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.510007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-627dacbc-616f-4a4a-aa5a-80ebe1326247 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1273 microversion: 2.1 time: 0.174029 Oct 06 12:54:36.520761 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 719/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:36 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:36.529979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:36.530769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:36.537917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.538414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.538858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.539578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.540042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.540504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.634717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.644604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.647096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.649241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a15ef49a-b472-43c9-83e5-6944c987ec9a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1575 microversion: 2.32 time: 0.126871 Oct 06 12:54:36.658194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 720/1429] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:36 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1575 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:36.658907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:36.659705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:36.670008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.670965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.672716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.673468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:36.674635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:36.675086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:36.936546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:36.945391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2fcc3045-dfe3-4824-ac7b-5289f9639e83 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1324 microversion: 2.1 time: 0.292961 Oct 06 12:54:36.946031 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 721/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:36 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:37.359480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:37.360386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:37.366963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:37.367463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:37.367917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:37.368661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:37.369125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:37.369561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:37.379151 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07d75423-0218-4982-900a-7d5f933b5a4b tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/bcfe1fbc-b677-427f-9150-996c2bb2f0b0" status: 202 len: 0 microversion: 2.1 time: 1.928129 Oct 06 12:54:37.387760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 710/1431] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:54:35 2022] DELETE /compute/v2.1/os-floating-ips/bcfe1fbc-b677-427f-9150-996c2bb2f0b0 => generated 0 bytes in 1938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 12:54:37.401483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d40175d3-e34a-4987-b3c0-0c7efe96263b tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Action: 'create', calling method: .version_select at 0x7f7d3f222160>, body: {"pool": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:37.872938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:37.884184 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39d28a61-ddae-49fe-8d70-8978b632caa4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.528854 Oct 06 12:54:37.885245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 722/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:37 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:37.900047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:37.906850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:37.916913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:37.917298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:37.918000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:37.918818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:37.919556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:37.920152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.034616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:38.046388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f4d9b80-dc23-4830-b749-19499228d1d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1271 microversion: 2.1 time: 0.157408 Oct 06 12:54:38.046388 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 723/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:37 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:38.051789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:38.052425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:38.059353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.060007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.060445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.061596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.062610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.063333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.241775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:38.264775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:38.267474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:38.268955 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d3e5f7d-bdcd-4852-80bd-9ca31051d100 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1593 microversion: 2.32 time: 0.221626 Oct 06 12:54:38.300232 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 724/1434] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:38 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1593 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:38.307126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:38.308694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:38.325500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.326292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.326892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.328439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.331853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.332530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.743950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:38.753174 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4cb39a8-2dbc-4a6c-b42a-5a811ff2eb2f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.451463 Oct 06 12:54:38.757861 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 725/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:38 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:38.778286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:38.779206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:38.793821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.794625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.795260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:38.796003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:38.796630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:38.797073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:39.174249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:39.183008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6c86096-d370-48ba-824b-fe998dac3095 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.408955 Oct 06 12:54:39.183594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 726/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:38 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:54:39.188386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:39.189005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:39.195875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:39.196740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:39.197412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:39.198427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:39.199143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:39.199839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:39.994514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:40.008413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2299ff24-82e7-4f90-a55d-47cb7902e080 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.823338 Oct 06 12:54:40.009360 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 727/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:39 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:40.035172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:40.038584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:40.057908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.058652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.059271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:40.060007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.060473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.060897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:40.484771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:40.497708 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74acbac2-46dc-4a2e-9b44-9c87b211ff61 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1313 microversion: 2.1 time: 0.486820 Oct 06 12:54:40.501020 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 728/1438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:40 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:40.508565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51601ba6-963d-4114-b8fa-1d940c5e226f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-607840226", "metadata": {"": ""}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51601ba6-963d-4114-b8fa-1d940c5e226f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action HTTP/1.1 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 106 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:54:40.513706 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-607840226", "metadata": {"": ""}}} Oct 06 12:54:40.515613 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-607840226', 'metadata': {'': ''}}}} Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'': ''} Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:40.516638 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.519053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:40.520684 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:40.523445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51601ba6-963d-4114-b8fa-1d940c5e226f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:40.524567 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51601ba6-963d-4114-b8fa-1d940c5e226f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action" status: 400 len: 170 microversion: 2.1 time: 0.022297 Oct 06 12:54:40.525171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 729/1439] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Oct 6 12:54:40 2022] POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:54:40.531604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:40.532743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:40.541152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.541658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.542588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:40.544115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.544598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.545276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:40.720910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:40.733013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:40.734454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:40.735720 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e5d4819-1c33-442e-b210-e3f0897319d8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1593 microversion: 2.32 time: 0.209335 Oct 06 12:54:40.749829 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 730/1440] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:40 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1593 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:40.758404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:40.762123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:40.773590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.774292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.774981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:40.776424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:40.777455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:40.777922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.261044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1783945a-fbee-4a63-9b55-b3a2f37e06cb tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1858 microversion: 2.1 time: 0.508842 Oct 06 12:54:41.282259 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 731/1441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:40 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1858 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:41.292081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:41.292081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:41.302421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:41.306171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.306807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.307360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.308263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.309066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.309607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.359327 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d40175d3-e34a-4987-b3c0-0c7efe96263b tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.968561 Oct 06 12:54:41.360776 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 711/1442] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:54:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:41.366240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:41.367265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:41.376120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.376815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.377561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.378811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.379343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.380129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.803483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:41.809568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:41.823446 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b3564b6-bdb9-4c6f-9cd4-1d931d370dce tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.460630 Oct 06 12:54:41.824844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 712/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:41 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:41.842645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-188bd91d-da8b-4a0f-94a0-aeb4d1c7ceca tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.557595 Oct 06 12:54:41.855488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 732/1444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:41 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:41.861792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860556-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:41.862671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26ec946-35e2-48c2-8686-858f7c4a4a79", "tag": "7f70f18c-6da6-499c-a302-cf81e27ca3f0"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:41.868227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:41.871916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.872482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.872987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.883767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.884372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.884894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.885691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:41.890425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:41.891140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:41.895852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] Creating event network-changed:7f70f18c-6da6-499c-a302-cf81e27ca3f0 for instance f26ec946-35e2-48c2-8686-858f7c4a4a79 on n-h2-860556-1 Oct 06 12:54:41.898278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:41.906719 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b4fa06de-e5e6-413c-b34e-6e52c7677aee req-c9d0a012-aea4-4f7e-9271-7c7b0557e0c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080069 Oct 06 12:54:41.908771 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 713/1445] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:41.914356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-216364ca-ab38-4a5c-bcb4-5414a9733c22 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f18ea60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:41.939211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lazy-loading 'flavor' on Instance uuid ec62f355-a28a-489f-95aa-e39d9c98c23c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:54:41.959900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Going to try to live migrate instance to n-h2-860556-1 {{(pid=129614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:54:43.818866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-216364ca-ab38-4a5c-bcb4-5414a9733c22 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee" status: 202 len: 0 microversion: 2.1 time: 1.907715 Oct 06 12:54:43.821444 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 714/1446] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:54:41 2022] DELETE /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:54:43.831317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:43.831678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:43.843634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:43.845220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:43.846525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:43.847900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:43.848677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:43.849418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:43.875625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:44.112748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:44.121834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:44.128051 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5d73291-f8bc-43e8-99a8-830dca91c9be tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1313 microversion: 2.1 time: 0.304158 Oct 06 12:54:44.128730 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 715/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:43 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:44.133509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:44.134404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:44.145119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.145630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.146129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:44.146860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.147323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.147758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:44.336299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:44.398646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:54:44.414116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bcdc9365-8024-444a-8d02-9c599273081c tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 2344 microversion: 2.25 time: 0.284038 Oct 06 12:54:44.414993 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 716/1448] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:44 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 2344 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:44.420235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:44.420848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:44.428572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.429131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.429695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:44.430472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.434601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.434601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:44.697249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:44.714369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:44.717003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:44.718546 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6ae14dc-bbf8-44de-afc3-3e1e08395d98 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1752 microversion: 2.32 time: 0.302387 Oct 06 12:54:44.719371 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 717/1449] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:44 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:44.742632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:44.743459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:44.750870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.752470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.753039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:44.754545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:44.755265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:44.755929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:45.018705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:45.072803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:45.086113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f8c97c4-eb06-4093-8830-73f0c10b6aa6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.350729 Oct 06 12:54:45.105834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 718/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:44 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:45.105834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:45.105834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:45.105834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:45.106338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:45.107314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:45.107984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:45.108438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:45.108841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:45.109546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:45.521665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:45.531113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a6da124-4c8f-4052-8385-66c8a711be64 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.440943 Oct 06 12:54:45.536093 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 719/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:45 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:45.548054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f222430>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:45.682323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4c073878-fad4-433c-9edb-f36bc98768ee could not be found", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:54:45.683160 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] HTTP exception thrown: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Request method failure captured: Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee HTTP/1.1 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtAEcFBHKPTbb6cJhYKKo462wQPA3AWnefoyouGyaSj0r6pKvsIOpKcLnrJnnZ9ElJ33WnYkzofFSj1WEnclI8AokezeyHauhz7UIkoUlM0IfD3RM0bCp5NvVQlnLzBTmGH87eKH1h8nFoCaP8Ab5TJM1jx_rLBbe0rqV0GTmvuOFh4 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f53cffd8ae474671b88a678cd5765dbd Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:54:45.688803 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53cffd8ae474671b88a678cd5765dbd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53cffd8ae474671b88a678cd5765dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53cffd8ae474671b88a678cd5765dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53cffd8ae474671b88a678cd5765dbd"}]}] Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f53cffd8ae474671b88a678cd5765dbd Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsTestJSON-520011768-project Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6c5624d20e354ae3a76043ad082fdf4e Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsTestJSON-520011768-project Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: exception: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4c073878-fad4-433c-9edb-f36bc98768ee'} Oct 06 12:54:45.690450 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:54:45.691456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4c073878-fad4-433c-9edb-f36bc98768ee could not be found Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-535b108d-61a7-4286-8e22-605fcdc9785e'] Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee. Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:45.692763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:54:45.694118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:54:45.695492 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:45.695492 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:45.695492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Returning 404 to user: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:45.695492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d643f86-5a70-4168-a01b-407f0b693dfb tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee" status: 404 len: 111 microversion: 2.1 time: 0.153771 Oct 06 12:54:45.697876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 720/1452] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:54:45 2022] GET /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:54:45.703661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:45.704384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:45.717944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:45.718836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:45.719623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:45.721549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:45.722388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:45.723202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.230193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:46.239807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:46.241164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:46.242656 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc3a65bb-c288-4270-8313-709197afbbb6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2952 microversion: 2.42 time: 0.543837 Oct 06 12:54:46.254211 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 721/1453] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:45 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2952 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:46.273367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:46.277403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.277929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.278376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.279122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.279762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.280390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.308323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12a15209-80ca-4e9c-9978-850e5e161550 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052938 Oct 06 12:54:46.309254 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 722/1454] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Oct 6 12:54:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:54:46.314887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c892a7a2-fed4-42c7-be7b-9901a0fdbced tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1253116396", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c892a7a2-fed4-42c7-be7b-9901a0fdbced tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action HTTP/1.1 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 619 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:54:46.320117 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:46.321549 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:54:46.322258 n-d-860556-1 devstack@n-api.service[129615]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1253116396", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 06 12:54:46.322258 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:54:46.322258 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1253116396', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 06 12:54:46.322513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:46.323274 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.324543 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 12:54:46.325344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.327992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c892a7a2-fed4-42c7-be7b-9901a0fdbced tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:46.328863 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c892a7a2-fed4-42c7-be7b-9901a0fdbced tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action" status: 400 len: 938 microversion: 2.1 time: 0.018361 Oct 06 12:54:46.329677 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 723/1455] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Oct 6 12:54:46 2022] POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:54:46.336244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:46.336859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:46.343921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.344415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.344857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.345929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.346395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.346827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.769242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:46.783513 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8f921b0-43d3-48ca-a6e2-7a2047703808 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1313 microversion: 2.1 time: 0.449252 Oct 06 12:54:46.798596 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 724/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:46 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:46.811626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Calling method '.version_select at 0x7f7d3f1a8790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:46.911661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4c073878-fad4-433c-9edb-f36bc98768ee could not be found", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:54:46.912590 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] HTTP exception thrown: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Request method failure captured: Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee HTTP/1.1 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtAEcFBHKPTbb6cJhYKKo462wQPA3AWnefoyouGyaSj0r6pKvsIOpKcLnrJnnZ9ElJ33WnYkzofFSj1WEnclI8AokezeyHauhz7UIkoUlM0IfD3RM0bCp5NvVQlnLzBTmGH87eKH1h8nFoCaP8Ab5TJM1jx_rLBbe0rqV0GTmvuOFh4 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f53cffd8ae474671b88a678cd5765dbd Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:54:46.914663 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53cffd8ae474671b88a678cd5765dbd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53cffd8ae474671b88a678cd5765dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53cffd8ae474671b88a678cd5765dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53cffd8ae474671b88a678cd5765dbd"}]}] Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f53cffd8ae474671b88a678cd5765dbd Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsTestJSON-520011768 Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsTestJSON-520011768-project Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6c5624d20e354ae3a76043ad082fdf4e Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsTestJSON-520011768-project Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: exception: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4c073878-fad4-433c-9edb-f36bc98768ee'} Oct 06 12:54:46.918205 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:54:46.919273 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4c073878-fad4-433c-9edb-f36bc98768ee could not be found Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fee4fd-8f60-4233-9c77-d6466c9505b0'] Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee. Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:46.920571 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:54:46.922551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:54:46.925310 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee Oct 06 12:54:46.925310 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:46.925581 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d1cedde-0756-45f5-b6ca-13a7ddcaaa36 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/action" status: 202 len: 0 microversion: 2.1 time: 5.065320 Oct 06 12:54:46.926095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] Returning 404 to user: Floating IP not found for ID 4c073878-fad4-433c-9edb-f36bc98768ee {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:46.929366 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 733/1457] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:54:41 2022] POST /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/action => generated 0 bytes in 5068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:54:46.929366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:46.929366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:46.929845 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7f4706b-00a5-4eef-933d-ea683d90aae9 tempest-FloatingIPsTestJSON-520011768 tempest-FloatingIPsTestJSON-520011768-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee" status: 404 len: 111 microversion: 2.1 time: 0.117087 Oct 06 12:54:46.929845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 725/1458] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:54:46 2022] DELETE /compute/v2.1/os-floating-ips/4c073878-fad4-433c-9edb-f36bc98768ee => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:54:46.942458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.943066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.943362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:46.943522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.944230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:46.948892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.950450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.951155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.959831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.960458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.960967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:46.961980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:46.962797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:46.963430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:47.239013 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e737f65-ae33-4da0-b090-7d75aa79d644 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.309474 Oct 06 12:54:47.250183 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 726/1459] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 12:54:46 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d/os-interface => generated 1829 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:47.257442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:47.258208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:47.275072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:47.275661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:47.276968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:47.278380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:47.280682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:47.285776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:47.560886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:47.576327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:47.578864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:47.581512 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a041bb92-9b42-403b-b72e-fc2f14f9e6a2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1798 microversion: 2.32 time: 0.663597 Oct 06 12:54:47.595238 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 734/1460] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:46 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1798 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:47.621041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:47.621673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:47.649394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:47.653598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:47.654232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:47.655069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:47.655550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:47.655973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.104670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:48.152749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2385ebf-eadf-440d-9f01-ad81e00bd3fa tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.901133 Oct 06 12:54:48.178186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 727/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:47 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:48.185576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:48.186980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:48.214608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.215793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.216845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.218453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.219845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.221165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.683840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:48.709553 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05d48d33-a88f-4244-a134-54e5d8ca16f6 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 1.112581 Oct 06 12:54:48.716652 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 735/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:47 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:48.730363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:48.731151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:48.743766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.744272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.744726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.745566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.745963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.746406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.772240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:48.786707 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6187693-793c-4327-be29-748aee1f34a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.606472 Oct 06 12:54:48.788786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 728/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:48 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:48.795294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:48.796340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:48.805080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.806352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.807072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:48.808139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:48.808846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:48.810990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:49.443196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:49.451471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b9db94a-656a-40cd-90de-dd295925bcfb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1313 microversion: 2.1 time: 0.733634 Oct 06 12:54:49.452075 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 736/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:48 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:49.473826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:49.474944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:49.481979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:49.482836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:49.483609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:49.484971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:49.485681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:49.486430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:49.598015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:49.612937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79db8b52-d947-4c06-8fab-3c34275e19d4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.821903 Oct 06 12:54:49.630224 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 729/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:48 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:49.641702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eb099fe-3d2c-4b91-afec-1502d00a7bc0", "device": "/dev/xvdb"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:49.645503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:49.659769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:49.662420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:49.663118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:49.664096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:49.664781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:49.665658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:49.982780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:50.040517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:50.045072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:50.047126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-738bb19d-7981-4a47-9b2e-2311a38fd436 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1798 microversion: 2.32 time: 0.584187 Oct 06 12:54:50.063483 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 737/1466] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:49 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1798 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:50.087624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26ec946-35e2-48c2-8686-858f7c4a4a79", "name": "network-vif-plugged", "status": "completed", "tag": "7f70f18c-6da6-499c-a302-cf81e27ca3f0"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:50.129159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.130052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.130728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.187076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] Creating event network-vif-plugged:7f70f18c-6da6-499c-a302-cf81e27ca3f0 for instance f26ec946-35e2-48c2-8686-858f7c4a4a79 on n-h2-860556-1 Oct 06 12:54:50.206311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7c1aace3-aa83-4863-bf29-a9a7b53bae15 req-34efe5fe-4887-43f0-8538-e9d74a734447 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132588 Oct 06 12:54:50.207007 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 738/1467] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:50.222273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d8b770b-d48a-4ab3-90b6-6608a4566397 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d8b770b-d48a-4ab3-90b6-6608a4566397 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action HTTP/1.1 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 285 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:54:50.240600 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:54:50.242168 n-d-860556-1 devstack@n-api.service[129614]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:54:50.242918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:54:50.243819 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:54:50.245169 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:54:50.247448 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:54:50.247448 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:54:50.252327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d8b770b-d48a-4ab3-90b6-6608a4566397 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:50.255690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d8b770b-d48a-4ab3-90b6-6608a4566397 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action" status: 400 len: 619 microversion: 2.1 time: 0.046065 Oct 06 12:54:50.262651 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 739/1468] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Oct 6 12:54:50 2022] POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:54:50.276073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:50.279778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:50.297213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.299734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.300490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.301511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.302218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.303637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.386117 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f33b43b2-af12-440a-8223-b1945cef4de4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.753488 Oct 06 12:54:50.387293 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 730/1469] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Oct 6 12:54:49 2022] POST /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:54:50.407152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:50.411920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:50.428208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.432128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.433719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.434548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.436050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.437157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.810970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:50.826471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6f893f2-5d70-4510-9ac0-36792831b41a tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.561231 Oct 06 12:54:50.828181 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 740/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:50 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:50.837514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:50.838758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:50.864059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.864985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.865530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.866629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.867988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.870336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.907010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:50.918301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ab5d3ff-339e-4be6-8bd1-36728dc4ec6f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.529404 Oct 06 12:54:50.942741 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 731/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:50 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:50.951608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:50.952236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:50.966360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.967281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.967895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:50.968789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:50.969420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:50.970077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.203866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.222879 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-257f01b4-590a-4beb-9b37-350628ed4e4e tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.393215 Oct 06 12:54:51.223564 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 741/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:50 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:51.257821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:51.258524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:51.269970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.270474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.270976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.271644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.272109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.280283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.398653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.419979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3403f82-0ea1-444d-a7b5-dc2f1940e4eb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1313 microversion: 2.1 time: 0.476081 Oct 06 12:54:51.426159 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 732/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:50 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:51.444236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:51.444948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:51.463817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.464234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.464677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.465395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.465939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.466373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.916135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.936667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.938809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.940885 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d3a9269-7f61-47e8-8175-568ccaf93a17 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1844 microversion: 2.32 time: 0.691603 Oct 06 12:54:51.942797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 742/1474] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:51 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1844 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:51.949147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:51.952558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:51.973977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.974546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.974944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.975178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:51.975697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:51.980999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:51.981475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:51.990020 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4eb54b1e-9434-47e7-a489-4f7d01d842dc tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.562156 Oct 06 12:54:52.003268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 733/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:51 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:52.018286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:52.031299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:52.041179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:52.057113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.062725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.063516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:52.066786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.067687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.068420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:52.774928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:52.783206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:52.796208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:52.802782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7c25cc1-0843-4a2b-a373-11406941f849 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.798280 Oct 06 12:54:52.823980 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bef56a05-6576-4518-a34e-0458f5dfb8a7 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1476 microversion: 2.1 time: 0.879704 Oct 06 12:54:52.824473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 734/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:52 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:52.831588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-219046774"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:52.831865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 743/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:51 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1476 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:52.846416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:52.847647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:52.848106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:52.868301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.868806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.873166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:52.873166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.873166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.873166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:52.876037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.876588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.877018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:52.878168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:52.878776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:52.879370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.223092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:53.237899 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7dd9cc8f-0105-47af-9ce3-41a5025c9350 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1463 microversion: 2.1 time: 0.404574 Oct 06 12:54:53.238573 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 744/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:52 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1463 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:53.249936 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e5ec7c4-3e4a-4829-98e4-f3bb48d5400a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action" status: 202 len: 0 microversion: 2.1 time: 0.423507 Oct 06 12:54:53.259234 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 735/1479] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:54:52 2022] POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:54:53.265036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "a9f95510-a50f-4321-aeb1-72abd000876f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:53.272816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:53.277049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:53.283485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.284006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.284517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.295458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.295973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.296424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.297164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.297625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.301694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.302335 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] Creating event network-changed:a9f95510-a50f-4321-aeb1-72abd000876f for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:54:53.308122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2b2bee03-0d74-4d41-92b2-8dcdd9fe8a16 req-ed639c46-295e-45b4-bdc1-a2199c2025f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047021 Oct 06 12:54:53.311618 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 736/1480] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:53.322278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-318504151"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:53.325170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:53.334279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.335287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.336228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.337146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.337852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.338335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.380881 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Cannot 'createImage' instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c while it is in task_state image_snapshot_pending Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action HTTP/1.1 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 84 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:54:53.383461 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-318504151"}} Oct 06 12:54:53.386065 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'createImage' instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c while it is in task_state image_snapshot_pending Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-318504151'}}} Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:54:53.387546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c while it is in task_state image_snapshot_pending Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c while it is in task_state image_snapshot_pending Oct 06 12:54:53.391459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:54:53.395699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 409 to user: Cannot 'createImage' instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c while it is in task_state image_snapshot_pending {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:54:53.395699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8bad05f6-6fb8-47fa-8b00-4342926feb65 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action" status: 409 len: 167 microversion: 2.1 time: 0.071895 Oct 06 12:54:53.396696 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 737/1481] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:54:53 2022] POST /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c/action => generated 167 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:54:53.594786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:53.604890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:53.606858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:53.608340 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fb0a9fc-4fc6-40a7-8d2f-aa2a1a0ed12c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1844 microversion: 2.32 time: 0.351699 Oct 06 12:54:53.612213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 745/1482] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:53 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1844 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:53.634398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14526931-5736-433d-9764-66732f7bf9b4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3f74ca60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:53.681341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:53.687199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'deleted': False, 'project_id': 'f9e8d2efd8324a44b48eb6fad5e57f62'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:54:53.694164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.694666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.695105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.695917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.696396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.696835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.737592 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36a34fc8-f8ae-438e-8580-362c9133cda1 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.338479 Oct 06 12:54:53.738939 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 738/1483] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 12:54:53 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:54:53.764965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:53.774538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'deleted': False} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:54:53.783524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.785618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.787122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.788176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.789345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.789976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.926241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14526931-5736-433d-9764-66732f7bf9b4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/images/0f722dde-4d80-42d0-804d-fb73e7b0b54a" status: 204 len: 0 microversion: 2.1 time: 0.312451 Oct 06 12:54:53.928490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 746/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:53 2022] DELETE /compute/v2.1/images/0f722dde-4d80-42d0-804d-fb73e7b0b54a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:54:53.934574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:53.935396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:53.972651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.974657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.977517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:53.979008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:53.987087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:53.988736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:54.072581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:54:54.210908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:54.211710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:54.212334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:54.515971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:54.530490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d51c42fc-d4c5-4fac-8251-41479180fa90 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.600042 Oct 06 12:54:54.546052 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 747/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:53 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:54.546052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:54.547359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:54.556138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:54.557134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:54.557595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:54.558557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:54.560074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:54.560660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:55.182478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:55.204260 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51d2125f-70db-4360-8672-e1969683096c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1475 microversion: 2.1 time: 0.662145 Oct 06 12:54:55.208261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 748/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:54 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1475 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:55.218973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:55.221071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:55.232612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:55.233685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:55.234891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:55.236793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:55.238626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:55.239373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.171546 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-050a1973-892d-46d9-b642-95554badf09a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 28076 microversion: 2.1 time: 2.408582 Oct 06 12:54:56.172364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 739/1487] 10.222.0.26 () {58 vars in 1171 bytes} [Thu Oct 6 12:54:53 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 28076 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 12:54:56.177102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:56.190610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a944a254-3dd2-4138-ae96-ef2a246cf5ee tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1532 microversion: 2.1 time: 0.980331 Oct 06 12:54:56.196678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 749/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:55 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1532 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:56.208468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:56.208719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:56.209235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:56.227431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:56.236726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.237137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.237512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.237657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.238106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.238253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.238849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.239277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.239439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.239734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.240134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.240753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.293329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:54:56.843152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:56.859593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:56.867080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:56.868784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73d8069e-5249-44f2-abea-ea1eda026a47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1865 microversion: 2.32 time: 0.677570 Oct 06 12:54:56.871163 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 740/1489] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:56 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1865 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:56.877174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:56.884221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:56.899357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.901552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.903170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.905335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:56.908235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:56.909130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:56.994098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:57.012831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6e3c408-1088-4ba2-8a71-87518e87aad8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.812628 Oct 06 12:54:57.015883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 750/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:56 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:57.032362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:57.049828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'deleted': False, 'project_id': 'f9e8d2efd8324a44b48eb6fad5e57f62'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:54:57.067358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.068878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.071943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.073162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.075187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.078419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.358075 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dce9363e-aaf0-4206-ac3f-ed87a0a070ed tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=68a6ecb1c7944a8cba67fb219e2b9f83" status: 200 len: 15 microversion: 2.1 time: 0.330987 Oct 06 12:54:57.375702 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 751/1491] 10.222.0.26 () {58 vars in 1231 bytes} [Thu Oct 6 12:54:57 2022] GET /compute/v2.1/servers/detail?tenant_id=68a6ecb1c7944a8cba67fb219e2b9f83 => generated 15 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:54:57.387321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-unplugged", "status": "completed", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:57.398624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:57.413618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.414557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.415363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.425940 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec656566-270e-49fd-98b6-87e8167723ae tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1475 microversion: 2.1 time: 0.551268 Oct 06 12:54:57.452151 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 741/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:56 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1475 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:57.458118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Creating event network-vif-unplugged:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h2-860556-1 Oct 06 12:54:57.473801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:54:57.478983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:57.479629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:57.487610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5f008577-dc01-41de-b93c-4f45cf81df84 req-ea9c1900-9745-46ca-a695-dab73956c4ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110513 Oct 06 12:54:57.488376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 752/1493] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:54:57.499616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:57.505212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.506875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'tenant_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'deleted': False} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:54:57.510028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.510517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.513017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.513781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.515132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.516163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.516288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.516819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.517326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.517693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.519019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:57.584761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:54:57.748947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:57.749455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:57.749901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:58.128719 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8f8ed33-6d26-4d28-a00d-28655225e868 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=68a6ecb1c7944a8cba67fb219e2b9f83" status: 200 len: 4825 microversion: 2.1 time: 0.635431 Oct 06 12:54:58.128719 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 753/1494] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 12:54:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=68a6ecb1c7944a8cba67fb219e2b9f83 => generated 4825 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:58.131599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:58.132344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:58.161711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:58.162311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:58.162726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:58.163659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:58.164304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:58.164748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:58.319163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:58.329341 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f75a0524-1809-4c14-82d2-3b39a03164e2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1533 microversion: 2.1 time: 0.875642 Oct 06 12:54:58.330514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 742/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:57 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1533 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:58.353147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:58.354218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:58.369434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:58.371430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:58.372068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:58.373025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:58.373690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:58.374407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.148928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:59.152646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:59.164297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:59.166282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-afc9d470-f62a-42fc-ad61-399e1fdae10e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.817136 Oct 06 12:54:59.172712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:59.174321 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49d7a632-20e2-4700-a43e-3978483ed49a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1865 microversion: 2.32 time: 1.046490 Oct 06 12:54:59.177879 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 754/1496] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:54:58 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1865 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:54:59.182719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:59.188400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 743/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:58 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:59.195258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'tenant_id': 'f9e8d2efd8324a44b48eb6fad5e57f62', 'deleted': False} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:54:59.208764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:59.210105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:59.211932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.218593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.219354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.220913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.221558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.222156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.222387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.223225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.225364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.229763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.230576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.231625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.289346 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ab916a3-53e5-422d-a413-62ed9eafca43 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f9e8d2efd8324a44b48eb6fad5e57f62" status: 200 len: 15 microversion: 2.1 time: 0.110099 Oct 06 12:54:59.318791 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 755/1498] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 12:54:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f9e8d2efd8324a44b48eb6fad5e57f62 => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:54:59.326035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35238919-c95b-4e3e-b494-6dbe40a14a1c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:59.342881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35238919-c95b-4e3e-b494-6dbe40a14a1c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012237 Oct 06 12:54:59.343444 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 756/1499] 10.222.0.26 () {58 vars in 1189 bytes} [Thu Oct 6 12:54:59 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:54:59.358908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:54:59.359528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:59.377455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.389072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.389657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.390484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.390965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.391501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.843098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:54:59.864141 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1dc03b4-c615-4203-aef9-85ef4bac2d92 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1520 microversion: 2.1 time: 0.509912 Oct 06 12:54:59.865183 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 757/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:59 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:54:59.887070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:54:59.897468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:54:59.916542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.920893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.922115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.928905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:54:59.930239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:54:59.935239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:54:59.996566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:00.010045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7e03f92-6ff6-4011-a169-36b3a62b83db tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1475 microversion: 2.1 time: 0.819473 Oct 06 12:55:00.011942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 744/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:54:59 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1475 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:00.019372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "5b42104a-a9d6-4bbd-a480-a2d2a849b73c"}, {"name": "network-changed", "server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:00.051962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.052439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.052872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.090615 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Creating event network-changed:5b42104a-a9d6-4bbd-a480-a2d2a849b73c for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:00.091436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Creating event network-changed:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h2-860556-1 Oct 06 12:55:00.105291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:55:00.131844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-926a751a-e602-4e10-bf5a-91d30443881f req-ae8f5c62-12fb-499f-8dc7-dfb96e149a66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.116152 Oct 06 12:55:00.136832 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 745/1502] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:00.149537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:00.156374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:00.178299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.178847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.179293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.180041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.186562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.187311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.188997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a2821d1-61cb-4c76-86ff-b980c50ead8f tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 0 microversion: 2.1 time: 0.320391 Oct 06 12:55:00.192869 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 758/1503] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:54:59 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:00.201005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff81df07-d7ab-4b15-ae79-c1ad5e17a79c", "name": "network-vif-plugged", "status": "completed", "tag": "087741d8-83a4-412e-9637-dc4470a8bdd5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:00.231980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.232472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.232911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.245729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:00.273371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] Creating event network-vif-plugged:087741d8-83a4-412e-9637-dc4470a8bdd5 for instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c on n-h1-860556-1 Oct 06 12:55:00.291769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6ad3ba9b-2bb3-4849-919d-51b31a148d17 req-53fe4c23-f2e0-4e32-b2a5-b124ae07e1c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097526 Oct 06 12:55:00.292385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 759/1504] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:00.308650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:00.322644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:00.332063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.333282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.334376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.347381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.348489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.349273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.426163 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2f9bc3a-fff4-44bb-89e8-c6e6f9419112 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 204 len: 0 microversion: 2.1 time: 0.287390 Oct 06 12:55:00.426766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 746/1505] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:00 2022] DELETE /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:00.432060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:00.440131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:00.441088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:55:00.458949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.459197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.459462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.460178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.460628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.461046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.658339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:55:00.787483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f682c847-b2a1-40a9-911f-50e9071a8391 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.359434 Oct 06 12:55:00.788336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 747/1506] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Oct 6 12:55:00 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:00.803531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:00.804565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:00.819055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.819802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.820436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:00.821336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:00.821995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:00.825671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:01.150951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:01.170944 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16805282-a4fc-4055-9ffb-59f296289b9a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.877255 Oct 06 12:55:01.172085 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 760/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:00 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:01.185168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:01.186128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:01.200536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:01.210107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:01.211482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:01.212734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:01.213316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:01.213785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.315531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:02.351084 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67805089-91e3-405e-b8f1-390ed476fc87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 200 len: 1526 microversion: 2.1 time: 1.172821 Oct 06 12:55:02.353608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 761/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:01 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 1526 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:02.361132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:02.389104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:02.423755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.424327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.424782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.425516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.426055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.426474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.633296 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47366083-383d-4506-99e1-f4ef6f34f954 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 0 microversion: 2.1 time: 0.277965 Oct 06 12:55:02.637047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 762/1509] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:02 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:02.641832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:02.642656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:02.666282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.667071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.667425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.668177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.668638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.672541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.698725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:02.717312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:02.719946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:02.725331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0de0e55d-08f3-4668-9b02-47dc8f0460a4 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1886 microversion: 2.32 time: 1.925711 Oct 06 12:55:02.726372 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 748/1510] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:00 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1886 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:02.746443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:02.748718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:02.772478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.776981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.778380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.782185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:02.783719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:02.784755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:02.800107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:03.451985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:03.464593 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-354a2b1b-0f98-479b-a169-cdd04c4ff4ad tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1473 microversion: 2.1 time: 0.827987 Oct 06 12:55:03.468014 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 763/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:02 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1473 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:03.668308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:03.683352 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67f06265-6463-46dd-9a09-273e8e01d0dd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.954797 Oct 06 12:55:03.683971 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 749/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:02 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:03.695741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:03.696507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:03.722307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:03.726135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:03.726857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:03.727788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:03.729100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:03.731530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:03.762463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f740d9e2-540b-4bf3-9680-1f9fa584be2d tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Action: 'create', calling method: .version_select at 0x7f7d3f4628b0>, body: {"pool": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:04.196015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:04.406838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30d79682-1335-48b8-990f-9b3724016897 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1615 microversion: 2.1 time: 0.716431 Oct 06 12:55:04.419378 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 750/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:03 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1615 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:04.440068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "67d910f1-0ac2-4e36-a881-ca9fdb8b28f8"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:04.470965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.475007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.475499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:04.511079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] Creating event network-changed:67d910f1-0ac2-4e36-a881-ca9fdb8b28f8 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:04.518297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e115ced9-dd00-4a79-8df2-d7a2b83a139e req-79c8140f-009f-4260-ad9a-23bd5b0b1c07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097337 Oct 06 12:55:04.520615 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 751/1514] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:04.528903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff81df07-d7ab-4b15-ae79-c1ad5e17a79c", "name": "network-vif-deleted", "tag": "087741d8-83a4-412e-9637-dc4470a8bdd5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:04.540416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.541479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.542122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:04.556498 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] Creating event network-vif-deleted:087741d8-83a4-412e-9637-dc4470a8bdd5 for instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c on n-h1-860556-1 Oct 06 12:55:04.569314 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-72dbe21b-cb57-4963-b28c-b8cb95ad6cc4 req-6948c5f1-e8b9-4bf0-8a31-ad76b69d9917 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046445 Oct 06 12:55:04.570732 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 752/1515] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:04.576531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:04.584793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:04.600610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.601448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.602207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:04.605900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.608096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.611331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:04.644366 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c HTTP/1.1 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:55:04.650529 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:55:04.653354 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c'} Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:04.654443 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:55:04.656171 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:04.659773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:04.661019 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23ed49e9-2da4-4270-9e88-8607cdebc8bf tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 404 len: 111 microversion: 2.1 time: 0.088809 Oct 06 12:55:04.662811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 753/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:04 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:55:04.668825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:04.670440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:04.678726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.679474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.680086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:04.681492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:04.682263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:04.682890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:05.487140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:05.508673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:05.513537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:05.517796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6aaac25f-4e5e-42b8-b923-0bf71fca4662 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1886 microversion: 2.32 time: 0.851580 Oct 06 12:55:05.519010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 754/1517] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:04 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1886 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:05.541770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:05.548852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:05.571738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:05.572601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:05.574368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:05.578525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:05.580946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:05.581580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:06.208171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e3b7837-9738-45ae-846f-b49910d05f5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1615 microversion: 2.1 time: 0.686105 Oct 06 12:55:06.210107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 755/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:05 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1615 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:06.224328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:06.226919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:06.248026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:06.250366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:06.252035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:06.258379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:06.259139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:06.259839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:06.763575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:06.774370 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d838ae4-2523-414a-b703-0b1899e0ee83 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1470 microversion: 2.1 time: 0.562119 Oct 06 12:55:06.774982 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 756/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:06 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1470 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:06.812778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16e5cb2f-5198-405a-b5c7-d5f1d062652f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'create', calling method: .version_select at 0x7f7d3f00daf0>, body: {"keypair": {"name": "tempest-keypair-262737026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXNl4XOpuOy39s67pGK02iYJbrIVX10tTpDIcetK1FD7+tgMgVtmT3HXzOLQ9xurGFSfk/O2A8QI6UKNHJuQeTLTsLjeHrrMx15cMZVBxluz4grRpibWsTUli6wciQDJA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:06.885760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-16e5cb2f-5198-405a-b5c7-d5f1d062652f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:55:06.895860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-16e5cb2f-5198-405a-b5c7-d5f1d062652f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for user 07b0c27e7810471cbb372142ad98f650 and project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:55:06.947135 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16e5cb2f-5198-405a-b5c7-d5f1d062652f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147026 Oct 06 12:55:06.948555 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 757/1520] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:55:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:06.955531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:06.956558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:06.977570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:06.978593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:06.981854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:06.983198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:06.984866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:06.986777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:07.582705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:07.594687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-650450cc-6b4e-401e-8d0a-4fb15fc208ba tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.644559 Oct 06 12:55:07.598997 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 758/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:06 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:07.613984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:07.629727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'host': 'n-h2-860556-1', 'deleted': False} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:55:07.638260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:07.638757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:07.639284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:07.640119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:07.640580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:07.641145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:07.713697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:07.833507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 12:55:07.911892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca7b9904-9c45-4b18-b946-586b12630b9a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=n-h2-860556-1&all_tenants=1" status: 200 len: 2942 microversion: 2.1 time: 0.311437 Oct 06 12:55:07.912815 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 759/1522] 10.222.0.26 () {58 vars in 1190 bytes} [Thu Oct 6 12:55:07 2022] GET /compute/v2.1/servers?host=n-h2-860556-1&all_tenants=1 => generated 2942 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:07.917963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:07.918807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:07.925832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:07.926616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:07.927233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:07.928128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:07.928757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:07.929355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:08.988109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:08.999037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:09.001018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:09.002588 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2701474-6fad-4ad0-a8f1-b24f71946568 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1886 microversion: 2.32 time: 1.088491 Oct 06 12:55:09.003807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 760/1523] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:07 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1886 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:09.009454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "ead8573b-ee9e-4abc-ac2c-a162f275fe79"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:09.024338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.025177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.025909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.039813 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] Creating event network-changed:ead8573b-ee9e-4abc-ac2c-a162f275fe79 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:09.045324 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ea4e7d42-1e86-4f1d-8e3b-71fa7e1a256c req-cf83ea9c-8014-443f-b9e5-60171c3b1865 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039953 Oct 06 12:55:09.046922 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 761/1524] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:09.063028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:09.063307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:09.073887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.074404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.074913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.075660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.076134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.076996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.134525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f740d9e2-540b-4bf3-9680-1f9fa584be2d tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.664043 Oct 06 12:55:09.136906 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 764/1525] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:55:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:09.152900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:09.185424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 12:55:09.200162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.201292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.202119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.205680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.210464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.210937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.294469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ecda05c-169d-4243-878e-09570a87d521 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "POST /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581/action" status: 202 len: 0 microversion: 2.1 time: 0.245693 Oct 06 12:55:09.295528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 762/1526] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:09 2022] POST /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:09.302165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:09.303520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:09.310871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.312114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.312791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.316178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.317035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.317804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.341601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8305b0dc-393b-47dc-b13c-7425298efb71 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.202967 Oct 06 12:55:09.342854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 765/1527] 10.222.0.26 () {58 vars in 1196 bytes} [Thu Oct 6 12:55:09 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:55:09.347840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-plugged", "status": "completed", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:09.361431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:09.362119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:09.362671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:09.376855 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Creating event network-vif-plugged:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h2-860556-1 Oct 06 12:55:09.387917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:55:09.413237 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e36cc725-5f9b-458b-9fd3-1929f7a6f154 req-d68ffd49-53bf-47b0-abe9-856c1b4e7318 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069010 Oct 06 12:55:09.414914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 766/1528] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:09.421853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ab82b3d-bc9a-4b7c-93eb-0dfdedc0135d tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Action: 'create', calling method: .version_select at 0x7f7d3f7da790>, body: {"pool": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:09.969527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:09.995679 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63a30d5a-1ce4-4416-8502-97ac7b6e5894 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.698039 Oct 06 12:55:09.997964 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 763/1529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:09 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:10.010955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:10.012333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:10.027853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:10.028907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:10.029967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:10.031868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:10.033339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:10.034137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:10.952618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:10.962287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d99079bc-8f2c-4922-aee7-0908533f87f4 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.962378 Oct 06 12:55:10.964080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 764/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:09 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:10.969131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:10.971621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:10.978704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:10.979327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:10.980262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:10.980676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:10.981223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:10.981838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:11.089566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:11.098461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-940829f3-3592-4d14-961a-191f98cc4d5a tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 0 microversion: 2.1 time: 0.133255 Oct 06 12:55:11.099416 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 765/1531] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:10 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:11.107509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:11.108396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:11.117357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:11.117903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:11.118537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:11.119442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:11.120149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:11.120794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.105960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:12.117018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:12.118604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:12.119761 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8255a85-32b9-49ae-a3b4-3be6a3666f15 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1886 microversion: 2.32 time: 1.018528 Oct 06 12:55:12.120701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 766/1532] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:11 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1886 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:12.125261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:12.125926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:12.133150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.133639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.134111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.134817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.135732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.135732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.571599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:12.581273 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-265f0518-f50f-4c23-840a-e3466d2045ce tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.459562 Oct 06 12:55:12.582466 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 767/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:12 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:12.604991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "dfe7bc37-ef26-4199-bf89-cfd34b50c2a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:12.618784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.619271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.619904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.634946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] Creating event network-changed:dfe7bc37-ef26-4199-bf89-cfd34b50c2a9 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:12.642031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-68c4b178-daa5-487f-95c5-523b0da53652 req-277bb31e-80e6-49f5-887f-76857bfa2ff7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044782 Oct 06 12:55:12.643474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 768/1534] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:12.662476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:12.665305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:12.691492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.691937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.692381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.693138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.693600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.694063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.822321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:12.822748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:12.823229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:12.823807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:12.824053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:12.903393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:12.914408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.914987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.915438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.916334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.916806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.917243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.947014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-05e56daa-119a-4cf2-8de9-dff1f6e749d5 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 1068 microversion: 2.1 time: 0.301485 Oct 06 12:55:12.947707 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 769/1535] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:12 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 1068 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 06 12:55:12.953541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:12.954018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:12.960347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:12.962399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.962627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.963371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:12.963807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:12.964776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:12.965092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:13.373400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:13.381305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc7ab878-90f1-4cc1-97c5-369d768069a2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.432387 Oct 06 12:55:13.382810 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 770/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:12 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:13.388483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1551674694", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:13.457005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] validate_networks() for [('5419d21e-2a7d-4337-845b-dcdc25ebc04e', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:55:13.900754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ab82b3d-bc9a-4b7c-93eb-0dfdedc0135d tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.484123 Oct 06 12:55:13.901368 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 767/1537] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:55:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:13.906313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:13.907056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:13.911956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=70 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:13.917969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:13.918466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:13.918909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:13.919624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:13.920082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:13.920514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.239487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:14.253186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b11893a3-64d1-4ba6-9f2a-a5efda3472e4 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 2422 microversion: 2.25 time: 0.350633 Oct 06 12:55:14.253977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 768/1538] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:13 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 2422 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:14.276392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:14.276392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:14.282470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.283483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.283923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.284640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.285297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.285727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.305627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:14.540494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:14.541631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:14.542435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:14.542971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:14.543600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:14.555464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.555980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.556416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.557297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.558007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.558435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.566259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=11 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:14.575734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:14.587027 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-117d7ea7-ea35-496c-b8fa-f26df267ea4b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1472 microversion: 2.1 time: 0.315668 Oct 06 12:55:14.588835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:55:14.588978 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 769/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:14 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:14.595700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:14.595969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for user 07b0c27e7810471cbb372142ad98f650 and project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:55:14.596992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:14.605912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.607545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.608242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.611424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:55:14.611665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.612486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.613661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.622636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:55:14.697200 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-919edeee-cfb2-4cff-998e-e6491e5d94c2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.313523 Oct 06 12:55:14.698166 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 771/1540] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:55:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:55:14.702534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:14.703146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:14.709899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.710173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.710553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:14.711261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:14.712088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:14.712239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:15.083592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:15.095906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:15.097929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:15.099508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-990a0004-9416-42d5-a97c-fee1e63c0dbb tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.508756 Oct 06 12:55:15.100240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 770/1541] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:14 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:15.105213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f2f1013-fc1d-4c21-813d-92ca32a9ca9b tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Action: 'create', calling method: .version_select at 0x7f7d3f78da60>, body: {"pool": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:15.133630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:15.145262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8f2ce1d-d343-4b0f-80e6-bbbb5fb7b699 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.445666 Oct 06 12:55:15.159323 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 772/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:14 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:15.159323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": "auto"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:15.161535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:15.170387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:15.171200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:15.171834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:15.172895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:15.174456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:15.174757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:15.207307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'flavor' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:15.221165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Going to try to live migrate instance to n-h1-860556-1 {{(pid=129615) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:55:17.647886 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22376904-4a1d-4bbb-811d-26e37bba345a tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/action" status: 202 len: 0 microversion: 2.25 time: 2.497340 Oct 06 12:55:17.649563 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 773/1543] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:55:15 2022] POST /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/action => generated 0 bytes in 2503 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:17.655442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:17.656540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:17.670676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:17.672335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:17.673536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:17.674654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:17.680802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:17.681716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:18.268999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:18.281109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0407f9d-ac94-4a66-b9db-e809d7b20539 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.630226 Oct 06 12:55:18.283153 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 774/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:17 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:18.292774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "a77b907c-6855-4a94-847a-ac82a0df06de"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:18.309667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:18.310536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:18.311239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:18.324226 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] Creating event network-changed:a77b907c-6855-4a94-847a-ac82a0df06de for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:18.330594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8c2d193b-8865-4078-a0dd-1bd5e0a9568d req-7361b7c4-8c65-4479-9e03-e91714e98003 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044307 Oct 06 12:55:18.332515 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 775/1545] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:18.339364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:18.340242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:18.347898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:18.348812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:18.349486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:18.350398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:18.350959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:18.351487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.168930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:19.200317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf82c75f-3eab-4bdb-bb0f-fe5edb380c35 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1325 microversion: 2.1 time: 0.866280 Oct 06 12:55:19.219408 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 776/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:18 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:19.225355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:19.226397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:19.236194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.237063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.237757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.238705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.239401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.240181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.258985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:19.268431 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f2f1013-fc1d-4c21-813d-92ca32a9ca9b tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.166926 Oct 06 12:55:19.277720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 771/1547] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:55:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:19.284030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:19.288361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:19.304550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.305420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.308310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.310572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.324220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.328305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.796315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:19.816839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc637486-77c0-4ffe-979e-f4cd0935d6a6 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1472 microversion: 2.1 time: 0.595194 Oct 06 12:55:19.817803 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 777/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:19 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1472 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:19.836190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:19.839182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:19.839797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:19.848872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.849361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.849809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.850526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.850977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.851412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.854297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:19.857428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:19.859320 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81a3f0e8-17b3-45e7-9832-d4f030897112 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.580220 Oct 06 12:55:19.861061 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 772/1549] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:19 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:19.878463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:19.879472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:19.886674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.887498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.888095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:19.888939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:19.889501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:19.890067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.160141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.164498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.169325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4bcdf2de-4f91-4076-8663-76ab079e0d07 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.334223 Oct 06 12:55:20.170581 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 778/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:19 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:20.175127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.176611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cea416a-4bfa-44c9-bd05-0e1dcb86d793", "tag": "c2bfb0e9-3222-40d4-85b2-7d3e74df5e66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:20.176848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.178566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f104a33-7315-43b6-b7d1-1d5bc9f145b9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.315754 Oct 06 12:55:20.180241 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 773/1551] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:19 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:20.185233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-609b75d0-30fd-485b-a550-129576c3dbee tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Action: 'create', calling method: .version_select at 0x7f7d3f09e4c0>, body: {"pool": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:20.186025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.186515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.186952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.200691 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] Creating event network-changed:c2bfb0e9-3222-40d4-85b2-7d3e74df5e66 for instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 on n-h1-860556-1 Oct 06 12:55:20.206526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8d284e61-e703-4584-a247-2499d00713fa req-f5074496-2156-4871-a9c1-03ab9e259501 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034313 Oct 06 12:55:20.207373 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 779/1552] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:20.217286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:20.219333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:20.225727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.226287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.226730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.227440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.227900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.228328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.431099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.440825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab16a012-23c2-4658-b8b8-22f385628117 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.227694 Oct 06 12:55:20.441476 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 780/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:20 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:20.446529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:20.447147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:20.453516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.454996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.455642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.456538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.457176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.457801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.462876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:20.687533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:20.696798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b827be3b-a1e2-4503-b0ee-dca7e9ef3353 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1325 microversion: 2.1 time: 0.253935 Oct 06 12:55:20.697776 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 781/1554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:20 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1325 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:20.702871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "687ed948-038f-4ab0-85a5-1637f4781814"}, {"server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}, {"name": "network-changed", "server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}, {"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-unplugged", "status": "completed", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}, {"name": "network-changed", "server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:20.716416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.716899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.717333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.732528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Creating event network-changed:687ed948-038f-4ab0-85a5-1637f4781814 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:20.733064 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Creating event network-vif-unplugged:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h1-860556-1 Oct 06 12:55:20.733785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Creating event network-changed:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h1-860556-1 Oct 06 12:55:20.734461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Creating event network-vif-unplugged:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:55:20.734971 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Creating event network-changed:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:55:20.741655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 12:55:20.768969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5e61756b-8291-41b9-8bce-a0b786cb7f79 req-806b1183-66ae-43ac-b17e-4e706a343b88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.069720 Oct 06 12:55:20.769838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 782/1555] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:20.844700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:20.845772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:20.857341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.857877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.858328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:20.859065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:20.859532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:20.859970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:21.447207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:21.460766 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43ec21ed-8fd5-4010-9ea7-1fff244e5cad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1472 microversion: 2.1 time: 0.620109 Oct 06 12:55:21.463172 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 783/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:20 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:21.469511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:21.470911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:21.479216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:21.480048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:21.480694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:21.482589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:21.483680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:21.484326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:22.106534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:22.119155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:22.122055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:22.123696 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84f67ec2-50e7-46cb-93e2-6ffa0fa631cc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.659139 Oct 06 12:55:22.124666 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 784/1557] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:21 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:22.132672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:22.133795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:22.142837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:22.143727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:22.144408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:22.145384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:22.146421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:22.147122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.055229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:23.069670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f0dc3f2-9f2e-4a15-9266-89926d1f021c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.943457 Oct 06 12:55:23.070877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 785/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:22 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:23.075921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:23.076809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:23.085810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.086953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.087775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.089382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.090358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.091247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.528900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:23.539732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:23.541550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:23.542812 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9728c191-fc8a-41c2-a006-241bf1adbc9a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.470816 Oct 06 12:55:23.543543 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 786/1559] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:23 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:23.548503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:23.549314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:23.556483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.557326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.558037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.558960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.559602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.560203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.797514 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-609b75d0-30fd-485b-a550-129576c3dbee tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.615340 Oct 06 12:55:23.818693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 774/1560] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 12:55:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:23.827964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:23.832885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:23.833556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:23.841792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.842256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.842692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.846235 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1889d30b-a721-4081-9aa1-6cd64483db42 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.301618 Oct 06 12:55:23.847253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.849109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.849567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.853837 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 787/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:23 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:23.860675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:23.861292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:23.870835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.871376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.871918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:23.873715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:23.874330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:23.875001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.088771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.100362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd4ec285-9d5e-4d93-a637-f2d4ab53f273 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1325 microversion: 2.1 time: 0.279559 Oct 06 12:55:24.116538 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 775/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:23 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:24.116954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.116954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-845d949a-76a6-493b-9013-380cf8932202 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1472 microversion: 2.1 time: 0.259469 Oct 06 12:55:24.116954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 788/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:23 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:24.122468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:24.127010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:24.129196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d6eca57-498d-440a-a21b-15ff09008b59 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3ee6cd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:24.141257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.142716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.143414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.144172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.144654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.145096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.449495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d6eca57-498d-440a-a21b-15ff09008b59 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/86b4fc20-2212-4505-b301-775b7f9e60fa" status: 200 len: 142 microversion: 2.1 time: 0.333090 Oct 06 12:55:24.450295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 789/1564] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 12:55:24 2022] GET /compute/v2.1/os-floating-ips/86b4fc20-2212-4505-b301-775b7f9e60fa => generated 142 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:24.455798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:24.456527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:24.462044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.463425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.464046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.464581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.465561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.466349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.467007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.473497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.475205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.476583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b096b6b5-4fba-48f9-90da-24a3d93673ad tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.367484 Oct 06 12:55:24.477338 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 776/1565] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:24 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:24.494052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a84431da-29da-4ab5-a27b-a551085600b0 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3f18f5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:24.578875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:24.603470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:24.748368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:24.778396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f5b7c5a-1992-4533-ae81-2e02a60e6b6d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.326097 Oct 06 12:55:24.797441 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 790/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:24 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:24.804824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:24.805980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:24.819182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.821068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.822003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:24.823234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:24.823961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:24.824725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.189903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:25.199266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:25.201084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:25.202402 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38015920-39dc-4ef3-8016-59bd8255f3be tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.403680 Oct 06 12:55:25.217779 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 791/1567] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:24 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:25.217779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:25.217779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:25.217779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.217779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.218389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.218389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.218389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.218389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.524659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:25.534094 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6d9cb6d-c6ed-4c3f-8604-9138b688694e tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1469 microversion: 2.1 time: 0.329653 Oct 06 12:55:25.535081 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 792/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:25 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1469 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:25.540197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:25.540956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:25.547748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.549092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.549608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.550457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.551007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.551500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.927823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:25.937469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cafb3417-efc5-490e-8972-d3a74eb7907d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1325 microversion: 2.1 time: 0.400860 Oct 06 12:55:25.943157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a84431da-29da-4ab5-a27b-a551085600b0 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/86b4fc20-2212-4505-b301-775b7f9e60fa" status: 202 len: 0 microversion: 2.1 time: 1.457501 Oct 06 12:55:25.944531 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 777/1569] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:55:24 2022] DELETE /compute/v2.1/os-floating-ips/86b4fc20-2212-4505-b301-775b7f9e60fa => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:25.950690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 793/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:25 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1325 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:25.958826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:25.960890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:25.961578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:25.962346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:25.968914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.969563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.970252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.971298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.971882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.972922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.978819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.979595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.980244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:25.981924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:25.982574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:25.983254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:26.347619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:26.356901 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bff65f05-ffc4-40e0-a241-764f08fcd013 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1472 microversion: 2.1 time: 0.411027 Oct 06 12:55:26.357773 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 778/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:25 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:26.362753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:26.363537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:26.369881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:26.370695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:26.371203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:26.372079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:26.372609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:26.373112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:26.374687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:26.385574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:26.387086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:26.388552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-980fe122-3ca9-4df8-ae01-470a10308d30 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.436654 Oct 06 12:55:26.389307 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 794/1572] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:25 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:26.394594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cea416a-4bfa-44c9-bd05-0e1dcb86d793", "name": "network-vif-plugged", "status": "completed", "tag": "c2bfb0e9-3222-40d4-85b2-7d3e74df5e66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:26.412880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:26.413552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:26.414114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:26.428749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] Creating event network-vif-plugged:c2bfb0e9-3222-40d4-85b2-7d3e74df5e66 for instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 on n-h1-860556-1 Oct 06 12:55:26.434970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b28b8785-5e9c-4636-acd3-ff294e2e7842 req-12af525e-17e8-4caa-a0f8-c1632d03220a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044170 Oct 06 12:55:26.435807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 795/1573] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:26.446311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3ba9551-e434-4d3f-a0a3-f37ff16f287f tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3ee6c1f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.223196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.232615 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3ba9551-e434-4d3f-a0a3-f37ff16f287f tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.790656 Oct 06 12:55:27.238956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 796/1574] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Oct 6 12:55:26 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:55:27.240491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.241428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:27.247318 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39695eb7-f440-4b81-9f72-e9d762d0db91 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.885220 Oct 06 12:55:27.261776 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 779/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:26 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:27.262044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.262044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.262044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.262044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.262443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.262443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.262645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.262645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:27.262645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.263145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.264080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.265023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.265673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.266631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.471649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.475441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.480786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.482266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.483498 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d890644e-c9fe-497c-b8d8-fda4d3ff9f9f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.248332 Oct 06 12:55:27.483633 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-035e3eeb-4daa-4c22-82cc-0cb328b4d43c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1462 microversion: 2.1 time: 0.234383 Oct 06 12:55:27.484074 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 797/1576] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:27.486098 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 780/1577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1462 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:27.489664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.490320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:27.491773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-074a7f62-8580-4405-aabe-e4631f111877 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3f33d310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.497029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.497538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.498006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.498722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.499235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.499857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.826832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-074a7f62-8580-4405-aabe-e4631f111877 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.339180 Oct 06 12:55:27.828239 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 781/1578] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:27.835056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.835728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:27.836432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:27.844379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e0931ac-1e87-4c51-beca-ed73b53109a2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1325 microversion: 2.1 time: 0.359220 Oct 06 12:55:27.845066 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 798/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:27.850062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:27.851012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:27.857386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.858284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.858969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.859923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.861041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.861412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.861550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.862026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.862479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:27.862756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:27.863225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:27.863666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:28.141859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:28.146030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:28.154973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52b40fdc-840d-47b2-b149-adb8f1962258 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.324337 Oct 06 12:55:28.155718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:28.157220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:28.158457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a6c84d3-ec9f-44c8-ab61-0b2e1e4b606c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.312093 Oct 06 12:55:28.159255 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 799/1580] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:28.168142 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 782/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:27 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:28.180074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d7e2740-8d5b-4b1d-9352-b259caacbc53 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3f09e9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:28.358928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:28.359817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:28.367554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:28.368311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:28.368925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:28.369857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:28.370507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:28.371104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:28.664254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:28.670133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e2c12c8-56d9-4726-abdf-df13b7583f3b tempest-MigrationsAdminTest-2092995360 tempest-MigrationsAdminTest-2092995360-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1613 microversion: 2.1 time: 0.509891 Oct 06 12:55:28.686183 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 800/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:28 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1613 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:28.706847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:28.707821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:28.715013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:28.715896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:28.716567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:28.717522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:28.718300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:28.718966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.077773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:29.097108 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e2827ea-16fb-4d28-b3da-1a2450a4abbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.408840 Oct 06 12:55:29.112020 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 801/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:28 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:29.125195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:29.125980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:29.139264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.139762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.140201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.140919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.141378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.146059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.473327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:29.482610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:29.484426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:29.485728 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a20b38bb-db51-4f00-999e-c1144403df8d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.372603 Oct 06 12:55:29.486392 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 802/1584] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:29 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:29.491177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:29.492004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:29.499299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.500187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.501511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.502545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.503316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.503991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.543692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:29.665492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21db318e-6225-44aa-89a4-05574c9f7c63 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 204 len: 0 microversion: 2.1 time: 0.177561 Oct 06 12:55:29.666248 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 803/1585] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:29 2022] DELETE /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:29.672076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:29.672805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:29.679421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.679671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.679971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.681206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.681206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.681677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.859034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d7e2740-8d5b-4b1d-9352-b259caacbc53 tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/1755c90a-33fe-4e7a-b066-ae1290da8912" status: 202 len: 0 microversion: 2.1 time: 1.688100 Oct 06 12:55:29.860034 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 783/1586] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:55:28 2022] DELETE /compute/v2.1/os-floating-ips/1755c90a-33fe-4e7a-b066-ae1290da8912 => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:29.869749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:29.870388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:29.877570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.878376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.878945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:29.879557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:29.880008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:29.880447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.048755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.059529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48ddf6f4-f334-4dee-9857-f1a2d13b400b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1521 microversion: 2.1 time: 0.391984 Oct 06 12:55:30.060882 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 804/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:29 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:30.066955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:30.067757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:30.075279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:30.075950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:30.076510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.078513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:30.079508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:30.080252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.256181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.264304 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02f2735c-629a-494e-90b3-51771a2afde2 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.398202 Oct 06 12:55:30.265125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 784/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:29 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:30.285086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:30.285782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:30.291943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:30.292440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:30.292944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.293672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:30.294158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:30.294591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.507916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.524289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.525729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.527063 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8247844-887f-4cd7-916a-805111a7234b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.464916 Oct 06 12:55:30.528041 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 805/1589] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:30 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:30.532771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2f22545-5691-48a3-b18c-fbbfaf04b5cf tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3ee63a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:30.951877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:30.960550 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a7fe0d8-0229-4425-8ee4-949cf56a0e37 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 200 len: 1468 microversion: 2.1 time: 0.679712 Oct 06 12:55:30.961137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 785/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:30 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 1468 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:30.965685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-plugged", "status": "completed", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:30.975532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:30.976050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:30.976456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:30.988600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] Creating event network-vif-plugged:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:55:30.993623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7324d819-322b-43fb-a5f0-9c854ca79ba5 req-a47d272a-319a-467e-95dd-663b26efc4d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Oct 06 12:55:30.994422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 786/1591] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:30.999482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:31.000283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:31.007279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.007768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.008210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:31.008928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.009387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.009843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:31.382698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:31.390722 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2652fb4b-22f3-4091-b18a-781706b839c1 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1521 microversion: 2.1 time: 0.395093 Oct 06 12:55:31.391309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 787/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:30 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:31.396102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:31.396709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:31.405234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.405749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.408833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:31.409626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.410135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.410773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:31.786340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:31.796347 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f64070b-e659-4f19-a551-c46655a1593b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.403723 Oct 06 12:55:31.797095 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 788/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:31 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:31.802984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:31.812901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:31.819991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.820599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.821319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:31.822219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:31.823067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:31.823612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:32.319294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:32.417787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:32.419319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:32.421871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7c7c0f7-f84a-44aa-9166-ca3e6e2c8c7f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.622406 Oct 06 12:55:32.423066 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 789/1594] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:31 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:32.430439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:32.434724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:32.450495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:32.455463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:32.457441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:32.463796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:32.464716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:32.465471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:32.995280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:33.004547 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-177125f5-cd35-4730-b6ba-b5cdc82054d8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.580072 Oct 06 12:55:33.005158 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 790/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:32 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:33.010461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2036084623"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:33.013663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:33.020241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.021080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.021799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.022739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.023521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.024437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.062573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:33.268155 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2f22545-5691-48a3-b18c-fbbfaf04b5cf tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/fe1b859a-5d68-4571-a2bc-4a6ab7b2c272" status: 202 len: 0 microversion: 2.1 time: 2.734187 Oct 06 12:55:33.269851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 806/1596] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:55:30 2022] DELETE /compute/v2.1/os-floating-ips/fe1b859a-5d68-4571-a2bc-4a6ab7b2c272 => generated 0 bytes in 2742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:33.284054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:33.286543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:33.304809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.305616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.306834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.307766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.308413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.309028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.334578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35634e70-6312-4b4e-8973-5bec9e12b037 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793/action" status: 202 len: 0 microversion: 2.1 time: 0.326081 Oct 06 12:55:33.335920 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 791/1597] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:33 2022] POST /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:55:33.345093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:33.346195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:33.358580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.359620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.361223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.365000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.365701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.366270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.388867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] HTTP exception thrown: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Request method failure captured: Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 HTTP/1.1 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7Ztsc7-3LUbPuXtGa-JsK4ItC5mVMD23kUaueOgjaTXmcNmZfxfevvAiXCsYkN942VgzWJH42MUuNJ5R25MlGv1jRS56A5Lc-4gT6gL_5psHS67kXhqNNVVRtS1zg4kkuuT22Bcr5srxPyeJfQhSqMNmBIRvBC1iscxGgHn_oqW64 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:55:33.391978 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b95526d417ea42d2873f54a772da9695", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b95526d417ea42d2873f54a772da9695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}] Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: be2535c026dd41458fd9971e14a19010 Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. Oct 06 12:55:33.393996 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581'} Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:33.395065 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. Oct 06 12:55:33.396768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:33.398352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Returning 404 to user: Instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:33.399063 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a598b35-39a9-4ae7-99c5-ee9c0c8e4548 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581" status: 404 len: 111 microversion: 2.1 time: 0.060192 Oct 06 12:55:33.400431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 792/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:33 2022] GET /compute/v2.1/servers/4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:55:33.405967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581", "name": "network-vif-deleted", "tag": "ca69a463-a707-49cc-b9c2-6dab557fb8df"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:33.421637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.422601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.424222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.440123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] Creating event network-vif-deleted:ca69a463-a707-49cc-b9c2-6dab557fb8df for instance 4e63f3cb-8eb7-4eb9-a7ff-fa6e0cbfb581 on n-h1-860556-1 Oct 06 12:55:33.453259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e5196cc9-3e08-4aa4-83c0-06be3ed62cf7 req-e6eae49b-6d74-422c-b77b-f45cb8e4ce66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051343 Oct 06 12:55:33.457234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 793/1599] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:33.463849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:33.464594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:33.471930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.472483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.472852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:33.473564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:33.474074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:33.474501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.028587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.037902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18436e82-1ada-4bc0-b44d-5ac82be36063 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.579158 Oct 06 12:55:34.038488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 794/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:33 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:34.043073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-unplugged", "status": "completed", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:34.053701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.054222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.054771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.069448 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] Creating event network-vif-unplugged:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:55:34.072474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.074984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7d515c60-451a-41e9-9177-6a8e4a70311e req-740a5d95-3a30-44e2-8090-bcd91b985411 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035221 Oct 06 12:55:34.076194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 795/1601] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:34.081924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-86aa875e-c644-4baf-9597-8314c233795b tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] Calling method '.version_select at 0x7f7d3f33d040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:34.094142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.096929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.098230 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9cd2b03a-52da-4bf9-9910-64b9f154b28e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.825729 Oct 06 12:55:34.099236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 807/1602] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:33 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:34.105885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab7e8be2-e2e9-4262-96a4-df1b8649b4ce tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3f01d5e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:34.254242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab7e8be2-e2e9-4262-96a4-df1b8649b4ce tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076" status: 204 len: 0 microversion: 2.1 time: 0.152962 Oct 06 12:55:34.255154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 808/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:34 2022] DELETE /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:34.260470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:34.261078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:34.269247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.270460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.270460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.271119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.271655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.272136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.302377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:34.383941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a9825671-1325-4f86-ab00-0102164df5cd tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 204 len: 0 microversion: 2.1 time: 0.127085 Oct 06 12:55:34.384536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 809/1604] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:34 2022] DELETE /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:34.389646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:34.390466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:34.393002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:34.399119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.399620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.400079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.400765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.401238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.401642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.814000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.823342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.824895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:34.826194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21ef56bc-81f5-4b26-8a97-b07612a09c87 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.440535 Oct 06 12:55:34.826864 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 810/1605] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:34 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:34.831577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:34.832329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:34.838429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.839026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.839510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:34.840279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:34.840799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:34.841543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.155519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:35.169860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-708a677c-73bb-43ff-9487-559585711917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.341823 Oct 06 12:55:35.170546 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 811/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:34 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:35.175127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-667e66b4-6539-4485-945c-bb5f6d250dab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3ee018b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:35.197590 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-667e66b4-6539-4485-945c-bb5f6d250dab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Image not found. Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-667e66b4-6539-4485-945c-bb5f6d250dab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076 HTTP/1.1 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:55:35.199960 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c4d8d85d-e082-4ec6-9ab5-e23f09291076'} Oct 06 12:55:35.201888 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:55:35.202882 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c4d8d85d-e082-4ec6-9ab5-e23f09291076 Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:55:35.204699 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4d8d85d-e082-4ec6-9ab5-e23f09291076 could not be found. Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:55:35.207063 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:35.208719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-667e66b4-6539-4485-945c-bb5f6d250dab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:35.210079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-667e66b4-6539-4485-945c-bb5f6d250dab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076" status: 404 len: 62 microversion: 2.1 time: 0.029909 Oct 06 12:55:35.210079 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 812/1607] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:35 2022] GET /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:55:35.210079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:35.210079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:35.216478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.216972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.217413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.218152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.218605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.219032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.527710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:35.537250 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d22d74c-242d-47ce-9b27-eea7019f0ad9 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1534 microversion: 2.1 time: 0.334022 Oct 06 12:55:35.537969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 813/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:35 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1534 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:35.542957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:35.543578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:35.545721 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-86aa875e-c644-4baf-9597-8314c233795b tempest-FloatingIPDetailsTestJSON-2024914584 tempest-FloatingIPDetailsTestJSON-2024914584-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/4830b42a-4a11-43aa-a6c9-38beae42678a" status: 202 len: 0 microversion: 2.1 time: 1.467416 Oct 06 12:55:35.550284 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 796/1609] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:55:34 2022] DELETE /compute/v2.1/os-floating-ips/4830b42a-4a11-43aa-a6c9-38beae42678a => generated 0 bytes in 1470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:35.552423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:35.553374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:35.556530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.557041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.557504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.558485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.561033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.561033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.563481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.564212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.564853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:35.566623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:35.567390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:35.567845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.091174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:36.112408 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac1854e0-30e4-43ad-bc1c-2ed9fd3785c4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1717 microversion: 2.1 time: 0.572647 Oct 06 12:55:36.114144 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 814/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:35 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1717 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:36.124845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:36.126864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:36.137674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.138593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.139246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.139992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.140457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.140943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.394819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:36.405135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:36.406735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:36.407913 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e17b97e-3663-4f8e-9f56-047202dfb922 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.859883 Oct 06 12:55:36.408513 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 797/1611] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:35 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:36.412975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}, {"name": "network-changed", "server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:36.423703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.424943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.425234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.445768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Creating event network-vif-unplugged:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h2-860556-1 Oct 06 12:55:36.446345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] Creating event network-changed:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h2-860556-1 Oct 06 12:55:36.453729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c5c8198e-a7f3-446a-9478-d995c62157be req-a420b833-1304-4637-9869-f290f39a451d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.043978 Oct 06 12:55:36.455343 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 798/1612] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:36.464128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:36.465332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:36.473169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.473667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.474255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.475084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.475639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.475946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.873111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:36.881967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d04ec2c5-634a-4f0b-8d72-d18c877f9b16 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1539 microversion: 2.1 time: 0.766058 Oct 06 12:55:36.882561 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 815/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:36 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1539 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:36.888789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:36.889406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:36.896706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.897206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.897883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:36.898635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:36.899328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:36.899768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.278969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:37.288107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:37.289776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:37.291220 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-157b4412-1bcf-4838-9dcc-2eee1727eb0a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.834418 Oct 06 12:55:37.291787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 799/1614] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:36 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:37.296192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-plugged", "status": "completed", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:37.306301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:37.306778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:37.307421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.319980 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] Creating event network-vif-plugged:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:55:37.325492 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-05a37322-657d-42bb-bb60-fe72e8bccaa9 req-17086242-902a-4c4b-b910-96975ac58d91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Oct 06 12:55:37.326370 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 800/1615] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:37.331641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:37.332184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:37.338531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:37.339017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:37.339453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.340174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:37.340607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:37.341029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.717674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:37.730211 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cf80575-c31f-42d3-899d-864afdcf4322 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.845769 Oct 06 12:55:37.731115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 816/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:36 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:37.739369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:37.740448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:37.748505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:37.749269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:37.749706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.750551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:37.751549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:37.751983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:37.756706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:38.317032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:38.329452 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4cba3312-2216-42de-b813-3e55429f1869 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1534 microversion: 2.1 time: 1.001635 Oct 06 12:55:38.331441 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 801/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:37 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1534 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:38.339197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:38.340083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:38.355025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.355808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.356599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:38.357814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.358535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.359541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:38.647068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:38.656893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2744bd5d-b573-4a65-9f08-fba533d87844 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1707 microversion: 2.1 time: 0.923561 Oct 06 12:55:38.657878 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 817/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:37 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1707 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:38.678551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:38.679434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:38.685806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.686301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.686739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:38.687480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.687934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.688877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:38.833223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:38.849045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:38.851473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:38.853382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-954fb921-4fda-4d3c-ba5f-44d12dfeca3a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.519911 Oct 06 12:55:38.853996 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 802/1619] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:38 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:38.861060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:38.862004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:38.868877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.869664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.870428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:38.871331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:38.872030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:38.872746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.139619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.151592 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ceafe86-32a6-4ce3-a30a-3bc311208959 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1521 microversion: 2.1 time: 0.484638 Oct 06 12:55:39.152548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 818/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:38 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:39.197112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-532a8b2e-a539-47d3-b1c1-404ce69cd34b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '.version_select at 0x7f7d3f01d9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.207851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532a8b2e-a539-47d3-b1c1-404ce69cd34b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.208677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532a8b2e-a539-47d3-b1c1-404ce69cd34b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.209406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532a8b2e-a539-47d3-b1c1-404ce69cd34b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.234717 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-532a8b2e-a539-47d3-b1c1-404ce69cd34b tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3495 microversion: 2.1 time: 0.065080 Oct 06 12:55:39.237370 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 819/1621] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:55:39 2022] GET /compute/v2.1/os-migrations => generated 3495 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:39.249500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.251298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:39.260349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.260963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.261520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.264161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.265127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.265844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.428680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.450332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.453979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.456020 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a39f699-6f28-422c-9645-b2bab59ed7d5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.600166 Oct 06 12:55:39.456956 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 803/1622] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:38 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:39.482626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.483845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:39.507978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.509117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.509924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.510932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.512366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.513907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.546583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:39.697314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b83aca1-2094-4577-a5d9-0fd3d0f41c06 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 204 len: 0 microversion: 2.1 time: 0.229163 Oct 06 12:55:39.701293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 804/1623] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:39 2022] DELETE /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:39.720966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.723644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:39.740574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.741762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.742281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.742776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.744280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.744953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.745237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.760364 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e353c91e-5a0e-4311-b295-0896b8c1798c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1478 microversion: 2.1 time: 0.521252 Oct 06 12:55:39.761640 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 820/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:39 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1478 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:39.767444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f031dfa4-0a78-4665-bc3a-9b152a2b1981", "name": "network-vif-deleted", "tag": "821a1f8d-56fb-4cf3-9639-15c767a4f3ab"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:39.782706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.784476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.785415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.814682 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] Creating event network-vif-deleted:821a1f8d-56fb-4cf3-9639-15c767a4f3ab for instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 on n-h1-860556-1 Oct 06 12:55:39.819845 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4a6f0709-feb4-40db-89c1-cc99b3fa6d8f req-8b235e86-720f-48c6-83ef-5e088ebc8325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056482 Oct 06 12:55:39.820470 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 821/1625] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:39.826385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.827089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:39.834403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.834876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.835499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.836406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.837438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.838200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.881109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:39.881601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:39.882405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:39.883066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lazy-loading 'fault' on Instance uuid f031dfa4-0a78-4665-bc3a-9b152a2b1981 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:39.970884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:39.981133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1e56db0-5d65-4b75-9b84-006fedfc46c3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1368 microversion: 2.1 time: 0.159251 Oct 06 12:55:39.982049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 822/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:39 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:39.993075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:39.994264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:40.006373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.008009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.009036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.011608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.012817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.013981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.064718 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3275fcc7-1ba9-412c-81c2-905ccc9f85b2 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1858 microversion: 2.1 time: 0.364944 Oct 06 12:55:40.065853 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 805/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:39 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1858 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:40.072079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:40.073048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:40.084566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.086517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.087604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.088691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.089407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.090116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.478599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:40.490828 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2dabbdc9-1e5e-4c3c-89b7-a13d96a0d2d9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1527 microversion: 2.1 time: 0.507478 Oct 06 12:55:40.491641 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 823/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:39 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1527 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:40.514976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:40.514976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:40.519111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.519614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.520132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.521404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.521404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.521722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.529014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:40.553043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:40.556094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:40.557352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edb92a45-0c14-4a27-9d1c-6b47c5012c1b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.490180 Oct 06 12:55:40.558059 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 806/1629] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:40 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:40.564696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cea416a-4bfa-44c9-bd05-0e1dcb86d793", "name": "network-vif-plugged", "status": "completed", "tag": "c2bfb0e9-3222-40d4-85b2-7d3e74df5e66"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:40.576575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.577052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.577623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.590827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] Creating event network-vif-plugged:c2bfb0e9-3222-40d4-85b2-7d3e74df5e66 for instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 on n-h1-860556-1 Oct 06 12:55:40.596666 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f116bef5-08c7-4957-b1e7-dbd740b4c435 req-372fd841-f3f6-4729-be56-a041ae9cc04c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037078 Oct 06 12:55:40.597807 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 807/1630] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:40.739623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:40.739623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:40.755427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.756254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.756904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:40.757688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:40.758223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:40.758659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.133595 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac15fcee-3815-4ba2-b3fe-939773d728d5 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1858 microversion: 2.1 time: 0.626262 Oct 06 12:55:41.146775 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 824/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:40 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1858 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:41.170618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.172105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.180928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.181854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.182529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.184721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.185770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.186617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.268941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.278904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.280788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.282995 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9acf525-632e-403a-818b-4d3455fc0e10 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.683182 Oct 06 12:55:41.296765 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 808/1632] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:40 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:41.304262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.304964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.314878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.315382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.315834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.316558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.317023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.317462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.355876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.356378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.356828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.357297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lazy-loading 'fault' on Instance uuid f031dfa4-0a78-4665-bc3a-9b152a2b1981 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:41.440262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.449243 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-139188a7-ab6b-43b0-a4a0-4140ee88c6ed tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1368 microversion: 2.1 time: 0.150887 Oct 06 12:55:41.466644 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 809/1633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:41 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:41.466644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.466644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.466644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.467587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.468289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.469261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.470055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.470719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.519591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:41.520172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.533109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9355dd1a-0468-4b9e-b959-6552f25ce04f tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1464 microversion: 2.1 time: 0.385120 Oct 06 12:55:41.555364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 825/1634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:41 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1464 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:41.561437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.562355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.586956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.587745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.588638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.589649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.591181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.591808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.690024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lazy-loading 'services' on Instance uuid ec62f355-a28a-489f-95aa-e39d9c98c23c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:41.759400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:41.774997 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ebbc8070-3426-4bd9-9449-3a1eede17c87 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1527 microversion: 2.1 time: 0.214453 Oct 06 12:55:41.790760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 826/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:41 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1527 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:41.805426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.806562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.823056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.834391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.835129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.836849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.837602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.838488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.873299 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60d3c00f-f677-425f-b66e-b3476279a9dc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments/6b201ff4-1929-4c49-96d2-609542382e84" status: 202 len: 0 microversion: 2.1 time: 0.421759 Oct 06 12:55:41.874272 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 810/1636] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 12:55:41 2022] DELETE /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments/6b201ff4-1929-4c49-96d2-609542382e84 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:41.880619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:41.881350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:41.900149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.902588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.903266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:41.906515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:41.907938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:41.914490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.392608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:42.407950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc77bc91-bf65-4e69-a6ba-42d09ee00942 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1464 microversion: 2.1 time: 0.615252 Oct 06 12:55:42.422242 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 827/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:41 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1464 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:42.434722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:42.439087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:42.446178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.447171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.447881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.448816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.449516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.450654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.453289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:42.491400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:42.494710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:42.498128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-384c2914-d014-42ec-9829-12b8f2c8879f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.622301 Oct 06 12:55:42.499380 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 811/1638] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:41 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:42.504552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-089d5be6-e67a-4da4-a058-15695898da93 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080174 Oct 06 12:55:42.505383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 828/1639] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:42 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:42.509388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:42.510823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:42.511307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:42.513945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:42.520688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.521197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.521915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.522386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.522847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.523279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.527847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.528589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.529695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.530774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.532883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.532883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.627244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:42.627810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:42.628299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:42.629009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:42.629620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:42.774590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:42.804016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.804438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.804579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.805340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.805820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.806311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.882924 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5f3ea9d-8b6c-487b-8f02-44007d91f2ef tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 1068 microversion: 2.1 time: 0.376200 Oct 06 12:55:42.883517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 829/1640] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:55:42 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 1068 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 06 12:55:42.902998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:42.903617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:42.915721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.916316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.916759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.917493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:42.917981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:42.918409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:42.999118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.003049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.004138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.004856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lazy-loading 'fault' on Instance uuid f031dfa4-0a78-4665-bc3a-9b152a2b1981 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:43.231292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:43.256963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fdf2a73-9d61-4431-ba83-5712d77bd106 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 200 len: 1368 microversion: 2.1 time: 0.361744 Oct 06 12:55:43.258020 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 830/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:42 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:43.271294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:43.272186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:43.297483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.299452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.300484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.302039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.302858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.303619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.373660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:43.406035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:43.419519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:43.427496 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-405e482d-1231-4db4-9e01-ea611de4e356 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.923510 Oct 06 12:55:43.430666 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 812/1642] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:42 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:43.442755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:43.444608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:43.490766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.495103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.504336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.508763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.510099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.512709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.635781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:43.648492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34d335fa-0430-40ce-be3f-441122da8e70 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 200 len: 1485 microversion: 2.1 time: 0.389055 Oct 06 12:55:43.649384 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 831/1643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:43 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:43.659445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cea416a-4bfa-44c9-bd05-0e1dcb86d793", "name": "network-vif-deleted", "tag": "c2bfb0e9-3222-40d4-85b2-7d3e74df5e66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:43.693974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.694400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.694840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.712732 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] Creating event network-vif-deleted:c2bfb0e9-3222-40d4-85b2-7d3e74df5e66 for instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 on n-h1-860556-1 Oct 06 12:55:43.718525 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5e05d4f1-563a-498a-8aa8-a6f085511a67 req-4ebe39ef-97c8-43e6-ab10-55db7906cf93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067855 Oct 06 12:55:43.721554 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 832/1644] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:43.728660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:43.731183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:43.746521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.746909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.747358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.748223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.749127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.749558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.755444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:43.850141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c431c04f-aed4-415d-a75b-7b9b1d84c398 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126778 Oct 06 12:55:43.851473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 833/1645] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:43 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:43.858240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:43.859447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:43.868209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.870174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.872299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:43.875261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:43.878324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:43.879836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.002060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:44.018759 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77d6c6b5-2b2d-4b98-838d-9886fa6d4628 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.586590 Oct 06 12:55:44.022274 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 813/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:43 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:44.282850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:44.284369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: f031dfa4-0a78-4665-bc3a-9b152a2b1981] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:44.307704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:44.314566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.316949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.319408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.320445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.323395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.324156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.346824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] HTTP exception thrown: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Request method failure captured: Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 HTTP/1.1 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs7Ztsc7-3LUbPuXtGa-JsK4ItC5mVMD23kUaueOgjaTXmcNmZfxfevvAiXCsYkN942VgzWJH42MUuNJ5R25MlGv1jRS56A5Lc-4gT6gL_5psHS67kXhqNNVVRtS1zg4kkuuT22Bcr5srxPyeJfQhSqMNmBIRvBC1iscxGgHn_oqW64 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:55:44.348576 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b95526d417ea42d2873f54a772da9695", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b95526d417ea42d2873f54a772da9695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}] Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: be2535c026dd41458fd9971e14a19010 Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. Oct 06 12:55:44.350268 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f031dfa4-0a78-4665-bc3a-9b152a2b1981'} Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:44.351122 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. Oct 06 12:55:44.352496 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.353868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Returning 404 to user: Instance f031dfa4-0a78-4665-bc3a-9b152a2b1981 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:44.353868 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63dc3aa6-3c15-4c80-89f1-02e098491e5b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981" status: 404 len: 111 microversion: 2.1 time: 0.072076 Oct 06 12:55:44.354711 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 814/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:44 2022] GET /compute/v2.1/servers/f031dfa4-0a78-4665-bc3a-9b152a2b1981 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:55:44.361051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a85400bc-d3dd-4d64-b9fa-a074d824f658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '.version_select at 0x7f7d3f070040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:44.387060 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a85400bc-d3dd-4d64-b9fa-a074d824f658 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974890092" status: 202 len: 0 microversion: 2.1 time: 0.030869 Oct 06 12:55:44.394193 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 815/1648] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 12:55:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974890092 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:55:44.478197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:44.479732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:44.506730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.509859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.511062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.512512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.514505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.516559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.774519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:44.803318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:44.810166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:44.816053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0174adce-f774-41d5-a7b8-91768691091c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.962147 Oct 06 12:55:44.819525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 834/1649] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:43 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:44.827343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:44.828578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:44.841864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.842887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.853262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.859601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.869570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.870281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.911529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 HTTP/1.1 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:55:44.914216 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:55:44.916144 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4cea416a-4bfa-44c9-bd05-0e1dcb86d793'} Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:44.917177 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:55:44.919241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:44.920786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:44.920786 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-331a4629-7e9a-4868-bb5d-fe4a5c94e2a3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 404 len: 111 microversion: 2.1 time: 0.095402 Oct 06 12:55:44.925940 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 835/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:44 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:55:44.936863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:44.941505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:44.949484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.950328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.950965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:44.952046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:44.952792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:44.953502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:45.005168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0da835e4-c45a-4fd0-834e-7b36cb88cdb3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077530 Oct 06 12:55:45.006625 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 836/1651] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:44 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:45.012685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-110752436", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:45.087819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] validate_networks() for [('5419d21e-2a7d-4337-845b-dcdc25ebc04e', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:55:45.353109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:45.366131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:45.367917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:45.369543 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-942113fb-b909-40e2-b932-c1a3d8468882 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.899971 Oct 06 12:55:45.370752 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 816/1652] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:44 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:45.375905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:45.377068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:45.384598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:45.385514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:45.386472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:45.388244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:45.389592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:45.390719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:45.854426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:45.865131 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f7b918b-8685-4a10-92ab-6bf4debda8d4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.493099 Oct 06 12:55:45.884300 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 817/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:45 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:45.890690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:45.894282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:45.903202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:45.904629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:45.905452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:45.906798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:45.908184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:45.908858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:45.952157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:46.065394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3926446d-6327-4899-98ff-b27a64ead429 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 204 len: 0 microversion: 2.1 time: 0.179250 Oct 06 12:55:46.067205 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 818/1654] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:45 2022] DELETE /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:46.073721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:46.074660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:46.081477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.082191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.082731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.083593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.084146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.084652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.649285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:46.665416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:46.673224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:46.674753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6e4e447e-06f4-407a-ba06-1abdf5a5f993 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.605999 Oct 06 12:55:46.675377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 819/1655] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:46 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:46.713562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:46.721794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:46.731141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.732074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.732852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.733830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.736915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.737777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.790320 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e126531-9899-44ba-b7ec-60dda5a4cffc tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110870 Oct 06 12:55:46.792488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 820/1656] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:46 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:46.801987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:46.803290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:46.807185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:46.807786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:46.808211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:46.808956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:46.809563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:46.815895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.817518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.818215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.819544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.820383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.822073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.830269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.831303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.834974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.840961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:46.842966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:46.845297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:46.910732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:55:46.920362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Getting quotas for user 07b0c27e7810471cbb372142ad98f650 and project 3fb28a0405a14e06b2d6adc19aa13c55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:55:46.941657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:55:46.945034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:55:47.015527 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4dab0510-7c38-4bb2-8b97-1fb0e2596fd2 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.007305 Oct 06 12:55:47.025127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 837/1657] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:55:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:55:47.035439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:47.036459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:47.046445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.048453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.058917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:47.059774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.060964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.061670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:47.346669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:47.372226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9f0b9f82-1252-437c-816f-3f5c18724d28 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1469 microversion: 2.1 time: 0.576803 Oct 06 12:55:47.375089 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 821/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:46 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:47.386951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:47.390078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:47.419635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.423585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.424332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:47.430189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.430996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.431920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:47.773426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:47.785554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:47.791677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:47.792962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a3c3f4b-4ef9-4f11-94dc-717ceb7d5133 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.764863 Oct 06 12:55:47.800201 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 838/1659] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:47 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:47.808397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb693822-31ca-44b9-b2c5-d1dcd978c014 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:47.809033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb693822-31ca-44b9-b2c5-d1dcd978c014 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:47.909850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb693822-31ca-44b9-b2c5-d1dcd978c014 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:47.925072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb693822-31ca-44b9-b2c5-d1dcd978c014 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1224 microversion: 2.1 time: 0.123445 Oct 06 12:55:47.930445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 839/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:47 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:47.935905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:47.936705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:47.956788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.966607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.967605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:47.968612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:47.969297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:47.969995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.019497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:48.035325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd90a45a-fb1a-411b-a3ad-1775703a2357 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.658830 Oct 06 12:55:48.037146 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 822/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:47 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:48.047890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:48.051100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:48.075286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.077278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.081650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.083414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.085635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.087033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.181185 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b5be2f8-88ab-4590-9378-522ca6220b19 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142644 Oct 06 12:55:48.182200 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 823/1662] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:48 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:48.404969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:48.405828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:48.417629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.419376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.420959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.421813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.425666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.426994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.506585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:48.516894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:48.529869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:48.531543 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67eae98c-7400-4ac8-a80f-8999bc54e177 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.599795 Oct 06 12:55:48.532940 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 840/1663] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:47 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:48.815379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:48.824370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:48.825548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:48.837024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.839778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.840615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.841193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8577f878-a551-47c6-b123-80c0040b062b tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1469 microversion: 2.1 time: 0.440899 Oct 06 12:55:48.841606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.842581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.843707 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 824/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:48 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:48.844493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.952489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:48.953422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:48.976216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.984604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.985395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:48.986358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:48.986994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:48.989144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.246582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:49.262168 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab2d9eb7-56ac-4054-b355-23502a5a2035 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1276 microversion: 2.1 time: 0.313215 Oct 06 12:55:49.263678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 825/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:48 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:55:49.279476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:49.280155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:49.296047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.302806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.303635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.304577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.305239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.306066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.311093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:49.340174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:49.352015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:49.353472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:49.369662 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6dbcc4e-08c3-499e-b6ba-754bfaf54d9c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1813 microversion: 2.25 time: 0.549020 Oct 06 12:55:49.370314 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 841/1666] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:48 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1813 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:49.375411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:49.384263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:49.403584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.404082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.404511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.405438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.405939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.406375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.453720 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c2e3b60-b060-4001-b840-0ab012def282 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081841 Oct 06 12:55:49.467017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 842/1667] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:49 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:49.479806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0291b1e-cf26-4bcc-bf8a-985fba21e598", "name": "network-vif-deleted", "tag": "b461120e-818a-47db-adb0-da7d642178aa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:49.501411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.503023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.504200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.532481 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] Creating event network-vif-deleted:b461120e-818a-47db-adb0-da7d642178aa for instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 on n-h2-860556-1 Oct 06 12:55:49.539299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8d45029f-281d-40dd-8357-8b9fccaf33dd req-2543e605-7759-4f03-83dc-359b6e55f89b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069707 Oct 06 12:55:49.540685 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 843/1668] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:49.573695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:49.574796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:49.590894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.591686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.592319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.593340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.594107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.594789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.867588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:49.880140 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b47f3b38-9a7d-4981-9292-881637450a40 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.614095 Oct 06 12:55:49.881121 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 826/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:49 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:49.889752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:49.890369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:49.897757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.898505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.899356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.900231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.900877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.901467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.937508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:49.938602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:49.939297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:49.939755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lazy-loading 'fault' on Instance uuid d0291b1e-cf26-4bcc-bf8a-985fba21e598 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:50.036572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:50.048675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6fc38ac-558d-406a-b918-6efa9bb15908 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 200 len: 1303 microversion: 2.1 time: 0.165480 Oct 06 12:55:50.049622 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 827/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:49 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:50.076870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:50.101158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:50.103086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:50.105330 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc4c0360-54ca-46d8-88f4-44f802ac4780 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.536093 Oct 06 12:55:50.106756 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 844/1671] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:49 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:50.288361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:50.289066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:50.295308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.296090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.296767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.297954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.298742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.299386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.383077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:50.395115 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33cb72e0-0c45-419b-b4a9-d3dc50d9d274 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1282 microversion: 2.1 time: 0.110604 Oct 06 12:55:50.397541 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 828/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:50 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:50.417605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:50.419097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:50.428236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.429015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.429705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.430688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.431405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.432062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.486520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:50.489235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:50.502831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.503824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.504563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.506063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.506848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.507828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.556241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b35f382-ce5d-4042-b64e-f9ff9f0bd0a7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073838 Oct 06 12:55:50.557220 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 829/1673] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:55:50 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 12:55:50.834368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5330e1f-c9da-453b-a21e-9442d55b5b2d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d477cab80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:50.917932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5330e1f-c9da-453b-a21e-9442d55b5b2d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2" status: 200 len: 662 microversion: 2.1 time: 0.088635 Oct 06 12:55:50.930631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 830/1674] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:50 2022] GET /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2 => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:50.936602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:50.937540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:50.957974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.958818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.960413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:50.961512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:50.962405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:50.963074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.135678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:51.151593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:51.155442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:51.159977 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43a93d80-f50c-4164-bd7f-e9c1f4f35d57 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1803 microversion: 2.25 time: 0.761221 Oct 06 12:55:51.161496 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 845/1675] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:50 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1803 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:51.167348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f06ec465-a48e-4ac6-8433-a65f29d53d44 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edd2b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.258266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f06ec465-a48e-4ac6-8433-a65f29d53d44 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2" status: 200 len: 662 microversion: 2.1 time: 0.095265 Oct 06 12:55:51.258873 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 846/1676] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:51 2022] GET /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:51.281534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.285368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: d0291b1e-cf26-4bcc-bf8a-985fba21e598] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:51.306670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.307178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.307618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.308342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.308808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.309239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.355029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] HTTP exception thrown: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Request method failure captured: Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 HTTP/1.1 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7Ztsc7-3LUbPuXtGa-JsK4ItC5mVMD23kUaueOgjaTXmcNmZfxfevvAiXCsYkN942VgzWJH42MUuNJ5R25MlGv1jRS56A5Lc-4gT6gL_5psHS67kXhqNNVVRtS1zg4kkuuT22Bcr5srxPyeJfQhSqMNmBIRvBC1iscxGgHn_oqW64 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:55:51.375225 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b95526d417ea42d2873f54a772da9695", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b95526d417ea42d2873f54a772da9695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}] Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: be2535c026dd41458fd9971e14a19010 Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. Oct 06 12:55:51.377482 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'd0291b1e-cf26-4bcc-bf8a-985fba21e598'} Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:51.378640 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. Oct 06 12:55:51.383264 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:51.391872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Returning 404 to user: Instance d0291b1e-cf26-4bcc-bf8a-985fba21e598 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:51.393507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-adc7c96a-4bb6-46d2-9db1-70f6f58e12f2 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598" status: 404 len: 111 microversion: 2.1 time: 0.133133 Oct 06 12:55:51.395484 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 847/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:51 2022] GET /compute/v2.1/servers/d0291b1e-cf26-4bcc-bf8a-985fba21e598 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:55:51.407595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.409401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:51.423934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:51.444450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.448403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.449117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.449404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-401de4e2-738b-4fff-9f66-2a6b5ac74547 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.518058 Oct 06 12:55:51.450631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 831/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:50 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:51.452333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.455019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.489294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.500943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c31ea2ac-925c-4ac5-8ba9-1a0d5858cf96 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '.version_select at 0x7f7d3fa23af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.508384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c31ea2ac-925c-4ac5-8ba9-1a0d5858cf96 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.509299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c31ea2ac-925c-4ac5-8ba9-1a0d5858cf96 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.510495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c31ea2ac-925c-4ac5-8ba9-1a0d5858cf96 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.573126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c31ea2ac-925c-4ac5-8ba9-1a0d5858cf96 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3207 microversion: 2.25 time: 0.118554 Oct 06 12:55:51.582940 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 832/1679] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Oct 6 12:55:51 2022] GET /compute/v2.1/os-migrations => generated 3207 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:51.588044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.601597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:51.618285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.619420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.620975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.625217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.627976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.630711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.695068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:55:51.870005 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61bcf321-fb38-4abf-baf7-eb278ad2fe52 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 204 len: 0 microversion: 2.1 time: 0.285044 Oct 06 12:55:51.871643 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 833/1680] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:55:51 2022] DELETE /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:51.880412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:51.882833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:51.899569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.900953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.901914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:51.905877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:51.908978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:51.910878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.131122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.145001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.147596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.150910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b9644fb-fa6a-45b7-91d6-01c7c8aa381d tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.753101 Oct 06 12:55:52.151505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 848/1681] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:51 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:52.163066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:52.164014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:52.170580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.171069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.171675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.172238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.172733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.173156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.353433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.362007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-86a2cb56-4c2a-4fa6-85c1-6255229cfd68 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.488098 Oct 06 12:55:52.362911 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 834/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:51 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:52.378388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:52.379370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:52.386698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.387807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.388473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.389929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.393763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.394544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.460825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:52.476421 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60541c10-37ca-45a7-b36d-90a1ad8fef09 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 2422 microversion: 2.25 time: 0.323483 Oct 06 12:55:52.477412 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 849/1683] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:52 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 2422 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:52.483716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:52.484541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:52.501843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.504757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.506026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.507036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.507758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.508483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.738034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.748053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44a975d3-dba0-4709-b9d0-632a2a94386c tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1469 microversion: 2.1 time: 0.383768 Oct 06 12:55:52.748650 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 835/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:52 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:52.759049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:52.759928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:52.768188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.768713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.768956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.769952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:52.770835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:52.771440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:52.932655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:52.942334 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cacdd8ad-9354-4256-b998-f1c67bc25917 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.463573 Oct 06 12:55:52.943444 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 850/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:52 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:52.958730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bad34608-58bc-4260-b66c-7b8db64b70d8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edd2160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.003782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bad34608-58bc-4260-b66c-7b8db64b70d8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf" status: 200 len: 661 microversion: 2.1 time: 0.058876 Oct 06 12:55:53.004656 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 851/1686] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:52 2022] GET /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:53.019779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b316730-b1c4-4674-bb7a-b2ae485519b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ee6f820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.069372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b316730-b1c4-4674-bb7a-b2ae485519b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf" status: 200 len: 661 microversion: 2.1 time: 0.053766 Oct 06 12:55:53.080680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 852/1687] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:53.160872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:53.180527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.181158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:53.188974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:53.191246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.191917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.192126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4449de7-42bf-48fc-9599-0455d0b18052 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 2422 microversion: 2.25 time: 0.442424 Oct 06 12:55:53.192740 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 836/1688] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:52 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 2422 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:53.193213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.193990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.194449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.195055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.295595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.296107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:53.302734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.303629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.304003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.304921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.305382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.305851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.409097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lazy-loading 'services' on Instance uuid 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:55:53.526733 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0276e46-3ebd-457f-9cfd-394437195698 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments/6eb099fe-3d2c-4b91-afec-1502d00a7bc0" status: 202 len: 0 microversion: 2.25 time: 0.234945 Oct 06 12:55:53.527961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 837/1689] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Oct 6 12:55:53 2022] DELETE /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments/6eb099fe-3d2c-4b91-afec-1502d00a7bc0 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:55:53.536335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.537049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:53.544649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.545660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.546516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.547466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.548248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.548853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.633978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:53.644940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:53.646766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:53.648287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1655cba-4a6f-45fb-8788-212c925a5dc8 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.474138 Oct 06 12:55:53.648870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 853/1690] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:53.654306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.657889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:53.664628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.665372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.666010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.666998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.667643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.668066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.733430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-978fd56c-b9a2-41c8-95d4-4c43061d2160 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082592 Oct 06 12:55:53.740174 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 854/1691] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:55:53.746040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76dbec89-3dd6-4a38-873d-f9dcff8f993f", "tag": "f6502784-f3aa-4ee9-841b-768fef81b0eb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:53.758408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.759210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.759910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.772516 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] Creating event network-changed:f6502784-f3aa-4ee9-841b-768fef81b0eb for instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f on n-h1-860556-1 Oct 06 12:55:53.790538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f627acd2-09bb-457c-8452-9ab4d6010f42 req-27fb45aa-38e4-4385-86f4-4f69d5701a54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036918 Oct 06 12:55:53.790538 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 855/1692] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:53.790538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:53.790538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:53.794370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.794986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.795538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.796383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:53.796928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:53.797656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:53.989617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:53.999017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-76983de4-41b6-4333-b2a2-e8b9a9638fb5 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.469585 Oct 06 12:55:53.999606 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 838/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:54.005899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:54.006768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:54.022045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.022666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.023183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.024449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.024979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.025596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.195935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2535c026dd41458fd9971e14a19010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95526d417ea42d2873f54a772da9695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:54.206370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:54.209481 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6959f2b5-87ae-4d7f-aa58-2aed0ed47c03 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 200 len: 1469 microversion: 2.1 time: 0.427923 Oct 06 12:55:54.211326 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 856/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:54.335039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:54.355941 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a1d553a7-f9e1-41ea-bd91-8084862b9b32 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.355026 Oct 06 12:55:54.359035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 839/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:53 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:54.676575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a66d2b89-4704-489e-9a4a-acb330bd1c20 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f126af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:54.677258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:54.677930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:54.711763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.714119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.714674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.715764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.717974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.725881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.779521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a66d2b89-4704-489e-9a4a-acb330bd1c20 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536" status: 200 len: 662 microversion: 2.1 time: 0.113926 Oct 06 12:55:54.780213 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 857/1696] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:54 2022] GET /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536 => generated 662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:54.798925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:54.802013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:54.811106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.811971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.812685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.814331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:54.815972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:54.816763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:54.869683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3217c79-6ded-4029-8862-ebf56820e39e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.063962 Oct 06 12:55:54.872115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 858/1697] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:55:54 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:55:54.882590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dbe1168b-695c-4697-bb16-47ff6e1677b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edf3820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:54.966683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dbe1168b-695c-4697-bb16-47ff6e1677b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536" status: 200 len: 662 microversion: 2.1 time: 0.093212 Oct 06 12:55:54.968586 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 859/1698] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:55:54 2022] GET /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:55.023893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:55.025112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:55.035071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.035920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.036548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.037442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.038101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.038527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.052694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:55.062744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:55.064836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:55.066066 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-307d193a-742a-4980-ab82-e45285f6d929 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.394889 Oct 06 12:55:55.066899 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 840/1699] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:54 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:55:55.071751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-55633283", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:55.141993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:55:55.334918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:55.347653 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf74c4a2-d04a-4a25-a375-046adae5f673 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.327475 Oct 06 12:55:55.348791 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 860/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:55 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:55:55.363756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:55.364692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] [instance: ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:55.387984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.389571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.390657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.392890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.393475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.393949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.429635 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] HTTP exception thrown: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Request method failure captured: Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e HTTP/1.1 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs7Ztsc7-3LUbPuXtGa-JsK4ItC5mVMD23kUaueOgjaTXmcNmZfxfevvAiXCsYkN942VgzWJH42MUuNJ5R25MlGv1jRS56A5Lc-4gT6gL_5psHS67kXhqNNVVRtS1zg4kkuuT22Bcr5srxPyeJfQhSqMNmBIRvBC1iscxGgHn_oqW64 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:55:55.431306 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b95526d417ea42d2873f54a772da9695", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b95526d417ea42d2873f54a772da9695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b95526d417ea42d2873f54a772da9695"}]}] Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b95526d417ea42d2873f54a772da9695 Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-MigrationsAdminTest-1416150329 Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: be2535c026dd41458fd9971e14a19010 Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-MigrationsAdminTest-1416150329-project Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. Oct 06 12:55:55.432833 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e'} Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:55:55.433681 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. Oct 06 12:55:55.435175 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:55:55.436434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] Returning 404 to user: Instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:55:55.436434 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75332281-515a-497c-b34d-b2d8c48733e3 tempest-MigrationsAdminTest-1416150329 tempest-MigrationsAdminTest-1416150329-project] 10.222.0.26 "GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e" status: 404 len: 111 microversion: 2.1 time: 0.081923 Oct 06 12:55:55.436434 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 861/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:55 2022] GET /compute/v2.1/servers/ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:55:55.457200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:55.457868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:55.475140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.475548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.476501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.477264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.483974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.484570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.507616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:55.508575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:55.509591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:55.510274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:55.511433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:55.525849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.527009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.527700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.528808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.531183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.532703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.557340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Getting quotas for project c52cdad615a1441a9af34cce351c9175. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:55:55.564648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Getting quotas for user b41581d657f340df99087566b4ac861f and project c52cdad615a1441a9af34cce351c9175. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:55:55.580837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:55:55.584369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:55:55.666028 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15b600dc-60b3-49c8-a74d-d2c74d39b676 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597772 Oct 06 12:55:55.667351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 841/1702] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:55:55.722465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:55.730787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1518811712", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:55.749083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e6c5168-4bcf-4cdc-99cf-da9482c133c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.313485 Oct 06 12:55:55.765057 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 862/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:55 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:55.820969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e", "name": "network-vif-deleted", "tag": "626b6e6a-e60e-4427-bdad-4971ed55efba"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:55.853986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.855323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.857967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.914619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:55:55.919340 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] Creating event network-vif-deleted:626b6e6a-e60e-4427-bdad-4971ed55efba for instance ae78ef9d-19f6-48bd-8310-39b7ac5e8b3e on n-h2-860556-1 Oct 06 12:55:55.941125 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-595de50c-3e82-4fd7-91b9-70e783d08b00 req-8ca3408b-5dc0-46a0-b125-56c483107925 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125653 Oct 06 12:55:55.945145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 863/1704] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:55.959584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:55.966395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:55.977551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.979734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.980122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:55.982222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:55.986997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:55.987740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:56.058663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aeb20943-9f00-421c-a6b6-9f29adc0393e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109905 Oct 06 12:55:56.066856 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 864/1705] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:55:55 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:55:56.093478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:56.094093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:56.119171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:56.119676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:56.120112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:56.123158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:56.126893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:56.128942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:56.871083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:57.226335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:57.254234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:57.256009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:57.257240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31c2b49e-6c68-466a-9a3b-b6b9d2d7abcd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 1.168585 Oct 06 12:55:57.258254 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 865/1706] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:56 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:55:57.262910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "67d910f1-0ac2-4e36-a881-ca9fdb8b28f8"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:55:57.305094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.309093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.311178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.362000 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] Creating event network-vif-plugged:67d910f1-0ac2-4e36-a881-ca9fdb8b28f8 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:55:57.380947 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ceb9b987-ccdd-4ad3-b182-8fea874996be req-e76e1e8c-0841-44bb-95ae-c047e6d43b83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121353 Oct 06 12:55:57.381974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 866/1707] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:55:57.402324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:57.403516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:57.410729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.426777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.427710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.429220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.430187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.431060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.460423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:55:57.461023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:55:57.462501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:55:57.463290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:55:57.464104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:55:57.497896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.501462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.502152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.503134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.503648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.504119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.532259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:57.553841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Getting quotas for project c52cdad615a1441a9af34cce351c9175. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:55:57.565993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Getting quotas for user b41581d657f340df99087566b4ac861f and project c52cdad615a1441a9af34cce351c9175. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:55:57.607318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:55:57.609514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:55:57.716675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a120316-a01d-4881-94e3-ceab6ad45698 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992258 Oct 06 12:55:57.717330 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 842/1708] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 12:55:57.722268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:57.731959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:57.739809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.740516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.741142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.742109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:57.742745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:57.743351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:57.916395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:58.162762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:58.175888 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efa0ce3e-50db-4c5e-aa08-a870bbcf5b29 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.792288 Oct 06 12:55:58.176489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 867/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:57 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:58.181377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:58.201601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:58.265789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:58.267054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:58.283249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:58.284347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:58.286720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:58.287511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:58.404704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:58.417106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c099ea59-1e93-4d25-8f78-22e4f0fbc2b4 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.698475 Oct 06 12:55:58.423388 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 843/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:57 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:58.442457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-523a4e10-f5a4-404b-809f-804ae0a0eba5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:58.443080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-523a4e10-f5a4-404b-809f-804ae0a0eba5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:58.446657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-177f03cb-d845-47d6-a87e-d290a16a006a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.268666 Oct 06 12:55:58.447656 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 868/1711] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:55:58 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:55:58.462109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:55:58.477229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:58.477888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:58.510216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:58.510713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:58.523549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:58.525474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:58.527190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:58.527663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:58.653856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-523a4e10-f5a4-404b-809f-804ae0a0eba5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:58.660840 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-523a4e10-f5a4-404b-809f-804ae0a0eba5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1218 microversion: 2.1 time: 0.233207 Oct 06 12:55:58.662562 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 844/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:58 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:59.067624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:59.080890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:59.082831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:59.085431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c59a9d1-88e8-4861-a37f-17319ecb477b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.632846 Oct 06 12:55:59.086604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 869/1713] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:55:58 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:55:59.208118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:59.212890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:59.249055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.250785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.252294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:59.254887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.255977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.257238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:59.455336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:59.459007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:59.505633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.508026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.510234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:59.515025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.519265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.522347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:59.849607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:55:59.871881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efc7d47e-c676-4144-b525-de09c4f3307f tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.671247 Oct 06 12:55:59.873684 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 845/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:59 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:55:59.882995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:55:59.896014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:55:59.909915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.917390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.918156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:55:59.920043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:55:59.920949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:55:59.926208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.004601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b26cacd-61bf-4f16-ab6d-4c86bbb54e5b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129362 Oct 06 12:56:00.009927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 846/1715] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:55:59 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:56:00.014982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "ead8573b-ee9e-4abc-ac2c-a162f275fe79"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "5b42104a-a9d6-4bbd-a480-a2d2a849b73c"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "a77b907c-6855-4a94-847a-ac82a0df06de"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:00.043024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.045177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.047071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.069840 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Creating event network-vif-plugged:ead8573b-ee9e-4abc-ac2c-a162f275fe79 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:00.070744 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Creating event network-vif-plugged:5b42104a-a9d6-4bbd-a480-a2d2a849b73c for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:00.073088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] Creating event network-vif-plugged:a77b907c-6855-4a94-847a-ac82a0df06de for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:00.101326 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1e799aa3-3645-4ad2-84e7-1fecf056c6af req-472c3ee5-2ce6-473f-880e-a468acb7de83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.094271 Oct 06 12:56:00.103311 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 847/1716] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:00.142817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:00.148872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:00.171639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.174775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.175973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.181115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:00.183047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.185670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.188920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.193092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f1c6de0-7ffc-4f05-8ba6-fa1024ab3898 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.745651 Oct 06 12:56:00.201816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 870/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:55:59 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:00.215857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:00.216737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:00.236768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.238953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.240464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.245407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.246241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.247679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.483159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:00.503368 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4eaaf446-cf7f-4e85-8335-8ad765d6dc03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1270 microversion: 2.1 time: 0.377673 Oct 06 12:56:00.505129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 848/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:00 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1270 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:00.904614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:00.905290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:00.917681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.918207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.920294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:00.924012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:00.924781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:00.925821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.283291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.300129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.301600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.302850 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32f5158e-cf83-4ad0-aef7-72195e1bac9e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 1.099877 Oct 06 12:56:01.312308 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 871/1719] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:00 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:01.312308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:01.312308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:01.318300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.318768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.319414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.320312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.320924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.321512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.386869 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4bd091a-d4fb-4d9b-b411-e7346890ddf1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082056 Oct 06 12:56:01.387881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 872/1720] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:56:01 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:56:01.404038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:01.404872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:01.414444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.414949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.418020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.418877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.423882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.424365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.501119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.519593 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb69e763-6b2d-42e3-ab5c-bbafa3a8f58b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.620498 Oct 06 12:56:01.523886 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 849/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:00 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:01.538560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:01.539576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:01.555657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.557331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.558433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.559474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:01.560651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:01.561407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:01.817486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.827285 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22ff103d-5297-42fe-9d08-34137e901a6d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1276 microversion: 2.1 time: 0.299188 Oct 06 12:56:01.841929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 850/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:01 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:01.919446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:01.946165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-672d0105-252b-4ce7-86b3-cd1efd8b1ba7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.552483 Oct 06 12:56:01.947167 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 873/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:01 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:02.059368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dd83d10-3fba-4fca-8dda-86bf60a0473f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d3f352940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.130493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "dfe7bc37-ef26-4199-bf89-cfd34b50c2a9"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "a9f95510-a50f-4321-aeb1-72abd000876f"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-plugged", "status": "completed", "tag": "687ed948-038f-4ab0-85a5-1637f4781814"}, {"server_uuid": "76dbec89-3dd6-4a38-873d-f9dcff8f993f", "name": "network-vif-plugged", "status": "completed", "tag": "f6502784-f3aa-4ee9-841b-768fef81b0eb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:02.143226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dd83d10-3fba-4fca-8dda-86bf60a0473f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e" status: 200 len: 371 microversion: 2.1 time: 0.307717 Oct 06 12:56:02.143904 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 851/1724] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 12:56:01 2022] GET /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e => generated 371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:02.152200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.152686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.153122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.157428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Action: 'update', calling method: .version_select at 0x7f7d4773f310>, body: {"quota_set": {"ram": "5120"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:02.183457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Creating event network-vif-plugged:dfe7bc37-ef26-4199-bf89-cfd34b50c2a9 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:02.186359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Creating event network-vif-plugged:a9f95510-a50f-4321-aeb1-72abd000876f for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:02.189995 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Creating event network-vif-plugged:687ed948-038f-4ab0-85a5-1637f4781814 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:02.190707 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] Creating event network-vif-plugged:f6502784-f3aa-4ee9-841b-768fef81b0eb for instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f on n-h1-860556-1 Oct 06 12:56:02.208392 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a384cd58-8ad0-4bc2-a54a-32ab06c1cf10 req-84ced5a8-6499-4bde-b91f-877a7ac7a325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.081470 Oct 06 12:56:02.209304 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 874/1725] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:02.235902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.236388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.237216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.238507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.239231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.239901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.311453 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e118e47-ced2-4290-a513-0dc9085022ce tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e" status: 200 len: 328 microversion: 2.1 time: 0.157641 Oct 06 12:56:02.311453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 852/1726] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:56:02 2022] PUT /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e => generated 328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:02.323355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5e256ee-d46e-4c71-b0bf-759440d97a64 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.329373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.330724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:02.337897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.338595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.339335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.340408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.340984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.341560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.350023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5e256ee-d46e-4c71-b0bf-759440d97a64 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e" status: 202 len: 0 microversion: 2.1 time: 0.030733 Oct 06 12:56:02.351291 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 875/1727] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 12:56:02 2022] DELETE /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:56:02.358948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f09a9778-f566-4bc6-8e3c-a217c0b183e9 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d3eda2820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.634946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f09a9778-f566-4bc6-8e3c-a217c0b183e9 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e" status: 200 len: 371 microversion: 2.1 time: 0.279540 Oct 06 12:56:02.637664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 876/1728] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 12:56:02 2022] GET /compute/v2.1/os-quota-sets/3220f54dc9524485933d6d8ffd9d927e => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:02.661989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.675720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:02.695877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.698117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.698798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.700024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.700664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.701289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.782663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e711a23-5875-4e66-b329-57e0de51a8c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143458 Oct 06 12:56:02.784049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 877/1729] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:56:02 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:56:02.826791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:02.832656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:02.851045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.856667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.861258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:02.863783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:02.869204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:02.872266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.078192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:03.095387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:03.096829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:03.098036 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-daf08969-a843-4243-a654-74939d23836b tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.773251 Oct 06 12:56:03.098603 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 853/1730] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:02 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:03.109213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:03.110610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:03.118210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.119027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.119629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.120531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.121159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.121578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.399471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:03.413500 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be841a68-95b8-46b4-aca6-056979a8610b tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.627552 Oct 06 12:56:03.414279 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 878/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:02 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:03.432522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca24617b-cb65-419c-b0b3-5ff1f69101d1 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d3edaa940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:03.489062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:03.500203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abb0d6a1-edf4-48f9-a7eb-6cdbbd9cda8b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.395698 Oct 06 12:56:03.501255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 854/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:03 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:03.517926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:03.518808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:03.530919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.535268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.536764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.539779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.541360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.542307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.717150 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca24617b-cb65-419c-b0b3-5ff1f69101d1 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291/defaults" status: 200 len: 371 microversion: 2.1 time: 0.301430 Oct 06 12:56:03.717759 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 879/1733] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:56:03 2022] GET /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291/defaults => generated 371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:03.797540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:03.800503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:03.810451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.812491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.813007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.814281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:03.815180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:03.815791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:03.850307 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04899e06-d4e3-4f5c-b1c0-124ffbcde313 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.056947 Oct 06 12:56:03.851186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 880/1734] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:56:03 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:04.015915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3edf3a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:04.029917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:04.038522 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ba404be-c79a-4f25-aa47-b113822fedbd tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.534051 Oct 06 12:56:04.041001 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 855/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:03 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:04.128918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:04.129909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:04.138154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.140269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.143734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.143734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.143734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.145647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.262856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.263592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.264506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.265715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.266517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.267015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.278768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:04.345958 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3c055b5-2483-4b3b-be36-f0dbeb3f1886 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48" status: 200 len: 328 microversion: 2.1 time: 0.331913 Oct 06 12:56:04.347770 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 881/1736] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:56:04 2022] PUT /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48 => generated 328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:04.360604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d3f126430>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:04.482695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.483381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.483620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.487081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.488548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.490050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.535963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af1a1ef0-1fcd-4760-a371-3572400a743f tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48/detail" status: 200 len: 916 microversion: 2.1 time: 0.180894 Oct 06 12:56:04.537387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 882/1737] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 12:56:04 2022] GET /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48/detail => generated 916 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:04.542952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:04.544055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:04.551345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.552099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.552736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.553619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.554287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.554887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.705648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:04.725524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:04.742803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:04.744439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df593e5c-8495-48b2-a69d-9f6f2d7de546 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1874 microversion: 2.32 time: 0.620000 Oct 06 12:56:04.745569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 856/1738] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:04 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1874 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:04.752826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:04.753693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:04.762341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.763089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.763773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.764832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:04.765516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:04.766867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:04.997860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:05.006470 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70232bab-4a25-4e78-a737-0232b68d3b86 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1324 microversion: 2.1 time: 0.467765 Oct 06 12:56:05.007291 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 883/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:04 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:05.012421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:05.046922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.048544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.049118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.063399 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] Creating event network-changed:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:56:05.068728 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3d4ec71c-3dc6-4099-aeb2-9f381ee5661d req-3d913267-306f-4178-adde-057a35a51109 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060135 Oct 06 12:56:05.070045 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 884/1740] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:05.076368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3edce1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:05.165598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.166385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.166925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.168467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.169708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.170432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.182745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:05.198899 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22961bfc-4b9d-4243-a46d-b60c4912906d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.451527 Oct 06 12:56:05.199756 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 857/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:04 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:05.204959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:05.205571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:05.218628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.221394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.222087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.223877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.224622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.225416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.226443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.227140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.227802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.232117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.232762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.233226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.366627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:05.368937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea816498-c4d5-4968-9bcb-f7145699dd4d tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48?user_id=eacc74bf4ece4bcbb1ad528a5ebb22a8" status: 200 len: 328 microversion: 2.1 time: 0.297525 Oct 06 12:56:05.369606 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 885/1742] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 12:56:05 2022] PUT /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48?user_id=eacc74bf4ece4bcbb1ad528a5ebb22a8 => generated 328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:05.384729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2877279-5efc-4da4-aa1a-dba795ab23fd tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d3ee63a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:05.531173 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2877279-5efc-4da4-aa1a-dba795ab23fd tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48?user_id=eacc74bf4ece4bcbb1ad528a5ebb22a8" status: 200 len: 370 microversion: 2.1 time: 0.152485 Oct 06 12:56:05.535372 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 886/1743] 10.222.0.26 () {58 vars in 1323 bytes} [Thu Oct 6 12:56:05 2022] GET /compute/v2.1/os-quota-sets/bf6ca1a26a9f4c3a97a4291d3a584a48?user_id=eacc74bf4ece4bcbb1ad528a5ebb22a8 => generated 370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:05.620720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:05.630698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff6ad7ec-79ee-41e5-8ad1-a881efd065c8 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.429869 Oct 06 12:56:05.631285 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 858/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:05 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:05.784125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:05.785786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:05.801346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.803725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.804828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:05.807085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:05.808614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:05.810089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:06.000378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6587b2a6-f344-40bc-b63a-ed5f87d620d6 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Calling method '.version_select at 0x7f7d47765820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:06.275048 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6587b2a6-f344-40bc-b63a-ed5f87d620d6 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291/defaults" status: 200 len: 371 microversion: 2.1 time: 0.278838 Oct 06 12:56:06.277533 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 859/1745] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:56:05 2022] GET /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291/defaults => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:06.284208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:06.284888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:06.300853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:06.301725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:06.302483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:06.303794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:06.305099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:06.305858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:06.685243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:06.698786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:06.700710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:06.702591 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6647eb2e-6c06-418d-8393-d6481e4936db tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2826 microversion: 2.32 time: 0.924488 Oct 06 12:56:06.704018 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 887/1746] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:05 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2826 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:06.709063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:06.709762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:06.716519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:06.717245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:06.717995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:06.718928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:06.719908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:06.720331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:06.951118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:06.963411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-318c5c71-c880-4ef7-9606-fe2ad61d351a tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1521 microversion: 2.1 time: 0.684513 Oct 06 12:56:06.978471 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 860/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:06 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:06.993170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Action: 'update', calling method: .version_select at 0x7f7d477ca4c0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:07.071941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:07.075284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.076116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.077215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.078255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.079555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.080303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.084480 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5be6c762-3a6a-4c0f-8346-7e9f63539c0f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.379140 Oct 06 12:56:07.088142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 888/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:06 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:07.093270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:07.094667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:07.113434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.115514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.119061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.120027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.120675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.121293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.299163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:07.308459 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed80c5f8-c4a9-4f6f-b627-5f5eba054b4a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.218910 Oct 06 12:56:07.311337 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 889/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:07 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:07.317313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:07.318172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:07.330163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.331166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.331667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.332469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.333240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.333652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.342768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09636bf4-12be-48f9-8617-ebb8f035a834 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291" status: 200 len: 329 microversion: 2.1 time: 0.362904 Oct 06 12:56:07.344697 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 861/1750] 10.222.0.26 () {60 vars in 1263 bytes} [Thu Oct 6 12:56:06 2022] PUT /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291 => generated 329 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:07.355345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:07.355985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:07.363149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.363757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.364253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.365262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.365887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.366798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.424505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:56:07.497360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:07.504168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e45be844-38f9-4cff-9b90-72587eff4b52 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.191449 Oct 06 12:56:07.505039 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 890/1751] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 12:56:07 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e/os-interface => generated 1830 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:07.509833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd98acd-107f-4f05-861c-af855cd0c487", "tag": "86a83b62-bdff-4a20-9c7d-900fa67f1d2e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:07.532898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.533429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.533912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.562374 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2668f41e-3a32-4214-a1e9-7493f7a850ef tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 204 len: 0 microversion: 2.1 time: 0.214526 Oct 06 12:56:07.563924 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] Creating event network-changed:86a83b62-bdff-4a20-9c7d-900fa67f1d2e for instance cbd98acd-107f-4f05-861c-af855cd0c487 on n-h1-860556-1 Oct 06 12:56:07.564177 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 862/1752] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:56:07 2022] DELETE /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:56:07.570621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Action: 'update', calling method: .version_select at 0x7f7d47773c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:07.577322 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-14c44f53-4413-4e89-b971-7fa9cc8368ee req-da591078-8c07-487d-beae-0fd444dddb71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070743 Oct 06 12:56:07.577956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 891/1753] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:07.588417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:07.589121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:07.596594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.597082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.597521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.598249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.598708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.599131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.669522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.670129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.670640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.671607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:07.672131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:07.673284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:07.691595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=15,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:07.864507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:07.873439 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ae14681-843e-4d0d-9670-1c182a4d8504 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1527 microversion: 2.1 time: 0.293541 Oct 06 12:56:07.874729 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 892/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:07 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:08.085057 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99a6d501-587b-4017-9c67-ccb4af226616 tempest-QuotasAdminTestJSON-1780037547 tempest-QuotasAdminTestJSON-1780037547-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291" status: 200 len: 329 microversion: 2.1 time: 0.518909 Oct 06 12:56:08.086386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 863/1755] 10.222.0.26 () {60 vars in 1263 bytes} [Thu Oct 6 12:56:07 2022] PUT /compute/v2.1/os-quota-sets/51290e3af5ff4793a3b6c24294954291 => generated 329 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:08.108106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:08.108710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:08.123852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.126446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.126888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:08.128037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.128491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.128978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:08.336121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:08.336875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:08.346037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.346809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.347113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:08.347693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.348308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.348563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:08.728884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:08.749978 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-98022519-4402-4f0d-b414-8fd41f397deb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.645231 Oct 06 12:56:08.753418 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 893/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:08 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:08.898969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:08.900717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:08.915152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.916010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.916678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:08.917636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:08.920467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:08.921215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:09.042933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:09.056382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6240f7c6-ea1c-44c7-bdc6-6dab6cfb7bed tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.727735 Oct 06 12:56:09.073409 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 864/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:08 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:09.794784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:09.797613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:09.815353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:09.818425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:09.821318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:09.822634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:09.824122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:09.827561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:09.857913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:09.868411 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4731885-ddd4-47fb-ab55-3375e6367bf4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1527 microversion: 2.1 time: 0.973786 Oct 06 12:56:09.871022 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 894/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:08 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1527 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:10.081040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:10.082446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:10.092028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:10.093580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:10.094089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:10.095474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:10.095781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:10.096307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:10.610164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:10.631410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14f7cf84-c074-4bb2-b2b7-bec4eaa007b8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.842130 Oct 06 12:56:10.636176 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 865/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:09 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:10.770987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:10.784496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a08da0f8-843c-4585-81b9-f317b7138abc tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.706500 Oct 06 12:56:10.785910 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 895/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:10 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:10.936967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:10.969865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:10.983903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:10.985006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:10.986294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:10.987251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:10.987888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:10.988521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.192650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "tag": "a9f95510-a50f-4321-aeb1-72abd000876f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:11.226321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.227033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.230264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.252005 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] Creating event network-changed:a9f95510-a50f-4321-aeb1-72abd000876f for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:56:11.272190 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-71126913-6f56-45af-9604-97db9776d2b8 req-7d5694ce-27a9-4dea-8554-bbe9b7655ec8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084667 Oct 06 12:56:11.273116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 896/1761] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:11.329839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-plugged", "status": "completed", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:11.350177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.350688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.351129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.373232 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] Creating event network-vif-plugged:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:56:11.385648 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ce5d0bb2-1dda-441e-8664-1ba3fe0072ba req-6d26682b-ac26-42fa-a5df-cd65c75b5890 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060324 Oct 06 12:56:11.386856 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 897/1762] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:11.417103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:11.435902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07ec638c-6ea4-4a8c-8784-0783584a9aa4 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1527 microversion: 2.1 time: 0.541656 Oct 06 12:56:11.438570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 866/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:10 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1527 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:11.665327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:11.666665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:11.688360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.702797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.704477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.705625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.706237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.711962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.807719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:11.808606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:11.826824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.834018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.835741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:11.841835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:11.843943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:11.847573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:12.128403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:12.138502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf04058f-30dd-4a2d-8d5a-cce3b73b5832 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.478830 Oct 06 12:56:12.154626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 898/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:11 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:12.221773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:12.232936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1aa6508-0da8-475a-8850-a55bc79e5ee0 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.428996 Oct 06 12:56:12.236030 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 867/1765] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:11 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:12.460681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:12.462280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:12.480541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:12.481439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:12.482355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:12.487997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:12.488660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:12.489269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:12.570536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:12.582875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:12.583914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:12.585215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lazy-loading 'fault' on Instance uuid 76dbec89-3dd6-4a38-873d-f9dcff8f993f {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:56:12.696312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0c27e7810471cbb372142ad98f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb28a0405a14e06b2d6adc19aa13c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:12.705140 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d53f925-164a-4a23-a5f0-25eb3f853732 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 200 len: 1314 microversion: 2.1 time: 0.248213 Oct 06 12:56:12.709299 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 899/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:12 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:13.165089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:13.165718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:13.180787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:13.181290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:13.181784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:13.182708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:13.183326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:13.184007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:13.256308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:13.256921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:13.263958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:13.264451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:13.264887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:13.265602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:13.266152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:13.266817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.007018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:14.017036 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c80a8e0-b5db-4b21-911e-cb7ed5fe41fe tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.763808 Oct 06 12:56:14.031313 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 900/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:13 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:14.042326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76dbec89-3dd6-4a38-873d-f9dcff8f993f", "name": "network-vif-deleted", "tag": "f6502784-f3aa-4ee9-841b-768fef81b0eb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:14.055022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.055585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.056018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.070461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] Creating event network-vif-deleted:f6502784-f3aa-4ee9-841b-768fef81b0eb for instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f on n-h1-860556-1 Oct 06 12:56:14.079212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3a1d5b47-9ad7-4860-bdae-bad1323d216d req-fbe013ed-a100-480c-b906-8f3c6f22243b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045295 Oct 06 12:56:14.079839 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 901/1768] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.084629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:14.086338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd98acd-107f-4f05-861c-af855cd0c487", "name": "network-vif-plugged", "status": "completed", "tag": "86a83b62-bdff-4a20-9c7d-900fa67f1d2e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:14.096744 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fde3f8a2-fc13-4f6e-98b8-054667ff03af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.935745 Oct 06 12:56:14.111615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.116010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.116508 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 868/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:13 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:14.117109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.146090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] Creating event network-vif-plugged:86a83b62-bdff-4a20-9c7d-900fa67f1d2e for instance cbd98acd-107f-4f05-861c-af855cd0c487 on n-h1-860556-1 Oct 06 12:56:14.152468 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6be8286d-ae51-4c05-bbdd-de2a20d153ce req-4590097b-6863-4f29-bd82-65499b5136fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071146 Oct 06 12:56:14.153257 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 902/1770] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.169207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.170916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 76dbec89-3dd6-4a38-873d-f9dcff8f993f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:14.180647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.181367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.182004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.183302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.183929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.184572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.201235 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f HTTP/1.1 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:14.205406 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. Oct 06 12:56:14.207566 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '76dbec89-3dd6-4a38-873d-f9dcff8f993f'} Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:14.208734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. Oct 06 12:56:14.210487 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.212171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance 76dbec89-3dd6-4a38-873d-f9dcff8f993f could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:14.212171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0da62d9b-e62e-4e01-bc18-4a54ecfbc9f3 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f" status: 404 len: 111 microversion: 2.1 time: 0.052482 Oct 06 12:56:14.212171 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 903/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/servers/76dbec89-3dd6-4a38-873d-f9dcff8f993f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:56:14.215847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13a7dc19-d4ea-41a2-b8f9-a829ac4d1fab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3eda2b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.260438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-13a7dc19-d4ea-41a2-b8f9-a829ac4d1fab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Image not found. Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13a7dc19-d4ea-41a2-b8f9-a829ac4d1fab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076 HTTP/1.1 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:14.262436 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c4d8d85d-e082-4ec6-9ab5-e23f09291076'} Oct 06 12:56:14.264261 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c4d8d85d-e082-4ec6-9ab5-e23f09291076 to delete Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.265371 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4d8d85d-e082-4ec6-9ab5-e23f09291076 could not be found. Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:14.267413 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13a7dc19-d4ea-41a2-b8f9-a829ac4d1fab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:14.268834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13a7dc19-d4ea-41a2-b8f9-a829ac4d1fab tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076" status: 404 len: 62 microversion: 2.1 time: 0.053423 Oct 06 12:56:14.270314 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 904/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:14 2022] DELETE /compute/v2.1/images/c4d8d85d-e082-4ec6-9ab5-e23f09291076 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:56:14.278565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.283677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:14.293327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.293869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.294308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.295017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.295953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.296412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.317896 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 HTTP/1.1 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:14.319753 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.321344 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4cea416a-4bfa-44c9-bd05-0e1dcb86d793'} Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:14.322254 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.323639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.328323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:14.329995 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62505295-cb5f-4300-b6a6-8b88736083b9 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 404 len: 111 microversion: 2.1 time: 0.059548 Oct 06 12:56:14.331286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 905/1773] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:56:14 2022] DELETE /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:56:14.340422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.341378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: 4cea416a-4bfa-44c9-bd05-0e1dcb86d793] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:14.349650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.359629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.361766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.370829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.371716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.372400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.384661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.389257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.391363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.394212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.398290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.398947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.400711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.401711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 HTTP/1.1 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:14.403409 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.404916 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4cea416a-4bfa-44c9-bd05-0e1dcb86d793'} Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:14.406498 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. Oct 06 12:56:14.409145 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:14.410697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance 4cea416a-4bfa-44c9-bd05-0e1dcb86d793 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:14.410697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44baf414-a37f-4994-add3-76b667444945 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793" status: 404 len: 111 microversion: 2.1 time: 0.069487 Oct 06 12:56:14.410697 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 906/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/servers/4cea416a-4bfa-44c9-bd05-0e1dcb86d793 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:56:14.415524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d36e40b-8c18-44d5-85e4-617598057479 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3f00d940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.444138 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d36e40b-8c18-44d5-85e4-617598057479 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262737026" status: 202 len: 0 microversion: 2.1 time: 0.032316 Oct 06 12:56:14.447199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 907/1775] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 12:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262737026 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:56:14.500865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c46ab5ab-f45e-4b11-9abb-dcd9270a5e34 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.382216 Oct 06 12:56:14.505639 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 869/1776] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.520348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.526008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.527005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.527703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.528907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.529602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.530306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.560544 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3337dbc-6369-4dda-8df7-2eb2a22e7981 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045149 Oct 06 12:56:14.570014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 908/1777] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.579723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.584651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.585569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.586249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.587163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.587810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.589168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.626605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03315713-798a-4dc6-abf0-1ba39d919a32 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053559 Oct 06 12:56:14.627552 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 870/1778] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.639413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.645849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.645849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.645849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.646919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.649124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.651896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.666149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:14.698017 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1a3383d-5454-408b-a2f6-09830fdb4956 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860556-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.062127 Oct 06 12:56:14.699360 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 909/1779] 10.222.0.26 () {58 vars in 1194 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services?host=n-d-860556-1&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:56:14.713457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.717094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.717589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.718060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.719536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.719992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.720426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.760331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d624205e-81d2-4dd2-a959-b5964c53605a tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050462 Oct 06 12:56:14.761574 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 871/1780] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:14.776129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:14.784962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.786294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.786748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.808490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:14.810193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:14.815877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:14.862077 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8920ab4-ecec-4cae-b2ac-8e34d1bc4713 tempest-ServicesAdminNegativeTestJSON-273818000 tempest-ServicesAdminNegativeTestJSON-273818000-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.092197 Oct 06 12:56:14.863722 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 910/1781] 10.222.0.26 () {58 vars in 1198 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:56:15.044354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.045021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:15.058435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.059674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.060136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.060865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.061326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.061776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.065539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd63507d-3986-438f-965a-9d81091f961c tempest-ServicesAdminNegativeTestJSON-1594024269 tempest-ServicesAdminNegativeTestJSON-1594024269-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.069498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd63507d-3986-438f-965a-9d81091f961c tempest-ServicesAdminNegativeTestJSON-1594024269 tempest-ServicesAdminNegativeTestJSON-1594024269-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '75e7a2af00604c4f82b5689574f44321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf518eb7154d8180d0a3df0dd07ced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd63507d-3986-438f-965a-9d81091f961c tempest-ServicesAdminNegativeTestJSON-1594024269 tempest-ServicesAdminNegativeTestJSON-1594024269-project] Request method failure captured: Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtBsLltJEBkbbMsqlNHhkTAcqdK20OUTnRwBYQFMTj3mKhRTP0PTfOotpjoqUJpgE_ZdpjOP2ylTfeyRFTArupBCgZrdGSb0fZcoZu2PF5yifOcLdLwzLMH891lH5qFLuPtxBBMew2aJOT3kDSdMQhBl6nqb1JLAVeqKDGLojTvU29g Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 72bf518eb7154d8180d0a3df0dd07ced Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1594024269 Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:56:15.076291 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_72bf518eb7154d8180d0a3df0dd07ced", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/72bf518eb7154d8180d0a3df0dd07ced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/72bf518eb7154d8180d0a3df0dd07ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/72bf518eb7154d8180d0a3df0dd07ced"}]}] Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1594024269 Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 72bf518eb7154d8180d0a3df0dd07ced Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1594024269 Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServicesAdminNegativeTestJSON-1594024269-project Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 75e7a2af00604c4f82b5689574f44321 Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1594024269-project Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:15.078154 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:56:15.079786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:15.081316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.084557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd63507d-3986-438f-965a-9d81091f961c tempest-ServicesAdminNegativeTestJSON-1594024269 tempest-ServicesAdminNegativeTestJSON-1594024269-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:15.085626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd63507d-3986-438f-965a-9d81091f961c tempest-ServicesAdminNegativeTestJSON-1594024269 tempest-ServicesAdminNegativeTestJSON-1594024269-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.213533 Oct 06 12:56:15.088160 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 872/1782] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:56:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:56:15.131448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.135347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:15.158757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.174676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.174676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.174676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.174676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.175231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.483986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:15.494634 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11e5927b-2ab2-494b-8fab-7da1be807def tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1473 microversion: 2.1 time: 0.453961 Oct 06 12:56:15.495533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 911/1783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:15 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:15.613507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:15.624806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22e20182-80a3-401c-9c82-5c06e21a2924 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1318 microversion: 2.1 time: 0.507726 Oct 06 12:56:15.634072 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 873/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:15 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:15.635455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=28 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:15.650795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72072325-38bc-4f0a-b5a2-71e1d550aae6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '.version_select at 0x7f7d3ee6ff70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.692162 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-72072325-38bc-4f0a-b5a2-71e1d550aae6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Image not found. Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72072325-38bc-4f0a-b5a2-71e1d550aae6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/0f722dde-4d80-42d0-804d-fb73e7b0b54a HTTP/1.1 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:15.695454 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0f722dde-4d80-42d0-804d-fb73e7b0b54a'} Oct 06 12:56:15.697394 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f722dde-4d80-42d0-804d-fb73e7b0b54a to delete Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.698733 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f722dde-4d80-42d0-804d-fb73e7b0b54a could not be found. Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:15.700884 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72072325-38bc-4f0a-b5a2-71e1d550aae6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:15.703976 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-72072325-38bc-4f0a-b5a2-71e1d550aae6 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/images/0f722dde-4d80-42d0-804d-fb73e7b0b54a" status: 404 len: 62 microversion: 2.1 time: 0.062778 Oct 06 12:56:15.705542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 912/1785] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:15 2022] DELETE /compute/v2.1/images/0f722dde-4d80-42d0-804d-fb73e7b0b54a => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:56:15.706871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.707534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:15.721164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.721693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.722573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.723665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.724022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.724474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.758098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c HTTP/1.1 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:56:15.760293 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.762115 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c'} Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:15.763113 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.764735 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.766415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:15.766415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22fc5189-7040-4cf7-b0c3-a1fd98fe3a5d tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 404 len: 111 microversion: 2.1 time: 0.060124 Oct 06 12:56:15.771982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:15.772620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] [instance: ff81df07-d7ab-4b15-ae79-c1ad5e17a79c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:15.777131 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 874/1786] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:56:15 2022] DELETE /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:56:15.781341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.782184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.782707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.784271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:15.785034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:15.786177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:15.818069 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] HTTP exception thrown: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Request method failure captured: Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c HTTP/1.1 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_2DkG1LuRDwdGhpDVPePi70iAAlZwLjmw-eGTSdD-4n39rnEVxMt7pD_OroSmr8zpwsVkNCdr4os-zp_JSn11NcXrYym5PsTllvkU9Mpm2R_zLBvDvXPA3CNDEZw7mZt4MhE9FD6CKh7yXuev6wXRA-Q_y3pAisA2mE76OBNzqduM Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:56:15.820407 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3fb28a0405a14e06b2d6adc19aa13c55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3fb28a0405a14e06b2d6adc19aa13c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3fb28a0405a14e06b2d6adc19aa13c55"}]}] Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3fb28a0405a14e06b2d6adc19aa13c55 Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996 Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 07b0c27e7810471cbb372142ad98f650 Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1859837996-project Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.822314 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ff81df07-d7ab-4b15-ae79-c1ad5e17a79c'} Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:15.823340 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. Oct 06 12:56:15.824980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:15.826501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] Returning 404 to user: Instance ff81df07-d7ab-4b15-ae79-c1ad5e17a79c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:15.827021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-865628ca-bf77-4b53-a275-79cab5b57f44 tempest-ImagesOneServerNegativeTestJSON-1859837996 tempest-ImagesOneServerNegativeTestJSON-1859837996-project] 10.222.0.26 "GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c" status: 404 len: 111 microversion: 2.1 time: 0.059400 Oct 06 12:56:15.827907 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 913/1787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:15 2022] GET /compute/v2.1/servers/ff81df07-d7ab-4b15-ae79-c1ad5e17a79c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:56:16.521296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:16.522133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:16.529424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:16.537106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:16.538111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:16.539508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:16.542507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:16.543657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:16.652364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:16.652984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:16.662909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:16.663403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:16.663884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:16.666043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:16.667418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:16.668722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:16.883878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:16.899805 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c39fcc4-fc56-44be-a66e-a0ceac3e53c1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.381812 Oct 06 12:56:16.900593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 875/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:16 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:17.035226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:17.049414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34a7497e-bf2e-4b32-9c0a-dd0ed1370b96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1467 microversion: 2.1 time: 0.401333 Oct 06 12:56:17.059461 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 914/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:16 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1467 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:17.075887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:17.076501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:17.089515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.090398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.091096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.092182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.093034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.100678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.588769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:17.602584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b23bcc1-1006-44fe-8b5d-baa746e93978 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1465 microversion: 2.1 time: 0.530468 Oct 06 12:56:17.603183 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 876/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:17 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1465 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:17.627175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2085915776"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:17.630341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:17.638322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.639630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.640383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.641396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.642200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.642899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.928080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:17.929933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:17.945301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.946380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.947594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.948888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:17.949578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:17.950366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:17.997323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8fa44bc-f7a5-45e4-bfd4-26c93ef85d46 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "POST /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972/action" status: 202 len: 0 microversion: 2.1 time: 0.373494 Oct 06 12:56:18.019682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 915/1791] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:56:17 2022] POST /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:56:18.035872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7cf70c1d-ccf1-4a34-9111-3ebde1a8b35b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed69790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:18.077725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=92 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:18.107455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7cf70c1d-ccf1-4a34-9111-3ebde1a8b35b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.086236 Oct 06 12:56:18.117231 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 916/1792] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:18 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:18.368538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:18.381989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-826f4ab6-2d40-4b71-94d3-1c42ae5eb375 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.461366 Oct 06 12:56:18.385178 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 877/1793] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:17 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:19.132119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3885a084-e77f-4d44-a5a6-a6b28dfd2dbf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f072820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:19.215271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3885a084-e77f-4d44-a5a6-a6b28dfd2dbf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.095109 Oct 06 12:56:19.226491 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 917/1794] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:19 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:19.413831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:19.415959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:19.436819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:19.437330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:19.443937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:19.444886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:19.445389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:19.445853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:19.542456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-unplugged", "status": "completed", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:19.575294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:19.575625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:19.591275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:19.637658 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] Creating event network-vif-unplugged:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:56:19.671531 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7afe411a-7be4-4007-8f12-c14d3233fb0c req-e94fe3d8-ad9f-4ce8-b95b-f25b5fe88d7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122993 Oct 06 12:56:19.683596 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 918/1795] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:19.889828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:19.905357 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9912b213-487a-4595-97d9-291f0cade4a7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.499748 Oct 06 12:56:19.907740 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 878/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:19 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:20.234763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee094a01-1ec4-44f1-b16c-436427b98380 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.330908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee094a01-1ec4-44f1-b16c-436427b98380 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.100590 Oct 06 12:56:20.332116 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 879/1797] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:20.433114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3edaaee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:20.440189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.441635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.442726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.454146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.457636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.460757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.471382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] HTTP exception thrown: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Request method failure captured: Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd HTTP/1.1 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 56 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtBzTqjKUqRH30eOATqTIJGV1MwThp1bmQLCQUr0Gvvfcrc-ebHMVswo3rOvWCPAIAc9EeWhRtInnZgqCfXJHgT3H7k0OVM87ZVBfS3ZHsXYwCxHRLM023mhHhuEwJvxzuB9R-a4S02aG8wdqbP9f5OO1_sPW116xvhht0qhPxZNDfk Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.53 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:56:20.474750 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_301b5daee3544423997783a77246e237", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/301b5daee3544423997783a77246e237"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}] Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 0b4813acd6964621a49320e8a6680abd Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:56:20.476437 n-d-860556-1 devstack@n-api.service[129615]: exception: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7dbac7af-c5a2-4be2-aef7-59601a935fbd', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.477518 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.479584 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:20.481257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:20.481257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.481257 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.484111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Returning 404 to user: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:20.486429 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c130e99f-46a6-4851-820e-9efa151ed319 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd" status: 404 len: 110 microversion: 2.53 time: 0.416915 Oct 06 12:56:20.487753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 919/1798] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Oct 6 12:56:20 2022] PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd => generated 110 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:56:20.498080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Action: 'update', calling method: .version_select at 0x7f7d476c0a60>, body: {"status": "disabled"} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:20.504054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.504852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.505656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.516884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=17 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:20.518633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.519354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.520786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.529564 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] HTTP exception thrown: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Request method failure captured: Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd HTTP/1.1 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 22 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtBzTqjKUqRH30eOATqTIJGV1MwThp1bmQLCQUr0Gvvfcrc-ebHMVswo3rOvWCPAIAc9EeWhRtInnZgqCfXJHgT3H7k0OVM87ZVBfS3ZHsXYwCxHRLM023mhHhuEwJvxzuB9R-a4S02aG8wdqbP9f5OO1_sPW116xvhht0qhPxZNDfk Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.53 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:56:20.531425 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_301b5daee3544423997783a77246e237", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/301b5daee3544423997783a77246e237"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}] Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0b4813acd6964621a49320e8a6680abd Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: {"status": "disabled"} Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: exception: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.533316 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '7dbac7af-c5a2-4be2-aef7-59601a935fbd', 'body': {'status': 'disabled'}} Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.534558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:20.536327 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:20.538997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.538997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.538997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Returning 404 to user: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:20.538997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e8dfaf4-f641-46c5-869b-1479e672d391 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd" status: 404 len: 110 microversion: 2.53 time: 0.040406 Oct 06 12:56:20.545239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3ed69670>, body: {"status": "enabled"} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:20.548967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.549461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.549835 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 880/1799] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Oct 6 12:56:20 2022] PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:56:20.550204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.556507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.557324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.559462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.572021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] HTTP exception thrown: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Request method failure captured: Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd HTTP/1.1 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 21 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtBzTqjKUqRH30eOATqTIJGV1MwThp1bmQLCQUr0Gvvfcrc-ebHMVswo3rOvWCPAIAc9EeWhRtInnZgqCfXJHgT3H7k0OVM87ZVBfS3ZHsXYwCxHRLM023mhHhuEwJvxzuB9R-a4S02aG8wdqbP9f5OO1_sPW116xvhht0qhPxZNDfk Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.53 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:56:20.574542 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_301b5daee3544423997783a77246e237", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/301b5daee3544423997783a77246e237"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/301b5daee3544423997783a77246e237"}]}] Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 301b5daee3544423997783a77246e237 Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493 Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 0b4813acd6964621a49320e8a6680abd Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: {"status": "enabled"} Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: exception: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.576186 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7dbac7af-c5a2-4be2-aef7-59601a935fbd', 'body': {'status': 'enabled'}} Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.577428 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:20.579546 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:20.580899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. Oct 06 12:56:20.580899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:56:20.582729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Returning 404 to user: Service 7dbac7af-c5a2-4be2-aef7-59601a935fbd could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:20.584188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ee27ad25-6bc2-4c0a-9815-f808f4fe2932 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd" status: 404 len: 110 microversion: 2.53 time: 0.042670 Oct 06 12:56:20.592298 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 920/1800] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Oct 6 12:56:20 2022] PUT /compute/v2.1/os-services/7dbac7af-c5a2-4be2-aef7-59601a935fbd => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 12:56:20.597135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.602266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.605918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.606515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.607493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.608033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.608542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.653584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:20.678342 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b422e765-d16a-41aa-baa5-f9db3dfda4f2 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.085546 Oct 06 12:56:20.679416 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 881/1801] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:56:20.693225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.698373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.699282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.699737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.700486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.701203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.701641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.730346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a7737f21-9329-443c-b73a-2ba54583b2a6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041131 Oct 06 12:56:20.740099 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 921/1802] 10.222.0.26 () {60 vars in 1211 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:20.746590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.751676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.752566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.753331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.754200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.754885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.755858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.796486 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-530241cd-034c-462f-a435-8b31fa2bb9a1 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054725 Oct 06 12:56:20.797888 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 882/1803] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:20.810323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.814855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.815071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.817540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.821049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.821543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.822011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.881385 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d8b3c62-5612-48a2-852d-b2bdbfb7f425 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860556-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.074890 Oct 06 12:56:20.894286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 922/1804] 10.222.0.26 () {60 vars in 1235 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/os-services?host=n-d-860556-1&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:20.899227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.904429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.905207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.906505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.908207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.910698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.912388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.932721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:20.933471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:20.946379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.947670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.947670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.948323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:20.948790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:20.949221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:20.993603 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d90f765-e457-4818-85c3-38416d0d85fb tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.098445 Oct 06 12:56:21.000218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 883/1805] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:21.007266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:21.011283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:21.011793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:21.012244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:21.013123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:21.013567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:21.014049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:21.043754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-433893bc-eac1-4726-98ac-b2bb7a1cfcf6 tempest-ServicesAdminNegativeV253TestJSON-1871344493 tempest-ServicesAdminNegativeV253TestJSON-1871344493-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040818 Oct 06 12:56:21.052425 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 884/1806] 10.222.0.26 () {60 vars in 1239 bytes} [Thu Oct 6 12:56:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:21.197406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdd12114-4c5c-4b6b-9851-f3339aee4307 tempest-ServicesAdminNegativeV253TestJSON-1690345129 tempest-ServicesAdminNegativeV253TestJSON-1690345129-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:21.200942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdd12114-4c5c-4b6b-9851-f3339aee4307 tempest-ServicesAdminNegativeV253TestJSON-1690345129 tempest-ServicesAdminNegativeV253TestJSON-1690345129-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1b1599de42d541b2aa6b5d09f54c9571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fe820af1974cc19c3863e87a971cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdd12114-4c5c-4b6b-9851-f3339aee4307 tempest-ServicesAdminNegativeV253TestJSON-1690345129 tempest-ServicesAdminNegativeV253TestJSON-1690345129-project] Request method failure captured: Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtByUQ6DYcLTAUF11up6eM5sVEqU6B87TmukxBCHlVY8H_3adr91G45tHiH_NVv5O6ZZVbKDj_jWWm9q1frCuWsvWTBOkt7tXsHvqe150eop67uC69JiQ2FaIRxyLPU-fHZwRBefx8PPf9VlPN1pgxzq4deb-nLkWK4BLAVa0Qd3Y6k Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.53 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 49fe820af1974cc19c3863e87a971cbe Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1690345129 Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:56:21.216106 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49fe820af1974cc19c3863e87a971cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49fe820af1974cc19c3863e87a971cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49fe820af1974cc19c3863e87a971cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49fe820af1974cc19c3863e87a971cbe"}]}] Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1690345129 Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 49fe820af1974cc19c3863e87a971cbe Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1690345129 Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1690345129-project Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1b1599de42d541b2aa6b5d09f54c9571 Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1690345129-project Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:21.218219 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 12:56:21.223191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 06 12:56:21.224743 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:21.227119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdd12114-4c5c-4b6b-9851-f3339aee4307 tempest-ServicesAdminNegativeV253TestJSON-1690345129 tempest-ServicesAdminNegativeV253TestJSON-1690345129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:21.227119 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fdd12114-4c5c-4b6b-9851-f3339aee4307 tempest-ServicesAdminNegativeV253TestJSON-1690345129 tempest-ServicesAdminNegativeV253TestJSON-1690345129-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.164268 Oct 06 12:56:21.227119 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 885/1807] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Oct 6 12:56:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 06 12:56:21.351263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6f98efeb-e9b4-41d0-9642-4322461601b4 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476f28b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:21.435208 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6f98efeb-e9b4-41d0-9642-4322461601b4 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.090780 Oct 06 12:56:21.436087 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 886/1808] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:21 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:21.491909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:21.518092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62f8334e-4ce2-45e0-893b-f577a2a1e643 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.588379 Oct 06 12:56:21.519532 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 923/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:20 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:22.460979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-613f03d2-370f-4006-91d0-3e2850a0df1c tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c4940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:22.531743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-613f03d2-370f-4006-91d0-3e2850a0df1c tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.079253 Oct 06 12:56:22.532693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 887/1810] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:22 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:22.544887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:22.546265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:22.554595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:22.555421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:22.556060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:22.557016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:22.557555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:22.558123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:22.746430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:22.756929 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0bd1a0e-21db-4353-887e-a89751ed3358 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.215851 Oct 06 12:56:22.758754 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 924/1811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:22 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:23.087550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-354607718", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4f0ce63f-ea60-4427-922a-c32b96edb684"}], "block_device_mapping_v2": [{"uuid": "dccedd8a-c546-4667-8d91-9df3526d466a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:23.175946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] validate_networks() for [('4f0ce63f-ea60-4427-922a-c32b96edb684', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:56:23.547330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82680086-d0cd-4e74-afd5-6be0f486cf93 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7c9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:23.623056 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82680086-d0cd-4e74-afd5-6be0f486cf93 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.080109 Oct 06 12:56:23.623816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 925/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:23 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:23.781042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:23.782597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:23.814918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:23.815431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:23.815880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:23.823725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:23.824172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:23.826674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:23.829837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:56:23.830279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:56:23.830640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:56:23.831066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:56:23.831492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:56:23.842964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:23.844300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:23.844969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:23.846062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:23.846745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:23.847409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:23.873965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:56:23.879611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Getting quotas for user 1f58173845e04996a0a5c2497e13d3cc and project 1be9f8d0d5cd4c95a81317a2fee17cf2. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:56:24.010757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:56:24.013281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dccedd8a-c546-4667-8d91-9df3526d466a',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:56:24.198091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:24.215282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3d37749-920f-4fb6-9cf5-cb1588c11aa1 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.432656 Oct 06 12:56:24.223594 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 926/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:23 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:24.311725 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5275a969-d617-4908-83f3-03393931933e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233239 Oct 06 12:56:24.313127 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 888/1814] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:56:24.327742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-276bd4fd-6c58-4e57-8f58-4fcb870fb895 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:24.336671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-276bd4fd-6c58-4e57-8f58-4fcb870fb895 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:24.471152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-276bd4fd-6c58-4e57-8f58-4fcb870fb895 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:24.493806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-276bd4fd-6c58-4e57-8f58-4fcb870fb895 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1052 microversion: 2.1 time: 0.173191 Oct 06 12:56:24.506865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 889/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:24 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1052 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:24.529221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-plugged", "status": "completed", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:24.562461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:24.563502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:24.563951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:24.580842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Calling method '.version_select at 0x7f7d3edaaee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:24.602754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] Creating event network-vif-plugged:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:56:24.612217 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-21206969-76b5-422c-aa0e-72d8363541d1 req-f4824698-b741-40a7-8515-3ae1ca83bc90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090983 Oct 06 12:56:24.613923 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 890/1816] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:24.621209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:24.636104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:24.644390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:24.650146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:24.653315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:24.654979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:24.658983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d992e98e-33ce-45c1-bef4-be7600e4de43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f04c670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:24.734192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec5cc731-23e2-43ed-8f6d-0104254d4398 tempest-AbsoluteLimitsTestJSON-410009258 tempest-AbsoluteLimitsTestJSON-410009258-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.474199 Oct 06 12:56:24.752680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 927/1817] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Oct 6 12:56:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:24.769486 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d992e98e-33ce-45c1-bef4-be7600e4de43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.127755 Oct 06 12:56:24.770856 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 891/1818] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:24 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:25.255802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:25.256782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:25.273286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:25.275378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:25.277478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:25.292735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:25.299094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:25.301150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:25.538138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:25.539029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:25.552389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:25.552900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:25.556471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:25.557307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:25.557938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:25.558487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:25.603454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:25.617714 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-706d59da-2bea-4856-9547-07300e8e26de tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 0.366982 Oct 06 12:56:25.638731 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 928/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:25 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:25.686208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:25.709533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c042a9c-3f95-4b7e-8edc-8ccfa842da8d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1102 microversion: 2.1 time: 0.176281 Oct 06 12:56:25.710732 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 892/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:25 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1102 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:25.799564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52e79b9e-fd96-478c-9a72-e42c56084d03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed63040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:26.033023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52e79b9e-fd96-478c-9a72-e42c56084d03 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.248746 Oct 06 12:56:26.034031 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 929/1821] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:25 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:26.654607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:26.654607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:26.670777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:26.671679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:26.672468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:26.673480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:26.674253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:26.676714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:26.703603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-plugged", "status": "completed", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:26.743128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:26.743128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:26.743128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:26.800020 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] Creating event network-vif-plugged:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:56:26.821083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-33aae81e-5aa2-4d97-bfa0-4ee08cd7bece req-c4d2ba8f-24e8-4599-ba64-0071b26b3a95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122711 Oct 06 12:56:26.822499 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 930/1822] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:26.830860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:26.832239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:26.840778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:26.841639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:26.842332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:26.843509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:26.844213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:26.844849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:27.881952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:27.902398 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62d31822-60c6-4b34-a88f-f52089618b50 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1158 microversion: 2.1 time: 1.071550 Oct 06 12:56:27.903597 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 931/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:26 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1158 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:27.910848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9370f17d-37e3-4507-b9b6-4cb1b65839d8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eda24c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:28.023290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9370f17d-37e3-4507-b9b6-4cb1b65839d8 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.118261 Oct 06 12:56:28.024116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 932/1824] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:27 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:28.578079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:28.612091 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-604e1c8e-9e05-43ed-973d-437180ac8f2e tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 1.970108 Oct 06 12:56:28.634402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 893/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:26 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:28.932037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:28.933526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:28.942627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:28.961697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:28.965062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:28.966829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:28.970856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:28.973379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:28.975957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:29.040250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73816d1d-1832-433b-948a-9837010efb2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476fb940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:29.174880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73816d1d-1832-433b-948a-9837010efb2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.139115 Oct 06 12:56:29.197048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 894/1826] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:29 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:29.277277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:29.290165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c6abcf9-67d9-4d0e-b34d-ad859aaa822c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1168 microversion: 2.1 time: 0.364841 Oct 06 12:56:29.294048 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 933/1827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:28 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1168 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:29.765944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:29.815072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:29.868251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:29.873719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:29.876805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:29.879190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:29.880525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:29.881541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:29.942628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:30.203938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39657ec6-29de-4b81-ab07-2cb2aa3c5aeb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ee6f0d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:30.306830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39657ec6-29de-4b81-ab07-2cb2aa3c5aeb tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.107187 Oct 06 12:56:30.317847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 934/1828] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:30 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:30.332910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:30.337459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:30.371841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:30.372178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:30.374603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:30.375449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:30.380484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:30.385205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:31.647243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:31.666149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b681a3fa-4e45-4e27-ba20-ec00a7929343 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1168 microversion: 2.1 time: 1.345102 Oct 06 12:56:31.678586 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 935/1829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:30 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1168 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:31.690653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2f94356-e8a0-4209-a1ea-e95de36469a7 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7a940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:31.821225 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2f94356-e8a0-4209-a1ea-e95de36469a7 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.141076 Oct 06 12:56:31.830887 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 936/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:31 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:31.934177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:31.947015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56cc7b67-70d9-4caf-aec4-db9e0c244812 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1479 microversion: 2.1 time: 2.265104 Oct 06 12:56:31.950947 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 895/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:29 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1479 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:32.697412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:32.697412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:32.754110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:32.758017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:32.759316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:32.762179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:32.766851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:32.770083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:32.841115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85642b2f-319a-445f-bcee-652731874ff3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c4310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:32.974228 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85642b2f-319a-445f-bcee-652731874ff3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.137761 Oct 06 12:56:32.985803 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 896/1832] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:32 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:32.997668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:32.998331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:33.018215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:33.018718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:33.019166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:33.019952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:33.020437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:33.023330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:33.862517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=11 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:33.989301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:34.012169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:34.035967 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-279957ff-9800-4285-a48b-0b032e8da35a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1464 microversion: 2.1 time: 1.035607 Oct 06 12:56:34.036969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 897/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:32 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1464 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:34.052091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7175739b-d0f0-43f2-9fbc-158eb030f4e2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c4ca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:34.060142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87e34cf0-a4dd-481c-b6fe-032b2f848422 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1210 microversion: 2.1 time: 1.369657 Oct 06 12:56:34.081555 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 937/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:32 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1210 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:34.112666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:34.128306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:34.157343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:34.158177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:34.158845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:34.162430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:34.165717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:34.169024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:34.195972 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7175739b-d0f0-43f2-9fbc-158eb030f4e2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.157565 Oct 06 12:56:34.204157 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 898/1835] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:34 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:34.374864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:34.566496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8318035-7000-49d1-a705-0dd6837752dc tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 0 microversion: 2.1 time: 0.457843 Oct 06 12:56:34.570851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 938/1836] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:56:34 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:56:34.573192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:34.588589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:34.589521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:34.640709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:34.646821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:34.648872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:34.652659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:34.656666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:34.657414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:34.773351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:34.785833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:34.789565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:34.795887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lazy-loading 'fault' on Instance uuid 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:56:35.107062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:35.109151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:35.113620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:35.120119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=25 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:35.139934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:35.140635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:35.141084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:35.141855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:35.142320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:35.142762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:35.539581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:35.548327 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba8a1db1-d927-4a11-a04e-c3f6cdd10291 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1210 microversion: 2.1 time: 0.446257 Oct 06 12:56:35.552641 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 939/1837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:35 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1210 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:35.563167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab502f29-bda2-4a5e-9790-ca6c2c28f4aa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edce160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:35.668537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab502f29-bda2-4a5e-9790-ca6c2c28f4aa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.113976 Oct 06 12:56:35.670591 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 940/1838] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:35 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:35.746783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e16ef2fa-1e81-43c5-9d62-cc9d31926513 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1598 microversion: 2.1 time: 1.174400 Oct 06 12:56:35.747557 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 899/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:34 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1598 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:35.777715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:35.780602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:35.798169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:35.802754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:35.810022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:35.816194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:35.818715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:35.819479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.050169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ed61abc-2fbc-4ec8-85a2-789c3e35dc75 tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action" status: 202 len: 0 microversion: 2.1 time: 0.277245 Oct 06 12:56:36.051705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 941/1840] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:56:35 2022] POST /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:56:36.060453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:36.061569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:36.077366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.080143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.081076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.082373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.083820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.085976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.450180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589391fb-b695-41bd-beb8-cb5f135506bd", "tag": "5b008fe2-700d-46f4-90ba-c14c9ca570ce"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:36.477955 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2082201e-851b-47f3-9017-f3508f66e52c tempest-ServersAdminTestJSON-1594640265 tempest-ServersAdminTestJSON-1594640265-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1615 microversion: 2.1 time: 0.421519 Oct 06 12:56:36.479069 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 900/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:36 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1615 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:36.496672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.499525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.506241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.512333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:36.513612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:36.527197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.532636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.534309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.537520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.541329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.566133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.573065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] Creating event network-changed:5b008fe2-700d-46f4-90ba-c14c9ca570ce for instance 589391fb-b695-41bd-beb8-cb5f135506bd on n-h2-860556-1 Oct 06 12:56:36.592400 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-15912f35-0215-4a47-973b-1e7ecb213775 req-743da605-bff6-4648-8e62-1f5945a56d09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146815 Oct 06 12:56:36.597012 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 942/1842] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:56:36.620682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:36.626878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:36.627077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:56:36.660074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.665241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.666740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.667681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:36.669659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:36.670633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:36.896724 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51cf9c95-a518-4133-8e12-4ce1b6a427f3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 204 len: 0 microversion: 2.1 time: 0.391032 Oct 06 12:56:36.897640 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 901/1843] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:56:36 2022] DELETE /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:56:36.910118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6010779-0b7a-452c-a039-c76f87915dea tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:37.030702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6010779-0b7a-452c-a039-c76f87915dea tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.131185 Oct 06 12:56:37.032824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 902/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:36 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:37.038351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:37.039360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:37.049094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:37.050050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:37.050672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:37.051575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:37.052373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:37.052992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:37.606818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:37.619218 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7d895847-258d-4416-96c3-ebb10457cca7 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1210 microversion: 2.1 time: 1.012775 Oct 06 12:56:37.620791 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 943/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:36 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1210 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:37.665636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:37.683277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42a905eb-58af-40d6-a50f-d5ca31e6f194 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1469 microversion: 2.1 time: 0.648936 Oct 06 12:56:37.684637 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 903/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:37 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1469 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:38.053529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b88f919-a5b4-46e1-8af7-b6ba93adef51 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eda8dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:38.258760 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b88f919-a5b4-46e1-8af7-b6ba93adef51 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.211926 Oct 06 12:56:38.259816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 944/1847] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:38 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:38.656587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:38.657485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:38.677416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:38.678501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:38.679077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:38.681555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:38.684462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:38.688895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:38.710697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:38.712009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:38.736461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:38.737241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:38.738956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:38.739849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:38.742916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:38.747575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:39.605266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:39.614611 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e31a3ab-3863-4560-9a32-cd00bf4b72d7 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1469 microversion: 2.1 time: 0.907985 Oct 06 12:56:39.630222 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 945/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:38 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1469 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:39.682763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1708990e-bacf-47d1-b754-6029c8295ec4 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7a160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:39.850976 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1708990e-bacf-47d1-b754-6029c8295ec4 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.200262 Oct 06 12:56:39.851959 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 946/1849] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:39 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:40.330772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:40.367935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-238b206d-bb81-42b5-bac0-c73422ea7abe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1210 microversion: 2.1 time: 1.710895 Oct 06 12:56:40.378681 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 904/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:38 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1210 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:40.655724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:40.659423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:40.680721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:40.681232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:40.682023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:40.682989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:40.685975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:40.686755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:40.870609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4c5395b-d7f2-4641-843e-017f0d2edb97 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f1e0670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:40.997790 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4c5395b-d7f2-4641-843e-017f0d2edb97 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.132272 Oct 06 12:56:41.012676 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 905/1851] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:40 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:41.253293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:41.281968 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4748beb4-9022-4417-9f33-1a4d46044d01 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1469 microversion: 2.1 time: 0.627771 Oct 06 12:56:41.285368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 947/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:40 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1469 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:41.438713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:41.439338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:41.475500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:41.476350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:41.478959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:41.479982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:41.480684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:41.481297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:41.555943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26ec946-35e2-48c2-8686-858f7c4a4a79", "name": "network-vif-deleted", "tag": "7f70f18c-6da6-499c-a302-cf81e27ca3f0"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:41.598930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:41.602556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:41.605384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:41.640706 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] Creating event network-vif-deleted:7f70f18c-6da6-499c-a302-cf81e27ca3f0 for instance f26ec946-35e2-48c2-8686-858f7c4a4a79 on n-h2-860556-1 Oct 06 12:56:41.652526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-34fbfbc3-949f-4dcc-8e6d-0f39308856c3 req-3c799a40-f05b-4b61-be4c-325e960faa8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104115 Oct 06 12:56:41.655278 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 948/1853] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:41.888345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:41.902612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e09c777d-4412-47bc-8525-04d8167105a6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1210 microversion: 2.1 time: 0.505047 Oct 06 12:56:41.915159 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 906/1854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:41 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1210 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:42.029597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f06f3da0-55bd-4f8d-82d8-88f30bea3369 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ee6cd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:42.242825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f06f3da0-55bd-4f8d-82d8-88f30bea3369 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.219692 Oct 06 12:56:42.268979 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 949/1855] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:42 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:42.314822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:42.316009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:42.351160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:42.352243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:42.353072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:42.355300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:42.356206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:42.357034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:42.682676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:42.712165 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48fc25cf-80b5-463f-a1bd-3cb47ac81c8b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1298 microversion: 2.1 time: 0.405273 Oct 06 12:56:42.732443 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 907/1856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:42 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1298 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:42.944178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:42.945638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:42.975080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:42.989347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:42.990003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:42.993618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:42.997511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:42.998263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:43.278032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aba16675-ee92-42a0-8876-12123ab54f61 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476fba60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:43.376944 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aba16675-ee92-42a0-8876-12123ab54f61 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.105630 Oct 06 12:56:43.386631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 908/1857] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:43 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:43.516310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:43.540095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1841dc76-6ee7-47b8-89bd-4bc6897a9d7d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.600784 Oct 06 12:56:43.553773 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 950/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:42 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:43.759960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:43.761229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:43.770883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:43.776632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:43.779233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:43.783637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:43.787640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:43.788364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:43.949426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:43.949957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:43.950404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:43.950874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lazy-loading 'fault' on Instance uuid f26ec946-35e2-48c2-8686-858f7c4a4a79 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:56:44.128510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:44.144816 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d4defd6-16f5-49d4-971e-ae2cc5f46ca3 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 200 len: 1303 microversion: 2.1 time: 0.388154 Oct 06 12:56:44.162961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 909/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:43 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 1303 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:44.310194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-281549685", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7894d46a-c18d-4a9f-a678-c98a979132b6"}], "block_device_mapping_v2": [{"uuid": "11e6cd0a-2fc7-40b5-8f41-51c5f4d6be27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:44.393043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44b8c5e3-c856-4e8c-9c50-8a2e19565912 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f04caf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:44.477261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] validate_networks() for [('7894d46a-c18d-4a9f-a678-c98a979132b6', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:56:44.483820 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44b8c5e3-c856-4e8c-9c50-8a2e19565912 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.095164 Oct 06 12:56:44.492179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 910/1860] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:44 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:44.569110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:44.569774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:44.589045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:44.602741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:44.604830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:44.607480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:44.608273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:44.611048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.346754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:45.357068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7c3105e-cfff-4d2c-90b8-bca2ebf8c686 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.792745 Oct 06 12:56:45.366165 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 911/1861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:44 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:45.395324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:45.396464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: f26ec946-35e2-48c2-8686-858f7c4a4a79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:45.430685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.438268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.439656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.444161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.454255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.454255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.507183 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] HTTP exception thrown: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Request method failure captured: Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 HTTP/1.1 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_h7Lt_O24KdWRjVCRIS2yqqnH7m4eq0eoE9A5eCTHc9xlqhdR5R1FJICUdgj5Dz42ZavPBF2xY203oB0JTqXu3yHx9pdqzp1SO4By4zEMzDCr4_Id9vo5I3TXz3oqQrhAnaRE-uFVsLYnwiZvHp6aHEWKTWsuOqGljdkEaz273yUM Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:56:45.511791 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68a6ecb1c7944a8cba67fb219e2b9f83", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}] Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8276c6052c6a4d31b9f913affd9148f2 Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. Oct 06 12:56:45.513886 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f26ec946-35e2-48c2-8686-858f7c4a4a79'} Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:56:45.514969 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. Oct 06 12:56:45.517309 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:56:45.518840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Returning 404 to user: Instance f26ec946-35e2-48c2-8686-858f7c4a4a79 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:56:45.518840 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c960ee0-a6b6-42f6-908c-fe98488df257 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79" status: 404 len: 111 microversion: 2.1 time: 0.149854 Oct 06 12:56:45.522085 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 912/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:45 2022] GET /compute/v2.1/servers/f26ec946-35e2-48c2-8686-858f7c4a4a79 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:56:45.541420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0078fdd9-341e-4967-8157-936a9baacce6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d477735e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:45.645883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0078fdd9-341e-4967-8157-936a9baacce6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.120956 Oct 06 12:56:45.647669 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 913/1863] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:45 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:45.666422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:45.670314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:45.702128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.703528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.705826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.706858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.708503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.710404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.757827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:56:45.758392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:56:45.759347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:56:45.759920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:56:45.760453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:56:45.790469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.793488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.795592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:56:45.796964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.799714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:45.809476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:45.810284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:45.867409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:56:45.877055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Getting quotas for user 17892d653b7d461e803f5423cf7191af and project 3b283101c4674072a49a14df6acb56bb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:56:46.067407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:56:46.074492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11e6cd0a-2fc7-40b5-8f41-51c5f4d6be27',volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:56:46.145819 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb0750a0-25ea-475d-b263-06f7f345ce58 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 204 len: 0 microversion: 2.1 time: 0.488762 Oct 06 12:56:46.150305 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 914/1864] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:56:45 2022] DELETE /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:56:46.576515 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6f6a822-c62c-4af6-a5ae-1a778d7cc16b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.272185 Oct 06 12:56:46.580161 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 951/1865] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:56:46.592938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:46.596770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:46.619191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:46.621414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:46.623157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:46.627287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:46.630441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:46.633203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:46.680963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1235094840", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "84843262-2197-411b-92b2-4903becced39"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:46.763195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] validate_networks() for [('84843262-2197-411b-92b2-4903becced39', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:56:48.164408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:48.177279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad1a324a-d1d8-4885-8c74-5306c4870075 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1468 microversion: 2.1 time: 1.592744 Oct 06 12:56:48.178251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 952/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:46 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1468 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:48.189804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:48.199671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:48.215452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.217008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.221573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.222763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.233064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.236192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.728600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:48.761334 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e732aa5-d60f-488d-b825-8dd1e471bf37 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.581748 Oct 06 12:56:48.767035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 953/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:48 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:48.786339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:56:48.788649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:56:48.791735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:56:48.792414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:56:48.793038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:56:48.802375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:48.809674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:48.819197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.822364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.823546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.825441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.826794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.827852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.829616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.830608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.831360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.833904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:48.835888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:48.836652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:48.913246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Getting quotas for project 44a1ecaaa6af48f7b86f77f818a365d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:56:48.925434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Getting quotas for user 761363f43e574f548fdc0cf3c133ff14 and project 44a1ecaaa6af48f7b86f77f818a365d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:56:48.941245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:56:48.945532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:56:48.998998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.014898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.021181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.024872 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ffea265-fe6c-4e31-9f9a-8cd63e20038e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1232 microversion: 2.25 time: 0.252272 Oct 06 12:56:49.028297 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 954/1868] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:48 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1232 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:49.032421 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6b89646-d264-47bc-8034-8fa52e18ac16 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.879193 Oct 06 12:56:49.039605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ea61eba-9305-4e1d-a262-27e975257fca tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed09dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:49.040817 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 915/1869] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:56:49.052195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:49.055702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:49.068643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:49.146765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ea61eba-9305-4e1d-a262-27e975257fca tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.113431 Oct 06 12:56:49.147701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 955/1870] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:49 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:49.203560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:49.205070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:49.216111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:49.219312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:49.220603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:49.223387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:49.225521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:49.226431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:49.238594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.248345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.258633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:49.272830 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41fa45a9-7ad8-4f5c-94eb-ed8a7f46aa45 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1259 microversion: 2.21 time: 0.230681 Oct 06 12:56:49.273718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 916/1871] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:49 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:49.826964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:49.863863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:49.876920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:49.878162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:49.879097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:49.902544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:49.903232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:49.904101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:49.963968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:50.209397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:50.232186 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20c10af7-209e-459c-9f2d-3049668061ad tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1468 microversion: 2.1 time: 1.033350 Oct 06 12:56:50.239510 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 956/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:49 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1468 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:50.246870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:50.247440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:50.274267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:50.275037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:50.275475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:50.276222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:50.276675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:50.277236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:50.569565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:50.581177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:50.582771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:50.594675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a9e31090-7d02-45b2-a168-7b0b0649e23f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1250 microversion: 2.25 time: 0.353483 Oct 06 12:56:50.595407 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 957/1873] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:50 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1250 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:50.602190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-087d49b1-339a-4fa1-9495-82f059f6f960 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed05c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:50.707373 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-087d49b1-339a-4fa1-9495-82f059f6f960 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.110154 Oct 06 12:56:50.723614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 958/1874] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:50 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:50.751842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:50.752619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:50.758703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:50.781115 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5b97296-faea-4919-a8ab-efeaa5a8a077 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.952897 Oct 06 12:56:50.782452 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 917/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:49 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:50.783961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:50.784682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:50.785306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:50.794653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:50.795403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:50.796014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.102654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:51.116525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:51.136016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:51.137338 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a1cdd0ba-bbd2-477b-9cff-29c691757cef tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1255 microversion: 2.21 time: 0.412606 Oct 06 12:56:51.146070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 959/1876] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:50 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1255 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:51.261893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:51.262535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:51.294672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.295374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.296255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.297503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.298534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.299112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.593654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:51.594625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:51.620948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.621448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.622004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.622737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.623265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.623710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.723177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:56:51.798079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:51.820089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:51.860610 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7e61a640-cae3-4862-8403-0d0f621441bf tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1426 microversion: 2.1 time: 0.602895 Oct 06 12:56:51.871068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 960/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:51 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1426 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:56:51.897284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:51.900177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:51.924004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.924867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.925538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.929789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:51.930572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:51.932608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:51.946087 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3c843a9-c018-46ae-b123-67e21c6945d8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 204 len: 0 microversion: 2.42 time: 0.722353 Oct 06 12:56:51.948749 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 918/1878] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:56:51 2022] DELETE /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:56:51.957209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27bd401b-e944-4a60-a107-d3929f2256a6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:52.044067 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27bd401b-e944-4a60-a107-d3929f2256a6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.093169 Oct 06 12:56:52.045013 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 919/1879] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:51 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:52.052034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:52.053653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:52.065276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.066321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.066983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.068435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.069104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.069855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.234869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.249173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.256496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.260029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0b3f1ea-cbd8-41f0-a4bf-6d4215121d61 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1250 microversion: 2.25 time: 0.380835 Oct 06 12:56:52.260733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 961/1880] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:51 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1250 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:52.293476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:52.294261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:52.307119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.312366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.315556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.322730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.328291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.333721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.672469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.686649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55807ce3-e59f-4399-a06a-3b084f85aa6a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.638856 Oct 06 12:56:52.687588 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 920/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:52 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:52.701493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae887a92-7271-4407-af71-b336162ac8d0", "name": "network-vif-deleted", "tag": "4e91c917-a2b8-4f7d-80cd-f595deb2831e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:52.741914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.745434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.749726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.816545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] Creating event network-vif-deleted:4e91c917-a2b8-4f7d-80cd-f595deb2831e for instance ae887a92-7271-4407-af71-b336162ac8d0 on n-h2-860556-1 Oct 06 12:56:52.835517 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-19c63e4d-e058-43c1-86a6-f63976a148f0 req-7b62b510-0b12-4c22-9a65-1fec49a3b8b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144250 Oct 06 12:56:52.842708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 921/1882] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:52.852870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:52.853583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:52.883381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.887310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.887992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.891710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:52.892559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:52.894368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:52.907948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.934271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.949756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:52.956976 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfc3aef5-7047-4ab0-bcbf-05acdb5c732c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2958 microversion: 2.42 time: 0.688973 Oct 06 12:56:52.969779 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 962/1883] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:52 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2958 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:52.992668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:52.998714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:53.012015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.012918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.013556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:53.014482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.015181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.015797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:53.071258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:53.080900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:53.082403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:53.083867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a1d412f-51a0-449d-98a8-6479b6712d8e tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1311 microversion: 2.21 time: 0.239349 Oct 06 12:56:53.088468 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 922/1884] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:52 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1311 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:53.108211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b620388-9b07-46e0-a0fd-323b6a47a1e3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:53.171870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:53.188244 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd8c2360-3638-4386-81a8-19fae5b8882a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1426 microversion: 2.1 time: 0.201554 Oct 06 12:56:53.198320 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 963/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:52 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1426 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:53.219190 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b620388-9b07-46e0-a0fd-323b6a47a1e3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.128712 Oct 06 12:56:53.219963 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 923/1886] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:53 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:53.300935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:53.301563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:53.332360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.333517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.334591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:53.336062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.336814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.337255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:53.722569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:53.723917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:53.776230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.797526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.798194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:53.799206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:53.799935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:53.800864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:54.223739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:54.243991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:54.243991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:54.251817 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d5c9c0e-7aca-4b28-829d-54b61661a3ef tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1292 microversion: 2.25 time: 0.958496 Oct 06 12:56:54.252761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 964/1887] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:53 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1292 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:54.269562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:54.270823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:54.289935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:54.290849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:54.291678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:54.298582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:54.299555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:54.300534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:54.537971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:54.546032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-522ec5ed-c4d2-4848-ba78-d9533736c537 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.834646 Oct 06 12:56:54.562455 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 924/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:53 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:54.574252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:54.575550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:54.609597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:54.610499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:54.611937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:54.611937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:54.614433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:54.615969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.011618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.026132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.028117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.031142 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aaf2b52b-3433-4bcd-bd9a-451abc01f73c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1311 microversion: 2.21 time: 0.467898 Oct 06 12:56:55.034251 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 925/1889] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:54 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1311 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:55.053920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:55.055073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:55.079021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.081257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.082235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.085040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.086402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.088412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.361080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.373449 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4df103e4-880a-4074-b9b9-52ae9ca7238d tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1426 microversion: 2.1 time: 0.337727 Oct 06 12:56:55.382409 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 926/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:55 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1426 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:55.388834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0898c0b-c38d-43ae-b0d9-39aca7ace9c7 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476933a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:55.395494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.423537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.426691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:55.434646 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b6e75e7-0d8a-4171-b727-03e602342ce5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2958 microversion: 2.42 time: 1.178990 Oct 06 12:56:55.448886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 965/1891] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:54 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2958 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:55.485662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a0898c0b-c38d-43ae-b0d9-39aca7ace9c7 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.101087 Oct 06 12:56:55.488921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 927/1892] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:55 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:55.498241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:55.504927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:55.521469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa6fab1-6b52-4d60-8ec9-27f057bfe744", "tag": "5d9c7a48-f940-4cb3-8093-05e80f1c520d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:56:55.539696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.540229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.540642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.543729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.544903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.545362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.581260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.581782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.582238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.641281 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] Creating event network-changed:5d9c7a48-f940-4cb3-8093-05e80f1c520d for instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 on n-h1-860556-1 Oct 06 12:56:55.659741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4a07223a-ffb2-4af5-89ff-3c1c7e795244 req-5822acfe-9bca-4bf0-8cd7-5f7755416fff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156935 Oct 06 12:56:55.663945 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 928/1893] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:56:55.679008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:55.680049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:55.699607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.700821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.705098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.709283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:55.710300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:55.712851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:55.842691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:55.894605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:57.141044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.156014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc438274-5851-4dba-a21a-0d3ef81d250e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 1.490129 Oct 06 12:56:57.157631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 929/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:55 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:57.171672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.176725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:57.184240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:57.192385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.199349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.204910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1589c9e4-ef2a-46c8-b522-268f7009e61d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1292 microversion: 2.25 time: 1.736912 Oct 06 12:56:57.206405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 966/1895] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:55 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1292 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:57.213172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.219592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.221287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.222166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.224251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.226591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.228006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:57.235695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:57.288057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.290508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.294934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.297787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.299368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.302647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.484394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.486532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.489144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.490484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lazy-loading 'fault' on Instance uuid ae887a92-7271-4407-af71-b336162ac8d0 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:56:57.788971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.804300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.808180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.812635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbad07fd-5fe2-496a-9c09-1be1864782d9 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1317 microversion: 2.21 time: 0.653635 Oct 06 12:56:57.820290 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 930/1896] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:57 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:57.831131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:57.832952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:57.840371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.854213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.855264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.856229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:57.856893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:57.860443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:57.966120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:57.974581 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dbd2ca2d-d30e-4543-8204-801790074e3c tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 200 len: 1304 microversion: 2.1 time: 0.766426 Oct 06 12:56:57.979664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 967/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:57 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 1304 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:57.996186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f11e8be0-5a14-4442-a314-86fc40091e20 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed4aaf0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:58.126962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f11e8be0-5a14-4442-a314-86fc40091e20 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1455 microversion: 2.1 time: 0.144196 Oct 06 12:56:58.132173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 968/1898] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:56:57 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:56:58.186835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:58.187853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:58.208925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:58.209437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:58.209920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:58.210659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:58.219397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:58.219944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:58.887837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:59.243862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:56:59.593667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:59.743972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:59.745428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:56:59.760007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fdc18153-c5b7-4ef4-90e8-df2fe3d08454 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2958 microversion: 2.42 time: 1.926055 Oct 06 12:56:59.768478 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 931/1899] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:57 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2958 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:56:59.830370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:56:59.831009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:56:59.856830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:59.860252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:59.860760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:56:59.861527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:56:59.862036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:56:59.862484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.088986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.117833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.123113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e0df9aa-b02f-48d3-811f-277a596c270d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 2.940542 Oct 06 12:57:01.125943 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 969/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:56:58 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 2945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:01.133892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.135453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.136800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:01.138673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.144958 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0cb3c879-277c-493a-890a-0b53a065ed6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1292 microversion: 2.25 time: 1.323892 Oct 06 12:57:01.145953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 932/1901] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:56:59 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1292 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:01.153215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.158386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: ae887a92-7271-4407-af71-b336162ac8d0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:01.168399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.169588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.172148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.174188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.174916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.176046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.176239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:01.179014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.182088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.189614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.190641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.191143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.191575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.216909 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] HTTP exception thrown: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Request method failure captured: Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 HTTP/1.1 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_h7Lt_O24KdWRjVCRIS2yqqnH7m4eq0eoE9A5eCTHc9xlqhdR5R1FJICUdgj5Dz42ZavPBF2xY203oB0JTqXu3yHx9pdqzp1SO4By4zEMzDCr4_Id9vo5I3TXz3oqQrhAnaRE-uFVsLYnwiZvHp6aHEWKTWsuOqGljdkEaz273yUM Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:57:01.220198 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68a6ecb1c7944a8cba67fb219e2b9f83", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}] Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8276c6052c6a4d31b9f913affd9148f2 Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. Oct 06 12:57:01.222218 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ae887a92-7271-4407-af71-b336162ac8d0'} Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:57:01.223269 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. Oct 06 12:57:01.225243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:01.228695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Returning 404 to user: Instance ae887a92-7271-4407-af71-b336162ac8d0 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:57:01.229999 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7fba22f-5ac5-4b6a-a24b-77c1d982943a tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0" status: 404 len: 111 microversion: 2.1 time: 0.082661 Oct 06 12:57:01.233012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 933/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/servers/ae887a92-7271-4407-af71-b336162ac8d0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:57:01.247473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589391fb-b695-41bd-beb8-cb5f135506bd", "name": "network-vif-plugged", "status": "completed", "tag": "5b008fe2-700d-46f4-90ba-c14c9ca570ce"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:01.269881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.270808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.272139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.301279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] Creating event network-vif-plugged:5b008fe2-700d-46f4-90ba-c14c9ca570ce for instance 589391fb-b695-41bd-beb8-cb5f135506bd on n-h2-860556-1 Oct 06 12:57:01.308334 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bfe6620d-4031-465c-ade7-0d935a388258 req-a35d9b98-a9fe-4068-859f-367c95bda4fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070959 Oct 06 12:57:01.309625 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 934/1903] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:01.316608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b7abcf4-2ac7-4782-b90d-ba6a20cd1eee tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.420606 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b7abcf4-2ac7-4782-b90d-ba6a20cd1eee tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1464 microversion: 2.1 time: 0.103908 Oct 06 12:57:01.423048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 935/1904] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1464 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:01.444362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.445351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:01.456337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.457074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.457694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.458903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.459502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.460790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.686910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.697428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.700189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:01.702804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd964f5a-32ce-43f7-a0e3-660b15f2a977 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.574391 Oct 06 12:57:01.703763 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 970/1905] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:01.715321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.716365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:01.730433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.731163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.731897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.733353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.734155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.734947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.779130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:57:01.880251 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fd0b73e-857b-4998-acb4-6e8d500aff46 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 204 len: 0 microversion: 2.1 time: 0.174145 Oct 06 12:57:01.881117 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 971/1906] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:57:01 2022] DELETE /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:57:01.887041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c8dfc47-5e7a-4e47-94c9-6c1f94ff16be tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed168b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.937326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c8dfc47-5e7a-4e47-94c9-6c1f94ff16be tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 200 len: 1464 microversion: 2.1 time: 0.053985 Oct 06 12:57:01.938034 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 972/1907] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:01.943748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:01.944726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:01.952609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.953103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.953538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:01.954409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:01.954980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:01.956099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.093686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:02.106489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:02.108266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:02.109864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-26948077-9e4f-456a-a3aa-4331d0fed1e5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2937 microversion: 2.42 time: 0.682312 Oct 06 12:57:02.111581 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 936/1908] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2937 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:02.117253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:02.118115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:02.126993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.127960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.128610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.129549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.130320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.131138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.467855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:02.481233 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6471bf3e-feb1-4324-a169-e8f85bb5aebb tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1470 microversion: 2.1 time: 0.541867 Oct 06 12:57:02.494289 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 973/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:01 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:02.504580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:02.505249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:02.513144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.513641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.514336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.515790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.516258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.516696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.654277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:02.665400 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0daa44b2-a377-44b6-a12c-0dd501c73813 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1478 microversion: 2.1 time: 0.552268 Oct 06 12:57:02.669035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 937/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:02 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1478 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:02.679374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:02.680650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:02.692119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.692548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.693004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.693848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:02.694324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:02.694776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:02.987887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.000658 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40717a50-e10b-4316-9065-a46b6fad4875 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1198 microversion: 2.1 time: 0.504459 Oct 06 12:57:03.001882 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 974/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:02 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1198 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:03.007533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:03.008170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:03.017024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.017698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.018201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.018941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.020347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.020902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.164002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.173619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.176829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.178276 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1d39d22-dcf5-48db-bfaf-c2af332ff3ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1292 microversion: 2.25 time: 0.507842 Oct 06 12:57:03.179811 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 938/1912] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:02 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1292 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:03.184912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:03.185521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:03.193197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.193993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.194664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.195623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.196256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.197007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.203073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:03.509534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.525457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.527979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.529612 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-74fe9e55-f74c-443c-a170-8a1e1dd97a93 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2943 microversion: 2.32 time: 0.526578 Oct 06 12:57:03.531053 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 975/1913] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:03 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2943 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:03.537415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:03.538425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:03.545539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.546483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.547104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.548119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.549066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.549856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.895215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.904561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.906797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:03.908269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c50b7674-2823-4d39-af96-27b2850ac7d4 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.727386 Oct 06 12:57:03.915879 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 939/1914] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:03 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:03.924384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6472fc-7c42-4457-9902-abe844e957e9"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "80777c32-8243-4ac0-bbc6-1c12abb3139a"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "df88f105-458a-4f4e-91ed-3f7f6cdf34ee"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "79933516-6c72-4e04-9a70-db079e28ac58"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "eb894875-9f93-44b5-ae4f-1c2b78742953"}, {"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "8e4f3006-44c1-4ddd-ba7f-49775d91bd45"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:03.938514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.939320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.939819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.952959 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:5f6472fc-7c42-4457-9902-abe844e957e9 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.953971 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:80777c32-8243-4ac0-bbc6-1c12abb3139a for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.954683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:df88f105-458a-4f4e-91ed-3f7f6cdf34ee for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.955196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:79933516-6c72-4e04-9a70-db079e28ac58 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.955700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:eb894875-9f93-44b5-ae4f-1c2b78742953 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.956201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] Creating event network-vif-unplugged:8e4f3006-44c1-4ddd-ba7f-49775d91bd45 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:03.962598 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3c265e61-382e-4dea-8b86-aca97c015217 req-527fb59e-2af4-4821-8f2a-b59ae78cc532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.043386 Oct 06 12:57:03.963366 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 940/1915] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:03.969401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:03.970138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:03.977075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.977622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.978066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:03.978790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:03.979595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:03.979938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.255767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:04.271529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:04.274028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:04.275819 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2632761-0956-4759-9691-c1ceaca73c19 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2937 microversion: 2.42 time: 0.743134 Oct 06 12:57:04.276399 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 976/1916] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:03 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2937 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:04.282998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:04.285889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:04.307880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.309701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.311001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.314301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.315472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.317171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.345709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8276c6052c6a4d31b9f913affd9148f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a6ecb1c7944a8cba67fb219e2b9f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:04.358394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d91435cb-59e4-4105-9989-3fc5759fa469 tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 200 len: 1470 microversion: 2.1 time: 0.392093 Oct 06 12:57:04.358628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:04.367575 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 941/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:03 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:04.514451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e8da161e-8942-4dad-8479-e0d85f2e9343 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Action: 'create', calling method: .version_select at 0x7f7d476fb790>, body: {"keypair": {"name": "tempest-keypair-267740942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0bOJM8PP3sY9gAlCd2Wx2h+57d5WVAzFGLaAfUbBHEQojbICu0yKKNzkhhIkvWm0Y1rtF2IEBxDNiR6wf0kjo1zyInb/SRbVQUWvfE6nI4mol868nIw8CMGKIqj6kOpg=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:04.533340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e8da161e-8942-4dad-8479-e0d85f2e9343 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:57:04.538513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e8da161e-8942-4dad-8479-e0d85f2e9343 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for user 98ac89cfe31446eeaec958ae0acaf663 and project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:57:04.576517 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e8da161e-8942-4dad-8479-e0d85f2e9343 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204645 Oct 06 12:57:04.583114 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 942/1918] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:57:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:04.591545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:04.592667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:04.600927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.601470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.602144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.603130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.603838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.604275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.703721 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6498501-d1bb-4938-b4aa-a0e551a3cc47 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.425670 Oct 06 12:57:04.705402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 977/1919] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 12:57:04 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e/os-interface => generated 1830 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:04.710729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:04.712151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:04.724023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.725079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.726059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:04.727435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:04.728326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:04.729118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.052442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:05.126178 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8beec218-3bca-4e38-bff7-bc5edc07fd45 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1465 microversion: 2.1 time: 0.538929 Oct 06 12:57:05.148312 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 943/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:04 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1465 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:05.158119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b52520-2ce8-4d8e-b929-ea758f1dc040", "tag": "c5d082ab-435f-45c9-b7b9-5b08f2896db7"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:05.187586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:05.188069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:05.188506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.227651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] Creating event network-changed:c5d082ab-435f-45c9-b7b9-5b08f2896db7 for instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 on n-h2-860556-1 Oct 06 12:57:05.239347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:05.253662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cfae326e-8d28-4b07-9e81-9cae47421b5c req-1345e3fc-5332-445a-bef6-b814929be945 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103223 Oct 06 12:57:05.255197 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 944/1921] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:05.262565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:05.263518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:05.266463 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0e2ffdd-a0ca-440d-bebb-48a693ce9705 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1380 microversion: 2.1 time: 0.559329 Oct 06 12:57:05.269170 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 978/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:04 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1380 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:05.273474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:05.274283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:05.275269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.276232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:05.276867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:05.277476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.283312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:05.291753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:05.307343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:05.309710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:05.313917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.315976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:05.318826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:05.319648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:05.935080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:05.951922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:05.954272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:05.955581 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5484dc9-e902-4aca-8e45-97cc4c1f525f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1280 microversion: 2.25 time: 0.698638 Oct 06 12:57:05.976672 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 945/1923] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:05 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1280 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:05.993632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1567156993"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:05.996313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:06.027217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.027713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.028166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:06.039387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.044338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.045298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:06.066873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:06.084737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:06.086277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:06.087476 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9d049eb-5118-4911-9087-b2be6396c50f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.815046 Oct 06 12:57:06.098173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 979/1924] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:05 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:06.555684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:06.556470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:06.568612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.570572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.571033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:06.571784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.572252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.572686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:06.777677 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07985804-0072-4e09-a8ec-dba6aadcd902 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "POST /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487/action" status: 202 len: 0 microversion: 2.1 time: 0.799284 Oct 06 12:57:06.779023 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 946/1925] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:57:05 2022] POST /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:57:06.787229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:06.788459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:06.798356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.798903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.799840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:06.800780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:06.801290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:06.802780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.706456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:07.716800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:07.718841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:07.723649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01c7346e-70cd-41eb-940a-0208ea4a41c4 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2916 microversion: 2.42 time: 0.942985 Oct 06 12:57:07.724800 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 947/1926] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:06 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2916 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:07.734467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:07.736140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] [instance: 9f5c2ed3-d469-4054-ba96-e9d58cc884e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:07.754710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.755707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.756381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.757654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.758494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.758747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.772603 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39842480-5443-4d42-a2b5-43feacdbd508 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1531 microversion: 2.1 time: 1.673097 Oct 06 12:57:07.773108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 980/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:06 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1531 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:07.795913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c2ed3-d469-4054-ba96-e9d58cc884e1", "name": "network-vif-deleted", "tag": "92e58d55-92c4-4606-a964-eef7182638ed"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:07.798873 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] HTTP exception thrown: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Request method failure captured: Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 HTTP/1.1 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_h7Lt_O24KdWRjVCRIS2yqqnH7m4eq0eoE9A5eCTHc9xlqhdR5R1FJICUdgj5Dz42ZavPBF2xY203oB0JTqXu3yHx9pdqzp1SO4By4zEMzDCr4_Id9vo5I3TXz3oqQrhAnaRE-uFVsLYnwiZvHp6aHEWKTWsuOqGljdkEaz273yUM Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:57:07.801334 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68a6ecb1c7944a8cba67fb219e2b9f83", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68a6ecb1c7944a8cba67fb219e2b9f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68a6ecb1c7944a8cba67fb219e2b9f83"}]}] Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 68a6ecb1c7944a8cba67fb219e2b9f83 Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminTestJSON-1910629568 Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8276c6052c6a4d31b9f913affd9148f2 Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminTestJSON-1910629568-project Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. Oct 06 12:57:07.803124 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '9f5c2ed3-d469-4054-ba96-e9d58cc884e1'} Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:57:07.804093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. Oct 06 12:57:07.805910 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:07.811961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] Returning 404 to user: Instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:57:07.818544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.819362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.819994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.822118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61ac1a3c-306a-4a99-b938-8e2ae180375b tempest-ServersAdminTestJSON-1910629568 tempest-ServersAdminTestJSON-1910629568-project] 10.222.0.26 "GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1" status: 404 len: 111 microversion: 2.1 time: 0.094767 Oct 06 12:57:07.822765 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 948/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:07 2022] GET /compute/v2.1/servers/9f5c2ed3-d469-4054-ba96-e9d58cc884e1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:57:07.829134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-unplugged", "status": "completed", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:07.850576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] Creating event network-vif-deleted:92e58d55-92c4-4606-a964-eef7182638ed for instance 9f5c2ed3-d469-4054-ba96-e9d58cc884e1 on n-h2-860556-1 Oct 06 12:57:07.862750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.863288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.863754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.887237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-36d77e6f-c24d-44b8-8bb5-60870a39cf75 req-5ef997d8-7cb4-4289-88ef-4f717b7f56ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109490 Oct 06 12:57:07.893918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 981/1929] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:07.910965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f1a12af-65a1-419c-9897-ef48399ae506 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed633a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:07.933034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] Creating event network-vif-unplugged:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:57:07.944096 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-80116496-f9d4-46c9-b16d-00b18dae31dd req-0f0ce00c-24c1-4a02-bdaf-e31464a91d92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116801 Oct 06 12:57:07.945173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 949/1930] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:07.959889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:07.962889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:07.977035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.979517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.979995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.980731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:07.981192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:07.981939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:07.999462 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f1a12af-65a1-419c-9897-ef48399ae506 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.099398 Oct 06 12:57:08.000068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 982/1931] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:07 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:08.005310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:08.006199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:08.015723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.016884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.017331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.018536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.019194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.019838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.208406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.217261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.219614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.221512 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9e5dc77-4328-41bd-a38a-368a26b98fe4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1280 microversion: 2.25 time: 0.273411 Oct 06 12:57:08.233788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.235044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 950/1932] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:07 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:08.242045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.244481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:08.246227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ec478ad-4246-4839-8ff9-3df999a81752 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.244808 Oct 06 12:57:08.247391 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 983/1933] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:08 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:08.251603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:08.252221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:08.258669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.259164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.259753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.260578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.261133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-deleted", "tag": "df88f105-458a-4f4e-91ed-3f7f6cdf34ee"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:08.261435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.262102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.272901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.273547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.274013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.287224 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] Creating event network-vif-deleted:df88f105-458a-4f4e-91ed-3f7f6cdf34ee for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:08.299161 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9788a0ca-3c46-4168-982f-788ad654a4ee req-cb66461d-d275-458e-ac04-a0097ac82be0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050363 Oct 06 12:57:08.303913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 984/1934] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:08.319344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-534411569", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "f5fb27b2-ac52-4aab-a895-1a59290dd02b"}], "security_groups": [{"name": "tempest-securitygroup--1370300893"}], "key_name": "tempest-keypair-267740942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:08.466587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] validate_networks() for [('f5fb27b2-ac52-4aab-a895-1a59290dd02b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:57:08.476089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98319051-1767-49d8-932f-5cb780c01ef3 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1531 microversion: 2.1 time: 0.239130 Oct 06 12:57:08.476986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 951/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:08 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1531 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:08.498898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:08.504584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.505490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.506183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.507155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.507830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.508470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.538669 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc9a9599-a59f-4770-a3fe-87e5bb20cef4 tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043409 Oct 06 12:57:08.541783 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 952/1936] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:57:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:08.553547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860556-1", "block_migration": false, "disk_over_commit": false}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:08.565484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:08.571668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.572165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.572609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.573331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:08.573814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:08.574250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:08.600492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lazy-loading 'flavor' on Instance uuid 589391fb-b695-41bd-beb8-cb5f135506bd {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:57:08.613056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Going to try to live migrate instance to n-h1-860556-1 {{(pid=129614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:57:08.997108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:57:08.998348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:57:08.999703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:57:09.000427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:57:09.001210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:57:09.011879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.012370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.013062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.013920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.014385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.015360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.034816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:57:09.042840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for user 98ac89cfe31446eeaec958ae0acaf663 and project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:57:09.056876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:57:09.059785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:57:09.119555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3337f30-d005-4ef8-8241-b396e296c2a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813948 Oct 06 12:57:09.120751 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 985/1937] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:57:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:57:09.131365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:09.132206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:09.145113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.145623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.146465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.147200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.147853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.148359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.360727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.380428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.381918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.383201 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f186f59c-1e0f-46e7-b804-9d93214a6241 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2869 microversion: 2.42 time: 0.260436 Oct 06 12:57:09.398007 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 986/1938] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:09 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2869 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:09.419452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8472ba3-859a-4dd4-bc7e-d84fa6695a96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecca8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:09.507707 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8472ba3-859a-4dd4-bc7e-d84fa6695a96 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.107980 Oct 06 12:57:09.509788 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 987/1939] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:09 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:09.515429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1bd9f3a-a4d0-4194-beb2-a3f1b71095e4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:09.516579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1bd9f3a-a4d0-4194-beb2-a3f1b71095e4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:09.581671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1bd9f3a-a4d0-4194-beb2-a3f1b71095e4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.590258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1bd9f3a-a4d0-4194-beb2-a3f1b71095e4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1240 microversion: 2.1 time: 0.079615 Oct 06 12:57:09.591360 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 988/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:09 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:09.603013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:09.603628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:09.611057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.611562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.612013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.612736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.613208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.613637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.774806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.783034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.784515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.785628 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d55179e6-bfe9-4c9a-b094-7dd022a8bb54 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1280 microversion: 2.25 time: 0.186574 Oct 06 12:57:09.786217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 989/1941] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:09 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:09.790829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:09.791660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:09.798330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.799035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.799551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.800168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:09.800793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:09.801212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:09.940387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.948988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.950564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:09.951682 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2d31048-8d15-466a-bc60-7b498df9ce93 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.164379 Oct 06 12:57:09.952491 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 990/1942] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:09 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:10.425877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:10.426636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:10.446081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:10.447135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:10.447597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:10.448339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:10.448862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:10.449355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:11.298905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:11.310324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:11.311883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:11.313434 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cc9e401-d967-4fbd-b4f9-e9ee6795eeb5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2869 microversion: 2.42 time: 0.893080 Oct 06 12:57:11.317796 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 991/1943] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:10 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2869 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:11.325512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85a830df-71d6-4bf0-9789-07c48a350861 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7c4c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:11.399271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85a830df-71d6-4bf0-9789-07c48a350861 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.083590 Oct 06 12:57:11.400263 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 992/1944] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:11 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:11.412973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:11.414648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:11.431508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:11.441313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:11.442114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:11.443070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:11.443995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:11.444623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:11.670826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:11.688564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6a7b9a1-b554-4dd6-a080-7aed69858a79 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1292 microversion: 2.1 time: 0.286175 Oct 06 12:57:11.690070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 993/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:11 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1292 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:11.696181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:11.696793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:11.716023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:11.717010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:11.717678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:11.718668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:11.719322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:11.719915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.172765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9b794c8-291a-4e88-bcff-65bff2cb426e tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd/action" status: 202 len: 0 microversion: 2.1 time: 3.623959 Oct 06 12:57:12.180154 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 953/1946] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:57:08 2022] POST /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd/action => generated 0 bytes in 3632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:57:12.186200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:12.189584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:12.198174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.199243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.200076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.201145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.201611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.202412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.424943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.440528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.447182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.449928 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-94c9edd5-6162-44c3-afd9-48cf5ed3c70a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1280 microversion: 2.25 time: 0.757598 Oct 06 12:57:12.470780 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 994/1947] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:11 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1280 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:12.803986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:12.809129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.809628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.813532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.814434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.814924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.815390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.849990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.876410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cbe6a577-6bc7-4265-b14e-210e3c222018 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.401682 Oct 06 12:57:12.878345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.893886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 995/1948] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:57:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:12.894369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:12.894369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c237d71-20dd-43f9-ba9b-358660f48dd5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.702150 Oct 06 12:57:12.894369 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 954/1949] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:12 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:12.897926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-deleted", "tag": "5f6472fc-7c42-4457-9902-abe844e957e9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:12.902458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:12.910360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:12.915558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.916844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.917299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.922052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.922640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.923293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.925715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:12.926474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:12.927193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:12.944247 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] Creating event network-vif-deleted:5f6472fc-7c42-4457-9902-abe844e957e9 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:12.960983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3a015385-8a77-4690-aca1-8ada6ce4d530 req-efaa8d84-dee5-4ac2-8a8f-af3df53fa384 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079961 Oct 06 12:57:12.962039 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 996/1950] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:12.974856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:12.977020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:13.005013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.006481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.010483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.014394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.016754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.018372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.436120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:13.447570 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb677192-b1dd-4617-87e1-c6d3f3b33192 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.555141 Oct 06 12:57:13.448173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 955/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:12 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:13.460447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6565347-650e-408a-92c8-09186bc307ce tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d4764fe50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:13.614578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6565347-650e-408a-92c8-09186bc307ce tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.160502 Oct 06 12:57:13.615675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 956/1952] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:13 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:13.647789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:13.649289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:13.653947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:13.672011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:13.674461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:13.674783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.676048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.677016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.677455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f1631e9-8d11-476d-a624-f89e4da14232 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2708 microversion: 2.42 time: 0.714267 Oct 06 12:57:13.681399 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 997/1953] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:12 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2708 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:13.687476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.688214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.692292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.704071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:13.708385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.709107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.711847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.712958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.713619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.716449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.781165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-681cdecf-9b0b-4a8c-a605-ee0bb088a2e9 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860556-1" status: 200 len: 578 microversion: 2.1 time: 0.097684 Oct 06 12:57:13.788849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 998/1954] 10.222.0.26 () {58 vars in 1172 bytes} [Thu Oct 6 12:57:13 2022] GET /compute/v2.1/os-services?host=n-d-860556-1 => generated 578 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:13.793932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa6fab1-6b52-4d60-8ec9-27f057bfe744", "name": "network-vif-plugged", "status": "completed", "tag": "5d9c7a48-f940-4cb3-8093-05e80f1c520d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:13.812870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.813578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.816257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.847776 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] Creating event network-vif-plugged:5d9c7a48-f940-4cb3-8093-05e80f1c520d for instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 on n-h1-860556-1 Oct 06 12:57:13.854765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-286b708c-61a8-4d10-aa07-6335d34687db req-b5c7c38b-70b5-4c17-a059-689f5375c72c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064374 Oct 06 12:57:13.855383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 999/1955] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:13.869163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:13.869904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:13.890391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.892697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.898960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:13.899933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:13.902872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:13.903444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.547032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:14.646767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:14.662372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:14.667874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd126b7f-d6ad-46e1-9443-eace7054f0e8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 1.043688 Oct 06 12:57:14.669056 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 957/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:13 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:14.671757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:14.679097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:14.681109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:14.682565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:14.683708 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dbde8772-7f61-41b3-a9c5-59e03195073d tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1280 microversion: 2.25 time: 0.827207 Oct 06 12:57:14.684287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1000/1957] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:13 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1280 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:14.687092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.687862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.688403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.689327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.691195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.692125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.719285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:14.720030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:14.724984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:14.735402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-90bffdc8-3246-4711-8318-9d5b425c8495 tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064800 Oct 06 12:57:14.745130 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 958/1958] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 12:57:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:14.750132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:14.750563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.751160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.751414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:14.751603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.752561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.753303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.753931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.758472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.759193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.760230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:14.761134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:14.761914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:14.762563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:15.237971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:15.257779 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efbe6785-7740-403a-aa0a-6b0fda4a6c11 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.512670 Oct 06 12:57:15.258754 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 959/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:14 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:15.283842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cfe1001-a6ef-4fb9-be68-5c7c21ea87fa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476ff700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:15.362542 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cfe1001-a6ef-4fb9-be68-5c7c21ea87fa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.090795 Oct 06 12:57:15.363436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 960/1960] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:15 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:15.376844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:15.377679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:15.405469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:15.406125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:15.407016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:15.408716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:15.410725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:15.411273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:15.998288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.017071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.033251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.036505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ce2f3d9-a1c8-4179-a0e3-ce9e7a70d522 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 1.351209 Oct 06 12:57:16.039344 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1001/1961] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:14 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:16.063947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:16.082500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.083335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.083907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.084850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.085321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.085765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.100497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.120981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.125978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.129253 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b649c3a-48cc-49a8-a872-a164a071aaa5 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2548 microversion: 2.42 time: 0.764659 Oct 06 12:57:16.140324 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 961/1962] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:15 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2548 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:16.167839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-deleted", "tag": "8e4f3006-44c1-4ddd-ba7f-49775d91bd45"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:16.191757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.195833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.197080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.227941 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] Creating event network-vif-deleted:8e4f3006-44c1-4ddd-ba7f-49775d91bd45 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:16.229933 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44abb17f-8e03-43ff-8964-5c456d3f1aad tempest-ServicesAdminTestJSON-1040644918 tempest-ServicesAdminTestJSON-1040644918-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.181112 Oct 06 12:57:16.231409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1002/1963] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:57:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:16.257086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-66b430af-6594-4ea2-ae13-eaf5125d3680 req-346d9afc-3efc-4a2f-b308-b08ad3039725 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108595 Oct 06 12:57:16.257469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bade59a5-d480-4187-87bb-4d4eb29e1741", "tag": "d96e48db-d849-4633-ab2a-d8f101b80f47"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:16.261255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 962/1964] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:16.315780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:16.316615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:16.344694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.345703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.348442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.360250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.361594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.363822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.368466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.369919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.375100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.398180 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] Creating event network-changed:d96e48db-d849-4633-ab2a-d8f101b80f47 for instance bade59a5-d480-4187-87bb-4d4eb29e1741 on n-h2-860556-1 Oct 06 12:57:16.415202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-cc83bbca-9d4d-4973-ad5f-756466aea511 req-e58b1b6f-c99c-408f-bff3-d2227213fdeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179349 Oct 06 12:57:16.417852 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1003/1965] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:16.435602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:16.437828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:16.459013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.461092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.462348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.465994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.470506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.472216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.504884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:16.897236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:16.911588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba942dde-2c9f-4ac9-998b-61647be9fb65 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.646677 Oct 06 12:57:16.912867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 963/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:16 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:16.930452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd98acd-107f-4f05-861c-af855cd0c487", "name": "network-vif-plugged", "status": "completed", "tag": "86a83b62-bdff-4a20-9c7d-900fa67f1d2e"}, {"server_uuid": "81b52520-2ce8-4d8e-b929-ea758f1dc040", "name": "network-vif-plugged", "status": "completed", "tag": "c5d082ab-435f-45c9-b7b9-5b08f2896db7"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:16.947851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:16.948595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:16.948793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:16.965053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Creating event network-vif-plugged:86a83b62-bdff-4a20-9c7d-900fa67f1d2e for instance cbd98acd-107f-4f05-861c-af855cd0c487 on n-h1-860556-1 Oct 06 12:57:16.966133 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] Creating event network-vif-plugged:c5d082ab-435f-45c9-b7b9-5b08f2896db7 for instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 on n-h2-860556-1 Oct 06 12:57:16.978751 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a7910e25-a81b-4009-8e29-73dcc0611021 req-73f0833a-a895-4856-be4d-be8073c66b66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060604 Oct 06 12:57:16.986731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 964/1967] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:16.999658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:17.001667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:17.013181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.014305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.015021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:17.016355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.017273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.018018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:17.106734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.117453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.125005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.126578 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c8b3439-8628-4471-b698-0994b03e575c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1475 microversion: 2.25 time: 0.705144 Oct 06 12:57:17.128822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1004/1968] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:16 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1475 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:17.142364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e924d32-84fb-4a9c-ba58-9b8ddf4e7558 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecca3a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:17.219445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e924d32-84fb-4a9c-ba58-9b8ddf4e7558 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.088336 Oct 06 12:57:17.220649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1005/1969] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:17 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:17.233668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:17.236082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:17.251100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.253791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.254369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:17.257300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.258605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.259639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:17.816558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.826671 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-761cdedb-ef56-4502-8f67-fa1c7b752cbe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.837010 Oct 06 12:57:17.827466 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 965/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:16 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:17.950760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.961400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.962868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:17.964083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a99fa0d-267d-443e-8235-b37051a77f6f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.742327 Oct 06 12:57:17.977761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1006/1971] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:17 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:17.977761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:17.977761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:17.977761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.978281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.980593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:17.980593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:17.980593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:17.980593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.378752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:18.384682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:18.385392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:18.388647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:18.395073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:18.397121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.399338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.400286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.401392 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4cdf173-773c-4be3-a7ca-2772e1a5ac43 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2343 microversion: 2.42 time: 0.434401 Oct 06 12:57:18.401554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.403189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.404336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1007/1972] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:17 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2343 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:18.415179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.422518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:18.423590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:18.434832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.435630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.436341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.437234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.442316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.443003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.763046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:57:18.781153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:18.794308 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5dcfea50-5d6d-4084-b7d4-2c231aa5317e tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1967 microversion: 2.25 time: 0.965686 Oct 06 12:57:18.795887 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 966/1973] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:17 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1967 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:18.804258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce8c861c-646b-4b70-9673-b3e31e48d476 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.397994 Oct 06 12:57:18.817777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-931a4536-5b5f-4e37-8423-06b620639ea1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476583a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:18.819533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1008/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:18 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:18.824067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-deleted", "tag": "80777c32-8243-4ac0-bbc6-1c12abb3139a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:18.856111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.858342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.858802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.876040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] Creating event network-vif-deleted:80777c32-8243-4ac0-bbc6-1c12abb3139a for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:18.882867 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7d28dcbf-9b29-41a2-80a4-0c89d5a0307b req-08938a15-a8dc-4b74-9d06-c16c9d82007c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062107 Oct 06 12:57:18.883654 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1009/1975] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:18.896076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:18.897318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:18.899929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:18.903344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-931a4536-5b5f-4e37-8423-06b620639ea1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.106046 Oct 06 12:57:18.904321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 967/1976] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:18 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:18.917533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.918098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.919064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.919802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.920036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:18.921316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.921762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.923343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:18.937401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.938961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.939692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:18.940689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:18.941400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:18.942134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:19.512573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:57:19.541438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc9a8369-68b1-4c09-8333-a669ce3364d9 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1967 microversion: 2.25 time: 0.656742 Oct 06 12:57:19.542818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1010/1977] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:18 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1967 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:19.548393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:19.549427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:19.563385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:19.565374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:19.566083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:19.567040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:19.567763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:19.568355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:19.600322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:20.100369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.137195 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a139a0f-93a0-4b7f-8a30-75c392df14ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.225834 Oct 06 12:57:20.140183 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 968/1978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:18 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:20.160498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:20.161824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:20.183710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.191972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.192552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.193321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.196046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.200206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.283836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.295364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.300135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.302351 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bb1d128d-0a79-4bdc-8c2b-cb2a61a9ee92 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.758399 Oct 06 12:57:20.306832 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1011/1979] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:19 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:20.317799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:20.324039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.329707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.330398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.331418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.332069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.332697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.408680 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b30d0ad4-8b20-4322-ba91-9a84515b2eb8 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.100324 Oct 06 12:57:20.418662 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1012/1980] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Oct 6 12:57:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:57:20.424150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:20.424769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:20.443609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.448647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.449665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.450717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.451429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.452133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.724859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.743337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.749964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.752600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6f658b1-f3f6-4118-bc70-930b8d0c5a27 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 2054 microversion: 2.42 time: 0.607889 Oct 06 12:57:20.771252 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 969/1981] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:20 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 2054 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:20.814213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15ab6200-ef1c-4749-a0e5-92d5c01415e9 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476ff0d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:20.871967 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15ab6200-ef1c-4749-a0e5-92d5c01415e9 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.099272 Oct 06 12:57:20.872850 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 970/1982] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:20 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:20.879521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860556-1", "block_migration": "auto"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:20.882704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:20.892022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.892828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.893481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.894497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.895162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.895921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:20.930873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'flavor' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:57:20.947355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:20.951582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Going to try to live migrate instance to n-h2-860556-1 {{(pid=129614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 12:57:20.966237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b6ca904f-d3f0-4458-a0f6-9c18434087a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.546289 Oct 06 12:57:20.970000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1013/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:20 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:20.978942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11f7c79-1a4d-44fd-b430-c46ebf955b0d", "name": "network-vif-deleted", "tag": "eb894875-9f93-44b5-ae4f-1c2b78742953"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:20.997729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:20.998582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:20.999678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:21.038050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] Creating event network-vif-deleted:eb894875-9f93-44b5-ae4f-1c2b78742953 for instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d on n-h2-860556-1 Oct 06 12:57:21.053019 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3f4b818a-0932-4cfc-b231-22d84398a967 req-6b0cc5d4-72ee-47bf-a9e2-cef90a93abfa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081279 Oct 06 12:57:21.054315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1014/1984] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:21.178329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:21.179730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:21.187609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:21.190484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:21.191187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:21.192219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:21.192845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:21.193492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:21.594725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:21.608024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d36550e-c747-4c3f-9459-9ac5fd6d74cd tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.442275 Oct 06 12:57:21.611365 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1015/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:21 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:21.632932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:21.638571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:21.657326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:21.658928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:21.675476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:21.676753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:21.678306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:21.678943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:21.972826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:21.983810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:21.985341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:21.986720 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d24631e5-9f75-4aed-89d2-eee578e4e4b5 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1359 microversion: 2.21 time: 0.374141 Oct 06 12:57:22.006903 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1016/1986] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:21 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:22.013327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:22.013981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:22.022900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.023406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.023915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.025061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.025525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.026836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.126093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:22.137156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:22.140304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:22.141609 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32b538ca-f37e-4c75-bd57-9022665eec8a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.133526 Oct 06 12:57:22.142839 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1017/1987] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:22 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:22.184733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1e01330-3e91-43f8-b942-3b44db4af2ac tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eced280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:22.286511 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1e01330-3e91-43f8-b942-3b44db4af2ac tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.140301 Oct 06 12:57:22.287116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1018/1988] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:22 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:22.302842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:22.303465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:22.311306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.312369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.312839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.314099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.314099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.314553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.544401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:22.555583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bfa3d8a9-f8b9-4933-a162-519502c8dd5f tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.257166 Oct 06 12:57:22.558710 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1019/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:22 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:22.638212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:22.639017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:22.659754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.661183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.661946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.674471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:22.675279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:22.676325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:22.990237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.005248 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3676e69b-7524-4d1a-b83b-f3917ec1c46b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.371094 Oct 06 12:57:23.009600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1020/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:22 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:23.016014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade59a5-d480-4187-87bb-4d4eb29e1741", "name": "network-vif-plugged", "status": "completed", "tag": "d96e48db-d849-4633-ab2a-d8f101b80f47"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:23.039588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.042548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.044948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.071202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] Creating event network-vif-plugged:d96e48db-d849-4633-ab2a-d8f101b80f47 for instance bade59a5-d480-4187-87bb-4d4eb29e1741 on n-h2-860556-1 Oct 06 12:57:23.088276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6c9744c6-6742-4522-b4f5-596f96fba960 req-f45b6c27-2681-48bf-883c-848974a6d7a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076987 Oct 06 12:57:23.090525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1021/1991] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:23.101007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:23.109017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:23.123107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.125832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.126627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.127771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.129434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.130609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.330911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.341022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.343229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.344568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37d912e2-bf8b-411c-9277-a9c67ab08827 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1551 microversion: 2.21 time: 0.250422 Oct 06 12:57:23.346029 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1022/1992] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:23 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1551 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:23.351006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:23.351704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:23.358434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.359015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.359531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.360316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.360845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.361362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.436376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.448610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.450568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:23.453074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22ca6bf1-61e7-4260-8940-31ae842003e2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.105752 Oct 06 12:57:23.468335 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1023/1993] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:23 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:23.468335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a886f4d6-81c7-43d4-9b12-f690611fc138 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecf6280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:23.533937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a886f4d6-81c7-43d4-9b12-f690611fc138 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.078143 Oct 06 12:57:23.544435 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1024/1994] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:23 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:23.551040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:23.551974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:23.562012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.562975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.563691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.564670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.565363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.566050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.595752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:57:23.654299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:23.762206 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24a7658d-0130-45ec-9281-e9c9fe9f552b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 204 len: 0 microversion: 2.21 time: 0.207594 Oct 06 12:57:23.762896 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1025/1995] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:57:23 2022] DELETE /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:57:23.771931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:23.772677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:23.799876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.800385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.800827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:23.801593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:23.802377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:23.802813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.092160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:24.105237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e1af5fb-4b59-4eb0-b715-7e866858858c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.337255 Oct 06 12:57:24.131964 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1026/1996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:23 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:24.156940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:24.160771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:24.173321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.176968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.177664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.182492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.183106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.183611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.223797 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49319c90-ae71-4874-8eeb-6cca694fe9e3 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744/action" status: 202 len: 0 microversion: 2.25 time: 3.348793 Oct 06 12:57:24.227050 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 971/1997] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:57:20 2022] POST /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744/action => generated 0 bytes in 3354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:57:24.260720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:24.268377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:24.304627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.304627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.304627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.308114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.309879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.312676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.688019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:24.704560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:24.707042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:24.709580 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eef09ef0-1b88-407d-801c-dba2371c8c0c tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1557 microversion: 2.21 time: 0.566000 Oct 06 12:57:24.709769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:24.713157 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1027/1998] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:24 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1557 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:24.734449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:24.735916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:24.764786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.765784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.766498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.767551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.774208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.782426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.820516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:24.849359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7713cfec-4876-4ea1-a292-e8d35dc0ca06 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.609966 Oct 06 12:57:24.865455 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 972/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:24 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:24.869455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:24.872097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:24.893609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.896355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.898268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:24.899474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:24.900971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:24.901660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.147735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.149318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.175123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.177885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.179598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.182409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.182824 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9775954a-4ffd-4dd6-8f24-dd90ce6dbde4 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.467481 Oct 06 12:57:25.184368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1028/2000] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:24 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:25.188960 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92fa0ee9-14fe-42c3-bb74-a5dd79bfda93 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.329520 Oct 06 12:57:25.202269 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 973/2001] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:24 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:25.204223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-593973f8-a4b2-4ac4-bc96-e2ed7135081b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed47dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:25.211848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:25.211848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:25.232468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.237054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.237816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.239240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.240838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.242904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.301083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-593973f8-a4b2-4ac4-bc96-e2ed7135081b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.112158 Oct 06 12:57:25.304879 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1029/2002] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:25 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:25.526174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:25.543983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02ccd712-9def-4db0-a44b-e2d71f0d079d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 0.351461 Oct 06 12:57:25.546527 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 974/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:25 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:25.761175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:25.762436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:25.776795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.778368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.781251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.783496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.797707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.798885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.880738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:25.881817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:25.905662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.906830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.907576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:25.908579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:25.916101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:25.918069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.271753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.281934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.284220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.285532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f397de91-8a4f-465b-ba34-9b0d187cb907 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1557 microversion: 2.21 time: 0.528949 Oct 06 12:57:26.286636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1030/2004] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:25 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1557 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:26.295729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:26.296505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:26.308798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.309458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.310485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.311502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.312080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.312627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.552528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.579132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6479f1c-c5d2-4853-971a-86f29280f3d3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.702871 Oct 06 12:57:26.592217 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 975/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:25 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:26.606860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:26.607832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:26.617097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.617956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.618593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.619633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.628335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.629107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.712622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.728894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.731958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.735050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0aa7dd38-f754-4d20-b1ff-20b9fe01a73f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.447084 Oct 06 12:57:26.749542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1031/2006] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:26 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:26.757185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0aa57a39-1b10-4d79-b56a-dd9d36488805 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eced160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:26.827654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.869439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.886706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:26.892053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-362d3009-712f-409f-9303-93c924b74456 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.290309 Oct 06 12:57:26.898021 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 976/2007] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:26 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:26.900573 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0aa57a39-1b10-4d79-b56a-dd9d36488805 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.160342 Oct 06 12:57:26.901333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1032/2008] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:26 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:26.937850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:26.942823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:26.969063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.970201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.972246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:26.973929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:26.975958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:26.977209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:27.065623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:27.318521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:27.319126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:27.328657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:27.340549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:27.343170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:27.344459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:27.347647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:27.349432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:27.984895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:28.009338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c95b1457-9472-4b8c-b513-d43d8ca31871 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1366 microversion: 2.1 time: 1.105679 Oct 06 12:57:28.010449 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 977/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:26 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1366 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:28.031642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:28.043258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:28.066769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:28.067569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:28.068355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:28.078239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:28.079438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:28.080999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:28.298855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:28.314054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:28.318618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:28.326651 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b249dc41-a6fc-40b5-90f6-af3cb9fdc744 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1557 microversion: 2.21 time: 1.009657 Oct 06 12:57:28.346633 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1033/2010] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:27 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1557 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:28.359486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:28.360512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:28.376343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:28.377328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:28.378136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:28.379228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:28.380020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:28.384536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:28.983186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:28.991416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-066d8aa3-e885-4495-91c2-3c600279f95a tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.968009 Oct 06 12:57:29.006223 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 978/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:28 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:29.006223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6be7a453-9671-4aed-9eb6-b642fa34e53e tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d4766f310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:29.149392 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6be7a453-9671-4aed-9eb6-b642fa34e53e tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.153773 Oct 06 12:57:29.158734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 979/2012] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:28 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:29.164218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:29.173586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:29.200080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.200583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.201024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.202416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.203021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.203648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.419445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.447462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.461587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.465242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e793fd0f-a871-4aae-90e4-55e64673a2b1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 1.116951 Oct 06 12:57:29.472676 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1034/2013] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:28 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:29.513612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b52520-2ce8-4d8e-b929-ea758f1dc040", "name": "network-vif-deleted", "tag": "c5d082ab-435f-45c9-b7b9-5b08f2896db7"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:29.544844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.551431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.552839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.604142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] Creating event network-vif-deleted:c5d082ab-435f-45c9-b7b9-5b08f2896db7 for instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 on n-h2-860556-1 Oct 06 12:57:29.618764 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9f8b93f1-b191-46d8-8050-6ff01a523313 req-460e3562-42d4-4603-acdf-f3dc98613b76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143253 Oct 06 12:57:29.621584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1035/2014] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:29.633109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:29.634892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:29.636249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.652225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.653464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.655674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.656023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:29.656612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.657714 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0628e01-833f-462c-a9d9-4cc86e8a2822 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.497494 Oct 06 12:57:29.659883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.661338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.662167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.677087 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 980/2015] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:29 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:29.685379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:29.689042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:29.703035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.706248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.707040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.708061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.710933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.711664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.810534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:29.821904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:29.822667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:29.823767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lazy-loading 'fault' on Instance uuid 81b52520-2ce8-4d8e-b929-ea758f1dc040 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:57:29.985689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:30.019966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:30.039073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '761363f43e574f548fdc0cf3c133ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a1ecaaa6af48f7b86f77f818a365d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:30.045453 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-674f4c51-5860-42b8-9bde-d399ff4caa35 tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 200 len: 1349 microversion: 2.21 time: 0.366741 Oct 06 12:57:30.058815 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 981/2016] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:29 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 1349 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:30.067839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:30.083070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:30.100156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.102096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.103702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:30.104684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.105599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.110614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:30.353172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:30.502754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:30.512750 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4fe31d5-908d-42ab-99b5-a29aed2052ae tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.452425 Oct 06 12:57:30.516412 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 982/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:30 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:30.521707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aeac68ec-f5bb-4113-b0dd-02200c11ddb5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c0f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:30.536862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:30.555250 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-09e073db-6aeb-4fe1-9596-09d5239c02af tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1555 microversion: 2.1 time: 0.928908 Oct 06 12:57:30.602102 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1036/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:29 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1555 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:30.630795 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aeac68ec-f5bb-4113-b0dd-02200c11ddb5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.112831 Oct 06 12:57:30.631400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 983/2019] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:30 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:30.634014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:30.635144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:30.647723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:30.655556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:30.659474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.661301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.661782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:30.662540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.662994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.663424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:30.673707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.677660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.678315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:30.679655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:30.680455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:30.680907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:31.162169 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef034574-8671-4dc2-baf3-afd83c2c37b3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.529154 Oct 06 12:57:31.162925 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 984/2020] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:57:30 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-interface => generated 284 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:31.177902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:31.178752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:31.196817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:31.198482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:31.198949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:31.201118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:31.202803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:31.203294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.127626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.151238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.158901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.164804 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41bd3845-df25-4529-b29a-2ae89e8721b2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.988891 Oct 06 12:57:32.166365 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 985/2021] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:31 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:32.179421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:32.180466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:32.202230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.203541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.204265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.205426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.206229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.211560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.274322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] HTTP exception thrown: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Request method failure captured: Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 HTTP/1.1 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtCNiqJEMS5cOWtBOQ-QWZ__NIuPfO0XC7yVMhCYoQhPSwz3HJ20YQSnE0BsQyH9-wWin99sE9V-3UUtlwpn6yG5b5lnx7DEU1u1dSy9b2o8TZmahHPm2Go7E7yALbb-2XgoTXoB9LRNSmKMG77Ima7ljnlwnaITFfNI81fRd3Kk5gc Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.21 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:57:32.282289 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a1ecaaa6af48f7b86f77f818a365d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}] Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 761363f43e574f548fdc0cf3c133ff14 Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:32.285398 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '81b52520-2ce8-4d8e-b929-ea758f1dc040'} Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:57:32.286392 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:32.289634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:32.299066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Returning 404 to user: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:57:32.307706 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5582ec89-b692-49b9-bc5b-5a6c472a457f tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 404 len: 111 microversion: 2.21 time: 0.139631 Oct 06 12:57:32.309824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 986/2022] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:32 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:57:32.328595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:32.330115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:32.337812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.338800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.339550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.340623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.342310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.343050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.647934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.664888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.670845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.672168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7085a448-d33f-40be-b0f5-ad39d484e283 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 2.068594 Oct 06 12:57:32.672786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1037/2023] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:30 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:32.687966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3270654b-5cbb-4080-9170-ebc05ef911de tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ec8b0d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:32.788497 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3270654b-5cbb-4080-9170-ebc05ef911de tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.102351 Oct 06 12:57:32.798000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1038/2024] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:32 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:32.805846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '.version_select at 0x7f7d3ed630d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:32.806859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:32.821432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.822297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.822921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.823841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:32.824484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:32.825115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:32.929639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:32.943081 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f6e7d95f-caca-41a4-874b-bd2ea11d0796 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.629447 Oct 06 12:57:32.959418 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 987/2025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:32 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:33.041807 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f92cecb-430e-42a6-bbcd-71e5262f93de tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.238395 Oct 06 12:57:33.070478 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1039/2026] 10.222.0.26 () {60 vars in 1337 bytes} [Thu Oct 6 12:57:32 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040/os-instance-actions => generated 611 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:57:33.090796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.091820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:33.121826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.124589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.125288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.128628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.129357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.130063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.163088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] HTTP exception thrown: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Request method failure captured: Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 HTTP/1.1 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtCNiqJEMS5cOWtBOQ-QWZ__NIuPfO0XC7yVMhCYoQhPSwz3HJ20YQSnE0BsQyH9-wWin99sE9V-3UUtlwpn6yG5b5lnx7DEU1u1dSy9b2o8TZmahHPm2Go7E7yALbb-2XgoTXoB9LRNSmKMG77Ima7ljnlwnaITFfNI81fRd3Kk5gc Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.21 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:57:33.168158 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a1ecaaa6af48f7b86f77f818a365d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}] Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 761363f43e574f548fdc0cf3c133ff14 Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.170780 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '81b52520-2ce8-4d8e-b929-ea758f1dc040'} Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:57:33.171831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.173336 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.174954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Returning 404 to user: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:57:33.174954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-303f45b5-3986-4bf1-8e6e-4866ef43ab4d tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 404 len: 111 microversion: 2.21 time: 0.096833 Oct 06 12:57:33.182684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.184554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] [instance: 81b52520-2ce8-4d8e-b929-ea758f1dc040] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:33.188421 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 988/2027] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:57:33 2022] DELETE /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:57:33.205013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.206103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.206875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.208687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.209531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.210533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.214295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.214941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:33.243192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.243699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.244148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.244878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.245342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.245795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.267454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] HTTP exception thrown: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Request method failure captured: Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 HTTP/1.1 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtCNiqJEMS5cOWtBOQ-QWZ__NIuPfO0XC7yVMhCYoQhPSwz3HJ20YQSnE0BsQyH9-wWin99sE9V-3UUtlwpn6yG5b5lnx7DEU1u1dSy9b2o8TZmahHPm2Go7E7yALbb-2XgoTXoB9LRNSmKMG77Ima7ljnlwnaITFfNI81fRd3Kk5gc Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.21 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:57:33.269545 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a1ecaaa6af48f7b86f77f818a365d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a1ecaaa6af48f7b86f77f818a365d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a1ecaaa6af48f7b86f77f818a365d1"}]}] Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 44a1ecaaa6af48f7b86f77f818a365d1 Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-809760747 Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 761363f43e574f548fdc0cf3c133ff14 Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-InstanceActionsV221TestJSON-809760747-project Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.271253 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '81b52520-2ce8-4d8e-b929-ea758f1dc040'} Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:57:33.272176 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. Oct 06 12:57:33.273658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:57:33.283066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] Returning 404 to user: Instance 81b52520-2ce8-4d8e-b929-ea758f1dc040 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:57:33.284810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9626a18a-eab0-4e4f-a2ed-40999dbea25b tempest-InstanceActionsV221TestJSON-809760747 tempest-InstanceActionsV221TestJSON-809760747-project] 10.222.0.26 "GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040" status: 404 len: 111 microversion: 2.21 time: 0.106924 Oct 06 12:57:33.291997 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1040/2028] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:33 2022] GET /compute/v2.1/servers/81b52520-2ce8-4d8e-b929-ea758f1dc040 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:57:33.471557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589391fb-b695-41bd-beb8-cb5f135506bd", "name": "network-vif-unplugged", "status": "completed", "tag": "5b008fe2-700d-46f4-90ba-c14c9ca570ce"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:33.504676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.509680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.512298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.548574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] Creating event network-vif-unplugged:5b008fe2-700d-46f4-90ba-c14c9ca570ce for instance 589391fb-b695-41bd-beb8-cb5f135506bd on n-h2-860556-1 Oct 06 12:57:33.564149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-30021feb-dac7-48fa-9867-49944e3541f0 req-ddd68705-a4a3-49f3-8c90-47bf226c84a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095005 Oct 06 12:57:33.566816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1041/2029] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:57:33.573130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:33.592018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:33.622144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:33.624372 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7df35ebc-c9b4-4509-a2f9-873ba4749357 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.427061 Oct 06 12:57:33.625136 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 989/2030] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:33 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:33.713915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.715308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:33.736836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.737500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.738096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.740441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.741469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.745326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.805631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b0d5758-7921-4710-9728-56e479238429 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476bd940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.921893 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b0d5758-7921-4710-9728-56e479238429 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.120957 Oct 06 12:57:33.924986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 990/2031] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:33 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:33.974665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:33.975283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:33.988465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.988977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.992005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:33.992850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:33.993566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:33.994053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:34.444886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:34.460362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bd96737-eb07-4164-b842-a8c2cf93afa0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.489668 Oct 06 12:57:34.462551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 991/2032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:33 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:34.660704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:34.661944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:34.676513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:34.677388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:34.679780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:34.680751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:34.682962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:34.683610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:34.895788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:34.920840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:34.927814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:34.929441 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f3526d7-eba4-4ec4-9ec0-c714beaf8b4a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.273519 Oct 06 12:57:34.930631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 992/2033] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:34 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:34.943221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-698792b2-5a75-4964-b0f1-a4bd5c306a71 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c4310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:34.983797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:35.006135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-698792b2-5a75-4964-b0f1-a4bd5c306a71 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.066826 Oct 06 12:57:35.015894 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 993/2034] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:34 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:35.017074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:35.019357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:35.021252 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f612175d-f767-440d-b29b-54c881c69d66 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 1.312953 Oct 06 12:57:35.023210 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1042/2035] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:33 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:35.484710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:35.485536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:35.508145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:35.508749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:35.512458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:35.513378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:35.516049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:35.516513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:35.682051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589391fb-b695-41bd-beb8-cb5f135506bd", "tag": "5b008fe2-700d-46f4-90ba-c14c9ca570ce"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:35.697002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:35.697995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:35.698644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:35.712228 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] Creating event network-changed:5b008fe2-700d-46f4-90ba-c14c9ca570ce for instance 589391fb-b695-41bd-beb8-cb5f135506bd on n-h2-860556-1 Oct 06 12:57:35.731423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b697fd14-7d1b-434c-9038-4176d9bc2881 req-0e72e8d6-7735-49a7-9466-f2aa7197b310 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059215 Oct 06 12:57:35.732716 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1043/2036] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 06 12:57:35.909499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bade59a5-d480-4187-87bb-4d4eb29e1741", "tag": "d96e48db-d849-4633-ab2a-d8f101b80f47"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:35.941624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:35.942257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:35.946302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:35.973896 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] Creating event network-changed:d96e48db-d849-4633-ab2a-d8f101b80f47 for instance bade59a5-d480-4187-87bb-4d4eb29e1741 on n-h2-860556-1 Oct 06 12:57:35.988723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d102a616-2b79-4a5d-86d2-897f6abf601d req-690b6de2-4b55-4118-8c2f-0a6af1d7f175 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085288 Oct 06 12:57:35.990991 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1044/2037] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:36.000993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:36.003663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:36.019204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:36.024316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:36.025499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:36.027415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:36.028363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:36.031195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:36.031854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:36.046113 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dfd568a6-7d1f-4b22-b047-9a5971eb75a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.566013 Oct 06 12:57:36.072671 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 994/2038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:35 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:36.081049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4808257e-fd18-4c8d-abd5-7b13233ab372 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476fbaf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:36.190083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4808257e-fd18-4c8d-abd5-7b13233ab372 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.114768 Oct 06 12:57:36.191068 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 995/2039] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:36 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:36.216027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:36.217361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:36.237316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:36.241924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:36.242547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:36.243447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:36.246525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:36.247320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:36.841817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:36.875443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:36.884833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:36.888130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8d4d560-c176-497b-9cf8-0a334966f6f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.895588 Oct 06 12:57:36.892281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1045/2040] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:35 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:36.998729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:37.011600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:37.017069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:37.018356 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b73c153d-3533-4fc8-ac79-5edbae68321a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.815948 Oct 06 12:57:37.020605 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 996/2041] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:36 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:37.084340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:37.089898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:37.128601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:37.131155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:37.135452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:37.141677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:37.145851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:37.148436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:37.207288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bc5da6f-b74b-46fb-b46d-ff29b0078315 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47658040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:37.313460 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1bc5da6f-b74b-46fb-b46d-ff29b0078315 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.111145 Oct 06 12:57:37.323551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 997/2042] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:37 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:37.939763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:37.940398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:37.979290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:37.982161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:37.985109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:37.989188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:37.991438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:37.994171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:38.418449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:38.454346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64ea32a1-2400-4ef9-b950-74333a0f2b31 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.379425 Oct 06 12:57:38.466083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:38.497678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:38.508762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:38.515423 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1046/2043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:37 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:38.519208 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60b58814-14ec-4377-b61b-22648ac8bb68 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.580307 Oct 06 12:57:38.521835 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 998/2044] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:37 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:38.566347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0c0f5aa8-9d35-4636-89b8-0bb2ec52ce69 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d4766fd30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:38.637177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:38.647446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:38.674239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:38.674881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:38.675340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:38.676108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:38.685951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:38.686675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:38.757344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0c0f5aa8-9d35-4636-89b8-0bb2ec52ce69 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.217324 Oct 06 12:57:38.774463 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 999/2045] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:38 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:39.483423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:39.484425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:39.502324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:39.502896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:39.503363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:39.506685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:39.507191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:39.507734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:40.124306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.138101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:40.143466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.146511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.148362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5353eb4e-5778-4ff8-a1d3-a906aceb8118 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 1.631259 Oct 06 12:57:40.160949 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1047/2046] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:38 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:40.180471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:40.181896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:40.191190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:40.192004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:40.192632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:40.193926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:40.194657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:40.195425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:40.681844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.700274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.725271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:40.726749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d876af2-835a-431c-a6ea-6ab015021ce0 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.550818 Oct 06 12:57:40.736053 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1048/2047] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:40 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:40.742387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1cf08334-6bab-4cc7-8070-12e1e5c1d2bd tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecd7160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:40.868430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1cf08334-6bab-4cc7-8070-12e1e5c1d2bd tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1455 microversion: 2.1 time: 0.126671 Oct 06 12:57:40.875104 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1049/2048] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:40 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:40.985498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:41.015766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f255aa40-5343-4816-98d2-e4b351f01f3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.538062 Oct 06 12:57:41.026761 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1000/2049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:39 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:41.190747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:41.193154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:41.230694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:41.235510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:41.236845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:41.248862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:41.251470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:41.252247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:41.802618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:41.803507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:41.891523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:41.899581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:41.903323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:41.905635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:41.906075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:41.906553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:42.104901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.131216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.136043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.140062 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01131a1c-c780-4b13-a4c6-50cbdc088b30 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.962273 Oct 06 12:57:42.143240 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1050/2050] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:41 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:42.143456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.165190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97219bd1-8a75-4fb2-ba5c-49ca28a104c1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecfef70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:42.174639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.178320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.182192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5b086b4-c3b8-4d2c-8499-7530d4f4109c tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.403003 Oct 06 12:57:42.183386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1001/2051] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:41 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:42.205356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:42.208022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:42.221156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:42.222617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:42.223769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:42.224773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:42.225550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:42.226353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:42.237518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:42.300526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97219bd1-8a75-4fb2-ba5c-49ca28a104c1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1464 microversion: 2.1 time: 0.155709 Oct 06 12:57:42.310765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1051/2052] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:42 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:42.316282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e3ebb97-1a4d-41a8-8502-707f25d5e17f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ecaf550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:42.400891 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e3ebb97-1a4d-41a8-8502-707f25d5e17f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 200 len: 1464 microversion: 2.1 time: 0.087592 Oct 06 12:57:42.402545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1052/2053] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:42 2022] GET /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:42.420973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:42.423940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:42.459661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:42.460565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:42.461224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:42.462169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:42.464088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:42.464792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:42.927076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.939294 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ffd02efb-682f-4132-b091-4d20761cd3ef tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.753677 Oct 06 12:57:42.964380 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1002/2054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:42 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:42.974763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:42.988900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f8993f0-c061-4401-b47e-d6a9780fb4ef tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1480 microversion: 2.1 time: 0.575670 Oct 06 12:57:42.991779 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1053/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:42 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1480 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:43.177363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:43.178988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:43.196741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:43.198085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:43.199080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:43.200288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:43.200991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:43.201950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:43.218648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:43.219368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:43.246585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:43.247463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:43.249608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:43.250643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:43.254610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:43.255416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:43.460968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.488104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.493569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.496675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16fffcdb-5c4e-4889-9f28-99c203f070f6 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.283927 Oct 06 12:57:43.499278 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1054/2056] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:43 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:43.645302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.659592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.661041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:43.668164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c4f0760-8afc-49c7-8104-20330cc38397 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.500271 Oct 06 12:57:43.687901 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1003/2057] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:43 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:43.979288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:43.980353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:43.997321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.001394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.002086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.005391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.007417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.008573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.015690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:44.016433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:44.036761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.037259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.037700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.038494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.038954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.039383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.562433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:44.577312 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6eb9438b-f046-4fc5-9ba7-3a8675462450 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1467 microversion: 2.1 time: 0.563594 Oct 06 12:57:44.580541 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1004/2058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:44 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1467 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:44.589354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:44.590524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:44.597945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.598959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.599785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.600711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.601344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.601994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.614914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:44.625501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fe1d143-4022-4c0d-8d16-8415e2b1b4d8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.650509 Oct 06 12:57:44.627270 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1055/2059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:43 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:57:44.632771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1679482825"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:44.635729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:44.643110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.643824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.644515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.645439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.646094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.646687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.724941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:44.744520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:44.750070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:44.753495 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9cfcd84b-dc06-4c2c-abfa-1977a603bb1f tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.171519 Oct 06 12:57:44.769769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1005/2060] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:44 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:44.769769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:44.769769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:44.782964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.787624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.788875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:44.791608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:44.792202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:44.792961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:45.044536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:45.060680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:45.070002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:45.076665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-34c6e331-7498-4fed-89dd-05e8a652289f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.317009 Oct 06 12:57:45.077467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1006/2061] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:44 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:45.337147 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8f61f33-9bec-4ce7-b1f8-e404bc69fe63 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "POST /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972/action" status: 202 len: 0 microversion: 2.1 time: 0.707943 Oct 06 12:57:45.344744 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1056/2062] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:57:44 2022] POST /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 12:57:45.349661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d11fe46e-4d05-4f8b-ac1c-983cf227e9f3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476feee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:45.421668 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d11fe46e-4d05-4f8b-ac1c-983cf227e9f3 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.076058 Oct 06 12:57:45.430341 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1007/2063] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:45 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:45.664694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:45.666721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:45.675191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:45.676409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:45.677095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:45.678984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:45.679902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:45.680627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:45.789177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:45.790719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:45.799906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=82 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:45.803548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:45.807142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:45.809279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:45.810357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:45.811071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:45.811696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:46.126079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.140827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.143578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.146648 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37cc43e7-d901-41a8-96e9-c4a1f978cb0a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.361859 Oct 06 12:57:46.148007 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1008/2064] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:45 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:46.159700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:46.161377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:46.182984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:46.183747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:46.184779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:46.187504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:46.188361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:46.188989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:46.593055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.636197 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-419cb0ce-675f-498a-aa7b-af4941c3e417 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.977786 Oct 06 12:57:46.637670 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1057/2065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:45 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:46.650679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49085de1-752a-4067-b656-2ffa8653b0a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed16a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:46.733336 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49085de1-752a-4067-b656-2ffa8653b0a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.092430 Oct 06 12:57:46.741399 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1058/2066] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:46 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:46.748003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.763759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.766718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:46.768604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6836769e-2dc6-40dc-b8dd-9f1b7af887d0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.619236 Oct 06 12:57:46.773857 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1009/2067] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:46 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:47.180932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:47.183112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:47.218596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.220878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.222541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:47.226398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.227919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.228968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:47.385527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:47.403800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:47.409317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:47.411347 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc4a75c2-fc97-445f-9336-eb1cd2759161 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.235226 Oct 06 12:57:47.429879 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1059/2068] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:47 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:47.669224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:47.670755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:47.687744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.688653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.689315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:47.690339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.691940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.692686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:47.748952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46a7ca59-fa67-414a-b6ff-962beff0bb14 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed16280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:47.826809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46a7ca59-fa67-414a-b6ff-962beff0bb14 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.074304 Oct 06 12:57:47.826809 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1060/2069] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:47 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:47.837714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:47.838707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:47.854478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.854984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.855441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:47.856169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:47.858996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:47.859138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:48.111111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.133572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64ee826c-82ae-4245-8ac4-aad0851ac8c0 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.466934 Oct 06 12:57:48.139589 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1010/2070] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:47 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:48.158045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd98acd-107f-4f05-861c-af855cd0c487", "name": "network-vif-unplugged", "status": "completed", "tag": "86a83b62-bdff-4a20-9c7d-900fa67f1d2e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:48.192026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:48.193002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:48.193463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:48.228411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] Creating event network-vif-unplugged:86a83b62-bdff-4a20-9c7d-900fa67f1d2e for instance cbd98acd-107f-4f05-861c-af855cd0c487 on n-h1-860556-1 Oct 06 12:57:48.235439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.239665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-56d11da3-3261-43f5-bfa0-328bd6ed5aa6 req-c98f4c50-c243-408f-ad03-c7bf50b40f31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095903 Oct 06 12:57:48.241040 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1011/2071] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:57:48.249426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.251497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.252912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-281cb17f-2635-46de-91a6-874deda5d7c1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.432312 Oct 06 12:57:48.253639 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1061/2072] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:47 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:48.448376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:48.449677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:48.481704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:48.496594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:48.497702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:48.498034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:48.498509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:48.501453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:48.600115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.616895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.623983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:48.625635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fd0f972-5a26-4707-b90d-f730780cc942 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.187379 Oct 06 12:57:48.626691 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1012/2073] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:48 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:48.839900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9673dd0-c4e6-494d-8650-93c0229911d0 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed16ca0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:48.915450 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9673dd0-c4e6-494d-8650-93c0229911d0 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.084561 Oct 06 12:57:48.916410 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1062/2074] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:48 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:49.188792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:49.191402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:49.221063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.224882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.227467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.234694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.235706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.236942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.351363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:49.352034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:49.381867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:49.407958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.413166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.414903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.416234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.416863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.417724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.600607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.611641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45f3a949-aadb-4ecd-94bc-e4f2360156b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.432741 Oct 06 12:57:49.624135 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1013/2075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:49 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:49.684602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:49.688641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:49.700973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.704389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.705630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.707950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:49.710113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:49.710979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:49.739643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.750760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.753855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.755292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33fb635f-ee78-44b1-af00-922390990a6e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.447410 Oct 06 12:57:49.756452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1063/2076] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:49 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:49.924428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.938770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a962de6f-3df1-4282-b9b9-47b4e965e3f5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7a310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:49.942716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.944193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:49.979170 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-483984e4-fb34-4dfe-96f6-044b9e4dd7b8 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.306393 Oct 06 12:57:49.979787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1014/2077] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:49 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:50.034668 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a962de6f-3df1-4282-b9b9-47b4e965e3f5 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.102044 Oct 06 12:57:50.041871 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1064/2078] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:49 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:50.640404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:50.642355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:50.680162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:50.681396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:50.682024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:50.683535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:50.684011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:50.687319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:50.790394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:50.791323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:50.816101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:50.818520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:50.819912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:50.822573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:50.824706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:50.834246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:51.139205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.156334 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-040f7002-31bc-4fc3-a74a-20741c99ecfb tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.522939 Oct 06 12:57:51.156970 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1015/2079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:50 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:51.179033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:51.181893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:51.211798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:51.212354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:51.212809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:51.236598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:51.237346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:51.253150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:51.343931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.364019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.365561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.366991 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4edc6605-2c06-428d-9a9f-8fb22bbc79f1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.582016 Oct 06 12:57:51.367561 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1065/2080] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:50 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:51.416742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5717257b-e7cf-4499-a66b-111f2f0f2982 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed16af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:51.510346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.533264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.537825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:51.539524 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-039711cc-4ac0-4e84-a7bf-40b21b049196 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.374294 Oct 06 12:57:51.540313 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1016/2081] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:51 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:51.584223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5717257b-e7cf-4499-a66b-111f2f0f2982 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.178289 Oct 06 12:57:51.584833 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1066/2082] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:51 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:52.187421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:52.189187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:52.206084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.206663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.207239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:52.208142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.208906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.209556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:52.404460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:52.405160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:52.419096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.423913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.424902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:52.431662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.432948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.434573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:52.728800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:52.748679 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e2a619a4-0e88-4e45-9c18-63c18643d7a8 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.562472 Oct 06 12:57:52.781342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1017/2083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:52 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:52.798665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:52.800585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:52.821289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.823688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.824313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:52.825870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:52.828559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:52.829547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:53.080804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.099497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.113211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.115203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e356069d-4d85-42b6-b3f5-e1afed5f072b tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.331119 Oct 06 12:57:53.130019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.131548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1018/2084] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:52 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:53.158828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8fc523e-b2cf-420a-9f04-3311714c17c6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47659ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:53.173620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.183801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:53.201901 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fba76ed-f9a9-4364-86ae-0f1b24624edf tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.796836 Oct 06 12:57:53.210173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1067/2085] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:52 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:53.310600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8fc523e-b2cf-420a-9f04-3311714c17c6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.175137 Oct 06 12:57:53.321714 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1019/2086] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:53 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:53.789611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:53.791243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:53.815183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:53.821577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:53.829798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:53.836252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:53.838158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:53.840104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:53.884332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-plugged", "status": "completed", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:57:53.946362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:53.953389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:53.955531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:54.018020 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] Creating event network-vif-plugged:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:57:54.054776 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8c525584-11bc-4d63-836d-1b7890c5f367 req-ad23eaf2-f099-4875-8715-d8d2ad3a4802 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170998 Oct 06 12:57:54.058211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1020/2087] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:57:54.162481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:54.168096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:54.210279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:54.213866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:54.214884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:54.223622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:54.226765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:54.231350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:54.365579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.378487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7653ee5-f02b-4b4f-921e-060542d0fb27 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.593327 Oct 06 12:57:54.383962 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1068/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:53 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:54.391767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:54.400143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:54.424895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:54.428280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:54.430398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:54.431370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:54.442707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:54.443417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:54.499970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.571158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.592275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.603440 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d93324a-6b97-4bf9-ab77-11da86de2b59 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.448208 Oct 06 12:57:54.625573 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1021/2089] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:54 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:54.669194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-522d91c6-812d-4bad-a146-7133ca5592fa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47608f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:54.854178 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-522d91c6-812d-4bad-a146-7133ca5592fa tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.213853 Oct 06 12:57:54.858130 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1022/2090] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:54 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:54.863518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.880050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.888302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:54.890326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fef94825-14ca-4b7a-896d-bceb9ca70493 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.509098 Oct 06 12:57:54.897453 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1069/2091] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:54 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:55.419246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:55.420768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:55.456054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:55.460219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:55.461415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:55.462463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:55.463320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:55.464841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:55.483542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:55.685525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:55.688758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:55.741698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:55.744101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:55.744565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:55.764765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:55.766153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:55.769963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:55.983975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.000058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-071c3fb4-a359-477c-8a4f-ea03a8a6a2fe tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.586565 Oct 06 12:57:56.006595 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1023/2092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:55 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:56.026272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb058155-17c8-47f6-9a94-796eb84cf918 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47622a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:56.127196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.142567 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb058155-17c8-47f6-9a94-796eb84cf918 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.133614 Oct 06 12:57:56.149128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.151123 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1024/2093] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:56 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:56.155848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.161293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bbeb65c3-b43d-4afa-9aad-0250982e3912 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.495261 Oct 06 12:57:56.165394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1070/2094] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:55 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:57:56.170167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:56.171012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:56.191422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:56.191422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:56.191422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:56.191422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:56.191846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:56.191846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:56.618747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.651564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.665015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:56.676059 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-222ea742-db43-430e-a6d9-03b6ec9e4214 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.517710 Oct 06 12:57:56.690184 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1025/2095] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:56 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:57.032672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:57.034187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:57.064100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.073483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.074197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:57.075620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.077259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.077938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:57.162022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:57:57.168690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aca4c7fb-2fc9-4e96-b9ac-efc93bf560cd tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47608a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:57.260438 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aca4c7fb-2fc9-4e96-b9ac-efc93bf560cd tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.096367 Oct 06 12:57:57.286621 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1026/2096] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:57 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:57.304468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:57.305125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:57.324667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.325165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.325609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:57.341071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.354650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.362208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:57.492362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:57.511972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a5bec32-665a-4e6d-9658-655530f421d5 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.483508 Oct 06 12:57:57.522445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1071/2097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:57 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:57.593146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:57.606425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:57.609038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:57.612233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e2bbc0f-d082-4ab5-a1b0-5d7e8143fe9a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.324467 Oct 06 12:57:57.622212 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1027/2098] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:57 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:57:57.714332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:57.715637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:57.731256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.733241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.734998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:57.738922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:57.740557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:57.742655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:58.303070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdedaa7f-7676-416d-a0d5-d8a5a2c97d06 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476fb700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:58.392593 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdedaa7f-7676-416d-a0d5-d8a5a2c97d06 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.097909 Oct 06 12:57:58.405731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1028/2099] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:57:58 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:58.559704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:58.565019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:58.599208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:58.601587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:58.606136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:58.612509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:58.613486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:58.615386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:59.868201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:57:59.882259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a85fd09e-de3f-4087-be1e-1014b9b30ecf tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.340045 Oct 06 12:57:59.905986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1029/2100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:57:58 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:57:59.924769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:57:59.931504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:57:59.961804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:59.962337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:59.962824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:57:59.967791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:57:59.968871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:57:59.972255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:00.119363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.150305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.154582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.165782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-148e269e-de0f-422a-bdc6-e915b338f2b6 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 2.451518 Oct 06 12:58:00.167400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1072/2101] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:57 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:00.178755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e850fa35-a8f9-46c3-9ad0-13f67db6d555 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eccaa60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:00.240602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.261286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.267137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:00.272596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9b746a4-82f3-4c1a-b9eb-25eb88a39551 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.363065 Oct 06 12:58:00.295606 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1030/2102] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:57:59 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:00.327749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e850fa35-a8f9-46c3-9ad0-13f67db6d555 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.155995 Oct 06 12:58:00.329028 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1073/2103] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:58:00 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:00.922816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:00.924038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:00.942205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:00.942866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:00.943422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:00.944445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:00.947212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:00.947797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:01.210490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:01.211337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:01.228808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:01.229407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:01.237117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:01.240858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:01.241379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:01.244611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:02.185656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.194313 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c54c007e-6793-4ea6-935e-101b6ebaa710 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.276636 Oct 06 12:58:02.194935 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1031/2104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:00 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:02.256319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:02.261020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:02.294990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:02.298100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:02.300368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:02.303161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:02.305215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:02.308267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:02.340445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.375839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.390064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.401517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e9a3cc0-4000-4396-8bea-3c641d878048 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 1.191292 Oct 06 12:58:02.412901 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1074/2105] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:01 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:02.456547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c32b839d-d141-4bfb-bfbc-841fbd0c1166 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edaa820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:02.603243 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c32b839d-d141-4bfb-bfbc-841fbd0c1166 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1455 microversion: 2.1 time: 0.182503 Oct 06 12:58:02.608953 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1075/2106] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:58:02 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:02.625752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.673335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.680215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:02.699380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2ee3735-da74-43e9-84d0-2431b8ee1eb2 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.463012 Oct 06 12:58:02.699979 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1032/2107] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:02 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:03.248620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:03.258418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:03.297067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:03.300618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:03.301869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:03.303452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:03.306260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:03.308350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:03.448294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:03.449558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:03.472917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:03.484860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:03.485600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:03.486585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:03.490420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:03.493376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:04.544978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:04.565876 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfa36f1a-ecc8-457d-8065-2ba07c27c491 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 1.331925 Oct 06 12:58:04.589034 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1076/2108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:03 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:04.605082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ed239c4-6d7b-4bb7-8eda-dc1455f1d2c6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed691f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:04.691109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:04.742400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:04.745218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:04.746866 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c783f5bd-cdee-44a8-b4a8-a6a3e6099615 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 1.302413 Oct 06 12:58:04.747677 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1033/2109] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:03 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:58:04.753294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:04.764791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:04.772255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:04.779622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:04.780534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:04.781511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:04.782213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:04.785013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:05.121361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:05.147337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:05.166024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:05.173692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f097da5e-48fe-427d-9e44-a7c55be3aedd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.424222 Oct 06 12:58:05.183901 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1034/2110] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:04 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:05.592490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:05.593119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:05.611573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:05.613925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:05.614759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:05.615760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:05.628625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:05.631513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:06.333585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:06.351049 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1d40b20-0983-4523-82fc-7c3e9a980a3b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1390 microversion: 2.1 time: 0.762408 Oct 06 12:58:06.355097 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1035/2111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:05 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1390 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:06.369203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:06.373013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:06.396992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:06.397814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:06.406390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:06.410661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:06.413512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:06.414229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:07.036812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.058599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.061498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.063914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-508f1bc1-c3d1-4c5d-93dc-1d0af298edb0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1485 microversion: 2.25 time: 0.706980 Oct 06 12:58:07.091155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1036/2112] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:06 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1485 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:07.110661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:07.111818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:07.122999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:07.123882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:07.124558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:07.125514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:07.126208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:07.131559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:07.368435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.392995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.413179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dfe076954e54c1aa8498659a124b7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3802f815f54ef4bc1b5debd38086ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:07.414471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88e886b0-c28b-45f8-b64f-1b9d3558137a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 200 len: 1604 microversion: 2.42 time: 0.320830 Oct 06 12:58:07.417991 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1037/2113] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:07 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 1604 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:08.015415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-521124860", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:13.283717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=19 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:14.560482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=23 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:17.382788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=70 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:18.054550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=51 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:19.129527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] validate_networks() for [('c5b6f957-7498-46d4-a4e2-e8b965536ea0', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:58:19.130326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ed239c4-6d7b-4bb7-8eda-dc1455f1d2c6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1464 microversion: 2.1 time: 14.538799 Oct 06 12:58:19.156435 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1077/2114] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:58:04 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1464 bytes in 14567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:19.165957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:19.166114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:19.175600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.176517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.177150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.178138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.178777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.179359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.539308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:19.577399 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a190cc85-5fa8-4e33-a567-7a58b198404d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1380 microversion: 2.1 time: 0.419282 Oct 06 12:58:19.581866 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1078/2115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:19 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1380 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:19.589034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:19.589659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:19.603920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.604427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.605294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.606536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.607870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.608684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.913299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:19.923400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:19.931840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:19.933319 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2b55278-ebb8-4021-acb8-095310d55d1b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1475 microversion: 2.25 time: 0.350023 Oct 06 12:58:19.946164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1079/2116] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:19 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:19.959375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa6fab1-6b52-4d60-8ec9-27f057bfe744", "name": "network-vif-unplugged", "status": "completed", "tag": "5d9c7a48-f940-4cb3-8093-05e80f1c520d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:19.960482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:58:19.960944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:58:19.961427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:58:19.961873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:58:19.962297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:58:19.972740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.973452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.974086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.975311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.975896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:19.976188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.976715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:19.977346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.977460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:19.994959 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] Creating event network-vif-unplugged:5d9c7a48-f940-4cb3-8093-05e80f1c520d for instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 on n-h2-860556-1 Oct 06 12:58:20.001577 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2ce876fc-d3d5-49af-b763-e7d3af9b39d5 req-0049df6f-7072-43a1-bb40-d63249330e21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053839 Oct 06 12:58:20.002074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Getting quotas for project 01fe61d37f9a4066b32989b00440841a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:58:20.005409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1080/2117] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:20.008444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Getting quotas for user 342ecfef9e7a450c93fdad2519facf31 and project 01fe61d37f9a4066b32989b00440841a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:58:20.011410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.012156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:20.019558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.020054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.020491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.021193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.021651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.022125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.025979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:58:20.029244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:58:20.040365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] HTTP exception thrown: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Request method failure captured: Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d HTTP/1.1 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8bMrp3g-vPljaIF3-FzwB-LtqAOO_BMp2UDCBUqIMIQu5hRtCszxN7f8T0hhBOWNJbSZ1pqPilQeJYws7_wXDZWU3Q0F18mr3fpFgmUwLgviNB6jL_1oY9AvurOhoamWvfh-Kfpt9z9P9EE6InAZDskTmqa9ap0wVUYDwUY21UlPs Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.42 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:58:20.043420 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee3802f815f54ef4bc1b5debd38086ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}] Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dfe076954e54c1aa8498659a124b7df Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:20.044659 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a11f7c79-1a4d-44fd-b430-c46ebf955b0d'} Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:20.045301 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:20.046457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:20.047372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Returning 404 to user: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:20.047372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d53f914-41e4-4976-b946-c8a918b2097a tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 404 len: 111 microversion: 2.42 time: 0.038921 Oct 06 12:58:20.047492 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1081/2118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:58:20.055445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20f5b07a-2cb9-4698-b151-4e6260448827 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edce1f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.104535 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20f5b07a-2cb9-4698-b151-4e6260448827 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 200 len: 1464 microversion: 2.1 time: 0.055449 Oct 06 12:58:20.105142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1082/2119] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 1464 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:20.124119 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-302bdd55-d457-49ed-a880-85ea1b51ef2d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.704521 Oct 06 12:58:20.124875 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1038/2120] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:58:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 12706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:58:20.131591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a3e9c0b-de0d-4c4c-9da5-3bab51173382 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '.version_select at 0x7f7d47670c10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.133458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea20e37d-3b55-485f-acbb-6e349736827f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '.version_select at 0x7f7d3ec5baf0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.136549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a3e9c0b-de0d-4c4c-9da5-3bab51173382 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.137045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a3e9c0b-de0d-4c4c-9da5-3bab51173382 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.137487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a3e9c0b-de0d-4c4c-9da5-3bab51173382 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.145030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea20e37d-3b55-485f-acbb-6e349736827f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.145533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea20e37d-3b55-485f-acbb-6e349736827f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.146000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea20e37d-3b55-485f-acbb-6e349736827f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.167829 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a3e9c0b-de0d-4c4c-9da5-3bab51173382 tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3625 microversion: 2.25 time: 0.041881 Oct 06 12:58:20.175788 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea20e37d-3b55-485f-acbb-6e349736827f tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3089 microversion: 2.1 time: 0.053861 Oct 06 12:58:20.178558 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1039/2121] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/os-migrations => generated 3625 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:20.188649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1083/2122] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/os-migrations => generated 3089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:20.194627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.195353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:20.196005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e6b1bdfb-8092-44f5-a585-b0fdca5c2b4e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '.version_select at 0x7f7d47622430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.210833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.223168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.224991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.226575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.227405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.228301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.237689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e6b1bdfb-8092-44f5-a585-b0fdca5c2b4e tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152034318" status: 204 len: 0 microversion: 2.42 time: 0.057380 Oct 06 12:58:20.242745 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1040/2123] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152034318 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:58:20.254461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0284a0e-5210-41f8-a2ac-000a536e598e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.256553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0284a0e-5210-41f8-a2ac-000a536e598e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:20.410224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b0284a0e-5210-41f8-a2ac-000a536e598e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:20.436053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0284a0e-5210-41f8-a2ac-000a536e598e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1216 microversion: 2.1 time: 0.178496 Oct 06 12:58:20.436053 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1041/2124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1216 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:20.436053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.436053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:20.447625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.448125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.448565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.449287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.449781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.450309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.666140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:20.683168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4f5b32d-fff8-4149-89a4-e6dab849766d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1465 microversion: 2.1 time: 0.493160 Oct 06 12:58:20.700544 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1084/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1465 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:20.708985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.710075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:20.726732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.727255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.727711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.728453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:20.728918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:20.729350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:20.739021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] Lazy-loading 'services' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:20.773571 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-144d3a18-9504-479c-8572-fc12da002caf tempest-LiveAutoBlockMigrationV225Test-479244430 tempest-LiveAutoBlockMigrationV225Test-479244430-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1967 microversion: 2.25 time: 0.352327 Oct 06 12:58:20.787431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1042/2126] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1967 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:20.921012 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-09ae9c99-152f-483d-91da-4d35058bc08c tempest-LiveMigrationTest-379016897 tempest-LiveMigrationTest-379016897-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1531 microversion: 2.1 time: 0.225258 Oct 06 12:58:20.922329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1085/2127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1531 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:20.927446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69edf0bc-5f37-41e6-ae15-2c3848839e5f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edd2af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:20.968215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03048aa6-b7ec-4fbf-adac-7b3b4243b61b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Action: 'create', calling method: .version_select at 0x7f7d47658040>, body: {"keypair": {"name": "tempest-keypair-1203017400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzGdLlKCiyZHNfncz9mrYRjx0yjZZRp+Ojg9B8g5zmHvQOfMkUn5MTH9FiYN9jVXzVHHinSXNxnHxQtbemjdNy3WKJgf9O3sPArH58v1eq9MuJw2LrnrvzAQgu3qINcbw=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:20.986181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-03048aa6-b7ec-4fbf-adac-7b3b4243b61b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Getting quotas for project 00cf9170d5cb462abebc8ad2bea567ee. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:58:20.991722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-03048aa6-b7ec-4fbf-adac-7b3b4243b61b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Getting quotas for user cede20d462824bc28ca072948a075ed3 and project 00cf9170d5cb462abebc8ad2bea567ee. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:58:21.020164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03048aa6-b7ec-4fbf-adac-7b3b4243b61b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218500 Oct 06 12:58:21.029916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1043/2128] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 12:58:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:21.037623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.038225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:21.046233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.047459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.048081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.048956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.049566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.050228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.071896 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69edf0bc-5f37-41e6-ae15-2c3848839e5f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-10-06T12%3A55%3A53Z" status: 200 len: 2802 microversion: 2.1 time: 0.148217 Oct 06 12:58:21.072686 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1086/2129] 10.222.0.26 () {58 vars in 1199 bytes} [Thu Oct 6 12:58:20 2022] GET /compute/v2.1/images?changes-since=2022-10-06T12%3A55%3A53Z => generated 2802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:21.078847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.079714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:21.087286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.088128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.088760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.089782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.090718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.091901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.100902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:21.134190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:21.238676 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdc25683-e6ba-40a6-be80-85107bf48ea0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 204 len: 0 microversion: 2.25 time: 0.206340 Oct 06 12:58:21.240533 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1044/2130] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:58:21 2022] DELETE /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:58:21.246097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49ccd97f-618a-4f18-9075-1b46d50fde0e tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476224c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.289438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-270a7703-bc97-49e0-bd7e-22465e97f9ed tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 204 len: 0 microversion: 2.1 time: 0.215124 Oct 06 12:58:21.293552 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1087/2131] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:58:21 2022] DELETE /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:21.298638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.300239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:21.316959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.317465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.319392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.320156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.320624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.321060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.374256 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49ccd97f-618a-4f18-9075-1b46d50fde0e tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1100568030" status: 200 len: 485 microversion: 2.1 time: 0.131405 Oct 06 12:58:21.375542 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1045/2132] 10.222.0.26 () {58 vars in 1231 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1100568030 => generated 485 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:21.380749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.381771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:21.391127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.391926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.392563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.393291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.393771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.394212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.584431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:21.599360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:21.601369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:21.608100 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc2de16c-68a9-4825-bb9b-2e3c3e3b7138 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1481 microversion: 2.25 time: 0.316546 Oct 06 12:58:21.625922 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1088/2133] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1481 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:21.626297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:21.626408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-afd810c3-5c5b-4d46-8e26-b75e5d745370 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3edceaf0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.632015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6092158-1e13-40d0-a6f5-48f75b6fb4db tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1386 microversion: 2.1 time: 0.254909 Oct 06 12:58:21.633630 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1046/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1386 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:21.641787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.642849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:21.652246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.652766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.653194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.656484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:21.657518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:21.658244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:21.752948 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-afd810c3-5c5b-4d46-8e26-b75e5d745370 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?server=eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 958 microversion: 2.1 time: 0.140898 Oct 06 12:58:21.758665 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1089/2135] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/images?server=eb590d60-d437-482d-bdf6-b775010f2972 => generated 958 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:21.777312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:21.782323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4239a914-b0cb-4344-be03-91f0b6eda41d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ec5b040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.788310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d5eb3afe-cde7-425a-8edd-f8390ed36d68 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1268 microversion: 2.1 time: 0.152193 Oct 06 12:58:21.789043 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1047/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:21.866665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4239a914-b0cb-4344-be03-91f0b6eda41d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 485 microversion: 2.1 time: 0.100484 Oct 06 12:58:21.867630 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1090/2137] 10.222.0.26 () {58 vars in 1317 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:21.880755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc023d27-76ad-4a09-acaf-b3c0d7eae6e0 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f78f0d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:21.953853 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc023d27-76ad-4a09-acaf-b3c0d7eae6e0 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 485 microversion: 2.1 time: 0.076672 Oct 06 12:58:21.955200 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1048/2138] 10.222.0.26 () {58 vars in 1303 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487 => generated 485 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:58:21.970961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acb38244-4b8b-4e9a-bcef-ff622b92e000 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3f21c9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.020271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa6fab1-6b52-4d60-8ec9-27f057bfe744", "tag": "5d9c7a48-f940-4cb3-8093-05e80f1c520d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:22.045229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:22.046897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:22.048240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:22.067687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] Creating event network-changed:5d9c7a48-f940-4cb3-8093-05e80f1c520d for instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 on n-h2-860556-1 Oct 06 12:58:22.078472 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d498622d-e0df-4ad1-acd2-953225da663c req-b57a76d5-f169-4073-8dc0-69498c97b3d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064887 Oct 06 12:58:22.079371 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1049/2139] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:58:22.149287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acb38244-4b8b-4e9a-bcef-ff622b92e000 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3708 microversion: 2.1 time: 0.183789 Oct 06 12:58:22.155236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1091/2140] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:58:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3708 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:22.184454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcb28976-00f0-41ec-a5c8-dcddd79e479d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47622940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.269784 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcb28976-00f0-41ec-a5c8-dcddd79e479d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.093992 Oct 06 12:58:22.271106 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1050/2141] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:22.286620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86a8828b-9432-4ded-93a9-e4727dc65455 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3eda29d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.374603 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86a8828b-9432-4ded-93a9-e4727dc65455 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.091903 Oct 06 12:58:22.375637 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1092/2142] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:22.389897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4996050c-da20-48b8-b32f-dfe7815301b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47631820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.483699 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4996050c-da20-48b8-b32f-dfe7815301b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-10-06T12%3A55%3A49Z" status: 200 len: 7023 microversion: 2.1 time: 0.098192 Oct 06 12:58:22.484829 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1051/2143] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-06T12%3A55%3A49Z => generated 7023 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:22.505362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bff39dec-d042-4b09-a8ee-2dcd8b334867 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ee01af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.594113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bff39dec-d042-4b09-a8ee-2dcd8b334867 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1100568030" status: 200 len: 665 microversion: 2.1 time: 0.087184 Oct 06 12:58:22.595136 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1093/2144] 10.222.0.26 () {58 vars in 1252 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1100568030 => generated 665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:22.612110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8af16fbc-0f7b-4020-bd56-b8e8c72e6ab1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47622c10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.639133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.639751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:22.649035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:22.649645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:22.650368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:22.656805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:22.657667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:22.658276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:22.704458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8af16fbc-0f7b-4020-bd56-b8e8c72e6ab1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1467 microversion: 2.1 time: 0.097556 Oct 06 12:58:22.705009 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1052/2145] 10.222.0.26 () {58 vars in 1338 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487 => generated 1467 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:22.718591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:22.719345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:22.742669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:22.743205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:22.743742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:22.746641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:22.750578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:22.751501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:23.093723 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 12:58:23.093959 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 12:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 (ip 10.222.0.26) !!! Oct 06 12:58:23.613349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:23.624186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1008ad3d-454c-4f69-a71e-bb8069ed6668 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1386 microversion: 2.1 time: 0.910707 Oct 06 12:58:23.632380 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1053/2146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1386 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:23.642809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c353c431-612f-415f-89c5-abb09f4c2220 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d4773f700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:23.710062 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c353c431-612f-415f-89c5-abb09f4c2220 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1467 microversion: 2.1 time: 0.076117 Oct 06 12:58:23.722108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1054/2147] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Oct 6 12:58:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2Fcbd98acd-107f-4f05-861c-af855cd0c487 => generated 1467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:23.727949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:23.729698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:23.738618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:23.739408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:23.740056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:23.741014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:23.741679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:23.742492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:23.829707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:23.850905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:23.852391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:23.853978 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c55b445-b4e1-447e-a6fc-c87bc46e4a55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1481 microversion: 2.25 time: 1.219042 Oct 06 12:58:23.874691 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1094/2148] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:22 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1481 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:58:23.882014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-unplugged", "status": "completed", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:23.906934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:23.907715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:23.908175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:23.915256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:23.920811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] Creating event network-vif-unplugged:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:58:23.926023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c679df52-2191-44a8-8f38-6dc1d00cefb0 req-3eb14234-543d-4627-aac7-3920b36a3236 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049064 Oct 06 12:58:23.927206 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1095/2149] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:23.930644 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7746b39-d7a9-4e99-be0d-50a89fdb0899 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1274 microversion: 2.1 time: 0.206982 Oct 06 12:58:23.931268 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1055/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:23 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:23.949650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc0c90d5-4677-4e0d-bec6-0a5fdd8d772f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7a790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.124170 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc0c90d5-4677-4e0d-bec6-0a5fdd8d772f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7798 microversion: 2.1 time: 0.195397 Oct 06 12:58:24.125181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1096/2151] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 12:58:23 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7798 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:24.149811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f236c11-cdfc-487b-b17f-d4a05f6c9b4a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476580d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.239186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f236c11-cdfc-487b-b17f-d4a05f6c9b4a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.093416 Oct 06 12:58:24.252665 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1056/2152] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 12:58:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:24.259931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-add7e887-be7e-44c2-b4d3-08ecd6da4634 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed05dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.327148 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-add7e887-be7e-44c2-b4d3-08ecd6da4634 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2" status: 200 len: 784 microversion: 2.1 time: 0.072974 Oct 06 12:58:24.329394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1097/2153] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 12:58:24 2022] GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2 => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:58:24.344929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6c68fa61-9921-4164-86c1-67976adfc091 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d47608790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.453080 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6c68fa61-9921-4164-86c1-67976adfc091 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.112015 Oct 06 12:58:24.454108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1057/2154] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:58:24 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:24.473567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e68aa740-2f65-43d6-b938-509f4c6ef036 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ec5b9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.660700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.661326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:24.679483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:24.679990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:24.680441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:24.687016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:24.688048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:24.689705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:24.830905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:24.850135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-baa1996b-dc3a-44f7-a85d-67ab91b8b929 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1344 microversion: 2.1 time: 0.198233 Oct 06 12:58:24.866029 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1058/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:24 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:24.871078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589391fb-b695-41bd-beb8-cb5f135506bd", "name": "network-vif-deleted", "tag": "5b008fe2-700d-46f4-90ba-c14c9ca570ce"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:24.905966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:24.906793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:24.907426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:24.921803 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] Creating event network-vif-deleted:5b008fe2-700d-46f4-90ba-c14c9ca570ce for instance 589391fb-b695-41bd-beb8-cb5f135506bd on n-h1-860556-1 Oct 06 12:58:24.939138 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0d7a3ca2-0cd9-4c76-b0fe-299073b6a424 req-a5c4b1c1-511d-4026-ba21-6ec1059f1144 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071408 Oct 06 12:58:24.939772 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1059/2156] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:24.954626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:24.958164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:24.971815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:24.972323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:24.972883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:24.973467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:24.973965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:24.974392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:25.229355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:25.247736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:25.254700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:25.270651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8109a7d7-a62e-45e7-abff-af4d4737ae69 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1439 microversion: 2.25 time: 0.325559 Oct 06 12:58:25.286751 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1060/2157] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:24 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1439 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:25.304141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:25.308507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:25.324528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:25.328427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:25.330373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:25.333015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:25.335376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:25.336161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:25.467098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e68aa740-2f65-43d6-b938-509f4c6ef036 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7" status: 204 len: 0 microversion: 2.1 time: 0.995890 Oct 06 12:58:25.467745 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1098/2158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:24 2022] DELETE /compute/v2.1/images/2ac7e3bf-f35d-4754-a8da-2826b53f3ae7 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:25.480604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1767545-81c5-4798-a6c2-cdcf8f2e5946 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed05f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:25.689324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:25.705481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3a48a8f-f90b-4dc7-99d7-146bd778ffc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.413983 Oct 06 12:58:25.718273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1061/2159] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:25 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:25.877817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:25.878692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:25.894153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:25.895301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:25.897575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:25.898427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:25.901878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:25.902271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:26.098111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:26.124352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b507733d-0e27-4d5c-a12f-bf6e725942d2 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1183 microversion: 2.1 time: 0.252254 Oct 06 12:58:26.124957 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1062/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:25 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:26.304729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:26.305389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:26.312187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:26.314657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:26.324716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:26.330202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:26.331769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:26.335402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:26.356950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1767545-81c5-4798-a6c2-cdcf8f2e5946 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9" status: 204 len: 0 microversion: 2.1 time: 0.884771 Oct 06 12:58:26.361627 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1099/2161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:25 2022] DELETE /compute/v2.1/images/c402486a-f30c-4786-b5ef-4c60658b16a9 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:26.367451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95b96771-d7a0-4e88-9eb6-f574c8df3337 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ed7cd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:26.523397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:26.537795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:26.539420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:26.540623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21dfaddc-65e2-491d-b825-01052504200f tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.240042 Oct 06 12:58:26.554607 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1063/2162] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:26 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:26.571359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-54679981", "imageRef": "ff29f9c4-93c0-4ee8-bee6-87d1d296fdd7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "de409600-a439-4a03-ac43-57efe2f6cb0f"}], "security_groups": [{"name": "tempest-securitygroup--211976657"}], "key_name": "tempest-keypair-1203017400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:26.834919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] validate_networks() for [('de409600-a439-4a03-ac43-57efe2f6cb0f', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:58:27.148903 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95b96771-d7a0-4e88-9eb6-f574c8df3337 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba" status: 204 len: 0 microversion: 2.1 time: 0.785558 Oct 06 12:58:27.153221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1100/2163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:26 2022] DELETE /compute/v2.1/images/48a448a3-b37c-46d3-8506-3b81dedcbfba => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:27.158427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.159428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.172955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.173713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.177035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.178116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.178783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.179426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.478581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:27.499141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3335a848-e1af-4475-a39b-3661a504a04e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.340472 Oct 06 12:58:27.499492 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1101/2164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:27 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:27.509475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa6fab1-6b52-4d60-8ec9-27f057bfe744", "name": "network-vif-deleted", "tag": "5d9c7a48-f940-4cb3-8093-05e80f1c520d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:27.526187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.526892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.527618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.541001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:58:27.541416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:58:27.542000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:58:27.542584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:58:27.543365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:58:27.548117 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] Creating event network-vif-deleted:5d9c7a48-f940-4cb3-8093-05e80f1c520d for instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 on n-h2-860556-1 Oct 06 12:58:27.554040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f8797c31-65cd-480e-8fb3-14e1323999f2 req-9ade9faf-8139-416f-86e6-ed3197d01a88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053064 Oct 06 12:58:27.555225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.555875 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1102/2165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:27.556364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.556992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.558028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.560291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.560939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.562290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.562889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.569970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.570651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.571103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.571828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.572286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.572806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.589904 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] HTTP exception thrown: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Request method failure captured: Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d HTTP/1.1 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8bMrp3g-vPljaIF3-FzwB-LtqAOO_BMp2UDCBUqIMIQu5hRtCszxN7f8T0hhBOWNJbSZ1pqPilQeJYws7_wXDZWU3Q0F18mr3fpFgmUwLgviNB6jL_1oY9AvurOhoamWvfh-Kfpt9z9P9EE6InAZDskTmqa9ap0wVUYDwUY21UlPs Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.42 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:58:27.591878 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee3802f815f54ef4bc1b5debd38086ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}] Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dfe076954e54c1aa8498659a124b7df Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:27.593326 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a11f7c79-1a4d-44fd-b430-c46ebf955b0d'} Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:27.594002 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:27.595022 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:27.597517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Returning 404 to user: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:27.598829 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7505f8eb-032f-49c3-ba00-4f2bc90d2348 tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 404 len: 111 microversion: 2.42 time: 0.041564 Oct 06 12:58:27.599947 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1103/2166] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:58:27 2022] DELETE /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:58:27.605915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.607563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.614971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Getting quotas for project 00cf9170d5cb462abebc8ad2bea567ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:58:27.616633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.618138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.618955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.619978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.620923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.621362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Getting quotas for user cede20d462824bc28ca072948a075ed3 and project 00cf9170d5cb462abebc8ad2bea567ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:58:27.621854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.635998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:58:27.638553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff29f9c4-93c0-4ee8-bee6-87d1d296fdd7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:58:27.699829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:27.708583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9f9a0542-7bd6-4356-96c2-4b8baa495b9e tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.152328 Oct 06 12:58:27.713125 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d654630-10c7-4bcd-9c28-d39dc269ca5e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1183 microversion: 2.1 time: 0.111655 Oct 06 12:58:27.714511 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1104/2167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:27 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:27.719283 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1064/2168] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:58:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:58:27.725822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.729911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.739454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:27.745083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.745516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.746005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.746750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.748963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.749469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.759144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.759650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.763091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.779700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] Creating event network-changed:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h2-860556-1 Oct 06 12:58:27.787537 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0cb051e9-55dd-4609-b37f-6528941e7536 req-47b70ad0-ea0d-4433-a90e-623db9b9c5ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064842 Oct 06 12:58:27.788573 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1065/2169] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:27.799569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.800592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.810613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.811183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:27.812059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.812677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.813625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.815030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.816604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.935572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:27.957798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:27.959819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:27.961522 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-985b3a6b-7e76-45bc-ac12-0cee7e7a88ed tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.171227 Oct 06 12:58:27.962091 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ef9ceab-35de-404f-b788-bd8b2a0e1c2a tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 204 len: 0 microversion: 2.1 time: 0.244464 Oct 06 12:58:27.962518 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1066/2170] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:27 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:27.963320 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1105/2171] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:58:27 2022] DELETE /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:27.968696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.969476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] [instance: a11f7c79-1a4d-44fd-b430-c46ebf955b0d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.971810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7327fac9-f12b-476a-abd1-1626aba0c09c tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:27.973057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7327fac9-f12b-476a-abd1-1626aba0c09c tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:27.981250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.982653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.983107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:27.986012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:27.986556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:27.987009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.003388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] HTTP exception thrown: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Request method failure captured: Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d HTTP/1.1 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8bMrp3g-vPljaIF3-FzwB-LtqAOO_BMp2UDCBUqIMIQu5hRtCszxN7f8T0hhBOWNJbSZ1pqPilQeJYws7_wXDZWU3Q0F18mr3fpFgmUwLgviNB6jL_1oY9AvurOhoamWvfh-Kfpt9z9P9EE6InAZDskTmqa9ap0wVUYDwUY21UlPs Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.42 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:58:28.007618 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee3802f815f54ef4bc1b5debd38086ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee3802f815f54ef4bc1b5debd38086ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee3802f815f54ef4bc1b5debd38086ed"}]}] Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: ee3802f815f54ef4bc1b5debd38086ed Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-411427861 Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1dfe076954e54c1aa8498659a124b7df Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TaggedBootDevicesTest_v242-411427861-project Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:28.008802 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a11f7c79-1a4d-44fd-b430-c46ebf955b0d'} Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:28.009468 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. Oct 06 12:58:28.014214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:28.015086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] Returning 404 to user: Instance a11f7c79-1a4d-44fd-b430-c46ebf955b0d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:28.015086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f41f1b0-4ab2-49d2-8c86-eb9ecb79aefd tempest-TaggedBootDevicesTest_v242-411427861 tempest-TaggedBootDevicesTest_v242-411427861-project] 10.222.0.26 "GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d" status: 404 len: 111 microversion: 2.42 time: 0.045251 Oct 06 12:58:28.015086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1067/2172] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:27 2022] GET /compute/v2.1/servers/a11f7c79-1a4d-44fd-b430-c46ebf955b0d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:58:28.017215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:28.018857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:28.027867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.030032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.030863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.031757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.032604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.033990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.039761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:28.074045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7327fac9-f12b-476a-abd1-1626aba0c09c tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:28.082342 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7327fac9-f12b-476a-abd1-1626aba0c09c tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1244 microversion: 2.1 time: 0.117529 Oct 06 12:58:28.085821 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1106/2173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:27 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:28.223397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:28.232496 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23fb970d-aecd-4127-bddb-e3b1f6adae02 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1473 microversion: 2.1 time: 0.221313 Oct 06 12:58:28.250650 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1068/2174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:28 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:28.524117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:28.525284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:28.533195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.533685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.534167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.534932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.535392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.535821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.742539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:28.749613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:28.750395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:28.751770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89b98db9-4bc4-421e-9038-5cb6065a133d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.231860 Oct 06 12:58:28.752372 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1107/2175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:28 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:28.762290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.764061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.764878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.766216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.767059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:28.767851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:28.846925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:28.855087 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6aea0f6-baaf-4091-9563-b90c4f76cf2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1183 microversion: 2.1 time: 0.112382 Oct 06 12:58:28.855674 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1069/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:28 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:28.991677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:28.992317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:28.999242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:28.999728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.000162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.000870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.001472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.001932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.006538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:29.070363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:29.080689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:29.082162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:29.083315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-94884fd3-8b29-47a1-a02d-b5fb156915d1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.095652 Oct 06 12:58:29.084241 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1108/2177] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:28 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:29.109802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:29.111119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:29.122539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.123335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.124029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.125193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.126010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.126746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.256642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:29.257306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:29.267011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.267512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.267957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.268693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.269155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.269583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.436245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:29.447379 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4b82161-db85-4bb7-91fc-cd63c3910873 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1248 microversion: 2.1 time: 0.341656 Oct 06 12:58:29.448175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1070/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:29 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1248 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:29.468290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:29.477172 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22222f5a-55c2-4502-b4c2-6ccae55c33a1 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1473 microversion: 2.1 time: 0.224353 Oct 06 12:58:29.477814 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1109/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:29 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:29.789814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:29.790667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:29.800414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.800910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.801340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.805947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.808932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.811681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.880413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:29.881803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:29.891271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.891795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.892435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:29.893311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:29.894269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:29.894881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.334301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.345385 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd1451ee-c7c5-482e-a431-f33981bb2b2e tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1183 microversion: 2.1 time: 0.469403 Oct 06 12:58:30.346406 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1110/2180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:29 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:30.351367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:30.352287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:30.359991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.360733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.361383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.362346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.362990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.366021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.478408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.490552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.492477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.494805 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-784e453f-97d2-4133-9690-edffa47ba59b tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.147177 Oct 06 12:58:30.498663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1111/2181] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:30 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:30.504448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:30.513067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:30.522012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.522739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.523376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.525548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.526285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.527920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.653208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.680012 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf43ca62-87a5-4eed-8a45-8f821324155d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.881431 Oct 06 12:58:30.689178 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1071/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:29 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:30.713756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:30.714411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:30.734287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:30.742433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.743607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.745078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.749779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:30.750618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:30.751401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:30.888899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:30.913475 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-546b6316-9ed9-4f58-99bb-d891dbe1589a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1296 microversion: 2.1 time: 0.401567 Oct 06 12:58:30.917624 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1112/2183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:30 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1296 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:31.389062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:31.389709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:31.423786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.426084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.426912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.430036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.430698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.431289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.477132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.477637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.478183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.478574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lazy-loading 'fault' on Instance uuid 589391fb-b695-41bd-beb8-cb5f135506bd {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:31.654739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:31.666440 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e3fe2d29-bfe5-47f4-89c1-67f569865e43 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1473 microversion: 2.1 time: 0.967912 Oct 06 12:58:31.667277 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1072/2184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:30 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1473 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:31.673295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:31.722351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:31.722681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:31.722797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.722797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.722797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.722797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.723110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.723110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.723254 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1d467df-a650-439d-a8f3-a5e7fe7b8e4d tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1188 microversion: 2.1 time: 0.321569 Oct 06 12:58:31.723398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1113/2185] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:31 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:31.732263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:31.750477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:31.774678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.775689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.779084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.781559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.795611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.800827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.862661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:31.872613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:31.879725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:31.881223 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37ef02ae-e70f-457d-b60c-1c88e5ecd6a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.212332 Oct 06 12:58:31.886544 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1073/2186] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:31 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:31.940913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:31.941539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:31.956469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.957049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.957519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:31.958313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:31.958782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:31.962609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:32.454511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:32.468904 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e18b7e2-2429-46d8-b173-97a610a6fb92 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1302 microversion: 2.1 time: 0.531838 Oct 06 12:58:32.490336 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1074/2187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:31 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1302 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:32.707897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:32.709719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:32.739984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:32.740561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:32.740935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:32.741671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:32.753379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:32.753929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:32.904568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:32.919538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9bb7fba-e2d4-4e8f-b2bc-2faa6a7f1908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 1.193481 Oct 06 12:58:32.943590 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1114/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:31 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:32.961797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:32.963640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:32.987333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:32.988112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:32.988742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:32.994287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:32.994927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:32.995558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.085108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.085311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.086366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.087279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.088237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lazy-loading 'fault' on Instance uuid 589391fb-b695-41bd-beb8-cb5f135506bd {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:33.099840 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-420516d1-9b21-4f4a-bc2b-8f9349b6168d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1431 microversion: 2.1 time: 0.405286 Oct 06 12:58:33.100432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1075/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:32 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1431 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:33.129794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:33.129794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:33.161382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.163251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.164040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.169600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.170192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.170662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.221995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.234737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ecf567fe-a5ab-4e79-a963-ad656c5feb74 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 200 len: 1188 microversion: 2.1 time: 0.289557 Oct 06 12:58:33.237182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1115/2190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:32 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 1188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:33.256872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd98acd-107f-4f05-861c-af855cd0c487", "name": "network-vif-deleted", "tag": "86a83b62-bdff-4a20-9c7d-900fa67f1d2e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:33.301130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.318004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.319321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.368444 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] Creating event network-vif-deleted:86a83b62-bdff-4a20-9c7d-900fa67f1d2e for instance cbd98acd-107f-4f05-861c-af855cd0c487 on n-h1-860556-1 Oct 06 12:58:33.392584 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5dec26ad-20da-4e27-ac7f-ee1e6a900313 req-4b1eef5d-c37d-4cbb-ad9d-5b333c0e1087 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148864 Oct 06 12:58:33.393844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1116/2191] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:33.445351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.458788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.466098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.468160 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce44a035-6e16-4cd4-89e4-3b6cbae631c7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.363581 Oct 06 12:58:33.470146 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1076/2192] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:33 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:33.500586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:33.501294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:33.520255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.520658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.521098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.536320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.537149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.537853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.935280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-plugged", "status": "completed", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:33.941588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:33.958631 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62f8ebf7-c482-40ca-b0fe-d446c59ac688 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1302 microversion: 2.1 time: 0.464036 Oct 06 12:58:33.963108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1117/2193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:33 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1302 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:33.967152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.967657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.974409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:33.977285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:33.984142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:33.994927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:33.998030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:33.998856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.004202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.009332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.010223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.041541 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] Creating event network-vif-plugged:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h2-860556-1 Oct 06 12:58:34.083175 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-650b441b-16f7-46e6-9f03-335e80c66475 req-ee50d59f-69de-4058-9108-4f2478f5e85e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136660 Oct 06 12:58:34.084387 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1077/2194] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:34.149635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:34.151042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:34.167839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.169144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.169908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.171316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.180761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.181391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.260283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.260787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.261233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.261699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lazy-loading 'fault' on Instance uuid cbd98acd-107f-4f05-861c-af855cd0c487 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:34.376867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:34.393123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b454e3ee-515d-4f1b-b8f0-5e734f3d124d tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1308 microversion: 2.1 time: 0.248938 Oct 06 12:58:34.404465 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1078/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:34 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:34.416753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:34.417379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 589391fb-b695-41bd-beb8-cb5f135506bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:34.435943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.436440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.436879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.437599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.438079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.438508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.470613 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] HTTP exception thrown: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Request method failure captured: Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd HTTP/1.1 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8jo9pXHM4Unm7m5PYVzRIDdN7E8Tm6ioLNvkex-XIWr1c-fnui4npqCsq7GrCao6489e1LlMfrPvpPbCm0hkAwCBZrp-k2h3cY-kzbGEZ0L5EQeWgs7EG_iZO2GO8c2WneY1Y7V7gJEJOwj_WP9IpvC-Pfb83nMXpCsYT97w7b2yE Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:58:34.475955 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be9f8d0d5cd4c95a81317a2fee17cf2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}] Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveMigrationTest-1221331169-project Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1f58173845e04996a0a5c2497e13d3cc Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveMigrationTest-1221331169-project Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. Oct 06 12:58:34.477486 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '589391fb-b695-41bd-beb8-cb5f135506bd'} Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:34.478558 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. Oct 06 12:58:34.485431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:34.488764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Returning 404 to user: Instance 589391fb-b695-41bd-beb8-cb5f135506bd could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:34.489960 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-490f20c4-06ad-40a6-bc3b-c29d11ce0f99 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd" status: 404 len: 111 microversion: 2.1 time: 0.084108 Oct 06 12:58:34.495846 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1079/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:34 2022] GET /compute/v2.1/servers/589391fb-b695-41bd-beb8-cb5f135506bd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:58:34.535624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:34.543101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:34.554854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:34.584181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.584718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.585179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.585963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:34.586428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:34.592521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:34.595521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eb2b51b2-5160-4d07-a479-55c8ec02ec75 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.630865 Oct 06 12:58:34.596520 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1118/2197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:33 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:34.792129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:34.815594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:34.817482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:34.819062 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dc9bbdd4-fb35-47ff-aaa4-e7160a9f4963 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.317839 Oct 06 12:58:34.820287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1080/2198] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:34 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:35.000932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:35.002232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:35.026226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.027143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.028619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.029640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.031795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.032914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.292669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:35.313543 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd9eaf2a-141a-4b06-bd6e-c1a2d3da34e9 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.329062 Oct 06 12:58:35.329981 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1119/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:34 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:35.421556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:35.423356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:35.439521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.440536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.442417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.443650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.446056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.446883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.574670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.575758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.576207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.576667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lazy-loading 'fault' on Instance uuid cbd98acd-107f-4f05-861c-af855cd0c487 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:35.632461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:35.633821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:35.648243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.648935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.649719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.650899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.651508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.652079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.661666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:35.683136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81f619a0-71e0-4218-8e98-7ebcb9279f1b tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1308 microversion: 2.1 time: 0.263504 Oct 06 12:58:35.684823 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1081/2200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:35 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:35.854406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:35.855382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:35.867646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.868501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.871035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.873449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:35.879127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:35.879938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:35.930645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:35.942078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25e244fd-c04d-47ea-aea8-13587b1335d5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1316 microversion: 2.1 time: 0.320268 Oct 06 12:58:35.972586 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1120/2201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:35 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:36.009135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:36.019453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:36.021375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:36.022937 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3eb2308f-d73f-4863-a68c-1497973758c9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.174384 Oct 06 12:58:36.042550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1082/2202] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:35 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:58:36.341866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:36.342471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:36.352460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.353256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.354048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.355001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.355659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.356946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.531738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:36.543450 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce61e60f-892a-46b7-827f-bb4dc246ac00 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.210527 Oct 06 12:58:36.544643 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1121/2203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:36 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:36.717016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:36.717645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:36.726191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.726958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.727604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.728824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.729464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.730113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.793883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.794745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.795341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.796013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lazy-loading 'fault' on Instance uuid cbd98acd-107f-4f05-861c-af855cd0c487 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:36.896467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:36.909811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67a566d3-e117-4961-b561-82581153e673 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1308 microversion: 2.1 time: 0.196590 Oct 06 12:58:36.911410 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1083/2204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:36 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:36.973379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:36.974878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:36.986119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.987314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.988349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:36.989805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:36.990843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:36.991830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.051012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:37.051986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:37.062404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.063190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.063793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.064717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.074544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.075587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.238045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:37.254022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:37.255800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:37.257184 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6498340c-41f0-4e9f-8d86-e5115b6e8f55 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.209949 Oct 06 12:58:37.261605 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1084/2205] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:37 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:37.281700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:37.291501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46026193-2b34-4b80-9661-46122fcc28ab tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.325435 Oct 06 12:58:37.292620 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1122/2206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:36 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:37.368452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-789734272", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:37.468462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] validate_networks() for [('c5b6f957-7498-46d4-a4e2-e8b965536ea0', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:58:37.573679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:37.576140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:37.579917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:37.609955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.612984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.615863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.617583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.619009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.620435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.630014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=18 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:37.951473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:37.961113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d5d67e7-6fe2-4bad-927d-05fc543085d8 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.392016 Oct 06 12:58:37.979173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1123/2207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:37 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:37.984458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:37.984991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:37.994178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.994843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.995581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:37.996839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:37.997478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:37.998175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.079027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:38.085198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:38.085998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.087202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lazy-loading 'fault' on Instance uuid cbd98acd-107f-4f05-861c-af855cd0c487 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:38.094131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:38.098476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:38.181874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:38.197498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:58:38.198505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:58:38.198801 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-102ed210-bce9-41d4-a1a2-5381e0c701b2 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 200 len: 1308 microversion: 2.1 time: 0.218421 Oct 06 12:58:38.199361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:58:38.200118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:58:38.200505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1124/2208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:37 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:38.200867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:58:38.228907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:38.229770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:38.230760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.232738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:38.233827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:38.235176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.254863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:38.276056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Getting quotas for project 01fe61d37f9a4066b32989b00440841a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:58:38.292695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:38.296595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Getting quotas for user 342ecfef9e7a450c93fdad2519facf31 and project 01fe61d37f9a4066b32989b00440841a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:58:38.298354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:38.324340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:58:38.329383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:58:38.329717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:38.333026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:38.333824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.335152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:38.335794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:38.337670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:38.426508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a165911-e791-493c-ab53-9012a238f5a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061330 Oct 06 12:58:38.427081 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1085/2209] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:58:38.439469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc1d44c9-1ad5-4db8-8a0b-9275adc704c1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:38.440134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc1d44c9-1ad5-4db8-8a0b-9275adc704c1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:38.496033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:38.538086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:38.552880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:38.559809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-597d7566-086a-41b3-911f-c1f575faccf5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1265 microversion: 2.25 time: 0.269468 Oct 06 12:58:38.569913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1125/2210] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:38 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:38.652749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc1d44c9-1ad5-4db8-8a0b-9275adc704c1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:38.680333 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc1d44c9-1ad5-4db8-8a0b-9275adc704c1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1216 microversion: 2.1 time: 0.245687 Oct 06 12:58:38.685870 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1086/2211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:38 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:38.990628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:38.991650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:38.999692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.015269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.019079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.020128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.024727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.025587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.223063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:39.224401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: cbd98acd-107f-4f05-861c-af855cd0c487] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:39.257294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.258078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.261145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.262131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.266386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.267090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.303228 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] HTTP exception thrown: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Request method failure captured: Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 HTTP/1.1 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtBU6Mi-U9Fru4llvgJeswasSeGd7qvJnKoyf8y_mw_cHBHaRnymLa4FTr9OLXFthiD4ETa5epyAbwFOz0c6Zm7-XLmVTKV_b9kEPMxyezJCzr_196Q-ZcJmU44fN-QJsEmSEgVK-JqPPh_UDVuHRWefv2WxqrKwkpXvAZPcAH3i_ns Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c52cdad615a1441a9af34cce351c9175 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:58:39.305024 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c52cdad615a1441a9af34cce351c9175", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c52cdad615a1441a9af34cce351c9175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c52cdad615a1441a9af34cce351c9175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c52cdad615a1441a9af34cce351c9175"}]}] Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c52cdad615a1441a9af34cce351c9175 Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListImageFiltersTestJSON-1419650946-project Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b41581d657f340df99087566b4ac861f Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListImageFiltersTestJSON-1419650946-project Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. Oct 06 12:58:39.306478 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'cbd98acd-107f-4f05-861c-af855cd0c487'} Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:39.307410 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. Oct 06 12:58:39.308782 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:39.311683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Returning 404 to user: Instance cbd98acd-107f-4f05-861c-af855cd0c487 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:39.313398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31a31efe-aca4-4832-8a0b-ae4725e6af35 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487" status: 404 len: 111 microversion: 2.1 time: 0.094110 Oct 06 12:58:39.321856 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1087/2212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:39 2022] GET /compute/v2.1/servers/cbd98acd-107f-4f05-861c-af855cd0c487 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:58:39.346895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:39.347409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:39.355241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.355819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.356795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.360729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.361214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.361667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.446894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:39.640173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:39.674049 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e428786d-9207-44a7-a32b-fc1f773d0fb1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.687582 Oct 06 12:58:39.687838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1126/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:38 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:39.708420 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6551137e-3890-4357-8f08-7f31051377bf tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 204 len: 0 microversion: 2.1 time: 0.384385 Oct 06 12:58:39.710032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:39.710859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:39.711683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1088/2214] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:58:39 2022] DELETE /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:39.719149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5ca718f-1565-4ef8-8822-b3c888d40c70 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:39.729621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.732904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5ca718f-1565-4ef8-8822-b3c888d40c70 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:39.737519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.738365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.739299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.739922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.740570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.837929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.838488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.838940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.839430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lazy-loading 'fault' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:39.873512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5ca718f-1565-4ef8-8822-b3c888d40c70 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:39.881470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5ca718f-1565-4ef8-8822-b3c888d40c70 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1216 microversion: 2.1 time: 0.166517 Oct 06 12:58:39.888171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1089/2215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:39 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:39.899132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:39.899542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:39.935165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.935680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.936138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:39.937022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:39.937498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:39.937987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:40.022836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:40.052144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:40.063979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:40.069554 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b2f124a-deae-477c-a63a-924f657cd718 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1270 microversion: 2.25 time: 0.380037 Oct 06 12:58:40.091682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1127/2216] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:39 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1270 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:40.715108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:40.716611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:40.727998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:40.735707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:40.736521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:40.737522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:40.738256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:40.738896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:40.824241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:40.837480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f45f2b17-166d-455a-867c-cf33d5389276 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1471 microversion: 2.1 time: 0.947996 Oct 06 12:58:40.849833 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1090/2217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:39 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1471 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:40.913163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:40.914028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:40.927431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:40.928309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:40.929669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:40.931460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:40.933420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:40.933963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.220475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:41.235239 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b6af7f3-7db3-41fb-a166-fa2e11b37a5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1220 microversion: 2.1 time: 0.325827 Oct 06 12:58:41.250641 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1091/2218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:40 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1220 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:41.256365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:41.261577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:41.271906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.272501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.273021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.273869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.274547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.275445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.362406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.363826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.364589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.367323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lazy-loading 'fault' on Instance uuid caa6fab1-6b52-4d60-8ec9-27f057bfe744 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:41.579862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:41.612847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:41.624675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48ddf4ce-5f36-4c80-94ed-40bf926cb66a tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.913921 Oct 06 12:58:41.627687 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1128/2219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:40 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:41.651746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:41.662558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:41.665710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48434ec9-1697-41fb-9c17-7ed2770c2486 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 200 len: 1270 microversion: 2.25 time: 0.413350 Oct 06 12:58:41.668935 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1092/2220] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:41 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 1270 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:41.865051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:41.866214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:41.877253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:41.880714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.894171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.895624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.899292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.902197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.903040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:41.915604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9939237-2dc6-4099-bf94-a1851974517b", "tag": "1ac56104-37e1-498b-b1a3-432deb1b78b4"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:41.958313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:41.960702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:41.961137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.007198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] Creating event network-changed:1ac56104-37e1-498b-b1a3-432deb1b78b4 for instance f9939237-2dc6-4099-bf94-a1851974517b on n-h1-860556-1 Oct 06 12:58:42.020071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ed5e954c-e3c3-4716-b0f8-f361fe3c56af req-c0d5cfa0-c7b3-460a-b817-571108df2936 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108950 Oct 06 12:58:42.023448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1093/2221] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:42.252079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:42.258272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:42.258979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:42.263026 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71222652-8f3f-43bf-959e-e144e34e8577 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1471 microversion: 2.1 time: 0.402034 Oct 06 12:58:42.271041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.271888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.275669 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1129/2222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:41 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:42.276387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.277372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.278598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.279235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.449294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:42.470847 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-420d3648-a315-4c9f-b3bb-d96fc16da49a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1268 microversion: 2.1 time: 0.216335 Oct 06 12:58:42.500871 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1094/2223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:42 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:42.653109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:42.654257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:42.661515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.662226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.662758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.663750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.664292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.664929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.701588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:42.706058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: caa6fab1-6b52-4d60-8ec9-27f057bfe744] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:42.726496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.732605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.733923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.734965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:42.738802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:42.742309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:42.819559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] HTTP exception thrown: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Request method failure captured: Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 HTTP/1.1 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8HNlhOHrtYgnoclHajYESm_b8_NTc-0O-yI8R9coyC4s5pFoKVX4_F2p4jYbjxHXIaTG_5P0OkDhzHoMM4l-zLlQHCnMaFteTOlEUgyLIDMKuijV5k8_6lkGATXiVd9XyQdZVWFf13UK4Fjt3PBbVahhcpm-Qc-YlG2sYLPt11M8g Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.25 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:58:42.824174 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b283101c4674072a49a14df6acb56bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}] Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 17892d653b7d461e803f5423cf7191af Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. Oct 06 12:58:42.825512 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'caa6fab1-6b52-4d60-8ec9-27f057bfe744'} Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:42.826272 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. Oct 06 12:58:42.827316 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:42.831736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Returning 404 to user: Instance caa6fab1-6b52-4d60-8ec9-27f057bfe744 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:42.834136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c886d53a-837d-4fef-bebc-c8e34c30cac0 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744" status: 404 len: 111 microversion: 2.25 time: 0.144322 Oct 06 12:58:42.839000 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1095/2224] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:42 2022] GET /compute/v2.1/servers/caa6fab1-6b52-4d60-8ec9-27f057bfe744 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:58:43.242957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:43.263903 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8de781f-b2d0-4142-aa41-e4d5f51750ad tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.613088 Oct 06 12:58:43.267212 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1130/2225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:42 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:43.290947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:43.292249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:43.304133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.308855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.309823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:43.311104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.313858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.315221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:43.509031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:43.510046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:43.535269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.536334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.537072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:43.538185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.541396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.543133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:43.722873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:43.736955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18e1fb6e-0f30-405e-ab59-01ae95cc47b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1274 microversion: 2.1 time: 0.230020 Oct 06 12:58:43.738127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1131/2226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:43 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:43.749045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:43.764374 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a4d04f0-e410-4813-9c40-21a742931327 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1471 microversion: 2.1 time: 0.472209 Oct 06 12:58:43.765880 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1096/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:43 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:43.908231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:43.909272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:43.942586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.943082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.945503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:43.946350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:43.946838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:43.951356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.037262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:44.054129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb590d60-d437-482d-bdf6-b775010f2972", "name": "network-vif-deleted", "tag": "a284ea90-d76f-455a-aba4-989e475f1209"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:44.088640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:44.091615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:44.092256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.168267 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] Creating event network-vif-deleted:a284ea90-d76f-455a-aba4-989e475f1209 for instance eb590d60-d437-482d-bdf6-b775010f2972 on n-h2-860556-1 Oct 06 12:58:44.183201 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-410a17c7-1085-444f-9f8c-931f882da5f4 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 204 len: 0 microversion: 2.1 time: 0.286486 Oct 06 12:58:44.185091 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1132/2228] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:58:43 2022] DELETE /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:44.216712 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4b9f6f55-0cfc-4a62-b82f-4b3c3a5ae03e req-c6e10528-cc12-4baf-aa79-7265a0c3f6eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174324 Oct 06 12:58:44.217230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:44.218383 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1097/2229] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:44.220732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:44.238525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:44.242834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:44.243646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.244591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:44.246196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:44.248686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.295991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:44.297416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:44.327843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:44.333785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:44.333785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.333785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:44.333785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:44.334334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:44.980403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:45.016668 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f885f80e-f16b-4c8e-87d5-75a708828d02 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.720313 Oct 06 12:58:45.019799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1098/2230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:44 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:45.034913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:45.041313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:45.046748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:45.055076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45fbf461-4449-4585-9516-a17c62b1cb79 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1667 microversion: 2.1 time: 0.857028 Oct 06 12:58:45.066090 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1133/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:44 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1667 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:45.081542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:45.082207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:45.097174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:45.098402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:45.101536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:45.104117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:45.105154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:45.105662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:45.106252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:45.106362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:45.106981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:45.107448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:45.107893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:45.108329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:45.191641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:45.192149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:45.192597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:45.193059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lazy-loading 'fault' on Instance uuid eb590d60-d437-482d-bdf6-b775010f2972 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:45.694147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41581d657f340df99087566b4ac861f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52cdad615a1441a9af34cce351c9175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:45.703323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c29a2e4a-2067-4d43-a918-8e453f81c6af tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 200 len: 1306 microversion: 2.1 time: 0.636061 Oct 06 12:58:45.710546 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1134/2232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:45 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 1306 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:46.046558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:46.047470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:46.063166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:46.063898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:46.064587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:46.065500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:46.066223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:46.067745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:46.100676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:46.117806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2205ce3-997f-464e-8444-3446979912f9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 1.094708 Oct 06 12:58:46.118446 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1099/2233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:45 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:46.171040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:46.175399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:46.218559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:46.224692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:46.230030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:46.236799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:46.237662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:46.238309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.069990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:47.082767 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5091e13-6466-4a69-9bdf-e4cf99c9e65b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 1.039449 Oct 06 12:58:47.102840 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1135/2234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:46 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:47.114451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:47.116214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] [instance: eb590d60-d437-482d-bdf6-b775010f2972] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:47.120047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:47.131761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-970b006a-4f59-4b8f-8d47-52312f7d6465 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1667 microversion: 2.1 time: 0.986360 Oct 06 12:58:47.136494 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1100/2235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:46 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1667 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:47.144077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:47.144782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:47.146440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.149909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:47.150814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:47.151403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.158140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:47.159081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:47.173973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:47.174484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:47.174916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.175628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:47.176081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:47.176498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.200916 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] HTTP exception thrown: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Request method failure captured: Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 HTTP/1.1 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtBU6Mi-U9Fru4llvgJeswasSeGd7qvJnKoyf8y_mw_cHBHaRnymLa4FTr9OLXFthiD4ETa5epyAbwFOz0c6Zm7-XLmVTKV_b9kEPMxyezJCzr_196Q-ZcJmU44fN-QJsEmSEgVK-JqPPh_UDVuHRWefv2WxqrKwkpXvAZPcAH3i_ns Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: c52cdad615a1441a9af34cce351c9175 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:58:47.218106 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c52cdad615a1441a9af34cce351c9175", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c52cdad615a1441a9af34cce351c9175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c52cdad615a1441a9af34cce351c9175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c52cdad615a1441a9af34cce351c9175"}]}] Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: c52cdad615a1441a9af34cce351c9175 Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1419650946 Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListImageFiltersTestJSON-1419650946-project Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b41581d657f340df99087566b4ac861f Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListImageFiltersTestJSON-1419650946-project Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. Oct 06 12:58:47.219597 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'eb590d60-d437-482d-bdf6-b775010f2972'} Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:47.220366 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. Oct 06 12:58:47.221815 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:58:47.226080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Returning 404 to user: Instance eb590d60-d437-482d-bdf6-b775010f2972 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:47.228962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb262098-ac59-4f08-b050-a1e5cbb4a79f tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972" status: 404 len: 111 microversion: 2.1 time: 0.123029 Oct 06 12:58:47.230108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1136/2236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:47 2022] GET /compute/v2.1/servers/eb590d60-d437-482d-bdf6-b775010f2972 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:58:47.251404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd6cb637-1794-4e30-92cb-0cebc57f2dc6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d3ef58c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:47.735368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:47.757997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdfb9281-5a84-47ba-8466-2b57748936b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.598629 Oct 06 12:58:47.766566 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1101/2237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:47 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:47.781790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e28c2e-5721-485c-bafe-4201f690bb65", "tag": "065ef7cb-0459-4be7-b6de-976781d77974"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:47.841825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:47.842326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:47.842958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:47.886601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] Creating event network-changed:065ef7cb-0459-4be7-b6de-976781d77974 for instance e5e28c2e-5721-485c-bafe-4201f690bb65 on n-h2-860556-1 Oct 06 12:58:47.908380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cd1668ef-b84c-4161-bb98-09ccc5ad6d37 req-d3f47dc6-e04b-487f-b189-ebc90b045dcb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138918 Oct 06 12:58:47.909296 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1102/2238] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:47.926770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd6cb637-1794-4e30-92cb-0cebc57f2dc6 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536" status: 204 len: 0 microversion: 2.1 time: 0.692024 Oct 06 12:58:47.928097 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1137/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:47 2022] DELETE /compute/v2.1/images/12e1fdb2-2562-4445-b02f-ff5f88ef5536 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:47.937444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2f4f32b-2beb-4c54-bd72-64d8b5b01626 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476315e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:48.112479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:48.113105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:48.154234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:48.154732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:48.155175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:48.156122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:48.156592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:48.162314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:48.255268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:48.536719 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2f4f32b-2beb-4c54-bd72-64d8b5b01626 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf" status: 204 len: 0 microversion: 2.1 time: 0.604436 Oct 06 12:58:48.537275 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1103/2240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:47 2022] DELETE /compute/v2.1/images/02a5e032-ee6f-4fa8-809f-1111d61ceaaf => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:58:48.542660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:48.543084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:48.561685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:48.562278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:48.562723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:48.563446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:48.563900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:48.564326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:49.571934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:49.589088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d27f842-1502-4be4-b4e3-c938925fb024 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1599 microversion: 2.1 time: 1.050537 Oct 06 12:58:49.592454 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1104/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:48 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1599 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:49.607992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d065f67-29cf-4bb8-8893-23ae53482e62 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] Calling method '.version_select at 0x7f7d476c4940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:49.670329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:49.682582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-db4a7f62-a84d-4f61-91b9-35eb1571fb10 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 1.574960 Oct 06 12:58:49.683420 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1138/2242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:48 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:49.713972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:49.722745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:49.734883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:49.735554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:49.736156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:49.737013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:49.737724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:49.738316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:49.881199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:50.153274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:50.172169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fccf51f9-9fc7-4408-bc38-f301ac7f5a5d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.469837 Oct 06 12:58:50.172687 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1139/2243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:49 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:50.187714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9939237-2dc6-4099-bf94-a1851974517b", "name": "network-vif-plugged", "status": "completed", "tag": "1ac56104-37e1-498b-b1a3-432deb1b78b4"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:50.221159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.221645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.226928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.256858 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] Creating event network-vif-plugged:1ac56104-37e1-498b-b1a3-432deb1b78b4 for instance f9939237-2dc6-4099-bf94-a1851974517b on n-h1-860556-1 Oct 06 12:58:50.271234 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0ab70896-a6f9-41b2-b1a2-4a34de118fc0 req-622d2bd5-6cd2-4551-99e6-de870e61b8bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097073 Oct 06 12:58:50.272188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1140/2244] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:50.312466 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d065f67-29cf-4bb8-8893-23ae53482e62 tempest-ListImageFiltersTestJSON-1419650946 tempest-ListImageFiltersTestJSON-1419650946-project] 10.222.0.26 "DELETE /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2" status: 204 len: 0 microversion: 2.1 time: 0.718703 Oct 06 12:58:50.313054 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1105/2245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:49 2022] DELETE /compute/v2.1/images/476964f1-8399-422d-9f9a-02a9c0f0eaa2 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:58:50.459131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec62f355-a28a-489f-95aa-e39d9c98c23c", "name": "network-vif-deleted", "tag": "8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:50.480498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.489273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.489767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.529131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:50.531390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] Creating event network-vif-deleted:8dc5d0f3-dd39-4dce-bc2c-8a3ea2602e87 for instance ec62f355-a28a-489f-95aa-e39d9c98c23c on n-h2-860556-1 Oct 06 12:58:50.551693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-df46737c-c664-465d-9811-c6d1d911f935 req-1b8155d5-5904-4627-83bb-1d756bf65608 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278087 Oct 06 12:58:50.553479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1141/2246] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:50.614625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:50.615248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:50.635432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.638634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.639265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.640339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.641484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.642203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.709379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:50.710845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:50.736979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.738761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.739251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.740035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:50.740518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:50.746984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:50.854382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:50.883826 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee133189-f9a7-466f-800d-494bc39d8f8f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1599 microversion: 2.1 time: 0.274459 Oct 06 12:58:50.903868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1106/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:50 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1599 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:51.207110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:51.207956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:51.232361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:51.234715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:51.241497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:51.242623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:51.245916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:51.246607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:51.602955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:51.617149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed8e60ca-30c8-431d-aa44-075f393230ed tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1369 microversion: 2.1 time: 0.912558 Oct 06 12:58:51.618069 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1142/2248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:50 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1369 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:51.928373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:51.929446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:51.938187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:51.938694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:51.941321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:51.942240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:51.942720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:51.945332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:51.997883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:52.034233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:52.051785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea492500-405a-4b37-b421-409ef57a2bb9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.848184 Oct 06 12:58:52.062406 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1107/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:51 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:52.101995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:52.102546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:52.102988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:52.110643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lazy-loading 'fault' on Instance uuid ec62f355-a28a-489f-95aa-e39d9c98c23c {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:58:52.296568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:52.336002 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4dac5d14-656b-4960-b3bc-1f0c119921e6 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 200 len: 1323 microversion: 2.1 time: 0.405102 Oct 06 12:58:52.338898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1143/2250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:51 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:52.405563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38c5a7fa-127c-4349-b58a-0181f9c1b7c1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:52.417843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:52.457315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:58:52.462240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:52.464079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:52.466141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:52.467802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:52.469148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:52.471474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:52.659184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:52.670121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:52.712757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:52.713361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:52.713838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:52.716578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:52.717670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:52.718621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.155336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:53.171958 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6445ce4-2473-46b0-aeb5-758bb7e86491 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1555 microversion: 2.1 time: 0.527300 Oct 06 12:58:53.172547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1144/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:52 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1555 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:53.184515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:53.186421 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-caea1aa4-157c-495c-8c36-6d8d06e0d4de tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "POST /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785822 Oct 06 12:58:53.194591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:53.206734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1108/2252] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 12:58:52 2022] POST /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:53.217813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.220482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.223717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.226775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.227425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.228025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.243790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:53.249319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:53.264224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.264999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.266528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.275596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.278867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.280089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.636430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e534ef8-4cc2-452c-b7fe-a2b9b9ccf055 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.406692 Oct 06 12:58:53.637627 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1109/2253] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 12:58:53 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-interface => generated 284 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:53.642759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:53.643321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: ec62f355-a28a-489f-95aa-e39d9c98c23c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:53.655527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.658381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.659013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.660833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.663235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.664003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.712703 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] HTTP exception thrown: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Request method failure captured: Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c HTTP/1.1 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8jo9pXHM4Unm7m5PYVzRIDdN7E8Tm6ioLNvkex-XIWr1c-fnui4npqCsq7GrCao6489e1LlMfrPvpPbCm0hkAwCBZrp-k2h3cY-kzbGEZ0L5EQeWgs7EG_iZO2GO8c2WneY1Y7V7gJEJOwj_WP9IpvC-Pfb83nMXpCsYT97w7b2yE Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:58:53.716722 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be9f8d0d5cd4c95a81317a2fee17cf2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}] Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveMigrationTest-1221331169-project Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1f58173845e04996a0a5c2497e13d3cc Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveMigrationTest-1221331169-project Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. Oct 06 12:58:53.717974 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ec62f355-a28a-489f-95aa-e39d9c98c23c'} Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:58:53.718615 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. Oct 06 12:58:53.719634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:58:53.722723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Returning 404 to user: Instance ec62f355-a28a-489f-95aa-e39d9c98c23c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:58:53.722723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ceea0189-db84-4e01-9503-5a01299b161c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c" status: 404 len: 111 microversion: 2.1 time: 0.080600 Oct 06 12:58:53.732541 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1110/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:53 2022] GET /compute/v2.1/servers/ec62f355-a28a-489f-95aa-e39d9c98c23c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:58:53.749172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:53.761460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:53.784519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:53.795391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.798285 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-961ecdf3-6deb-4ab9-9d93-f9d0bff56a1e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.621340 Oct 06 12:58:53.799131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.803571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.809435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:53.818340 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1145/2255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:53 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:53.824393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2453dd98-4554-4b21-a370-4c41b0997a96 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '.version_select at 0x7f7d3eda2670>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:53.826334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:53.827423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:53.913380 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2453dd98-4554-4b21-a370-4c41b0997a96 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138794812" status: 202 len: 0 microversion: 2.1 time: 0.093043 Oct 06 12:58:53.914878 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1146/2256] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 12:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138794812 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:58:54.003283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:54.307567 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa87fdca-1936-4770-a83f-f86a5639cb1a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 204 len: 0 microversion: 2.25 time: 0.573141 Oct 06 12:58:54.308514 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1111/2257] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:58:53 2022] DELETE /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:58:54.317896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:54.318419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:54.330213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:54.330618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:54.334394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:54.342148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:54.343033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:54.343932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:54.786516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:54.819393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:54.820947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:54.822382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-236e73d5-500c-41ff-8226-b188fc787662 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1731 microversion: 2.25 time: 0.509743 Oct 06 12:58:54.836845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:54.837854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:54.840594 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1147/2258] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:54 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1731 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:54.850145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:54.850925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:54.860972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:54.862259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:54.863307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:54.863972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:55.687972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:55.697045 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0984cc69-a48d-4736-836a-003e4c8baff1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.867741 Oct 06 12:58:55.701795 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1112/2259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:54 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:58:55.850620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:55.851952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:55.865190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:55.872343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:55.872964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:55.873906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:55.874532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:55.875137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.289265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:56.290642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:56.303563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:56.324000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.325097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.325613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.327401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.327966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.330545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.342096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:56.351802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:56.354736 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77031142-2023-405a-9f70-981a88c20ba7 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1731 microversion: 2.25 time: 0.507972 Oct 06 12:58:56.356425 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1148/2260] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:55 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1731 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:56.413960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:58:56.620123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-baeea053-e436-437a-8ea2-039543779e40 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 204 len: 0 microversion: 2.1 time: 0.337136 Oct 06 12:58:56.625383 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1113/2261] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:58:56 2022] DELETE /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 12:58:56.632286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:56.639689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:56.659829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.660659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.661538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.662550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.663378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.664353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.841660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e28c2e-5721-485c-bafe-4201f690bb65", "name": "network-vif-plugged", "status": "completed", "tag": "065ef7cb-0459-4be7-b6de-976781d77974"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:56.869821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.870685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.872080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.901396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] Creating event network-vif-plugged:065ef7cb-0459-4be7-b6de-976781d77974 for instance e5e28c2e-5721-485c-bafe-4201f690bb65 on n-h2-860556-1 Oct 06 12:58:56.909818 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7faad845-a7b4-40c9-b741-8e4cf6f4e463 req-77db0cb2-5f45-4d62-a569-9c85f20af82d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.466746 Oct 06 12:58:56.910405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1149/2262] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:58:56.915593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:56.916302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:56.936504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.937757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.938443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:56.940281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:56.941096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:56.942745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:57.257773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:57.272888 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08ae1c1c-5998-4f1e-b556-fefe397bb577 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1484 microversion: 2.1 time: 0.645752 Oct 06 12:58:57.273957 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1114/2263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:56 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1484 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:57.392957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9939237-2dc6-4099-bf94-a1851974517b", "tag": "1ac56104-37e1-498b-b1a3-432deb1b78b4"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:57.404353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:57.409369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:57.414421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:57.415112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:57.418037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-470948ff-33cb-4e59-8eb7-878609cfebf7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 0.504119 Oct 06 12:58:57.419824 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1150/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:56 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:58:57.430829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:57.432975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:57.448080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:57.448264 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] Creating event network-changed:1ac56104-37e1-498b-b1a3-432deb1b78b4 for instance f9939237-2dc6-4099-bf94-a1851974517b on n-h1-860556-1 Oct 06 12:58:57.448989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:57.452199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:57.453141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:57.453817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:57.455111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:57.467591 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f6a537f6-3a7b-4768-96aa-40b24ad78530 req-cf691ebf-7a12-4d56-9583-5858dd6e5a41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192153 Oct 06 12:58:57.468399 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1115/2265] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:57.648593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:57.658005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:57.667517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:58:57.669701 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-187f7166-3274-4b33-aa9a-d570c36d9f7e tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 200 len: 1664 microversion: 2.25 time: 0.248759 Oct 06 12:58:57.675973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1151/2266] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:58:57 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 1664 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:58:58.133902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38ecd4-393f-4ae8-97a7-3f71379fa3bf", "name": "network-vif-deleted", "tag": "4aa239a8-3c36-4913-8716-29819da1aa84"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:58:58.158796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:58.159241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:58.159704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:58.195165 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] Creating event network-vif-deleted:4aa239a8-3c36-4913-8716-29819da1aa84 for instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf on n-h1-860556-1 Oct 06 12:58:58.207213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-994db755-e181-4c77-b811-61bc4a369cec req-847e3126-636b-40fd-b4bb-af44460905a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078634 Oct 06 12:58:58.212238 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1116/2267] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:58:58.302816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:58.303889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:58.331843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:58.334566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:58.335562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:58.338285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:58.339009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:58.344062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:58.447491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:58:58.450309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:58:58.464217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:58.466452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:58.467139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:58:58.468120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:58:58.468831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:58:58.469799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:00.130239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:00.160024 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1e63451-0d84-4a27-995e-9f9dcabcb9d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1316 microversion: 2.1 time: 1.721615 Oct 06 12:59:00.169831 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1117/2268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:58 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1316 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:00.177003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:00.190132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:00.202748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:00.213305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:00.214698 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42a7d03a-122a-4e1e-8225-7e4bcc8204b3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 200 len: 1484 microversion: 2.1 time: 1.917851 Oct 06 12:59:00.215915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:00.217257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:00.217676 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1152/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:58:58 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 1484 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:00.220395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:00.225400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:00.234595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:00.243822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7633a7-c49a-4734-9ea8-1644557f8f6d", "name": "network-vif-deleted", "tag": "a2f55cdb-4b8b-4548-b0c6-f91447ebcd68"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:00.275035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:00.275757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:00.278396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:00.281090 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] HTTP exception thrown: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Request method failure captured: Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf HTTP/1.1 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8HNlhOHrtYgnoclHajYESm_b8_NTc-0O-yI8R9coyC4s5pFoKVX4_F2p4jYbjxHXIaTG_5P0OkDhzHoMM4l-zLlQHCnMaFteTOlEUgyLIDMKuijV5k8_6lkGATXiVd9XyQdZVWFf13UK4Fjt3PBbVahhcpm-Qc-YlG2sYLPt11M8g Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.25 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:00.283731 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b283101c4674072a49a14df6acb56bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}] Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 17892d653b7d461e803f5423cf7191af Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. Oct 06 12:59:00.285016 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4c38ecd4-393f-4ae8-97a7-3f71379fa3bf'} Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:00.285653 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. Oct 06 12:59:00.286813 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:00.288989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Returning 404 to user: Instance 4c38ecd4-393f-4ae8-97a7-3f71379fa3bf could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:00.288989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-72163053-ac8a-4598-bc5d-0776a5312fd1 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf" status: 404 len: 111 microversion: 2.25 time: 0.114881 Oct 06 12:59:00.294453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1118/2270] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:00 2022] GET /compute/v2.1/servers/4c38ecd4-393f-4ae8-97a7-3f71379fa3bf => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:00.305306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] Creating event network-vif-deleted:a2f55cdb-4b8b-4548-b0c6-f91447ebcd68 for instance cb7633a7-c49a-4734-9ea8-1644557f8f6d on n-h2-860556-1 Oct 06 12:59:00.306966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3c87f89-dd8a-4bd5-9f60-3bc92a7ae1a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '.version_select at 0x7f7d3f04cc10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:00.311775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-97928424-bdce-436c-8468-ac093b55276d req-34d0c2bc-ca20-4fa2-ae2d-57f5a0981d13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092175 Oct 06 12:59:00.313233 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1153/2271] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:00.340828 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c3c87f89-dd8a-4bd5-9f60-3bc92a7ae1a9 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741199981" status: 204 len: 0 microversion: 2.25 time: 0.044687 Oct 06 12:59:00.346035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1119/2272] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 12:59:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741199981 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:59:01.194438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.197812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.215786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.220772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.222335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.223372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.224883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.230810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.245709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.248495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: cb7633a7-c49a-4734-9ea8-1644557f8f6d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.280215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.281934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.290294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.291104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.291577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.292022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.334870 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] HTTP exception thrown: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Request method failure captured: Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d HTTP/1.1 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs8jo9pXHM4Unm7m5PYVzRIDdN7E8Tm6ioLNvkex-XIWr1c-fnui4npqCsq7GrCao6489e1LlMfrPvpPbCm0hkAwCBZrp-k2h3cY-kzbGEZ0L5EQeWgs7EG_iZO2GO8c2WneY1Y7V7gJEJOwj_WP9IpvC-Pfb83nMXpCsYT97w7b2yE Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:01.341939 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be9f8d0d5cd4c95a81317a2fee17cf2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}] Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-LiveMigrationTest-1221331169-project Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1f58173845e04996a0a5c2497e13d3cc Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-LiveMigrationTest-1221331169-project Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. Oct 06 12:59:01.343155 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'cb7633a7-c49a-4734-9ea8-1644557f8f6d'} Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:01.343797 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. Oct 06 12:59:01.345234 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:01.348980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Returning 404 to user: Instance cb7633a7-c49a-4734-9ea8-1644557f8f6d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:01.350799 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b32cc5a-ee93-4cb3-bd36-10ed8b31f079 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d" status: 404 len: 111 microversion: 2.1 time: 0.110919 Oct 06 12:59:01.355089 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1120/2273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:01 2022] GET /compute/v2.1/servers/cb7633a7-c49a-4734-9ea8-1644557f8f6d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:59:01.373377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.374487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.389655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.390796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.391499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.393000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.393719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.394650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.451993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:59:01.590372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:01.609921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-849c447b-3ccd-4cf2-80a3-7ef585ba185f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1506 microversion: 2.1 time: 0.418927 Oct 06 12:59:01.615401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1154/2274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:01 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:01.625993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.629560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.643847 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a719511c-73da-4081-8d19-24af84bc6d15 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 204 len: 0 microversion: 2.25 time: 0.279096 Oct 06 12:59:01.644863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1121/2275] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:59:01 2022] DELETE /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:59:01.653245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.653715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.654193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.657031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.657552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.658020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.660841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.663125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.680321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.681169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.681833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.682851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.685949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.686605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.723164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:59:01.743062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:59:01.757687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:01.877040 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2348d336-3d21-49c5-ade1-7039fceeace0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 204 len: 0 microversion: 2.1 time: 0.228403 Oct 06 12:59:01.880900 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1122/2276] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:59:01 2022] DELETE /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:59:01.886035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.886987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.896951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.897509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.898079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.899588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.899588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.899961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.924087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a8ae0b6-38a9-4203-a551-e1b8af25514f tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 204 len: 0 microversion: 2.1 time: 0.307058 Oct 06 12:59:01.925615 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1155/2277] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:59:01 2022] DELETE /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 12:59:01.941317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:01.942327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:01.962311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.962826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.963284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:01.967989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:01.969880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:01.970490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:02.268967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:02.283617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:02.292924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:02.298114 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-34ed888f-92f1-41e3-b563-254e77999529 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1549 microversion: 2.25 time: 0.417815 Oct 06 12:59:02.303134 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1123/2278] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:01 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1549 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:02.329001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:02.342481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:02.358368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:02.362792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:02.363555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:02.365766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:02.372602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:02.373068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:02.895223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:02.912521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9528e33e-2e69-47c1-9043-b9f0a27ca0a0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1512 microversion: 2.1 time: 0.984360 Oct 06 12:59:02.915613 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1156/2279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:01 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1512 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:03.226732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:03.260726 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2cee617-d2d5-40b8-9ca7-88911f58673b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1499 microversion: 2.1 time: 0.955927 Oct 06 12:59:03.264295 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1124/2280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:02 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1499 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:03.337929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:03.339643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:03.357283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:03.358495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:03.361438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:03.364819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:03.366141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:03.370604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:03.900592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:03.916930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:03.919081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:03.920384 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e5d53582-2c10-4962-818b-7b31d2b1b92c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1549 microversion: 2.25 time: 0.587593 Oct 06 12:59:03.934198 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1157/2281] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:03 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1549 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:03.938670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45994c2d-4076-494a-b0c1-1814a8c350cc", "name": "network-vif-deleted", "tag": "c16d7655-1745-479a-90a8-c4a6bf167cdb"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:03.942414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:03.943039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:03.963235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:03.965514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:03.974587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:03.975061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:03.975909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:03.976322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:03.976762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:03.976995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:03.977654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:04.001494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] Creating event network-vif-deleted:c16d7655-1745-479a-90a8-c4a6bf167cdb for instance 45994c2d-4076-494a-b0c1-1814a8c350cc on n-h1-860556-1 Oct 06 12:59:04.038854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e292f9d9-7167-4986-97e7-6df76ff41027 req-397f5d4e-2ed3-4272-bfa9-59231e259d88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104536 Oct 06 12:59:04.044116 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1125/2282] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:04.294028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:04.294802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:04.322809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:04.323821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:04.324326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:04.325074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:04.325542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:04.326003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:04.578446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:04.590373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:04.592150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b85b707a-825a-44db-98d7-11a7bd93f0e3 tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1457 microversion: 2.1 time: 0.303649 Oct 06 12:59:04.599735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:04.604537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5901e6ce-ee99-4629-9ac6-a02ec83a28f3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1512 microversion: 2.1 time: 0.665859 Oct 06 12:59:04.608720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1126/2283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:04 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1457 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:04.614306 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1158/2284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:03 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1512 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:04.950329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:04.951755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:04.971424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:04.972584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:04.973059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:04.973865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:04.974338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:04.974776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.021361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.030558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.032027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.033106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lazy-loading 'fault' on Instance uuid 45994c2d-4076-494a-b0c1-1814a8c350cc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:59:05.116664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:05.171410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:05.175580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:05.184552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5070128f-1f92-4aa9-a156-54f0bc92cbe5 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 200 len: 1352 microversion: 2.25 time: 0.236019 Oct 06 12:59:05.186822 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1127/2285] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:04 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 1352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:05.616685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:05.617430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:05.633879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.633879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.634381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.635442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.636307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.638108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.649705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:05.650936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:05.674377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.675848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.676498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.677585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.678249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.697170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.746729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:05.747507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:05.748177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:05.749466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lazy-loading 'fault' on Instance uuid 2c5c384d-8090-45ae-944b-d84bbb84359a {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:59:05.952230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f58173845e04996a0a5c2497e13d3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9f8d0d5cd4c95a81317a2fee17cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:05.984495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8fcf74ab-d597-4012-9ef0-205542f8ae8c tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 200 len: 1301 microversion: 2.1 time: 0.367244 Oct 06 12:59:06.013534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1159/2286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:05 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 1301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:06.020937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e28c2e-5721-485c-bafe-4201f690bb65", "name": "network-vif-deleted", "tag": "065ef7cb-0459-4be7-b6de-976781d77974"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:06.036222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.038291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.039028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.061565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] Creating event network-vif-deleted:065ef7cb-0459-4be7-b6de-976781d77974 for instance e5e28c2e-5721-485c-bafe-4201f690bb65 on n-h2-860556-1 Oct 06 12:59:06.069935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-35a8c845-95c0-4417-b022-bdf55d0642cf req-b6319f3e-0ca0-48e8-a14c-90e9de43f9ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054415 Oct 06 12:59:06.071094 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1160/2287] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:06.098195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c384d-8090-45ae-944b-d84bbb84359a", "name": "network-vif-deleted", "tag": "faa79828-2c68-4f74-9734-527649c3bb24"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:06.118215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.120052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.121625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.144848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] Creating event network-vif-deleted:faa79828-2c68-4f74-9734-527649c3bb24 for instance 2c5c384d-8090-45ae-944b-d84bbb84359a on n-h1-860556-1 Oct 06 12:59:06.154830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c6bf047d-75d3-4551-b07d-67c7f6c224bc req-f90cb145-3127-427d-8ac8-11e73c713fdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073604 Oct 06 12:59:06.157356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1161/2288] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:06.195898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:06.208858 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67515b87-22c8-48d0-a076-2c264545d1ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 200 len: 1470 microversion: 2.1 time: 0.573005 Oct 06 12:59:06.217855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:06.218574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: 45994c2d-4076-494a-b0c1-1814a8c350cc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:06.222708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1128/2289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:05 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 1470 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:06.228764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.229543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.230200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.232179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.232880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.233625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.276293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] HTTP exception thrown: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Request method failure captured: Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc HTTP/1.1 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8HNlhOHrtYgnoclHajYESm_b8_NTc-0O-yI8R9coyC4s5pFoKVX4_F2p4jYbjxHXIaTG_5P0OkDhzHoMM4l-zLlQHCnMaFteTOlEUgyLIDMKuijV5k8_6lkGATXiVd9XyQdZVWFf13UK4Fjt3PBbVahhcpm-Qc-YlG2sYLPt11M8g Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.25 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:06.278959 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b283101c4674072a49a14df6acb56bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}] Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 17892d653b7d461e803f5423cf7191af Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. Oct 06 12:59:06.280325 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '45994c2d-4076-494a-b0c1-1814a8c350cc'} Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:06.281228 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. Oct 06 12:59:06.282598 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:06.286314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Returning 404 to user: Instance 45994c2d-4076-494a-b0c1-1814a8c350cc could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:06.287415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-540e2658-9a9f-4e0a-8e81-fe0f7a958b33 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc" status: 404 len: 111 microversion: 2.25 time: 0.076479 Oct 06 12:59:06.288540 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1162/2290] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:06 2022] GET /compute/v2.1/servers/45994c2d-4076-494a-b0c1-1814a8c350cc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:06.299031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:06.299829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:06.308185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.310067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.310759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.311765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.312414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.313804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.399789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:59:06.518687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fddccdc7-cb91-4285-9207-d57ef2cb66dd tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 204 len: 0 microversion: 2.25 time: 0.225083 Oct 06 12:59:06.521137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1129/2291] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:59:06 2022] DELETE /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:59:06.530805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:06.531426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:06.545329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.565480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.566141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.576196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:06.577014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:06.577647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:06.658889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d926931-1358-4ac2-8062-65fedfd12939 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f352280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1379070977", "description": "tempest-description-1768504341"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:06.981396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:07.003161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:07.007462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:07.015489 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-698be171-33fc-41ef-870d-81d55aea2dfa tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1562 microversion: 2.25 time: 0.487826 Oct 06 12:59:07.015681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1163/2292] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:06 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1562 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:07.029570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:07.031406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] [instance: 2c5c384d-8090-45ae-944b-d84bbb84359a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:07.053356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.054044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.054703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.055592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.056639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.057335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.088653 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] HTTP exception thrown: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Request method failure captured: Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a HTTP/1.1 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8jo9pXHM4Unm7m5PYVzRIDdN7E8Tm6ioLNvkex-XIWr1c-fnui4npqCsq7GrCao6489e1LlMfrPvpPbCm0hkAwCBZrp-k2h3cY-kzbGEZ0L5EQeWgs7EG_iZO2GO8c2WneY1Y7V7gJEJOwj_WP9IpvC-Pfb83nMXpCsYT97w7b2yE Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:07.094049 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be9f8d0d5cd4c95a81317a2fee17cf2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be9f8d0d5cd4c95a81317a2fee17cf2"}]}] Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 1be9f8d0d5cd4c95a81317a2fee17cf2 Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveMigrationTest-1221331169 Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveMigrationTest-1221331169-project Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1f58173845e04996a0a5c2497e13d3cc Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveMigrationTest-1221331169-project Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. Oct 06 12:59:07.095503 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2c5c384d-8090-45ae-944b-d84bbb84359a'} Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:07.096354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. Oct 06 12:59:07.097465 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.099054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] Returning 404 to user: Instance 2c5c384d-8090-45ae-944b-d84bbb84359a could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:07.099054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5908591b-6a67-49da-9c36-f5c538b6aa7b tempest-LiveMigrationTest-1221331169 tempest-LiveMigrationTest-1221331169-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a" status: 404 len: 111 microversion: 2.1 time: 0.082016 Oct 06 12:59:07.100409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1164/2293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:07 2022] GET /compute/v2.1/servers/2c5c384d-8090-45ae-944b-d84bbb84359a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:07.260736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:07.261381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:07.268205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.268710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.269348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.270327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.270974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.271573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.300973 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 HTTP/1.1 Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:07.302680 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 12:59:07.304239 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e5e28c2e-5721-485c-bafe-4201f690bb65'} Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:07.305082 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 12:59:07.307013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.309701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:07.309701 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd206439-4f3b-42fd-8066-79dfedb8ebff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 404 len: 111 microversion: 2.1 time: 0.047354 Oct 06 12:59:07.309701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1165/2294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:07 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 12:59:07.314228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:07.314858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:07.323743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.324280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.324726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.325438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.325945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.327033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.472874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d926931-1358-4ac2-8062-65fedfd12939 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.925691 Oct 06 12:59:07.473481 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1130/2295] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:59:07.487462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b2a4bae-8255-4041-8746-6300a8cb7540 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f1e21f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-435027163", "description": "tempest-description-1706191360"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:07.733344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:07.745378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f64cd74-f54f-449c-88df-8495d1b1060a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.434745 Oct 06 12:59:07.747525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1166/2296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:07 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:07.921876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-027a8527-cd2c-4f5f-985a-5fbb1eaf8dc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-027a8527-cd2c-4f5f-985a-5fbb1eaf8dc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 163 Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:07.936889 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": 12345, "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:07.939143 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 12345 Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.940439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:07.944074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:07.948242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:07.948242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 06 12:59:07.948242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:07.948242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-027a8527-cd2c-4f5f-985a-5fbb1eaf8dc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:07.948242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-027a8527-cd2c-4f5f-985a-5fbb1eaf8dc6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.030358 Oct 06 12:59:07.954389 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1167/2297] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:07 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:07.957333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:07.958504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:07.968406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.968905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.969350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:07.970371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:07.971243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:07.971786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:08.395512 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b2a4bae-8255-4041-8746-6300a8cb7540 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.911995 Oct 06 12:59:08.411203 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1131/2298] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:59:08.416982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:08.418513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:08.436792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:08.438023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:08.438636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:08.439531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:08.440149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:08.440768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:08.487230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:08.495799 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-485753c1-a6f1-466d-b93b-c9c8e874de85 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.544037 Oct 06 12:59:08.496409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1168/2299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:07 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:08.515601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1966710717", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "8fce8b2d-3fef-4315-8543-c4cc45bb0b30"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:08.602422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] validate_networks() for [('8fce8b2d-3fef-4315-8543-c4cc45bb0b30', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:08.618138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:08.638698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:08.640151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:08.641343 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8280de3-758a-43e5-b619-b2be5c67e93a tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1520 microversion: 2.25 time: 0.228967 Oct 06 12:59:08.641948 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1132/2300] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:08 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:08.656782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:08.663084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:08.675227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:08.677460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:08.682582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:08.684140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:08.690154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:08.690798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:09.569533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:09.584909 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f712d4e-2a98-43ee-88ff-1a20faf202ed tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.931864 Oct 06 12:59:09.585593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1133/2301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:08 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:09.597821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d5be5b-600f-4746-9309-4fecd91121bd", "name": "network-vif-deleted", "tag": "55c1f1a9-f64c-414b-a61e-6249231b7c35"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:09.633229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:09.633842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:09.634209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:09.652777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] Creating event network-vif-deleted:55c1f1a9-f64c-414b-a61e-6249231b7c35 for instance b2d5be5b-600f-4746-9309-4fecd91121bd on n-h1-860556-1 Oct 06 12:59:09.673943 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-59201f86-de8c-420d-a5e6-e8558c109b0c req-e0998ab2-a59b-4e45-b041-0357e27c87cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086830 Oct 06 12:59:09.679610 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1134/2302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:09.698996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:09.700855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:09.715286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:09.715789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:09.719426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:09.722093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:09.722624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:09.723098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:09.802417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:09.802917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:09.803375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:09.803842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lazy-loading 'fault' on Instance uuid b2d5be5b-600f-4746-9309-4fecd91121bd {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:59:09.981549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:09.995335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:10.003859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17892d653b7d461e803f5423cf7191af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b283101c4674072a49a14df6acb56bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:10.005280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-365b48e7-75d0-4a37-b73c-5d0990e44226 tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 200 len: 1351 microversion: 2.25 time: 0.324280 Oct 06 12:59:10.006464 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1135/2303] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:09 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 1351 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:10.357720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:10.358266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:10.382049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.382270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.382580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.383336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.383806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.384243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.447755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 12:59:10.493508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:10.494065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:10.494657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:10.495223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:10.495786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:10.516742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.520243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.521375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.537574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.540909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.554987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.601934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:10.614768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Getting quotas for project b3e65666907a4c2db886bfe58fdd71c1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:10.629098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Getting quotas for user 7e2c67f80b24481b9b7e1b2ecc6f481c and project b3e65666907a4c2db886bfe58fdd71c1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:10.657070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:10.663604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:10.734920 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1caf58e7-77a0-4c89-8021-ac93d2d02f21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 204 len: 0 microversion: 2.32 time: 0.726486 Oct 06 12:59:10.736270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1136/2304] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 12:59:10 2022] DELETE /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 12:59:10.749713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:10.750939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:10.798857 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd9cf527-6bbc-426e-9fc4-d8112ef72773 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290664 Oct 06 12:59:10.800227 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1169/2305] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:59:10.821398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.822551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.823018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.832553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:10.833155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c3dd311-18d8-49f4-8f6e-150b828d5b25 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:10.833344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:10.839231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:10.841926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c3dd311-18d8-49f4-8f6e-150b828d5b25 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:10.911557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:11.016632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c3dd311-18d8-49f4-8f6e-150b828d5b25 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:11.040716 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c3dd311-18d8-49f4-8f6e-150b828d5b25 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1216 microversion: 2.1 time: 0.232833 Oct 06 12:59:11.048452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1170/2306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:10 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1216 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:11.066365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:11.066995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] [instance: b2d5be5b-600f-4746-9309-4fecd91121bd] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:11.087870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:11.088923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:11.089597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:11.099683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:11.099683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:11.099683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:11.141638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] HTTP exception thrown: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Request method failure captured: Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd HTTP/1.1 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs8HNlhOHrtYgnoclHajYESm_b8_NTc-0O-yI8R9coyC4s5pFoKVX4_F2p4jYbjxHXIaTG_5P0OkDhzHoMM4l-zLlQHCnMaFteTOlEUgyLIDMKuijV5k8_6lkGATXiVd9XyQdZVWFf13UK4Fjt3PBbVahhcpm-Qc-YlG2sYLPt11M8g Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.25 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:11.143265 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b283101c4674072a49a14df6acb56bb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b283101c4674072a49a14df6acb56bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b283101c4674072a49a14df6acb56bb"}]}] Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3b283101c4674072a49a14df6acb56bb Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032 Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 17892d653b7d461e803f5423cf7191af Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1322758032-project Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. Oct 06 12:59:11.144734 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b2d5be5b-600f-4746-9309-4fecd91121bd'} Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:11.145509 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. Oct 06 12:59:11.146928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:11.148491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] Returning 404 to user: Instance b2d5be5b-600f-4746-9309-4fecd91121bd could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:11.154207 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e813478e-f20a-4603-a46e-27441e68226c tempest-LiveAutoBlockMigrationV225Test-1322758032 tempest-LiveAutoBlockMigrationV225Test-1322758032-project] 10.222.0.26 "GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd" status: 404 len: 111 microversion: 2.25 time: 0.094952 Oct 06 12:59:11.155381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1171/2307] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:11 2022] GET /compute/v2.1/servers/b2d5be5b-600f-4746-9309-4fecd91121bd => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:11.492671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:11.530874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:11.536616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:11.540489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c17684c-4a55-4d6a-a75a-cd81955e7105 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2949 microversion: 2.32 time: 0.799387 Oct 06 12:59:11.541955 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1137/2308] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:10 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2949 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:11.952595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cfaa7f7b-52ac-4564-95f8-0fb170c90063"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:11.955391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:11.971579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:11.987510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:11.988019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:11.988787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:11.989257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:11.989849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:12.072151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab4d9ebf-7d01-4c19-9157-76bf2f7f1aa9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:12.072823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab4d9ebf-7d01-4c19-9157-76bf2f7f1aa9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:12.098151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=6,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:12.215919 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] HTTP exception thrown: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Request method failure captured: Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments/38c5a7fa-127c-4349-b58a-0181f9c1b7c1 HTTP/1.1 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 74 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtCfYjitHU3dobPb23axECVyL-xLGhbLlzMPnrTVIfDpDo4fI6NCUQ3T_Ic9n7rCseBk5sveMbreGif6gixhUIIev7Ln4CQD6ve-JQbpGj5Mg0eFlcIP-Nko_z4QvsdpZ0StHmB9HWG2MTczUJkjGzT7rdSgZoC03A4JRaVORqDq_9I Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f0e9319713f0429982ed3ee77a05bf45 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 12:59:12.256268 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0e9319713f0429982ed3ee77a05bf45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e9319713f0429982ed3ee77a05bf45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0e9319713f0429982ed3ee77a05bf45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e9319713f0429982ed3ee77a05bf45"}]}] Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f0e9319713f0429982ed3ee77a05bf45 Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesAdminNegativeTest-1166568662-project-admin Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6db41147b4ee4fce91f2b37430118596 Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesAdminNegativeTest-1166568662-project-admin Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: {"volumeAttachment": {"volumeId": "cfaa7f7b-52ac-4564-95f8-0fb170c90063"}} Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:12.257799 n-d-860556-1 devstack@n-api.service[129615]: exception: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'bade59a5-d480-4187-87bb-4d4eb29e1741', 'id': '38c5a7fa-127c-4349-b58a-0181f9c1b7c1', 'body': {'volumeAttachment': {'volumeId': 'cfaa7f7b-52ac-4564-95f8-0fb170c90063'}}} Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:59:12.258741 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. (HTTP 404) (Request-ID: req-8985f444-cb82-4f7f-b9ba-6d1f26d88834) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:59:12.260300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:12.261641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. Oct 06 12:59:12.263398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:12.264594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Returning 400 to user: Volume cfaa7f7b-52ac-4564-95f8-0fb170c90063 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:12.264594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f574c74-9a5e-4e88-b4f1-03b05f6d9f80 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments/38c5a7fa-127c-4349-b58a-0181f9c1b7c1" status: 400 len: 107 microversion: 2.1 time: 0.651660 Oct 06 12:59:12.268139 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1172/2309] 10.222.0.26 () {60 vars in 1433 bytes} [Thu Oct 6 12:59:11 2022] PUT /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments/38c5a7fa-127c-4349-b58a-0181f9c1b7c1 => generated 107 bytes in 662 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:12.313842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab4d9ebf-7d01-4c19-9157-76bf2f7f1aa9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:12.324916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab4d9ebf-7d01-4c19-9157-76bf2f7f1aa9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1216 microversion: 2.1 time: 0.256899 Oct 06 12:59:12.344061 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1138/2310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:12 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1216 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:12.445467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:12.446586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:12.465514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:12.466070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:12.466713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:12.467649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:12.468272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:12.468879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:12.571035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:12.572582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:12.619392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:12.619392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:12.619392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:12.619392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:12.619850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:12.619850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:12.854097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lazy-loading 'services' on Instance uuid bade59a5-d480-4187-87bb-4d4eb29e1741 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 12:59:13.055904 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d5cfebd-d3ba-4009-a3b8-6a0ea4b19c77 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments/38c5a7fa-127c-4349-b58a-0181f9c1b7c1" status: 202 len: 0 microversion: 2.1 time: 0.635474 Oct 06 12:59:13.060666 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1173/2311] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 12:59:12 2022] DELETE /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments/38c5a7fa-127c-4349-b58a-0181f9c1b7c1 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:13.067988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae3e54e8-0b61-4927-ab70-5925e70c4cfd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1490702136", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f6930cd9-90da-4e30-a34c-7a801a666da0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:13.213589 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ae3e54e8-0b61-4927-ab70-5925e70c4cfd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae3e54e8-0b61-4927-ab70-5925e70c4cfd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 358 Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:13.218964 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:13.220430 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1490702136", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f6930cd9-90da-4e30-a34c-7a801a666da0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: exception: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1490702136', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f6930cd9-90da-4e30-a34c-7a801a666da0'}], 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 06 12:59:13.221088 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 06 12:59:13.222090 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae3e54e8-0b61-4927-ab70-5925e70c4cfd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Block Device f6930cd9-90da-4e30-a34c-7a801a666da0 is not bootable. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae3e54e8-0b61-4927-ab70-5925e70c4cfd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.163832 Oct 06 12:59:13.223808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1174/2312] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:13.228853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:13.243441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:13.256400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.257214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.257908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.258705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.259263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.259894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.298967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b78fd7a-4f04-4b59-931a-69bff3f85868 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074564 Oct 06 12:59:13.300640 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1175/2313] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:13 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:13.307549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:13.308306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:13.315020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.315600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.316166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.317113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.317696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.318271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.377659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:13.392456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:13.396047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:13.398359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da4e47be-b384-4908-a3dd-d0e364a13f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2949 microversion: 2.32 time: 0.832377 Oct 06 12:59:13.399442 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1139/2314] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:12 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2949 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:13.414844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:13.415726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:13.429044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.429553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.430022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.430748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.431207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.431641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.553867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:13.565756 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc2cdef2-49f2-4604-bd82-40b595b952d2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1268 microversion: 2.1 time: 0.165044 Oct 06 12:59:13.567196 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1140/2315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:13 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:13.665535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:13.678279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95a8221d-9d49-4837-8520-f3b791e07619 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.376412 Oct 06 12:59:13.679262 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1176/2316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:13 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:13.707591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:13.708488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:13.724198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.724715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.725169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:13.725946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:13.726416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:13.726861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.222862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:14.259456 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fc140bb-7705-4485-8d71-4a7bb76e3717 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.555591 Oct 06 12:59:14.260147 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1141/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:13 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:14.312693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:14.315054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:14.332302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.332798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.333242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.333980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.334808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.335394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.401650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7cb50608-3a2a-4f67-be06-3e3be5d08642 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092743 Oct 06 12:59:14.402349 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1177/2318] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:14 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:14.430693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:14.431892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:14.450133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.450665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.451130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.451891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.452364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.452806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.591331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:14.591959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:14.610049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.610552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.610997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.611724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:14.612186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:14.628709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:14.922685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:14.937253 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-abd0af95-c557-4e8d-8c22-94812ac56afe tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1274 microversion: 2.1 time: 0.350275 Oct 06 12:59:14.937877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1178/2319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:14 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1274 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:15.415058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:15.418366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:15.430785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:15.431291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:15.431740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:15.432512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:15.432987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:15.433448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:15.515984 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4016a663-65fa-4ca2-b536-fd3dd0b116db tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104935 Oct 06 12:59:15.517329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1179/2320] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:15 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:59:15.962490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:15.963583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:15.975626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:15.978668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:15.979463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:15.980433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:15.982967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:15.983766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:16.520233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:16.534860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:16.536607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:16.538706 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a4b624e-b97c-4db4-9fbf-cd92ae7a1f04 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2949 microversion: 2.32 time: 2.112077 Oct 06 12:59:16.542169 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1142/2321] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:14 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2949 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:16.550651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:16.552975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:16.575879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:16.576315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:16.577203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:16.580793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:16.581304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:16.587410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:16.678095 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbfa8112-e610-452b-920f-b497b9eb96a4 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133934 Oct 06 12:59:16.678691 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1143/2322] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:16 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:17.385383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:17.395657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99fa50dd-8f37-4690-b816-017d4a3a81be tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 1.437904 Oct 06 12:59:17.396260 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1180/2323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:15 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:17.447457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4da591e0-c921-4efe-9520-e3994dfafb79 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2121515258", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9c012702-c0af-44bb-9be6-c3831386ffe2", "destination_type": "local"}, {"source_type": "volume", "uuid": "8d2b5855-8ca1-424e-89c7-5a8859b4bea9", "destination_type": "invalid"}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4da591e0-c921-4efe-9520-e3994dfafb79 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 495 Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:17.454639 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:17.456171 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2121515258", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9c012702-c0af-44bb-9be6-c3831386ffe2", "destination_type": "local"}, {"source_type": "volume", "uuid": "8d2b5855-8ca1-424e-89c7-5a8859b4bea9", "destination_type": "invalid"}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2121515258', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8d2b5855-8ca1-424e-89c7-5a8859b4bea9', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 06 12:59:17.456831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'invalid' Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:17.457665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 06 12:59:17.459431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:17.462042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4da591e0-c921-4efe-9520-e3994dfafb79 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:17.463248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4da591e0-c921-4efe-9520-e3994dfafb79 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019703 Oct 06 12:59:17.464119 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1144/2324] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:17 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:17.473160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:17.474556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:17.482930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:17.483857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:17.484606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:17.486205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:17.486951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:17.487542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:17.575573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:17.577035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:17.591674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:17.592419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:17.593134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:17.594057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:17.594725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:17.595312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.614672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:18.626623 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21e94a5b-6a98-4396-a6dc-e2975240dcc5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 1.157145 Oct 06 12:59:18.642872 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1181/2325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:17 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:18.661706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:18.670486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:18.695366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.698193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.699509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.700510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.703789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.704492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.748262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:18.786508 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1e2cf37-05b2-4adc-b80c-29474fe218a2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142083 Oct 06 12:59:18.794063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1182/2326] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:18 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:18.802997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:18.805130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:18.823936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.825410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.826088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.827234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.827903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.828095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:18.829257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.848687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:18.851248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:18.852888 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4b29d6e-04c6-4150-a7e6-df2482fe5713 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2949 microversion: 2.32 time: 1.283715 Oct 06 12:59:18.857764 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1145/2327] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:17 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2949 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:18.874683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:18.875667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:18.908112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.908918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.909605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:18.916543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:18.918033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:18.919436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.614693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:19.628639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9682b96a-0b4b-4ccd-a3ee-0280ac6fbc2e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 0.832965 Oct 06 12:59:19.629294 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1183/2328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:18 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:19.644269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "67d910f1-0ac2-4e36-a881-ca9fdb8b28f8"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:19.680314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:19.686212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.686938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.687532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.694345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba539ccd-9afc-449e-86e5-548235c62b97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.834941 Oct 06 12:59:19.695961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1146/2329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:18 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:19.704188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc66a497-dbfe-4e82-aadc-0d6beaa6c74c", "tag": "a0cec150-2588-4936-b6f3-abd0ea36573c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:19.722130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.725561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.727778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.744178 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] Creating event network-changed:a0cec150-2588-4936-b6f3-abd0ea36573c for instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c on n-h2-860556-1 Oct 06 12:59:19.745445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] Creating event network-vif-unplugged:67d910f1-0ac2-4e36-a881-ca9fdb8b28f8 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:19.751741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0370b1c6-87d7-49c9-a1ed-bca18a818322 req-50455cfa-67d4-4d54-adab-20a213261c2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053839 Oct 06 12:59:19.757224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1147/2330] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:19.772522 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c5db56cc-b89e-4da8-8016-7bb21f339941 req-323a39c8-c0c1-4f34-bca6-d23a2f015976 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139120 Oct 06 12:59:19.773397 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1184/2331] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:19.800673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64f8cde8-6402-49a8-b0f4-ae928683439a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166493904", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:19.801630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:19.804081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64f8cde8-6402-49a8-b0f4-ae928683439a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 491 Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:19.806322 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:19.807762 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166493904", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-166493904', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:19.808601 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:19.809103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:19.810263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 06 12:59:19.811273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:19.811747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64f8cde8-6402-49a8-b0f4-ae928683439a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:19.811747 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64f8cde8-6402-49a8-b0f4-ae928683439a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014080 Oct 06 12:59:19.818694 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1148/2332] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:19 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:19.819097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.819763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.820355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.821222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.821857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.822735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.827460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:19.828187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:19.840597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.841110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.841540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.846819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.847316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.847758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.869328 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f92cba35-1043-40de-808a-3a4da1d97cc9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072305 Oct 06 12:59:19.870625 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1185/2333] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:19 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:19.890637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:19.891556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:19.907956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.910816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.911486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:19.913227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:19.916981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:19.918507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:20.565793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:20.678196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:20.688949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:20.698098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b33fa3e9-4b26-4920-a295-fc60857dfc9d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.874130 Oct 06 12:59:20.699656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:20.701128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:20.701281 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1149/2334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:19 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:20.710671 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca42053b-07db-4472-b5ca-64fc027d80da tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2928 microversion: 2.32 time: 0.825755 Oct 06 12:59:20.711580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1186/2335] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:19 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2928 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:20.713507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:20.715034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:20.728340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:20.729120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:20.730390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:20.731112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:20.731494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:20.732214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:20.732672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:20.733105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:20.739268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:20.740000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:20.740446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:20.741163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:20.741625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:20.742079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.026512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:21.286914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:21.299164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e28fabfd-7c15-46d3-81d5-d636c6c3a3d5 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 0.596406 Oct 06 12:59:21.300081 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1150/2336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:20 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:21.305246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:21.305998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:21.309755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:21.313608 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bfaa7428-c574-477f-a735-9ec1baaccfeb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.589033 Oct 06 12:59:21.326062 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1187/2337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:20 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:21.329146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.329672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.330158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.330896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.331362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.331801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.378523 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d72ba3df-a29a-4034-876f-756510363940 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077046 Oct 06 12:59:21.384329 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1151/2338] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:21 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:21.392882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd19099f-bafc-4b25-a9f1-bfdfdc23a771 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd19099f-bafc-4b25-a9f1-bfdfdc23a771 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 416 Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:21.397226 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:21.398684 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:21.399381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:21.399928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.401290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:21.405502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd19099f-bafc-4b25-a9f1-bfdfdc23a771 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:21.406041 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd19099f-bafc-4b25-a9f1-bfdfdc23a771 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009818 Oct 06 12:59:21.406041 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1188/2339] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:21 2022] POST /compute/v2.1/servers => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:21.409649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:21.410298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:21.416621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.417114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.418195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.418904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.419365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.419793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.742520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:21.743208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:21.758235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.759017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.759614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.760485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:21.761094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:21.762229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:21.978761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:21.994105 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-90f4cc2e-7aed-444a-b29e-cf33a136a8b1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.589627 Oct 06 12:59:22.001978 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1152/2340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:21 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:22.033549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:22.034422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:22.040872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:22.041478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:22.042063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:22.043650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:22.044919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:22.045645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:22.319782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:22.729026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:22.741295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:22.743273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:22.745255 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f017025-463a-47eb-8463-e3418bbce8d9 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2907 microversion: 2.32 time: 1.006340 Oct 06 12:59:22.746203 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1189/2341] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:21 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2907 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:22.751838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "ead8573b-ee9e-4abc-ac2c-a162f275fe79"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "a77b907c-6855-4a94-847a-ac82a0df06de"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "dfe7bc37-ef26-4199-bf89-cfd34b50c2a9"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "a9f95510-a50f-4321-aeb1-72abd000876f"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-unplugged", "status": "completed", "tag": "687ed948-038f-4ab0-85a5-1637f4781814"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:22.766324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:22.767064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:22.767687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:22.783234 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Creating event network-vif-unplugged:ead8573b-ee9e-4abc-ac2c-a162f275fe79 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:22.783752 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Creating event network-vif-unplugged:a77b907c-6855-4a94-847a-ac82a0df06de for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:22.784293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Creating event network-vif-unplugged:dfe7bc37-ef26-4199-bf89-cfd34b50c2a9 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:22.784987 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Creating event network-vif-unplugged:a9f95510-a50f-4321-aeb1-72abd000876f for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:22.785649 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] Creating event network-vif-unplugged:687ed948-038f-4ab0-85a5-1637f4781814 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:22.792002 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-991f351c-ef69-4765-be5d-be4bbed17b4a req-2e33a4d3-3291-4b40-bd80-ddbed5c5aeda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.044292 Oct 06 12:59:22.793563 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1190/2342] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:22.799087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:22.799805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:22.806598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:22.807318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:22.807929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:22.809349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:22.810005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:22.810583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:22.968940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:22.985530 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-926d0c78-eed1-48e3-ae47-cc0f2ac6038c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.961329 Oct 06 12:59:23.003832 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1153/2343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:22 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:23.020888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:23.026379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:23.037341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.037868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.038315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:23.039599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.040142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.040580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:23.097931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df205956-b007-4a50-ba1b-c5bd5714a259 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092448 Oct 06 12:59:23.100250 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1154/2344] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 12:59:23 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 12:59:23.125136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-40448afa-4e6f-4cde-8083-4135512690e1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-336698652", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": -1, "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:23.148836 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-40448afa-4e6f-4cde-8083-4135512690e1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Flavor -1 could not be found. Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-40448afa-4e6f-4cde-8083-4135512690e1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 205 Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:23.151248 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:23.153333 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-336698652", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": -1, "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: exception: Flavor -1 could not be found. Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-336698652', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': -1, 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 12:59:23.154132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 06 12:59:23.155405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 06 12:59:23.157139 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:23.159920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-40448afa-4e6f-4cde-8083-4135512690e1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:23.161494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-40448afa-4e6f-4cde-8083-4135512690e1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.060196 Oct 06 12:59:23.167080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1155/2345] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:23 2022] POST /compute/v2.1/servers => generated 73 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:59:23.180516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:23.183941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:23.195809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.198348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.199011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:23.201246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.202115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.203246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:23.246537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:23.259045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99aa936d-b294-4d90-8a8b-3598aef97f1c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 0.462816 Oct 06 12:59:23.259964 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1191/2346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:22 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:23.389766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2102257258", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "f5fb27b2-ac52-4aab-a895-1a59290dd02b"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:23.461472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] validate_networks() for [('f5fb27b2-ac52-4aab-a895-1a59290dd02b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:23.796737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:23.812557 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-090c23de-d4d5-4912-88d3-a5f513ca7d07 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.643531 Oct 06 12:59:23.813632 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1156/2347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:23 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:23.821393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:23.822731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:23.831078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.832430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.833019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:23.835566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:23.835566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:23.835801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:24.267999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:24.286928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:24.297547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:24.298921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fee9d90c-4558-4eb2-859c-525daca3d738 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2861 microversion: 2.32 time: 0.481624 Oct 06 12:59:24.314208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1157/2348] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:23 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2861 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:24.319036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:24.319650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:24.331967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:24.332391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:24.332845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:24.333568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:24.334072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:24.334502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:24.367655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:25.155429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:25.163697 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa792cd1-daaa-498b-814a-a2d860796fc0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.848336 Oct 06 12:59:25.164531 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1158/2349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:24 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:25.170080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-deleted", "tag": "a77b907c-6855-4a94-847a-ac82a0df06de"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:25.180624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.181348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.182133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.194624 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] Creating event network-vif-deleted:a77b907c-6855-4a94-847a-ac82a0df06de for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:25.206591 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b25685eb-eff0-40cd-9289-ecc617fb81bc req-dd11984d-ee94-4108-bc97-132d5b8a6dcb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040604 Oct 06 12:59:25.207977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1159/2350] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:25.221519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:25.222585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:25.231637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.232679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.233371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.234903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.235944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.237308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.490882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:25.492159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:25.492803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:25.493378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:25.493982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:25.509984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.510709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.511929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.512858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.513610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.514280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.538273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:25.544646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Getting quotas for user 98ac89cfe31446eeaec958ae0acaf663 and project 9bb9c2997ff14b6b92702ea515b119c0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:25.560483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:25.563157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:25.575547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:25.591088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92d4fca1-2c06-49da-9d93-be1c4adf85f0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 0.379228 Oct 06 12:59:25.593350 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1160/2351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:25 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:25.607236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2feac529-fe48-4943-be3a-4c613cc78149 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126541405", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2feac529-fe48-4943-be3a-4c613cc78149 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 173 Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:25.626358 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126541405", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:25.627832 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1126541405', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi -1 Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:25.628691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:25.630159 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:25.631498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:25.631498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:25.631498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 06 12:59:25.631498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:25.633212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2feac529-fe48-4943-be3a-4c613cc78149 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:25.634867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2feac529-fe48-4943-be3a-4c613cc78149 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.035164 Oct 06 12:59:25.638867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1161/2352] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:25 2022] POST /compute/v2.1/servers => generated 145 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:25.646021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c0303de-661e-4ef3-aaec-caab73b04b51 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260460 Oct 06 12:59:25.647342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1192/2353] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:59:25.656583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:25.658115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:25.661007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:25.661891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:25.679422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.680062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.681008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.681682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.684777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.685458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.685756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.686081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.687445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:25.689209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:25.693191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:25.694257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:26.142096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:26.161485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:26.164063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:26.165419 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a8e4754-af5e-4588-b685-0a1a1336fd55 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2747 microversion: 2.32 time: 0.524150 Oct 06 12:59:26.166432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1162/2354] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:25 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2747 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:26.187132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-12e8fbd1-00b7-4994-894b-6779dfa9c9a9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:26.188224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-12e8fbd1-00b7-4994-894b-6779dfa9c9a9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:26.281002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:26.294952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3edcc714-14e3-42aa-89ab-51633aac00b7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.645787 Oct 06 12:59:26.296396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1193/2355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:25 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:26.324731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:26.326718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:26.340961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:26.341395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:26.344826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:26.345857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:26.346802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:26.347542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:26.369293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-12e8fbd1-00b7-4994-894b-6779dfa9c9a9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:26.380408 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-12e8fbd1-00b7-4994-894b-6779dfa9c9a9 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1218 microversion: 2.1 time: 0.211795 Oct 06 12:59:26.382145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1163/2356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:26 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:26.618197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:26.620303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:26.637485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:26.650881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:26.651415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:26.657862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:26.658659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:26.660188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.238002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:27.248067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13f3b45f-3abd-40f1-9024-234583d4c2b8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.930524 Oct 06 12:59:27.248957 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1194/2357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:26 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:27.255078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc66a497-dbfe-4e82-aadc-0d6beaa6c74c", "name": "network-vif-plugged", "status": "completed", "tag": "a0cec150-2588-4936-b6f3-abd0ea36573c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:27.268364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.269565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.270258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.301307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:27.304007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] Creating event network-vif-plugged:a0cec150-2588-4936-b6f3-abd0ea36573c for instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c on n-h2-860556-1 Oct 06 12:59:27.311537 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5840900-2691-414b-ab7a-55cadc78cd4d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 0.699606 Oct 06 12:59:27.319500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1164/2358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:26 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:27.324997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:27.325628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:27.327932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-eda54877-2f6e-4db7-9381-55f21a5ccca9 req-03a8d272-4e8f-4d72-a5d6-0c39c323e29d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076514 Oct 06 12:59:27.329109 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1195/2359] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:27.343222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.343500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-deleted", "tag": "687ed948-038f-4ab0-85a5-1637f4781814"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:27.343724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.344255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.344875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.347160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.351832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.384088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.386699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.387499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.431969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] Creating event network-vif-deleted:687ed948-038f-4ab0-85a5-1637f4781814 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:27.447229 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2f054a33-5b09-4403-b4cf-fdcedb68651f req-e38438ff-2805-477e-9df3-ec044f776d77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116218 Oct 06 12:59:27.452015 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1196/2360] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:27.462744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:27.468735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:27.488281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.490342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.490801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.491555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:27.496227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:27.497302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:27.944201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:27.955161 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c64c763-f8b4-4c05-b1c2-4e56797df209 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1270 microversion: 2.1 time: 0.500495 Oct 06 12:59:27.957356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1197/2361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:27 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1270 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:27.963982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1af1604-9cea-4d6f-aef2-fcf83212c37b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245329365", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:27.970229 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f1af1604-9cea-4d6f-aef2-fcf83212c37b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1af1604-9cea-4d6f-aef2-fcf83212c37b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 215 Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:27.972553 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:27.973775 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245329365", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-245329365', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:27.974412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 06 12:59:27.975412 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:27.979516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1af1604-9cea-4d6f-aef2-fcf83212c37b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:27.981957 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1af1604-9cea-4d6f-aef2-fcf83212c37b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022881 Oct 06 12:59:27.990926 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1198/2362] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:27 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:27.998600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:27.999455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:28.009944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.011080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.012600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:28.013626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.014319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.015020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:28.059605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:28.080519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:28.085972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:28.089725 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2d6ef92-d94a-4333-b719-1a7d948c4b21 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2701 microversion: 2.32 time: 0.766784 Oct 06 12:59:28.108966 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1165/2363] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:27 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2701 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:28.344019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:28.345327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:28.357165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.358361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.358849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:28.362197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.362698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.363150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:28.633471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:28.643386 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4fb55d31-40e6-4108-b58e-e30b5b59dc1c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.650546 Oct 06 12:59:28.649429 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1199/2364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:27 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:28.682912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:28.683748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:28.718676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.719197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.719654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:28.720396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:28.720860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:28.721637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.363842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:29.373729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a8ad6f1-3be0-4e9c-908f-4ea6b5c39785 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1316 microversion: 2.1 time: 1.034849 Oct 06 12:59:29.374358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1166/2365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:28 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:29.386154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:29.386154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:29.390783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:29.391290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:29.391731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.392540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:29.393001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:29.393431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.629663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:29.664748 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e73e67f-578a-4c97-8532-39c735c78e1a tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1276 microversion: 2.1 time: 0.289041 Oct 06 12:59:29.676874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:29.698795 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1167/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:29 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:29.708310 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c7314634-a97c-415b-8f18-8e079acce326 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 1.017987 Oct 06 12:59:29.708984 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1200/2367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:28 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:29.720688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:29.720688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:29.744834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:29.745339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:29.748857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.753667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:29.755911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:29.756513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.762359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-deleted", "tag": "ead8573b-ee9e-4abc-ac2c-a162f275fe79"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:29.803565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:29.809923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:29.810713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:29.856632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] Creating event network-vif-deleted:ead8573b-ee9e-4abc-ac2c-a162f275fe79 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:29.868512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b14ac203-4208-4c5a-9b8f-b44d8b20301b req-2b6c50f0-608f-477c-8ccc-4d98264acb94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131375 Oct 06 12:59:29.874347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1201/2368] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:29.950162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-477746490", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-key-1549028058", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:30.043061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] validate_networks() for [('c5b6f957-7498-46d4-a4e2-e8b965536ea0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:30.489113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:30.514286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:30.516347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:30.518228 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-765acfc9-b868-4213-a0b8-dae7e978ebdd tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2497 microversion: 2.32 time: 0.817728 Oct 06 12:59:30.518814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1168/2369] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:29 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2497 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:30.534201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:30.534825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:30.545157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:30.545669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:30.546140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:30.546872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:30.548264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:30.548742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:30.924795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Invalid key_name provided. Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 246 Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:30.934263 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:30.935849 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-477746490", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-key-1549028058", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid key_name provided. Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-477746490', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'key_name': 'tempest-key-1549028058', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 151, in get_by_name Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 06 12:59:30.936552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 133, in _get_from_db Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1549028058 not found for user 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:30.937547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 06 12:59:30.938723 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:30.943971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid key_name provided. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:30.945963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a275212e-9af8-4b2a-82e3-22cca840be84 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.000975 Oct 06 12:59:30.953182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1202/2370] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:29 2022] POST /compute/v2.1/servers => generated 70 bytes in 1008 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 12:59:30.962566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:30.964715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:30.982546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:30.983922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:30.985427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:30.986557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:30.988054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:30.988684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:31.465129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:31.478635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7585ac03-1481-4095-bd99-2badd8f13b33 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1503 microversion: 2.1 time: 0.958621 Oct 06 12:59:31.482195 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1169/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:30 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1503 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:31.493303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:31.499419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:31.524833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:31.525596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:31.529820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:31.530589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:31.531068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:31.531512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:31.532055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:31.540712 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71f65e37-aebd-4ce1-8550-2ee6c1bdf86e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.585608 Oct 06 12:59:31.550307 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1203/2372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:30 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:31.571357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1379070977"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:31.572209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:31.591645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:31.592046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:31.592699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:31.593612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:31.594129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:31.594534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:32.721754 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Adding security group 95af230a-c25b-483b-8c9d-d89661cb3b70 to port a0cec150-2588-4936-b6f3-abd0ea36573c Oct 06 12:59:33.044653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:33.079263 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61077ca6-6f5d-4f35-ad25-ba60dc0bd1a6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 1.592373 Oct 06 12:59:33.079875 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1170/2373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:31 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:33.084511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:33.085188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:33.118775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:33.119300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:33.119755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:33.124852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:33.126757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:33.127237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:33.946160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:33.974925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:33.976510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:33.977843 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-944fb89b-ca48-4d56-97a3-06892aa8d0c2 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 2338 microversion: 2.32 time: 0.896960 Oct 06 12:59:33.999582 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1171/2374] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:33 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 2338 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:33.999582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:33.999582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:34.009784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:34.010638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:34.011804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:34.012865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:34.013432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:34.014001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:34.825855 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4fab8a5-9a69-49e5-8b2e-e9d254f913ea tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/action" status: 202 len: 0 microversion: 2.1 time: 3.272893 Oct 06 12:59:34.828186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1204/2375] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:31 2022] POST /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/action => generated 0 bytes in 3277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:34.838306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:34.841145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:34.860400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:34.861672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:34.863242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:34.865624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:34.868256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:34.869290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:35.242809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:35.253863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c87b9f1-98ee-48d9-afde-217139b6b9ea tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 1.262747 Oct 06 12:59:35.254468 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1172/2376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:33 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:35.474443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8b0f86e-fa58-483c-8227-bc745684be01 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] Calling method '.version_select at 0x7f7d3f33c940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:35.489722 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8b0f86e-fa58-483c-8227-bc745684be01 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.234170 Oct 06 12:59:35.490653 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1173/2377] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:59:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:35.496285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-deleted", "tag": "a9f95510-a50f-4321-aeb1-72abd000876f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:35.507902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:35.508560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:35.509196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:35.526357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:35.527987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] Creating event network-vif-deleted:a9f95510-a50f-4321-aeb1-72abd000876f for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:35.535225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d1e7c146-34fc-46d0-87b8-2595a25e11af req-3c6f52e5-f3b2-4f31-89d1-b1baa50595c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043235 Oct 06 12:59:35.536674 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1174/2378] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:35.542804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-435027163"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:35.543831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:35.551403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:35.552041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:35.552587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:35.552755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:35.554173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:35.555278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:35.555828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:35.909174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:35.924128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ce8b76e-f95d-4bc9-9c2c-41a8c30625aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 1.091471 Oct 06 12:59:35.925028 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1205/2379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:34 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:35.940511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:35.941338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:35.963945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:35.966204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:35.968780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:35.969725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:35.970696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:35.973776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:36.021538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:36.119091 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.network.security_group_api [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Adding security group 48f40ba9-f808-41df-a3ac-0ff2970e7f41 to port a0cec150-2588-4936-b6f3-abd0ea36573c Oct 06 12:59:36.241195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:36.258542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:36.260296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:36.262936 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70fe1da8-1d6a-4c6a-8a4a-18d940f74fb3 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1985 microversion: 2.32 time: 0.334698 Oct 06 12:59:36.289972 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1206/2380] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:35 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1985 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:36.297312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc7952b3-2caf-4b80-9886-aaceaf125906"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:36.301704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:36.322837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:36.337249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:36.338312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:36.339721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:36.340790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:36.346453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:36.349237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:36.942281 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ad11960-7e02-439f-bda1-5f985b854ce4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "POST /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650709 Oct 06 12:59:36.943931 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1207/2381] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 12:59:36 2022] POST /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:36.975149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e10a32d8-3fa3-4dad-ac67-c025b5b24ff8 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3f6c3310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:37.470115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e10a32d8-3fa3-4dad-ac67-c025b5b24ff8 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.524262 Oct 06 12:59:37.481776 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1208/2382] 10.222.0.26 () {60 vars in 1206 bytes} [Thu Oct 6 12:59:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:37.486944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2077130218", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:38.491578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd28794f-7f18-47c3-b7d4-1e1e07d91b7c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/action" status: 202 len: 0 microversion: 2.1 time: 2.952208 Oct 06 12:59:38.493306 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1175/2383] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:35 2022] POST /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/action => generated 0 bytes in 2956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:38.508603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:38.512525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:38.546201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:38.555523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:38.558923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:38.565359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:38.566197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:38.571740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.000242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Neutron security group does_not_exist not found {{(pid=129615) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 06 12:59:39.000242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 258 Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:39.023181 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:39.024751 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2077130218", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2077130218', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 06 12:59:39.025794 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:39.027057 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.028285 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.029871 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 06 12:59:39.031446 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:39.035846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:39.037148 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d93aa4f6-ea1a-4d02-aacc-25c58c3d23c8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.564632 Oct 06 12:59:39.038249 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1209/2384] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:37 2022] POST /compute/v2.1/servers => generated 106 bytes in 1566 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:39.077008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:39.078521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:39.110903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.112208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.112824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.114293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.115025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.115636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.258215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:39.262789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:39.273451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d340eb6c-1be4-4706-892d-7198c3b1fb8e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.778141 Oct 06 12:59:39.289088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:39.289400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1176/2385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:38 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:39.293971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:39.306662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-53d7bce6-6e6c-493a-b396-5c26e621dde2 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] Calling method '.version_select at 0x7f7d3f2768b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:39.307094 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7a0301f-6d6f-4b59-8c0f-318cab5f3298 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.267079 Oct 06 12:59:39.314228 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1210/2386] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:39 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:39.322244 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-53d7bce6-6e6c-493a-b396-5c26e621dde2 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031393 Oct 06 12:59:39.323304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1177/2387] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 12:59:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:39.330037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc66a497-dbfe-4e82-aadc-0d6beaa6c74c", "tag": "a0cec150-2588-4936-b6f3-abd0ea36573c"}, {"server_uuid": "3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e", "name": "network-vif-deleted", "tag": "dfe7bc37-ef26-4199-bf89-cfd34b50c2a9"}, {"name": "network-changed", "server_uuid": "92e05880-0af6-4654-97bd-6293cb59a9a1", "tag": "265f5185-2670-46ee-9878-d3d0ec95adaa"}, {"name": "network-changed", "server_uuid": "bc66a497-dbfe-4e82-aadc-0d6beaa6c74c", "tag": "a0cec150-2588-4936-b6f3-abd0ea36573c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:39.332987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:39.334235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:39.341856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.342819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.343507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.356169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.356696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.357151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.357919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.358462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.358905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.365435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Creating event network-changed:a0cec150-2588-4936-b6f3-abd0ea36573c for instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c on n-h2-860556-1 Oct 06 12:59:39.366845 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Creating event network-vif-deleted:dfe7bc37-ef26-4199-bf89-cfd34b50c2a9 for instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e on n-h1-860556-1 Oct 06 12:59:39.367596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Creating event network-changed:265f5185-2670-46ee-9878-d3d0ec95adaa for instance 92e05880-0af6-4654-97bd-6293cb59a9a1 on n-h1-860556-1 Oct 06 12:59:39.368827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] Creating event network-changed:a0cec150-2588-4936-b6f3-abd0ea36573c for instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c on n-h2-860556-1 Oct 06 12:59:39.383858 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-79578861-e747-4c72-8bca-32ef0c81131d req-0d14c99e-33e3-4fe4-aab1-357e8f56b57f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.059220 Oct 06 12:59:39.386402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1178/2388] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:39.398373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:39.399424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:39.411505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.412003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.412438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.413874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:39.414680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:39.415703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:39.766017 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b4ee9c6-b721-483e-b2c5-9bbb279671b3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.449316 Oct 06 12:59:39.767080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1211/2389] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Oct 6 12:59:39 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c/os-security-groups => generated 1158 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:39.781209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:39.787842 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f369935e-debb-4cd5-b963-6fb4d80cfb4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.396306 Oct 06 12:59:39.789598 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1179/2390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:39 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:39.831850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b64819c-a3cc-4b64-9815-e790da9de3d7 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3f458040>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:39.987168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=11 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:40.036711 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b64819c-a3cc-4b64-9815-e790da9de3d7 tempest-QuotaClassesAdminTestJSON-1039048050 tempest-QuotaClassesAdminTestJSON-1039048050-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.217100 Oct 06 12:59:40.038086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1180/2391] 10.222.0.26 () {60 vars in 1206 bytes} [Thu Oct 6 12:59:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:40.048630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9f56bc4-3bbd-4d55-8645-7bcecf6b885e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3fd8fe50>, body: {"security_group": {"name": " tempest-securitygroup -676047547 ", "description": "tempest-description-778895024"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:40.318817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-942598294", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d177263e-a196-42a7-8555-65753d4f2ed0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:40.410155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] validate_networks() for [('d177263e-a196-42a7-8555-65753d4f2ed0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:40.661875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9f56bc4-3bbd-4d55-8645-7bcecf6b885e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.622403 Oct 06 12:59:40.663070 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1181/2392] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:40 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:40.669516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:40.670484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:40.704021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:40.704775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:40.705398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:40.706528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:40.707152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:40.707739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.061269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:41.078645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5e3c5a5-f0e0-4ea1-beb9-d2823500fd0e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.414170 Oct 06 12:59:41.086168 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1182/2393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:40 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:41.091960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:41.102708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:41.131697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.132199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.132642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.133358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.134024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.134619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.173232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:41.648479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:41.648911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:41.649357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:41.649832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:41.650238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:41.666644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.667801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.668243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.669014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.674429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.674876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.700839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:41.708727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:41.717869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c1f4c10-9a5e-4668-bb1a-7789855e2d5e tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.630311 Oct 06 12:59:41.722219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for user 72051080ff9c4e9d80df2ff14b828464 and project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:41.740012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1183/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:41 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:41.762609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:41.769873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:41.773017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:41.778750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:41.797679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.806665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.807608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.812100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:41.813548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:41.819018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:41.909524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c29eb18-6729-4e16-855b-568a3ce3496f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.139567 Oct 06 12:59:41.925548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1212/2395] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:59:41.933075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7ecfa48-6d4e-496b-b227-5837ae62b2a7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f1fc820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.151034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:42.171784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:42.181699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:42.188578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a5fdab6-f06c-46f2-a2c1-2c2f489de637 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.444273 Oct 06 12:59:42.189226 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1184/2396] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:41 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:42.199545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.209655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 80dcaf29-9825-4995-8c7d-1969e36abf47] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:42.229566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/80dcaf29-9825-4995-8c7d-1969e36abf47 HTTP/1.1 Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:42.234228 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. Oct 06 12:59:42.235633 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '80dcaf29-9825-4995-8c7d-1969e36abf47'} Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:42.236375 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. Oct 06 12:59:42.237692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:42.242271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 80dcaf29-9825-4995-8c7d-1969e36abf47 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:42.242271 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5dd4b0c-d431-4b0c-bccf-4e1f1f88aa40 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80dcaf29-9825-4995-8c7d-1969e36abf47" status: 404 len: 111 microversion: 2.1 time: 0.048699 Oct 06 12:59:42.242271 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1185/2397] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 12:59:42 2022] DELETE /compute/v2.1/servers/80dcaf29-9825-4995-8c7d-1969e36abf47 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:42.247826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8456fb82-9f80-48ad-8a4b-d95c6080605f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.248459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8456fb82-9f80-48ad-8a4b-d95c6080605f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:42.264367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7ecfa48-6d4e-496b-b227-5837ae62b2a7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e" status: 200 len: 222 microversion: 2.1 time: 0.337368 Oct 06 12:59:42.264912 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1213/2398] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:59:41 2022] GET /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e => generated 222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:42.269954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.270717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:42.284591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.285087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.285526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:42.287789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.295899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.296869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:42.373632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8456fb82-9f80-48ad-8a4b-d95c6080605f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:42.388819 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8456fb82-9f80-48ad-8a4b-d95c6080605f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1217 microversion: 2.1 time: 0.148061 Oct 06 12:59:42.390148 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1186/2399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:42 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:42.414405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7602c02e-1e8c-46d4-8a82-3eb7da47f837 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f96fa60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.599362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:42.618212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b171257a-b7d7-457b-b9ea-ac24bd7b1edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.350750 Oct 06 12:59:42.619327 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1214/2400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:42 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:42.645666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.646330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:42.655731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.656386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.656660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:42.657384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.657904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.663545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:42.851095 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7602c02e-1e8c-46d4-8a82-3eb7da47f837 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e" status: 202 len: 0 microversion: 2.1 time: 0.458234 Oct 06 12:59:42.855924 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1187/2401] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:59:42 2022] DELETE /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:42.861397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:42.862558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:42.881290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.882222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.882943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:42.884333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:42.886693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:42.889197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:43.072865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:43.084076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23fe39de-452f-4cb6-b5db-cebe09afa754 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.442237 Oct 06 12:59:43.090587 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1215/2402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:42 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:43.109497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3ecf6040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:43.244091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:59:43.244976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group c55ca3a7-4833-4272-87c7-c185ffe5229e not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:59:43.246030 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.246030 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e HTTP/1.1 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:43.253445 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.255082 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c55ca3a7-4833-4272-87c7-c185ffe5229e'} Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:43.255958 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 12:59:43.257279 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.258582 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] Oct 06 12:59:43.260061 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.262017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 12:59:43.262017 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-c36eb8a8-ab26-47be-b5c4-34ae57936cd3'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:43.263205 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7343b65-4406-4549-a223-5d13848f6fee tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e" status: 404 len: 194 microversion: 2.1 time: 0.170546 Oct 06 12:59:43.263952 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1216/2403] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:59:43 2022] GET /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e => generated 194 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:43.276135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:43.283204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Failed to fetch instance by id 9223372036854775808 {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:59:43.285269 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:43.293836 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 9223372036854775808 could not be found. Oct 06 12:59:43.295558 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '9223372036854775808'} Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:59:43.296491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 06 12:59:43.298118 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:43.308653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:43.309849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c73715b0-2ede-4c4e-9fa2-982ee23dc4e8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.044749 Oct 06 12:59:43.311595 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1217/2404] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Oct 6 12:59:43 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:59:43.332202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:43.335307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:43.364155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:43.364645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:43.365096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:43.365860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:43.366401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:43.381850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:43.399035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:43.426561 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23900631-20c8-4ecf-ab47-bf1648a399b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.566025 Oct 06 12:59:43.441777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1188/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:42 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:43.451105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cacea510-7b9f-4c25-9063-88829e5d7155 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f7abe50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1880237964", "description": "tempest-description-247807797"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:43.592026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:43.610048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:43.617825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:43.620838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6b882c0-c531-4c1a-abc0-44af9b963f62 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.306770 Oct 06 12:59:43.625181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1218/2406] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:43 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:43.640025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:43.643353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:43.661291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:43.662020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:43.664111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:43.666264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:43.670756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:43.671901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.223840 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cacea510-7b9f-4c25-9063-88829e5d7155 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.791309 Oct 06 12:59:44.224777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1189/2407] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:43 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:44.231583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:44.234105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:44.256028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:44.257497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.258100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.261944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.262745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.263235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.265709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.282300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20ead1b3-10f1-4499-acea-6190803b0363 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.655233 Oct 06 12:59:44.284145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1219/2408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:43 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:44.297899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30cd1155-0fef-483e-9ba9-8af64b805c8a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f552e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-347376257", "description": "tempest-description-367042970"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:44.457886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:44.474190 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d2ce05a-ab08-4d4e-b324-9470927694d8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1269 microversion: 2.1 time: 0.247222 Oct 06 12:59:44.477825 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1190/2409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:44 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1269 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:44.491922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:44.493724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:44.508207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.509633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.510485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.511447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.514386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.515210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.890220 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30cd1155-0fef-483e-9ba9-8af64b805c8a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.603884 Oct 06 12:59:44.891823 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1220/2410] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:44 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:44.904076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:44.905381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:44.922610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.923798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.925875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:44.929284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:44.930141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:44.931286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:45.093511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:45.102288 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f9fbdf9-c5a2-4792-af76-9d852a4dde0f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.621347 Oct 06 12:59:45.107956 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1191/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:44 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:45.114757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:45.116953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:45.135024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:45.135838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:45.137439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:45.140248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:45.141014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:45.141668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:45.255132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:45.271348 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ee0656c-ea0a-4944-9905-93bed6c650f8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.375797 Oct 06 12:59:45.276978 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1221/2412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:44 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:45.325698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:45.349692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:45.351704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:45.355891 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08019f3f-2660-482b-a88f-e2853764af05 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.246618 Oct 06 12:59:45.379240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1192/2413] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:45 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:45.388916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50e5ec7c-5f60-4e37-b10c-9c3be99f19bc tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f450dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1232825995", "description": "tempest-description-1929158692"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:45.802552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2122665972", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:45.848258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50e5ec7c-5f60-4e37-b10c-9c3be99f19bc tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.467259 Oct 06 12:59:45.849362 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1193/2414] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:45 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:45.861725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:45.862581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Failed to fetch instance by id -1 {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 12:59:45.863282 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance -1 could not be found. Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:45.865163 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance -1 could not be found. Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '-1'} Oct 06 12:59:45.866676 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 12:59:45.867811 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 06 12:59:45.869178 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:45.871705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance -1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:45.872871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b058a27-1cda-4cb7-8e60-aa84b7b0a6e4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.022194 Oct 06 12:59:45.875454 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1194/2415] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 12:59:45 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:59:45.894548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e05880-0af6-4654-97bd-6293cb59a9a1", "name": "network-vif-plugged", "status": "completed", "tag": "265f5185-2670-46ee-9878-d3d0ec95adaa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:45.926031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:45.926672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:45.927301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:45.928644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:45.930933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:45.946790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:45.953282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:45.953282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:45.978729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:45.986966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] Creating event network-vif-plugged:265f5185-2670-46ee-9878-d3d0ec95adaa for instance 92e05880-0af6-4654-97bd-6293cb59a9a1 on n-h1-860556-1 Oct 06 12:59:45.990019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:45.990585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:45.991667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:45.992263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:45.992796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:46.001663 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b67b6967-4177-4eb8-94a3-30e0cc9bbc54 req-255b1127-6133-4dca-8740-fd77b47d31d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122118 Oct 06 12:59:46.002334 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1195/2416] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:46.022067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Getting quotas for project ff413d5b2509412c88ab326dfe2d2f98. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:46.036029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:46.039013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:46.048568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Getting quotas for user 3e4deb932edd42ab89afe97e2c791e70 and project ff413d5b2509412c88ab326dfe2d2f98. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:46.075410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:46.076008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:46.076480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:46.077255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:46.077731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:46.078189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:46.145182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:46.149021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:46.263675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-739b3e04-b3a0-46b9-8d80-e122abb77253 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.979793 Oct 06 12:59:46.264809 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1222/2417] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 12:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 12:59:46.269794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a259f49-ad41-4ec9-820c-b15924d82e6f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f4b39d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:46.836335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:46.848161 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec8fd78e-1fc5-469f-9b87-e2d95eae2ced tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.842670 Oct 06 12:59:46.852218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1196/2418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:46 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:46.867101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:46.867733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:46.875395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:46.875900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:46.876345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:46.877060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:46.878143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:46.879958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:46.897387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a259f49-ad41-4ec9-820c-b15924d82e6f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.631258 Oct 06 12:59:46.898495 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1223/2419] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:59:46 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:46.912797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:46.920966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:46.974403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=12,nova_api:INSERT=13 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:47.130489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.141492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.143209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.161941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d2fd204-2c37-4d5f-a200-fb9367adf526 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "PUT /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1359 microversion: 2.75 time: 0.261086 Oct 06 12:59:47.163281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1224/2420] 10.222.0.26 () {62 vars in 1297 bytes} [Thu Oct 6 12:59:46 2022] PUT /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:47.187103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:47.190666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:47.199754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.200497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.201441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.202415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.203110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.203741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.226106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.235338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c905f15-8edd-424a-9a5b-29b93c87fcd7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.382013 Oct 06 12:59:47.242027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1197/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:46 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:47.248149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:47.255599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:47.267727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.268309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.268659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.270253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.270884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.271476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.391121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.401108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.404618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.407032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb036cfd-070a-40dd-96d5-6c0ff347564a tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.163331 Oct 06 12:59:47.407812 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1198/2422] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:47 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:47.412608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc09f6f4-d82c-4026-a7c2-00f83e03a12e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f74c310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:47.594426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:47.622062 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3fe3f6e-71b8-4c95-ad4e-ac235667cfd3 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1318 microversion: 2.1 time: 0.455800 Oct 06 12:59:47.624664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1225/2423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:47 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:47.889987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc09f6f4-d82c-4026-a7c2-00f83e03a12e tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3" status: 202 len: 0 microversion: 2.1 time: 0.480795 Oct 06 12:59:47.891090 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1199/2424] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:59:47 2022] DELETE /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:47.895736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:47.896361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:47.921873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.922691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.923344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.924108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:47.924575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:47.925013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:47.981310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3f126c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:48.088046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.089610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.090445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.094321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.095366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.096084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.125059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.139808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.142441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.152092 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6aab6546-01e5-4b03-a63c-bf797e8aefd9 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1411 microversion: 2.75 time: 0.259283 Oct 06 12:59:48.153370 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1200/2425] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:47 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1411 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:48.159287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.160142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:48.185884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.187507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.190787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.191911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.192385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.193282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.221287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48f04fcc-10e9-40f8-8672-a9389548e433 tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c" status: 200 len: 240 microversion: 2.36 time: 0.591600 Oct 06 12:59:48.232783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1226/2426] 10.222.0.26 () {62 vars in 1303 bytes} [Thu Oct 6 12:59:47 2022] PUT /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c => generated 240 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:59:48.232783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41113534-cc14-42a5-895b-49aff31cc262", "tag": "dfe46d27-1bed-4cdd-bbe1-5751d9410117"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:48.251406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.251902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.252343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.270838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] Creating event network-changed:dfe46d27-1bed-4cdd-bbe1-5751d9410117 for instance 41113534-cc14-42a5-895b-49aff31cc262 on n-h2-860556-1 Oct 06 12:59:48.276945 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2487cb65-d34a-48e4-a80e-53b4f145f124 req-9ab7aa00-f70d-4de9-a5f2-eec133c35715 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052406 Oct 06 12:59:48.277973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1227/2427] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:48.283819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.284445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:48.291244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.292494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.292958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.293683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.294175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.294627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.479737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.493174 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e62a82a-8bd9-4a48-8996-7ff868989e87 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.338082 Oct 06 12:59:48.494100 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1201/2428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:48.500075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f33c670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.531465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.533464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:59:48.534306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 9385d37b-560a-40ba-919d-c325aab16fb3 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:59:48.535088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.535088 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3 HTTP/1.1 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:48.538498 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.540067 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '9385d37b-560a-40ba-919d-c325aab16fb3'} Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:48.541000 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 12:59:48.555017 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.556264 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 12:59:48.557761 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-713034d8-5ea2-4061-84e5-693a536acadc'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:48.558715 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc0d6038-cafd-4517-8ebf-19aafe9f9af6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.261218 Oct 06 12:59:48.558715 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1228/2429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:48.558875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcb39fab-529d-4b60-9afb-c352ea9b6267 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3" status: 404 len: 194 microversion: 2.1 time: 0.046641 Oct 06 12:59:48.558875 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1202/2430] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:48.559150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Calling method '.version_select at 0x7f7d3f01dc10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.559251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.559251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:48.563434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.571799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.573625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.574599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.575320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.575926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.621563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.622255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.622805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.624218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.624928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.625466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.650879 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3da879cc-4efd-49fe-bd3f-ba41ca98e92b tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c/detail" status: 200 len: 672 microversion: 2.36 time: 0.108352 Oct 06 12:59:48.663059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1229/2431] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c/detail => generated 672 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:59:48.668910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:48.669474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 52ac367f-f04f-4f7e-a5c9-3b999217d4dc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:48.669957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.677268 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/52ac367f-f04f-4f7e-a5c9-3b999217d4dc/action HTTP/1.1 Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 19 Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:48.684366 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: {"forceDelete": {}} Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:48.686086 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '52ac367f-f04f-4f7e-a5c9-3b999217d4dc', 'body': {'forceDelete': {}}} Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:48.690127 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:48.691473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 52ac367f-f04f-4f7e-a5c9-3b999217d4dc could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:48.692584 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f06a909-ae86-412e-9f09-5f2ffcc9c66e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/52ac367f-f04f-4f7e-a5c9-3b999217d4dc/action" status: 404 len: 111 microversion: 2.1 time: 0.021933 Oct 06 12:59:48.692584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1230/2432] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:48 2022] POST /compute/v2.1/servers/52ac367f-f04f-4f7e-a5c9-3b999217d4dc/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:48.698142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85f76dfc-4f73-4244-b75c-2e8b437d9ea0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f1a8f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.707148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.717279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:48.722802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ff1e8c6-f5af-4841-b044-6be0cf8b139c tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.173608 Oct 06 12:59:48.724850 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1203/2433] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:48.759237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:48.759984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:48.767584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.768094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.769043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:48.769327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:48.769879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:48.770609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.019391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.029351 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-afe29207-bf9a-4570-bd97-1a5225b063c6 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1507 microversion: 2.1 time: 0.302021 Oct 06 12:59:49.029978 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1204/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:48 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:49.034723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.035341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.043520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.044228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.045009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.045930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.046536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.047249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.051374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85f76dfc-4f73-4244-b75c-2e8b437d9ea0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21" status: 202 len: 0 microversion: 2.1 time: 0.360856 Oct 06 12:59:49.052387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1231/2435] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:59:48 2022] DELETE /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:49.058924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3f693940>, body: {"quota_set": {"ram": "2048"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:49.145256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.145955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.146494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.147324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.147915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.148439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.205258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.205880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.206329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.207073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.208043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.208043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.219307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.228598 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e823ea6-1134-4b6c-b86b-9e0d94bd7074 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.197400 Oct 06 12:59:49.229186 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1205/2436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:49.235074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f78fb80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.264033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:59:49.264861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 034c2751-d41b-400b-9751-a65bb0bf9d21 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:59:49.265415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.265415 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21 HTTP/1.1 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:49.267309 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.268762 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '034c2751-d41b-400b-9751-a65bb0bf9d21'} Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.269629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 12:59:49.270858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.271991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] Oct 06 12:59:49.273243 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.274666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 12:59:49.274666 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-c6abc759-d7f2-4055-98a1-7b8e690a0808'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:49.275808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-583bd39d-e829-4698-b016-ac6a836ff4ac tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21" status: 404 len: 194 microversion: 2.1 time: 0.045410 Oct 06 12:59:49.280054 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1206/2437] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:49.284070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.284683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.287734 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2eb9a0a7-855b-4472-a2f8-9074b169d48d tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c?user_id=01be03de67d844b598c178af33506cc6" status: 200 len: 240 microversion: 2.36 time: 0.233681 Oct 06 12:59:49.288954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1232/2438] 10.222.0.26 () {62 vars in 1384 bytes} [Thu Oct 6 12:59:49 2022] PUT /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c?user_id=01be03de67d844b598c178af33506cc6 => generated 240 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:59:49.292116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.292619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.293050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.294035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.294672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.295586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.301781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.303065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.314521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.315023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.315668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.316662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.317337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.318010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.379535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.390518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.392231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.398619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc43c194-3e15-4b07-81f4-d63e5a806c6a tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1417 microversion: 2.75 time: 0.119969 Oct 06 12:59:49.399359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1207/2439] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1417 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:49.406157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f1aba1d4-b6c3-4ccb-a56e-204af088ac20 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d47631670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.527993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:49.536153 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88e3b527-1f37-4b66-aab9-01cd2fafc390 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.245714 Oct 06 12:59:49.550049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1233/2440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:49.559929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f19c7d9-caf8-4bd7-b9b8-0a0942a01dce tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] Calling method '.version_select at 0x7f7d3f222a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.644147 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f19c7d9-caf8-4bd7-b9b8-0a0942a01dce tempest-QuotasAdminTestV236-84761722 tempest-QuotasAdminTestV236-84761722-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c?user_id=01be03de67d844b598c178af33506cc6" status: 200 len: 282 microversion: 2.36 time: 0.092520 Oct 06 12:59:49.644798 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1234/2441] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/os-quota-sets/9b4f92020ca9476a82807b744f87dc5c?user_id=01be03de67d844b598c178af33506cc6 => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 12:59:49.650213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:49.654083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 8f6c842c-c605-4e81-8a47-8972cdabe9a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.660571 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/8f6c842c-c605-4e81-8a47-8972cdabe9a3/action HTTP/1.1 Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 39 Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:49.670623 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: {"os-getConsoleOutput": {"length": 10}} Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:49.671990 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8f6c842c-c605-4e81-8a47-8972cdabe9a3', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:49.672722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. Oct 06 12:59:49.673914 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.675335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f1aba1d4-b6c3-4ccb-a56e-204af088ac20 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704" status: 202 len: 0 microversion: 2.1 time: 0.271299 Oct 06 12:59:49.676613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 8f6c842c-c605-4e81-8a47-8972cdabe9a3 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:49.677652 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fca27899-0d73-402b-8b60-3a31b36ff937 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/8f6c842c-c605-4e81-8a47-8972cdabe9a3/action" status: 404 len: 111 microversion: 2.1 time: 0.031677 Oct 06 12:59:49.681078 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1208/2442] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 12:59:49 2022] DELETE /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:49.681886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1235/2443] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:49 2022] POST /compute/v2.1/servers/8f6c842c-c605-4e81-8a47-8972cdabe9a3/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:49.687633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f1fc700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.695261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.696416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.718046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 807165d4-4160-4596-980e-6628eca36704 does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 12:59:49.718857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 807165d4-4160-4596-980e-6628eca36704 not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 12:59:49.718995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.719594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.719820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.719820 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.720239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.721327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.722560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.723258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704 HTTP/1.1 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:49.723864 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.725200 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '807165d4-4160-4596-980e-6628eca36704'} Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.725963 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 12:59:49.727351 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.728517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-d774021c-8f99-45f3-8c48-8604b3d63605'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d33b70ef-48f2-4326-a27a-d835d85118e0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704" status: 404 len: 194 microversion: 2.1 time: 0.042367 Oct 06 12:59:49.731740 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1236/2444] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:49.734754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:49.735559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:49.742766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.744499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.744499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:49.745685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:49.746339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:49.746942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.031871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.033068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.048022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb0ff5ae-92a9-405a-9600-5ac6b6a64bea tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.364387 Oct 06 12:59:50.048613 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1209/2445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:50.051554 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38b45a71-d7d3-4a2d-86c5-6d3b4abf3d8c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.320534 Oct 06 12:59:50.066847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1237/2446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:49 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:50.084979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af751311-ae57-406a-bd51-f4d7f12f03ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3ee99b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.086062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.087183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:50.102278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.102877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.103336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.104066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.105061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.105789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.204514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.210975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:50.220673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.223710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.225227 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89463c11-491f-4333-b6f4-9bdf453f0070 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.148174 Oct 06 12:59:50.237858 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1210/2447] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:50.237858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.237858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:50.242061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.242919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.243857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.244773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.246284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.246926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.402372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af751311-ae57-406a-bd51-f4d7f12f03ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.326675 Oct 06 12:59:50.413135 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1238/2448] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:50.418769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d5d0f44-c456-4808-acd6-2b6d47b6ec7b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3ecfe280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-683719336", "description": "tempest-description-2033988596"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:50.450751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.466146 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c8bf30c-e2ba-4010-b731-6ef7f350926b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.237789 Oct 06 12:59:50.467290 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1211/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:50.472670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.473510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:50.483264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.484106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.484882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.485821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.486429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.487588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.585000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.611093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.612621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.628745 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3cb8b503-74f4-462c-8ee7-9692d40f7de3 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1417 microversion: 2.75 time: 0.159688 Oct 06 12:59:50.629597 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1212/2450] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1417 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:50.651711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d5d0f44-c456-4808-acd6-2b6d47b6ec7b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.235098 Oct 06 12:59:50.651711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1239/2451] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:50.656534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.657159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 5473a938-0795-4036-baa3-2775ee8b77b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:50.672479 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. Oct 06 12:59:50.675616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3397003-ba2e-4207-a233-7d50280e861c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f76b040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1173749690", "description": "tempest-description-1700485336"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/5473a938-0795-4036-baa3-2775ee8b77b1 HTTP/1.1 Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:50.677762 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. Oct 06 12:59:50.679291 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '5473a938-0795-4036-baa3-2775ee8b77b1'} Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:50.680043 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:50.683261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 5473a938-0795-4036-baa3-2775ee8b77b1 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:50.684914 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c8a02029-1572-4d2d-9fa1-aa2f74105647 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/5473a938-0795-4036-baa3-2775ee8b77b1" status: 404 len: 111 microversion: 2.1 time: 0.027822 Oct 06 12:59:50.684914 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1240/2452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/servers/5473a938-0795-4036-baa3-2775ee8b77b1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:50.694032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:50.695008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:50.703195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.704613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.705335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.719179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:50.721645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:50.724929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:50.994163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:50.999636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:51.024095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c2dee5e-6069-435c-b692-3f75439e9430 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.338027 Oct 06 12:59:51.025297 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1241/2453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:50 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:51.055029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:51.056329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:51.070487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.074737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.075424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.076923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.079722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.080356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.099428 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3397003-ba2e-4207-a233-7d50280e861c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.438440 Oct 06 12:59:51.102966 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1213/2454] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 12:59:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 12:59:51.111703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:51.113244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:51.127999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.128870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.129635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.130592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.131220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.131815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.345932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.357978 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96ce5891-d0db-40e1-8f53-6ac56d425bd8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.308169 Oct 06 12:59:51.358305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1242/2455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:51 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:51.363141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:51.363646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:51.375738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.376431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.377023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.378022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.378647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.379223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.580804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.591808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.593999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.595034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.600487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e20ea9f9-fb1b-429a-a613-e3fdf60fa772 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.241130 Oct 06 12:59:51.601924 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fac23d12-8cc0-496c-b737-8e0b72c05fcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.497488 Oct 06 12:59:51.605464 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1214/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:51 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:51.610381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-517663346", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "8fce8b2d-3fef-4315-8543-c4cc45bb0b30"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:51.616626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1243/2457] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:51 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:51.647508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe2dc255-df8e-4d86-af16-de281a26d0d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1250457869", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe2dc255-df8e-4d86-af16-de281a26d0d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 238 Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:51.685918 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:51.687754 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1250457869", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1250457869', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:51.688547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:51.689906 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 06 12:59:51.691392 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:51.693141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe2dc255-df8e-4d86-af16-de281a26d0d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:51.694118 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe2dc255-df8e-4d86-af16-de281a26d0d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.062382 Oct 06 12:59:51.698510 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1244/2458] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:51.706613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:51.708792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:51.732474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.735309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] validate_networks() for [('8fce8b2d-3fef-4315-8543-c4cc45bb0b30', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:51.741125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.741995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.746416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:51.747753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:51.750029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:51.949595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.960801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.962627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:51.970997 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7dbed446-4db2-42e7-899e-41d2ba551a01 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1438 microversion: 2.75 time: 0.271031 Oct 06 12:59:51.993407 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1245/2459] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:51 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1438 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:51.997867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:51.999590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:52.007148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.007639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.008074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.008786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.009383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.019158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.306771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:52.316737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9acdfc66-45a3-46f6-87ab-2adc5a698eb5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.329514 Oct 06 12:59:52.317347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1246/2460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:51 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:52.322887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:52.326482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:52.333569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.337519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.338189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.339410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.339887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.340318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.388604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:52.463684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:52.464624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:52.465102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:52.465523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:52.465955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:52.531057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:52.540735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:52.541472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:52.542965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.543468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.543714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:52.543908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.544622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.544954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:52.545063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.545625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.546289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:52.559854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.560911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.561754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.563414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.564371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.565132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.612863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:52.620579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Getting quotas for project b3e65666907a4c2db886bfe58fdd71c1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:52.622793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:52.625830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:52.637140 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00e57963-fb81-45a5-baee-6a92594fe818 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "POST /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d/action" status: 202 len: 1495 microversion: 2.75 time: 0.313886 Oct 06 12:59:52.640040 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1247/2461] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 12:59:52 2022] POST /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d/action => generated 1495 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 06 12:59:52.648650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:52.652505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:52.660868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Getting quotas for user 7e2c67f80b24481b9b7e1b2ecc6f481c and project b3e65666907a4c2db886bfe58fdd71c1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:52.664020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.668122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.668833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.669953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.670732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.671343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.710863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:52.713185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:52.866094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30517c75-6616-4105-8afe-0c4ff46a374b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259246 Oct 06 12:59:52.867079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1215/2462] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:59:52.880125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:52.881019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:52.891323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.892044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.892719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:52.893662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:52.894381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:52.895024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.329720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.342057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.344177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.345656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f54fec0a-acc3-43e5-a41c-93b94a3e7b8f tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.477435 Oct 06 12:59:53.346547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1216/2463] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:52 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:53.352837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:53.353844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:53.360974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.361629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.362504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.363382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.364126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.364783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.372041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.383486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5151c002-98b1-4438-a3eb-57c87af5b08d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.741660 Oct 06 12:59:53.384736 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1248/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:52 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:53.403772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:53.405095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:53.412172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.413059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.413952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.415007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.416000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.416670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.536732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.549491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.551471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.559811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1cb795b9-a74c-4a5e-ae2f-6719fc68ebbe tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.172700 Oct 06 12:59:53.561543 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1249/2465] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:53 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:53.591727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d3e7d93-cc09-48fc-a2cc-6963dd61ffc3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:53.593050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d3e7d93-cc09-48fc-a2cc-6963dd61ffc3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:53.603811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:53.673432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.690469 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6bfe4a83-722b-4d65-9b48-44bfda8e1d6a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.342642 Oct 06 12:59:53.691380 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1217/2466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:53 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:53.695721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41113534-cc14-42a5-895b-49aff31cc262", "name": "network-vif-plugged", "status": "completed", "tag": "dfe46d27-1bed-4cdd-bbe1-5751d9410117"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:53.721325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.721982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.722428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.742392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d3e7d93-cc09-48fc-a2cc-6963dd61ffc3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.744428 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] Creating event network-vif-plugged:dfe46d27-1bed-4cdd-bbe1-5751d9410117 for instance 41113534-cc14-42a5-895b-49aff31cc262 on n-h2-860556-1 Oct 06 12:59:53.751439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-74f89b30-15fe-4c09-9159-cb46842d42be req-772709b7-5ca4-4d89-a3bf-1a8ef9f7de15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059047 Oct 06 12:59:53.751933 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1218/2467] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:53.759422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-413fddd9-faaf-46cc-911b-c6b899f3b444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-892679017", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:53.762675 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d3e7d93-cc09-48fc-a2cc-6963dd61ffc3 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1215 microversion: 2.1 time: 0.180545 Oct 06 12:59:53.763277 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1250/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:53 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-413fddd9-faaf-46cc-911b-c6b899f3b444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 234 Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:53.765945 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:53.767155 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-892679017", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-892679017', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:53.767768 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:53.768842 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 06 12:59:53.770126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:53.771698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-413fddd9-faaf-46cc-911b-c6b899f3b444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:53.771698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-413fddd9-faaf-46cc-911b-c6b899f3b444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014709 Oct 06 12:59:53.777299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:53.778010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:53.781094 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1219/2469] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:53 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 12:59:53.784712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.784870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.785305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.786226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:53.793802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:53.795713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:53.977590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:53.987466 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-516d03c3-8e7b-4bed-ae67-3613f6d1e740 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.214351 Oct 06 12:59:53.989375 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1251/2470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:53 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:54.014316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.015187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.022134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.022882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.023533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.024253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.024716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.025165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.203934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.214494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4466c72f-0617-49b9-b246-aeae36665d64 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.203908 Oct 06 12:59:54.214991 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1220/2471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:54.237436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:54.238011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: fbc25f26-4bbf-4d6f-a5f1-07c04fadef30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.245642 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/fbc25f26-4bbf-4d6f-a5f1-07c04fadef30/action HTTP/1.1 Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 13 Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 12:59:54.251573 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: {"pause": {}} Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. Oct 06 12:59:54.252879 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'fbc25f26-4bbf-4d6f-a5f1-07c04fadef30', 'body': {'pause': {}}} Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:54.253778 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 12:59:54.255665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance fbc25f26-4bbf-4d6f-a5f1-07c04fadef30 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:54.257104 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44daa69f-073f-4b5e-a299-ac8d1d01eecc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/fbc25f26-4bbf-4d6f-a5f1-07c04fadef30/action" status: 404 len: 111 microversion: 2.1 time: 0.019857 Oct 06 12:59:54.257457 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1252/2472] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:54 2022] POST /compute/v2.1/servers/fbc25f26-4bbf-4d6f-a5f1-07c04fadef30/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:54.262833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.263650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.271509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.271949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.272397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.273105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.273616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.274109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.390541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.391728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.399267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.400026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.401625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.402635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.403246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.403839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.490222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.492499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.503707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.506188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.507001 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fcb01265-eee2-4b00-8585-9fa1bbb86edd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.247772 Oct 06 12:59:54.507704 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1221/2473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:54.509179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5de65f6-3c0a-4cd4-a807-10e354168689 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.131021 Oct 06 12:59:54.510072 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1253/2474] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:54.540052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.541217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.557041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.560133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.560934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.561909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.562686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.564739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.603064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.604887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.614662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.615202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.615699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.616417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.616945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.618828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.749642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.759911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.762666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.770932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79e64614-0f80-4c26-8e3e-50add7d123ca tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.179653 Oct 06 12:59:54.772242 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1254/2475] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:54.779345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.780343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.788251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.789368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.790076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.791071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.792318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.793279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.832356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:54.843935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-892970d5-52f5-4389-a53d-acc848de954c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.311434 Oct 06 12:59:54.844530 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1222/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:54.850031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:54.850899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:54.859853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.860798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.861473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.864654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:54.866566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:54.867287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:54.992649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.001171 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0124a306-b793-4853-9bdf-15c42bb48586 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1267 microversion: 2.1 time: 0.155038 Oct 06 12:59:55.015667 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1223/2477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:55.016999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.024531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:55.026903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:55.034651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.034884 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c80d7d9b-2751-447a-8a92-148f201737a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1317 microversion: 2.1 time: 0.259379 Oct 06 12:59:55.035522 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1255/2478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:54 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:55.036118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.036825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.037695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.038318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.038878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.144069 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee55b596-4402-4cd4-8c07-41e19e49af92 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.127078 Oct 06 12:59:55.145015 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1224/2479] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:55 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:55.165687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:55.169359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:55.195707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.196280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.196723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.201360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.203043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.203735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.397037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.407636 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-55bd5517-6c53-4edb-9ad5-ec453e6d7e5e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1510 microversion: 2.1 time: 0.258556 Oct 06 12:59:55.412641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-538321703", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:55.419370 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1256/2480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:55 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:55.500366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 12:59:55.610036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:55.610674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:55.620512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.621012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.621463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.622220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.622680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.623104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.727856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.741373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.743099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.744524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41beb8fd-5868-4373-9324-4fdc9e2e1f97 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.140045 Oct 06 12:59:55.745835 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1257/2481] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:55 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:55.780712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:55.781151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:55.781670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:55.782154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:55.782581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:55.795323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.795766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.796220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.796968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.797433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.797898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.800539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:55.801347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:55.818251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Getting quotas for project 7ec72636dea9428ca82392552f8bf5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 12:59:55.819460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.820114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.820644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.821714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:55.822071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:55.824423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:55.825003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:55.828020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Getting quotas for user bffe6199a46f4191a20ba08904b17dae and project 7ec72636dea9428ca82392552f8bf5e8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 12:59:55.846554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 12:59:55.850748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 12:59:55.909121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-746a390c-4e49-4191-ac02-fae8ec1fc24c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731998 Oct 06 12:59:55.912360 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1225/2482] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 12:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 12:59:55.922386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.933412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ae50f23-8445-4aab-a245-d9d36494e1c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:55.939888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ae50f23-8445-4aab-a245-d9d36494e1c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:55.943940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.945524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:55.959175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f119bd0-cf46-4565-81b5-f932c856a827 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.162355 Oct 06 12:59:55.962186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1258/2483] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:55 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 12:59:56.019873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ae50f23-8445-4aab-a245-d9d36494e1c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:56.029103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:56.029704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.042623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ae50f23-8445-4aab-a245-d9d36494e1c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1222 microversion: 2.1 time: 0.117440 Oct 06 12:59:56.044491 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1226/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:55 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:56.045599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.049768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.050296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.050964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.051423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.051883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.065061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:56.065686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.072658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.074057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.074750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.075636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.076252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.076842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.101885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:56.196722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:56.242123 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1363fa87-b2a3-4fa3-9c0a-7403b005b9ae tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1275 microversion: 2.1 time: 0.212250 Oct 06 12:59:56.263399 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1259/2485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:56 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:56.325200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:56.341785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fb953746-a7ab-433d-b3d0-2a7e502804fd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1508 microversion: 2.1 time: 0.280614 Oct 06 12:59:56.342385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1227/2486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:56 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:56.364321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:56.365777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.377623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.378306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.379172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.381661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.382304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.382942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.432894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:56.433953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.447807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.449127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.449575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.450326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.450785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.451437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.676021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:56.692800 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f54dad29-1f05-42b6-91c9-8fe305b4d746 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1508 microversion: 2.1 time: 0.330542 Oct 06 12:59:56.693946 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1260/2487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:56 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:56.723222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:56.726971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.743596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.744503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.745804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.748442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.750864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.754660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.858179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:56.867792 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04dbeb29-7841-4628-a12a-d1545ce45328 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1490 microversion: 2.1 time: 0.439847 Oct 06 12:59:56.875379 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1228/2488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:56 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1490 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:56.889069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:56.890119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:56.907535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.908049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.908497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.909230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:56.909688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:56.910210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:56.911529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 12:59:56.914140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 12:59:56.915437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 12:59:56.917465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 12:59:56.924108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 12:59:57.009542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.024273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.026796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.028346 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad6adb18-5a4f-4009-8274-40dc247bf92e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.151731 Oct 06 12:59:57.029520 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1229/2489] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:56 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:57.035102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:57.035904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.044025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.044765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.045401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.046384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.047065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.047646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.063570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.080077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.081251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.082115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.082959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.083495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.084696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.084810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'pause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state paused Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 13 Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 12:59:57.086719 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: {"pause": {}} Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:57.088064 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'pause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state paused Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'pause': {}}} Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state paused. Cannot pause while the instance is in this state. Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:57.088850 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state paused Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state paused Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:57.089987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'pause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state paused {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:57.091398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-349704c4-4c95-4a83-adef-0c306cadc536 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 143 microversion: 2.1 time: 0.058195 Oct 06 12:59:57.092897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1230/2490] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:57 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 143 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 12:59:57.100551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:57.101253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.109827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.110375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.111009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.111777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.112294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.112780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.124576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-35662d09-bf4e-4919-ab0c-53c3b3b4f11e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "POST /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262/action" status: 202 len: 1110 microversion: 2.1 time: 0.408723 Oct 06 12:59:57.138579 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1261/2491] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:56 2022] POST /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262/action => generated 1110 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 06 12:59:57.150240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:57.151301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.159355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.160312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.161498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.162502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.163345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.174277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.212404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.219152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:57.236186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.239236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.273824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43afb6dc-a6a2-418b-9804-d8599601a439 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.179495 Oct 06 12:59:57.280022 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1231/2492] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:57 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:57.302602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.303136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:57.303690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.310092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.310594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.311219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.312239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.312964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.313574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.314969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dfb1704d-4335-4e90-af9e-2ad0c5a504b6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1274 microversion: 2.1 time: 0.175252 Oct 06 12:59:57.315921 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1262/2493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:57 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:57.329547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:57.334728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.342493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.343005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.353110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.353961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.355035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.355485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.404447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-829b22ef-4f66-4c7e-8ec7-a3f57decb165 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.122821 Oct 06 12:59:57.408113 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1232/2494] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 12:59:57 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 12:59:57.416014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:57.417287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.443860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.445028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.445487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.446865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.447383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.448347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.540392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:57.549390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-392d297c-d95f-4815-86b9-98f7a05c5774 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.232129 Oct 06 12:59:57.550027 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1263/2495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:57 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:57.562753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:57.563385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:57.579017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.579981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.579981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:57.580666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:57.581585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:57.581585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.037194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.050702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b9ee13b-ba9e-4c77-a6cc-dfbfb26f7092 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.638789 Oct 06 12:59:58.051614 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1233/2496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:57 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:58.061660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "23c24db8-d774-4a62-9079-04458a13bf05"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:58.067426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:58.077934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.078944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.079584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.083908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.086929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.091341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.112550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.121663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d6f26ad-4646-4c23-b583-65cdfcc94654 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1497 microversion: 2.1 time: 0.570715 Oct 06 12:59:58.125591 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1264/2497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:57 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1497 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:58.136288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:58.138324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:58.152637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.155162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.157341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.159008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.159724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.160637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.190153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] HTTP exception thrown: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Request method failure captured: Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1/os-volume_attachments/a0f11d46-3ebe-439e-955d-402f5d02cfcd HTTP/1.1 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 74 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtCfYjitHU3dobPb23axECVyL-xLGhbLlzMPnrTVIfDpDo4fI6NCUQ3T_Ic9n7rCseBk5sveMbreGif6gixhUIIev7Ln4CQD6ve-JQbpGj5Mg0eFlcIP-Nko_z4QvsdpZ0StHmB9HWG2MTczUJkjGzT7rdSgZoC03A4JRaVORqDq_9I Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f0e9319713f0429982ed3ee77a05bf45 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 12:59:58.197024 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0e9319713f0429982ed3ee77a05bf45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e9319713f0429982ed3ee77a05bf45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0e9319713f0429982ed3ee77a05bf45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e9319713f0429982ed3ee77a05bf45"}]}] Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f0e9319713f0429982ed3ee77a05bf45 Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1166568662 Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesAdminNegativeTest-1166568662-project-admin Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6db41147b4ee4fce91f2b37430118596 Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesAdminNegativeTest-1166568662-project-admin Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: {"volumeAttachment": {"volumeId": "23c24db8-d774-4a62-9079-04458a13bf05"}} Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 12:59:58.199385 n-d-860556-1 devstack@n-api.service[129614]: exception: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '92e05880-0af6-4654-97bd-6293cb59a9a1', 'id': 'a0f11d46-3ebe-439e-955d-402f5d02cfcd', 'body': {'volumeAttachment': {'volumeId': '23c24db8-d774-4a62-9079-04458a13bf05'}}} Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:59:58.200230 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. (HTTP 404) (Request-ID: req-143846cd-f1a7-4c7d-b0d5-06014658ecbb) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 12:59:58.201207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 12:59:58.203843 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. Oct 06 12:59:58.206091 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 12:59:58.212072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] Returning 404 to user: Volume a0f11d46-3ebe-439e-955d-402f5d02cfcd could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 12:59:58.213192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c28b835-128d-4011-a94c-fa0a14420640 tempest-VolumesAdminNegativeTest-1166568662 tempest-VolumesAdminNegativeTest-1166568662-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1/os-volume_attachments/a0f11d46-3ebe-439e-955d-402f5d02cfcd" status: 404 len: 109 microversion: 2.1 time: 0.160418 Oct 06 12:59:58.215514 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1234/2498] 10.222.0.26 () {60 vars in 1433 bytes} [Thu Oct 6 12:59:58 2022] PUT /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1/os-volume_attachments/a0f11d46-3ebe-439e-955d-402f5d02cfcd => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 12:59:58.316863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:58.319577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:58.329099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.335270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.338390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.339400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.344472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.347515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.348789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.349918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.351704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.354612 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9b945b9-36d1-431f-94f2-8a85f22b21dc tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.227637 Oct 06 12:59:58.358913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1265/2499] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:58 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:58.369003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:58.371261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:58.389398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.392093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.393917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.394832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.397623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.397965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.537090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.555345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.555787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.558109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.563753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0088971f-e549-490b-a12f-7a6a597cb589 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.262634 Oct 06 12:59:58.566328 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1235/2500] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:58 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:58.569021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d88b144e-8a65-47f3-9785-85f9d4d359fd tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1280 microversion: 2.1 time: 0.204594 Oct 06 12:59:58.582442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:58.583337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:58.586795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1266/2501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:58 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:58.594538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.595070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.595627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.606000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:58.606777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:58.607253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:58.938429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:58.953195 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ae5aad0-7e85-4cdd-8f02-47f6e9c3dc80 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.380320 Oct 06 12:59:58.957120 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1236/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:58 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:59.085964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.086710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.100111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.100774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.101834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.102807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.106374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.107111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.148854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.150210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.162120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.163019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.164983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.166030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.169396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.170276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.221157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=13 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:59:59.548491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.556748 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c6fc4c7-f4f5-42e9-8f23-16eec8e6154a tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.475679 Oct 06 12:59:59.557282 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1267/2503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:59.569027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.570548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.572166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.584958 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51494887-8ccb-4069-a67c-fe7e86301969 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.440350 Oct 06 12:59:59.588334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.589662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.590573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.591476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.601806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.602693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.606522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1237/2504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 12:59:59.620518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb6b39e-2549-4cb7-b92d-ef831a5e2c91", "tag": "62f693b0-5327-4ba6-acce-b8ce6b787c19"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 12:59:59.643299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.643791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.644238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.665495 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] Creating event network-changed:62f693b0-5327-4ba6-acce-b8ce6b787c19 for instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 on n-h2-860556-1 Oct 06 12:59:59.677704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-30b35238-0ff0-403f-9143-a7fb370382d2 req-6203af4d-bef4-45be-afba-e0a68b37ac66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069914 Oct 06 12:59:59.680657 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1238/2505] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 12:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 12:59:59.686517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.692210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.692934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.701819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.704135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.706871 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61a9312a-ea48-4121-8548-b4c08e316652 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.140937 Oct 06 12:59:59.720515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.720515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.720515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.720515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.720994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.720994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.731928 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1268/2506] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:59.747059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.747935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.767539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.770457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.774761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.777130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.777811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.778266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.829178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.838486 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9da0b7df-b60d-481d-8654-52da1912b184 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1280 microversion: 2.1 time: 0.156138 Oct 06 12:59:59.840377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1239/2507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 12:59:59.846793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.847805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.854739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.855563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.856197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.857481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.858373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 12:59:59.858970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 12:59:59.887257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.902264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.909841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 12:59:59.920372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8cd2f27-bd4a-413b-b373-6f69a7fc13e2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.181468 Oct 06 12:59:59.923694 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1269/2508] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 12:59:59.986261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 12:59:59.986822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 12:59:59.998995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 12:59:59.999740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.000360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.002929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.003420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.003861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.354776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:00.368668 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df1c4139-9f73-4e07-8928-f56488ad466a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.526677 Oct 06 13:00:00.369266 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1240/2509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:00.377940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:00.383369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b80dcafb-c155-4cb0-b6f4-8cdd138e9f9d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.402155 Oct 06 13:00:00.383958 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1270/2510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 12:59:59 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:00.442572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:00.444934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:00.457522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.458174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.458630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.460992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.460992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.464220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.495683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action HTTP/1.1 Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 28 Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:00.499417 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: {"reboot": {"type": "SOFT"}} Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:00.500786 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e5e28c2e-5721-485c-bafe-4201f690bb65', 'body': {'reboot': {'type': 'SOFT'}}} Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:00.501534 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:00.503143 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:00.504261 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:00.504261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:00.504261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-83eff20c-6a4c-4655-841f-2f9d8dace9dd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action" status: 404 len: 111 microversion: 2.1 time: 0.062308 Oct 06 13:00:00.504261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1241/2511] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:00 2022] POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:00.512174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:00.512875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:00.519765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.520265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.520710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.521424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.521942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.523075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.593633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:00.594300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:00.601621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.603175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.603845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.605395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:00.606251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:00.606913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:00.972097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:00.985269 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ef667b0-fb17-4f7c-8df0-bc5d73b36d57 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.477270 Oct 06 13:00:00.986872 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1271/2512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:00 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:00.995874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:00.996857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.009300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.011113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.011737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.017166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.019465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.019900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.068080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.081060 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f93c0698-0f23-462d-8c7a-2b18beedf42b tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.501354 Oct 06 13:00:01.084655 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1242/2513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:00 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:01.097850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.099942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.109005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.109925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.110617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.111572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.112382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.113038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.123079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.136193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.138102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.139841 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78d9ff5a-5c4a-4444-a5a2-a0b57b328a92 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.150843 Oct 06 13:00:01.141841 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1272/2514] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:00 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:01.165350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.166354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.173217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.173990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.175148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.176139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.177058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.177731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.334047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.336841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:01.362995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.364907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.371912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8895683d-4e66-4b7b-a4df-7eaecde14879 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.228136 Oct 06 13:00:01.372094 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1273/2515] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:01.376658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.377282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.384044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.384613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.385001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.386254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.386718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.387147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.591327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.603875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa3d7e15-70a0-420f-9155-3c80edb739a4 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.514743 Oct 06 13:00:01.605781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1243/2516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:01.610938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.611807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.619550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.621211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.622383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.623799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.624489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.625433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.672710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.683873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81d4686e-a474-4fa1-a5e0-3900f77d4f5c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.310455 Oct 06 13:00:01.701468 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1274/2517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:01.706847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.711466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.719040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.719867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.721352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.722627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.723469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.724191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.751313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:01.872127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61076c25-82ee-444e-9385-4578cc3b34f2 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "DELETE /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 204 len: 0 microversion: 2.1 time: 0.168371 Oct 06 13:00:01.873637 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1275/2518] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:01 2022] DELETE /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:01.882749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:01.886833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: dabb1dd7-ce4d-437b-b0c4-35432c41b394] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.893464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/dabb1dd7-ce4d-437b-b0c4-35432c41b394/action HTTP/1.1 Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 28 Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:01.896423 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: {"reboot": {"type": "SOFT"}} Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:01.897968 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dabb1dd7-ce4d-437b-b0c4-35432c41b394', 'body': {'reboot': {'type': 'SOFT'}}} Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:01.898728 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. Oct 06 13:00:01.899861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:01.901883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:01.903227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance dabb1dd7-ce4d-437b-b0c4-35432c41b394 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:01.904314 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6fc57c8-c182-4257-bd7f-c07c52c5bbdc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/dabb1dd7-ce4d-437b-b0c4-35432c41b394/action" status: 404 len: 111 microversion: 2.1 time: 0.028110 Oct 06 13:00:01.905492 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1276/2519] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:01 2022] POST /compute/v2.1/servers/dabb1dd7-ce4d-437b-b0c4-35432c41b394/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:01.910671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.911556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.914833 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bad4b087-13e1-43b7-bea9-b7884abc7790 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.307670 Oct 06 13:00:01.919633 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1244/2520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:01.926903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:01.927526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:01.931821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.933448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.934187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.935006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.935574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.936149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.954798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.955549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.957194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:01.957599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:01.958343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:01.958600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.266975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.270230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.283390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0b94565-61f5-44d0-a138-83ffe8fe482b tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1513 microversion: 2.1 time: 0.376502 Oct 06 13:00:02.283706 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56ae4a94-0eae-4d96-ba20-2fa72b3f1431 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.360695 Oct 06 13:00:02.302212 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1245/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:02.302967 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1277/2522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:01 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:02.309970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.310837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.316337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.318601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.321326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.322030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.328926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.329631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.330095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.330811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.331272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.331699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.336121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.336981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.337471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.337937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.457412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.468765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.470289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.471693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b05bfc18-463f-40ad-b736-8cd2bcec8fa6 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1604 microversion: 2.32 time: 0.167414 Oct 06 13:00:02.472996 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1278/2523] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:02.478276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e1a287-ca95-4127-b45d-76409bc9ecb4", "tag": "e7912191-20df-448f-ad7d-dfc8d02d55a2"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:02.490472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.490959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.491398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.506167 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] Creating event network-changed:e7912191-20df-448f-ad7d-dfc8d02d55a2 for instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 on n-h1-860556-1 Oct 06 13:00:02.511165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-66cf0373-4f58-4fea-80db-ac86772145d4 req-88e11dc4-235f-468c-9a92-f9c20fe762cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037003 Oct 06 13:00:02.511783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1279/2524] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:02.517458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.518193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.524999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.525492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.526266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.527010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.527473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.527913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.547068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.556724 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c467f81-c1a4-4bfd-92a0-021f3354f7c7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.252598 Oct 06 13:00:02.558103 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1246/2525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:02.568039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.568844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.584225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.585517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.586224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.587543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.588349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.589577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.685552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.707823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.709805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.716437 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27c4580e-ee76-4b5d-9bf2-e105559f2e6f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.157491 Oct 06 13:00:02.717065 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1247/2526] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:02.730109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.738411 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-152e2224-8eef-40d7-8511-842a4728350c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.225382 Oct 06 13:00:02.741777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1280/2527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:02.741935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.742368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.749780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.750399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.751142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.751865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.752325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.752758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.761560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:02.764426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.770781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.771281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.772150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.772442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.772886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.773313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.790023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action HTTP/1.1 Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 65 Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:02.791712 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:02.792968 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e5e28c2e-5721-485c-bafe-4201f690bb65', 'body': {'rebuild': {'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2'}}} Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:02.793722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:02.795600 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6888e6d-825a-4b62-b8d2-5dd78a7dbabb tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action" status: 404 len: 111 microversion: 2.1 time: 0.036261 Oct 06 13:00:02.797646 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1281/2528] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:02 2022] POST /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:00:02.812460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.814708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.826839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.827627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.828124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.829393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.829886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.830410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.949265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:02.958658 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef521be2-e787-484c-bea0-bf9fd93ea5c2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.227336 Oct 06 13:00:02.966070 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1248/2529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:02.978597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:02.979797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:02.988027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.988576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.989040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.989944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:02.990968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:02.991414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:02.997431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:03.051279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.062810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51d9b7cf-50ca-4487-874d-f4c6f2414c5b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.264317 Oct 06 13:00:03.078084 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1282/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:03.087693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.088864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.096798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.097302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.097771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.098639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.099110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.099546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.160956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.169420 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c1c1132-85bf-4030-a25d-f79003606d61 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.201951 Oct 06 13:00:03.170542 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1249/2531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:02 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:03.263970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.272463 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b1748aa-4f3b-4961-ad5c-06b419bb5a35 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.188597 Oct 06 13:00:03.273073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1283/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:03.297377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:03.300620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 08eb7ee9-5182-4733-aa61-40d6d64d82f8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.306241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/08eb7ee9-5182-4733-aa61-40d6d64d82f8/action HTTP/1.1 Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 65 Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:03.308082 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:03.309551 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '08eb7ee9-5182-4733-aa61-40d6d64d82f8', 'body': {'rebuild': {'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2'}}} Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:03.310357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:03.311453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 08eb7ee9-5182-4733-aa61-40d6d64d82f8 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a3f1b5b-f8c5-4a09-8e2e-fe735793575f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/08eb7ee9-5182-4733-aa61-40d6d64d82f8/action" status: 404 len: 111 microversion: 2.1 time: 0.016932 Oct 06 13:00:03.312679 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1250/2533] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:03 2022] POST /compute/v2.1/servers/08eb7ee9-5182-4733-aa61-40d6d64d82f8/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:03.316359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.316989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.319252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.319871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.323652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.324236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.324692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.325406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.325913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.326348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.328170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.328666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.329302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.330145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.332413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.333035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.550661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.558172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.558965 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d13f506-5fa0-4fd9-bc9b-c169b31ae2ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.243803 Oct 06 13:00:03.559534 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1251/2534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:03.564204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.564893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.566660 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2eedb607-9351-4fab-bd6d-cc26fd218dfa tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1513 microversion: 2.1 time: 0.254449 Oct 06 13:00:03.567469 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1284/2535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:03.571126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.571684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.572123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.572853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.573888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.574322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.580911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.581959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.588476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.588962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.589402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.590125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.590813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.591237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.611921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.612405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.612842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.613292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lazy-loading 'fault' on Instance uuid 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:03.681721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.707849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.709338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76bc81cc0db047fe926e1d1c211a2a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441d9683a1d479bbd90ca094cac3bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:03.711225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c74e27ac-be46-450b-9432-3d2d14302193 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 200 len: 1609 microversion: 2.32 time: 0.150474 Oct 06 13:00:03.722358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1252/2536] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 1609 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:03.736702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:03.737332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:03.745415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.745951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.746474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.747255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:03.747948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:03.749195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:03.754927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:04.272097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.283239 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e555551-9bb2-4e6d-9295-b33fa502e1f8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.706896 Oct 06 13:00:04.291569 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1285/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:04.307331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:04.308202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.314976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.315700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.316149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.316862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.317357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.318024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.441520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.449630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.451101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.456132 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-166ce635-950b-4aee-ad68-207d4980beae tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.152765 Oct 06 13:00:04.456917 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1286/2538] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:04 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:04.474479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:04.475429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.480751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.489660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.489807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e082e064-7a54-4129-8039-55891eaca1c0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.756664 Oct 06 13:00:04.490189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.490631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.491444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.491927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.492329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.497259 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1253/2539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:03 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:04.511693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:04.512539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.523859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.524365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.524816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.526453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.526940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.527601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.897003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.907693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b87a5029-4d4e-4c1a-a806-a8facfe24eff tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.402533 Oct 06 13:00:04.908889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:04.922523 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1254/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:04 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:04.929815 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-547311cc-d41e-4723-b7b6-fb52b8b99251 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.458345 Oct 06 13:00:04.930128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:04.930937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 7cce04d6-e6d4-4c91-a644-899287025086] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.931560 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1287/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:04 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:04.938131 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/7cce04d6-e6d4-4c91-a644-899287025086/action HTTP/1.1 Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 15 Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:04.940215 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: {"restore": {}} Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:04.943169 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '7cce04d6-e6d4-4c91-a644-899287025086', 'body': {'restore': {}}} Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:04.944741 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:04.947123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 7cce04d6-e6d4-4c91-a644-899287025086 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:04.948682 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1f6db03-0c96-44a8-b6cb-c3de765d729e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/7cce04d6-e6d4-4c91-a644-899287025086/action" status: 404 len: 111 microversion: 2.1 time: 0.019491 Oct 06 13:00:04.948682 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1255/2542] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:04 2022] POST /compute/v2.1/servers/7cce04d6-e6d4-4c91-a644-899287025086/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:04.955309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:04.956108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:04.957592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.958354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:04.967499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.968013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.968697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.969659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.970371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.971018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.971531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.972340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.973323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:04.974714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:04.975950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:04.977177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.011967 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbf67472-6388-4e2e-8538-a3bb4485d720 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061069 Oct 06 13:00:05.021830 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1256/2543] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:00:04 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:05.021830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.021830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.026672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.027312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.027870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.028812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.029383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.029961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.045012 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] HTTP exception thrown: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Request method failure captured: Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e HTTP/1.1 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_GF0P8kqEjNmvFHliaXH2ayScaOMNxpO75N1nRU-7mo4wGwBXW2--_OK5Uf_C0MffvFOiCazAAJT76zq0NJ-VATXg13bcY38lEzfVLVqLZUgCc1oa0MuzYSZOS2MJGTM3ioW0rfdmZo0UK-WCnymGufuGwbWyTVwtUBD0ikKbQP-I Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.32 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:05.047023 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f441d9683a1d479bbd90ca094cac3bac", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}] Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 76bc81cc0db047fe926e1d1c211a2a56 Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:05.048322 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e'} Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:05.049031 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:05.050191 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:05.052625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Returning 404 to user: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:05.053832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f3694ec3-5800-4f1f-9a03-072a3f1bc382 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 404 len: 111 microversion: 2.32 time: 0.040028 Oct 06 13:00:05.054941 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1257/2544] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:05.063341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.064112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.070165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.070637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.071080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.071783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.072239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.072724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.479616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.481962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.491499 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5b0523e-ae0a-4f3f-969e-9a5c951ac635 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1513 microversion: 2.1 time: 0.556661 Oct 06 13:00:05.501799 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1288/2545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:04 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:05.501999 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1fb4d5ad-12da-42ae-ae60-524816768467 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.437050 Oct 06 13:00:05.501999 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1258/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:05.502203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.502203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.508421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.509092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.509710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.511093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.511680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.512574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.514080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4fdd82fc-4ef7-40cf-b5f9-0da246b8b982 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '.version_select at 0x7f7d3f1d1ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.564760 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4fdd82fc-4ef7-40cf-b5f9-0da246b8b982 tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724958310" status: 204 len: 0 microversion: 2.32 time: 0.066850 Oct 06 13:00:05.569391 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1259/2547] 10.222.0.26 () {60 vars in 1259 bytes} [Thu Oct 6 13:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724958310 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:00:05.584333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.585770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.598255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.598498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.598923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.604530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.605096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.605529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.659045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lazy-loading 'services' on Instance uuid f9939237-2dc6-4099-bf94-a1851974517b {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:05.758609 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f73d3f2-0006-4ecf-ab4c-c2a12ce1f433 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments/bc7952b3-2caf-4b80-9886-aaceaf125906" status: 202 len: 0 microversion: 2.1 time: 0.264656 Oct 06 13:00:05.759636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1289/2548] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:00:05 2022] DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments/bc7952b3-2caf-4b80-9886-aaceaf125906 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:05.765837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e05880-0af6-4654-97bd-6293cb59a9a1", "name": "network-vif-deleted", "tag": "265f5185-2670-46ee-9878-d3d0ec95adaa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:05.772312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:05.778029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.778519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.778967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.798630 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] Creating event network-vif-deleted:265f5185-2670-46ee-9878-d3d0ec95adaa for instance 92e05880-0af6-4654-97bd-6293cb59a9a1 on n-h1-860556-1 Oct 06 13:00:05.804305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-22222dd5-096b-4d5b-ace4-e7f0f185811c req-866b6e45-ab7b-4ee9-aac8-33f35473753b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043006 Oct 06 13:00:05.805087 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1290/2549] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:05.810929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.811456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:05.811705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.819106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.819608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.820056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.820775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.821239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.823981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.832716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:05.861029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.868859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0613fb40-eb7c-4ac9-9d96-a8b230e7bbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.302435 Oct 06 13:00:05.869705 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1260/2550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:05.886160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.886916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.897319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.898510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.899184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.900390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.902066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.902739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.935468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.945190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.946710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:05.953525 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4543f4d1-b8b9-43ed-add8-9f95d75e6713 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.147398 Oct 06 13:00:05.966988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1291/2551] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:05.981190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:05.982106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:05.989495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.990253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.990960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:05.991858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:05.992475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:05.993062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.024042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:06.124583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.137628 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-008ea498-8332-4f87-a3ab-820e65f58e6e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.267043 Oct 06 13:00:06.138563 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1261/2552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:06.165183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.167797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.175434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.175948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.176399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.177827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.178313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.178749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.203536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.213219 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fada8dff-7036-4433-b959-f4bc3def9827 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.244992 Oct 06 13:00:06.229766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1292/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:05 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:06.234875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:06.235438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.242699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.243420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.244007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.245318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.246161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.246774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.280470 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'restore' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 15 Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:06.282640 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: {"restore": {}} Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:06.284104 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'restore' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'restore': {}}} Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state active. Cannot restore while the instance is in this state. Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:06.284988 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:06.286375 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.288352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'restore' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:06.289374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60fddffc-a7a3-45b9-92c4-de1c70680d9e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 145 microversion: 2.1 time: 0.058532 Oct 06 13:00:06.290521 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1293/2554] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:06 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:00:06.299502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.300446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.308337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.309102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.309697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.310721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.311470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.312112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.356671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.365883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dbc7236c-ac6c-468d-adc5-63082617654b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.208555 Oct 06 13:00:06.367695 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1262/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:06.515970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.516601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.517284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.524415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.524908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.525349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.525992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8bbab586-371d-43c1-bead-c9ab659d04a5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.231169 Oct 06 13:00:06.526449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.527210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.527879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.556920 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1294/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:06.567909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.568699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.569062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.569180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.569521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lazy-loading 'fault' on Instance uuid 92e05880-0af6-4654-97bd-6293cb59a9a1 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:06.569723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.579094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.579593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.580043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.580748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.581204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.581633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.699993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.710168 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-579b8e96-4261-4caf-a204-6aa12ed26124 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 200 len: 1308 microversion: 2.1 time: 0.198225 Oct 06 13:00:06.710900 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1263/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:06.837588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb6b39e-2549-4cb7-b92d-ef831a5e2c91", "name": "network-vif-plugged", "status": "completed", "tag": "62f693b0-5327-4ba6-acce-b8ce6b787c19"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:06.846519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:06.852157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:06.866111 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c67ea40b-f758-43b4-bd91-42ccb9275444 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.307317 Oct 06 13:00:06.877954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1295/2558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:06.878188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.878188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.878188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.892867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.893798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.901966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] Creating event network-vif-plugged:62f693b0-5327-4ba6-acce-b8ce6b787c19 for instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 on n-h2-860556-1 Oct 06 13:00:06.904058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.904927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.905763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.907566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.908229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.910180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.915541 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8c23b975-ed47-4e43-8c0d-4c774ce69f26 req-6cdb4dac-b604-49ea-9f46-2e140f0b1401 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082241 Oct 06 13:00:06.916483 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1264/2559] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:06.930416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:06.931406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 25b1c273-54d4-4579-8c53-d035ff6409cf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.938262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/25b1c273-54d4-4579-8c53-d035ff6409cf/action HTTP/1.1 Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 14 Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:06.946160 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: {"resume": {}} Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:06.948207 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '25b1c273-54d4-4579-8c53-d035ff6409cf', 'body': {'resume': {}}} Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:06.949198 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:06.950551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 25b1c273-54d4-4579-8c53-d035ff6409cf could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:06.951467 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b13f01de-77e7-46cd-8401-8a9d292222a4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/25b1c273-54d4-4579-8c53-d035ff6409cf/action" status: 404 len: 111 microversion: 2.1 time: 0.032632 Oct 06 13:00:06.951467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1265/2560] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:06 2022] POST /compute/v2.1/servers/25b1c273-54d4-4579-8c53-d035ff6409cf/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:06.959511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:06.960496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:06.970386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.970880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.971496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:06.972203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:06.972660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:06.973089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.257027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.262124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.269128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a425b5a9-c161-4601-8177-c51e1951f5ad tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.380348 Oct 06 13:00:07.270209 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1296/2561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:07.278580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5cb1861-2aff-429c-82ee-6b30aec54a48 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.323215 Oct 06 13:00:07.279478 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1266/2562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:06 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:07.284147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.285464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.292609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.293232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.293987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.294746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.295337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.295776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.301361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.302240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.313687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.314394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.315256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.316361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.317055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.318285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.402976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.415917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.417999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.424011 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0648c354-bae9-4ec9-a559-8e9caa3abf4f tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.152514 Oct 06 13:00:07.425190 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1297/2563] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:07.430125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.431049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.437332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.438120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.438776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.439709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.440398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.441055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.613215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.624432 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02ddbb26-e3e8-4c54-af17-37a71b8204f6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.343815 Oct 06 13:00:07.638855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1267/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:07.646684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.647886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.649626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.656412 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2a58b18-239e-4fc4-b77c-ec02d6cb74f0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.229886 Oct 06 13:00:07.657586 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1298/2565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:07.662769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.663275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.663726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.664444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.664909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.665346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.681591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:07.682663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.689338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.690199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.691291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.693490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.694768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.715662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.773638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'resume' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 14 Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:07.775482 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: {"resume": {}} Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:07.777551 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'resume' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'resume': {}}} Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state active. Cannot resume while the instance is in this state. Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:07.778319 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:00:07.782896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.783864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'resume' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:07.783864 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3de8db54-45d6-40d0-bf1f-051c6f39d38a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 144 microversion: 2.1 time: 0.101200 Oct 06 13:00:07.783864 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1299/2566] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:07 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 144 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 06 13:00:07.783864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.784121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: 92e05880-0af6-4654-97bd-6293cb59a9a1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.802917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.803487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.803947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.814552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.815053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.816617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.840700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] HTTP exception thrown: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Request method failure captured: Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 HTTP/1.1 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtCLGG6AKHEUKvXUhQCh7BTvgLuyJmWS5Z5-2qw9YVwjrsO1wfPGjb_yRtmVPOztnocb5jwPEjpIAOmmqhw82I_ncgtsZGaDRoemkfmyyListaeMYdstHyMaBOKUVio8QAoo2TscKy99jTW6etRUZfXcHG3g5cY40jBNFHxZDTq4Dro Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 9bb9c2997ff14b6b92702ea515b119c0 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:07.842868 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bb9c2997ff14b6b92702ea515b119c0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bb9c2997ff14b6b92702ea515b119c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bb9c2997ff14b6b92702ea515b119c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bb9c2997ff14b6b92702ea515b119c0"}]}] Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 9bb9c2997ff14b6b92702ea515b119c0 Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesAdminNegativeTest-526628732-project Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 98ac89cfe31446eeaec958ae0acaf663 Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesAdminNegativeTest-526628732-project Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. Oct 06 13:00:07.844162 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '92e05880-0af6-4654-97bd-6293cb59a9a1'} Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:07.844896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. Oct 06 13:00:07.846658 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:07.848185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Returning 404 to user: Instance 92e05880-0af6-4654-97bd-6293cb59a9a1 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:07.848185 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8939523d-db49-466b-a246-7e6e22b5769d tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1" status: 404 len: 111 microversion: 2.1 time: 0.064714 Oct 06 13:00:07.848467 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1300/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/92e05880-0af6-4654-97bd-6293cb59a9a1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:07.855371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:07.856007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:07.863915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.864418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.864863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.865748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:07.873368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:07.873879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:07.946689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:07.956965 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-13c588dd-24d9-406b-a7f9-4a4fc3568aa8 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.314932 Oct 06 13:00:07.959579 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1268/2568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:08.068429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.078487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89fff6a1-14b6-40de-8db8-6e211869ad4a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.229127 Oct 06 13:00:08.094508 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1301/2569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:07 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:08.105477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.105825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.112599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.113579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.113951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.115000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.115625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.116217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.294351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.294986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.303212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.304191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.305160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.306228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.306930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.307630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.355129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.368590 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7de2447-798c-4621-96d3-3899dfce46b4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.268484 Oct 06 13:00:08.369529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1269/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:08.459700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.460336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.473611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.474185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.474654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.475376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.475845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.476276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.525999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:08.582070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.593024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3932e1c-4e7c-4dfa-b2e4-01b7f5424ebb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1315 microversion: 2.1 time: 0.302935 Oct 06 13:00:08.593547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1302/2571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:08.598636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80c83d84-ff5a-4d32-b673-9d7aec148990 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80c83d84-ff5a-4d32-b673-9d7aec148990 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 160 Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:08.602604 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c5b6f957-7498-46d4-a4e2-e8b965536ea0"}]}} Oct 06 13:00:08.604816 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': '', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'networks': [{'uuid': 'c5b6f957-7498-46d4-a4e2-e8b965536ea0'}]}}} Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '' Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:08.605538 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:00:08.606858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:00:08.607997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:00:08.607997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:08.609694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80c83d84-ff5a-4d32-b673-9d7aec148990 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:08.610772 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80c83d84-ff5a-4d32-b673-9d7aec148990 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016056 Oct 06 13:00:08.611343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1303/2572] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:00:08 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:08.621430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.622185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.624746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.629545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.630712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.631388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.632315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.633086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.633842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.637378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.639261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.644736 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9247119b-c9e0-4301-9e05-40c609a232aa tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.189719 Oct 06 13:00:08.645698 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1270/2573] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:08.662654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.663285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.675181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.675994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.676627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.677382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.678049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.678656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.922482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.935883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-722b7d32-9c5d-46fc-9823-9f9bcc750c15 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.276928 Oct 06 13:00:08.946837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1271/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:08.968173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:08.976617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30c18768-d2af-41ef-b09a-ff3e5731f82d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.360543 Oct 06 13:00:08.977449 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1304/2575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:08.984401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:08.985020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:08.995764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:08.996265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:08.998734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:08.999678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.005679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.007751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.008249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.012002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.039191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.039703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.040178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.040884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.041375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.044620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.382152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.393169 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7c12aba-5582-4099-ba54-1b55c9ace56c tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.412498 Oct 06 13:00:09.406416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.408739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1272/2576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:09.428609 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e534f5c-1cb6-4077-bfe8-35860152b9b5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.427644 Oct 06 13:00:09.437866 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1305/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:08 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:09.453354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:09.454903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 3f600b2e-5474-48d8-86eb-76e56a8603af] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.461038 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/3f600b2e-5474-48d8-86eb-76e56a8603af/action HTTP/1.1 Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 14 Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:09.465217 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: {"shelve": {}} Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. Oct 06 13:00:09.466518 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3f600b2e-5474-48d8-86eb-76e56a8603af', 'body': {'shelve': {}}} Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:09.467351 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:09.472211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 3f600b2e-5474-48d8-86eb-76e56a8603af could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:09.473291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd334b47-fff9-4548-be59-59225ba4e300 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/3f600b2e-5474-48d8-86eb-76e56a8603af/action" status: 404 len: 111 microversion: 2.1 time: 0.018667 Oct 06 13:00:09.473291 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1273/2578] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:09 2022] POST /compute/v2.1/servers/3f600b2e-5474-48d8-86eb-76e56a8603af/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:09.480746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.481970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.491154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.491863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.492484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.493628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.499565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.500121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.616691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.617328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.632511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.632692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.633360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.635381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.636088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.639177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.707940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.717613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2b7fa69-ce60-42ac-a035-61bd13fc5f53 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.242602 Oct 06 13:00:09.719278 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1306/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:09 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:09.726278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.727121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.734567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.735464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.737204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.737204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.737534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.738149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.821035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.839181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.853304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.880367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-08b93088-311c-4e6d-a706-f4d6b6fe87a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.159681 Oct 06 13:00:09.880984 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1307/2580] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:09 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:09.887152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.888097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:09.914165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.916737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.922472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.924488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:09.927024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:09.930839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:09.967466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:09.979292 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae824a10-42c2-4870-ba3b-311335df2f83 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1501 microversion: 2.1 time: 0.366595 Oct 06 13:00:09.982712 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1274/2581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:09 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:09.991529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:09.992164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:10.005675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.014340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.014820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.015606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.016080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.016525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.332824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:10.341303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04e75922-9ad0-44b9-8117-3c1b2ba3b92b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.458372 Oct 06 13:00:10.345680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1308/2582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:09 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:10.350643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-683719336"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:10.358597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:10.367366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.367854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.368286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.368988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.370015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.370452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.382227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:10.392841 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-845819e1-d27e-4db5-8600-27fb50d3d42c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.408953 Oct 06 13:00:10.393629 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1275/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:09 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:10.398748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:10.399475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:10.406293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.406989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.407590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.408449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.409238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.409903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.438624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lazy-loading 'flavor' on Instance uuid 69deb394-39d0-4415-9693-ce716eb374b0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:10.605230 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Adding security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 to port 62f693b0-5327-4ba6-acce-b8ce6b787c19 Oct 06 13:00:10.771808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-645e379f-a3cf-421e-abe1-5e986971af38 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.376549 Oct 06 13:00:10.776707 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1276/2584] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:10 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:10.786817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:10.787809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:10.806009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.807030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.814194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:10.815106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:10.815842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:10.823682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.066692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.084995 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e8759a8-eeb6-4c8d-9481-676b9aba0c3d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.309097 Oct 06 13:00:11.096687 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1277/2585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:10 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:11.096687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.096687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.106593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.107462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.108678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.109955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.110654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.111402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.127808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-57480ba1-4535-48b5-8e53-9146b463b2ec tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action" status: 202 len: 0 microversion: 2.1 time: 0.780693 Oct 06 13:00:11.129896 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1309/2586] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:10 2022] POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:11.134936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] HTTP exception thrown: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.137925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Request method failure captured: Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e HTTP/1.1 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPs_GF0P8kqEjNmvFHliaXH2ayScaOMNxpO75N1nRU-7mo4wGwBXW2--_OK5Uf_C0MffvFOiCazAAJT76zq0NJ-VATXg13bcY38lEzfVLVqLZUgCc1oa0MuzYSZOS2MJGTM3ioW0rfdmZo0UK-WCnymGufuGwbWyTVwtUBD0ikKbQP-I Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.32 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:11.139662 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f441d9683a1d479bbd90ca094cac3bac", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}] Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 76bc81cc0db047fe926e1d1c211a2a56 Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.141130 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e'} Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:11.142133 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.143282 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.145300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Returning 404 to user: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:11.145300 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c98d74b-ffde-41cc-9976-954a1b3bebbe tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 404 len: 111 microversion: 2.32 time: 0.054751 Oct 06 13:00:11.145300 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1278/2587] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:00:11 2022] DELETE /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:11.147081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.148257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.149006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.155847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.156084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.156448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.157058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.157862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.157979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.158620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.158747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.160150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.160643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.161307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.161976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.185237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:11.271019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.283093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.284798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.290620 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-936d79ae-571b-4d6a-9cb5-530239c80c31 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.147122 Oct 06 13:00:11.293779 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1279/2588] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:11 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:11.304953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e1a287-ca95-4127-b45d-76409bc9ecb4", "name": "network-vif-plugged", "status": "completed", "tag": "e7912191-20df-448f-ad7d-dfc8d02d55a2"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:11.328163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.330537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.331200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.364060 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] Creating event network-vif-plugged:e7912191-20df-448f-ad7d-dfc8d02d55a2 for instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 on n-h1-860556-1 Oct 06 13:00:11.379496 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8dc30cfc-0956-406d-b659-be758bf49f39 req-fb681e1e-b8f0-413d-852d-7c8422e7a927 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083398 Oct 06 13:00:11.379496 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1280/2589] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:11.401818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f228e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.444430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.461280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf1910d5-6bd3-46ad-96a7-9ef164eb9320 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.329741 Oct 06 13:00:11.463221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1310/2590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:11 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:11.472865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb6b39e-2549-4cb7-b92d-ef831a5e2c91", "tag": "62f693b0-5327-4ba6-acce-b8ce6b787c19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:11.483763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.484607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.485261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.499457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] Creating event network-changed:62f693b0-5327-4ba6-acce-b8ce6b787c19 for instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 on n-h2-860556-1 Oct 06 13:00:11.504886 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5117ceda-eb1e-4d19-af9b-82e8200a4672 req-cd872d52-24ab-4b84-9ac5-9f0c9925a93e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039044 Oct 06 13:00:11.505759 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1311/2591] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:11.512540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.513432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] [instance: 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.520847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.521725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.521865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.523021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.523492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.524007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.551266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] HTTP exception thrown: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Request method failure captured: Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e HTTP/1.1 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPs_GF0P8kqEjNmvFHliaXH2ayScaOMNxpO75N1nRU-7mo4wGwBXW2--_OK5Uf_C0MffvFOiCazAAJT76zq0NJ-VATXg13bcY38lEzfVLVqLZUgCc1oa0MuzYSZOS2MJGTM3ioW0rfdmZo0UK-WCnymGufuGwbWyTVwtUBD0ikKbQP-I Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.32 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:11.555766 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f441d9683a1d479bbd90ca094cac3bac", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f441d9683a1d479bbd90ca094cac3bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f441d9683a1d479bbd90ca094cac3bac"}]}] Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f441d9683a1d479bbd90ca094cac3bac Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1971885446 Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 76bc81cc0db047fe926e1d1c211a2a56 Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TaggedBootDevicesTest-1971885446-project Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.558191 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e'} Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:11.559020 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. Oct 06 13:00:11.560439 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.562165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] Returning 404 to user: Instance 3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:11.570710 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40a4d343-b042-43dc-a69b-9b36dfece13e tempest-TaggedBootDevicesTest-1971885446 tempest-TaggedBootDevicesTest-1971885446-project] 10.222.0.26 "GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e" status: 404 len: 111 microversion: 2.32 time: 0.063402 Oct 06 13:00:11.571753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1312/2592] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:11 2022] GET /compute/v2.1/servers/3b1d6397-22f9-47c3-a3d6-9a791ec6fd7e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:11.580345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:11.582453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.606089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.606893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.607128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.608023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.614156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.614820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.836848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use.", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:11.837623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.837623 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 HTTP/1.1 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:11.845684 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: exception: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.848041 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6'} Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:11.849201 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.850543 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:11.852510 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] Oct 06 13:00:11.855997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:11.858481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 400 to user: Security Group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 in use. Oct 06 13:00:11.858481 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-a33b5337-326f-4066-ad90-b3443cb3adb2'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:11.859712 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01fdccd4-69f7-4a89-b10e-d1b40015a041 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6" status: 400 len: 185 microversion: 2.1 time: 0.474689 Oct 06 13:00:11.860952 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1281/2593] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:11 2022] DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 => generated 185 bytes in 478 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:11.885167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:11.890577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:11.891084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:11.901467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.901731 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9cae121-3d03-44e3-8876-981b20b32e74 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.326831 Oct 06 13:00:11.902605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.902847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1313/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:11 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:11.903646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:11.904696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:11.905663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:11.906442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.014587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21655a6c-a6d4-453e-b512-05c671f7ff48 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action" status: 202 len: 0 microversion: 2.1 time: 0.135993 Oct 06 13:00:12.016747 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1282/2595] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:11 2022] POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:12.025362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:12.026316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:12.035393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.035894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.036495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.037492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.038029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.038729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.112488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:12.120701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:12.135272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.136028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.136935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.138018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.150555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.151330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.299697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.309305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4037209c-dc74-4241-8718-61d2b4f2f6b8 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1571 microversion: 2.1 time: 0.288314 Oct 06 13:00:12.309927 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1314/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:12 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1571 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:12.351165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:12.352142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:12.360468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.361290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.362014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.362963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.363667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.364667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.411929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.420664 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-547e2477-0dba-420b-9613-1da464917d6d tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1322 microversion: 2.1 time: 0.313722 Oct 06 13:00:12.423562 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1283/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:12 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:12.464810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.473614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.475340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.481293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-621fc946-39f7-47a9-9688-360cb0851309 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.135175 Oct 06 13:00:12.482356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1315/2598] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:12 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:12.490668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:12.491293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:12.504667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.505162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.505611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.507978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.508450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.516244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.684696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:12.692887 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d4aec5f-f08f-4b90-9cc9-9689fcbeae3d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.208425 Oct 06 13:00:12.693782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1284/2599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:12 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:12.929238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:12.929883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:12.938295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.939154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.939809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:12.940769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:12.941429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:12.942099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.125022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:13.133120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21bcfe86-f5ef-4f6f-b1e3-607229b3bb13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.207805 Oct 06 13:00:13.133706 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1316/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:12 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:13.332702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:13.333256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:13.340654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.341145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.341584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.342315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.342770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.343289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.448983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:13.449614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:13.456796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.457294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.457778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.458487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.458950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.459378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.922878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:13.937106 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45f7a0db-8eff-4beb-ba1d-d8c88ef56841 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1472 microversion: 2.1 time: 0.493177 Oct 06 13:00:13.938043 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1317/2601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:13 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:13.943057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:13.944013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:13.950982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.951721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.952339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.953214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:13.954007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:13.954597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:13.969702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:13.980519 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e97887db-7417-4eec-a24e-082d3c8b96de tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1576 microversion: 2.1 time: 0.651682 Oct 06 13:00:13.996519 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1285/2602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:13 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1576 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:13.996519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:13.999137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.013226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.013904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.014422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.015220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.015753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.016279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.049316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.060376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.062217 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1cf42a5f-27bb-40dc-815b-09adb7581d87 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072623 Oct 06 13:00:14.063172 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1286/2603] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:00:13 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:00:14.063810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.068394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.069409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.074109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ba3db6a-6bc5-4198-9163-3aa680e6a115 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.134454 Oct 06 13:00:14.077304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.078136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.078749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.080093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.080712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.081294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.090540 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1318/2604] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:13 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:14.101099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.101977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.108842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:14.109410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.110315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.111544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.112451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.113075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.113668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.156842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Request method failure captured: Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4/diagnostics HTTP/1.1 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtFJPLq-wKiUzM9CxRGKRF8WexUOToLfOssnTqtsrYncTmoIBTacZE_7HV4g83rwA_Mi0dsjP8IdcD8F2bfWV4FX27RCaFq0zGbHIIJ0KmoEfxcfl8RUj1UtHv8s5j-2xT0z1iolAbtek64mQWhKZaTRK3cMoUKO7kzIerRNdiaHy2c Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 7ec72636dea9428ca82392552f8bf5e8 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:14.162017 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7ec72636dea9428ca82392552f8bf5e8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ec72636dea9428ca82392552f8bf5e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7ec72636dea9428ca82392552f8bf5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ec72636dea9428ca82392552f8bf5e8"}]}] Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 7ec72636dea9428ca82392552f8bf5e8 Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerDiagnosticsNegativeTest-296624823-project Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: bffe6199a46f4191a20ba08904b17dae Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-296624823-project Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:14.164520 n-d-860556-1 devstack@n-api.service[129615]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'f3e1a287-ca95-4127-b45d-76409bc9ecb4'} Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:00:14.167577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 06 13:00:14.170110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:14.183175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:14.183175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d61384c6-9315-49dd-be76-89a92abf9463 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.087938 Oct 06 13:00:14.185274 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1319/2605] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4/diagnostics => generated 117 bytes in 94 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:14.194657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.196437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.208359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.209637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.210749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.212411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.214105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.215151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.361318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.376454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6cae9254-fda9-46f4-92dd-757b4d5e1166 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.311616 Oct 06 13:00:14.378288 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1287/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:14.384235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.387328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.394864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.395572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.396318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.402993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.403733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.404642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.468413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-939062dc-c29a-4b85-ab5d-5ef4612c4b37 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088243 Oct 06 13:00:14.470197 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1288/2607] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:00:14.480689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.481869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.494226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.496018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.497290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.499373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.500433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.501444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.524291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.539219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:14.539416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1656bfa-04e8-46cf-b267-777f4102bdf0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.352172 Oct 06 13:00:14.540891 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1320/2608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:14.579584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.580497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.587530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.588531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.589274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.590312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.591054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.591720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.625949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:14.678742 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70a5113a-aed6-4dac-a526-36827273ee5e tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 204 len: 0 microversion: 2.1 time: 0.202762 Oct 06 13:00:14.679652 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1289/2609] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:14 2022] DELETE /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:14.698308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.699200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.708122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.708629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.709126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.710105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.710578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.711285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.771214 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a35256b-d349-43da-a31b-d9e7e2695bb4 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 204 len: 0 microversion: 2.1 time: 0.195562 Oct 06 13:00:14.772484 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1321/2610] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:14 2022] DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:00:14.785005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:14.786284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:14.795335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.796126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.796851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.798558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:14.799179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:14.799965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:14.982291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:14.992485 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a698d1af-2239-472e-b50a-bc996f6ba8fa tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1478 microversion: 2.1 time: 0.303518 Oct 06 13:00:14.993959 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1290/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1478 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:15.006147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:15.007429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:15.015751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.016489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.016790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.018021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.019134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.019753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.021325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.026579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-76d86424-3f2b-4943-b9a4-eb9d1b11d2f1 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1679 microversion: 2.1 time: 0.246519 Oct 06 13:00:15.034800 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1322/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:15.107453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:15.109769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:15.119275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.121245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.121920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.123290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.123918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.124507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.221254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.227172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.236029 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37ce4a29-6486-450a-a019-83d025a30f04 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1569 microversion: 2.1 time: 0.235326 Oct 06 13:00:15.244394 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1291/2613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:14 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:15.246609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.248301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.255714 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33090178-9355-4751-8499-d7c1050a0c3b tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.153150 Oct 06 13:00:15.256906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1323/2614] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:15 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:15.272447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1173749690"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:15.273151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:15.282525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.283106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.283615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.284417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.284940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.285487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.421412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:15.421412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:15.428314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.428825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.429261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.430169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.430864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.431307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.439403 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.network.security_group_api [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Adding security group 3567e110-1af5-4e04-bd82-977291ea5050 to port 62f693b0-5327-4ba6-acce-b8ce6b787c19 Oct 06 13:00:15.706902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:15.719983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-caaa2c08-9502-4843-90d7-9e8c29673c5a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.303233 Oct 06 13:00:15.721343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1324/2615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:15 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:15.728725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:15.730333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:15.738308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.739335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.739996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:15.741779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:15.742488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:15.743122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.040578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.053383 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d60e9b0-610f-4270-8224-606a8c036c69 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.328285 Oct 06 13:00:16.069895 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1325/2616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:15 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:16.069895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.069895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:16.069895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.070366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.070366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.073148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.077835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.078960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.123366 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e39645cd-3a98-4453-a1ba-3c396c656ba0 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action" status: 202 len: 0 microversion: 2.1 time: 0.854777 Oct 06 13:00:16.125801 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1292/2617] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:00:15 2022] POST /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:16.137488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.138503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:16.145728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.146840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.147659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.148916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.149588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.152250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.386984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.397407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e4d5b69-0692-4f00-94e6-729db03487ec tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1679 microversion: 2.1 time: 0.269699 Oct 06 13:00:16.415598 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1293/2618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:16 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1679 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:16.423486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb6b39e-2549-4cb7-b92d-ef831a5e2c91", "tag": "62f693b0-5327-4ba6-acce-b8ce6b787c19"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:16.423988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.433978 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14c49cea-b2e2-47db-86cd-e1d08c7b4ff2 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1478 microversion: 2.1 time: 0.377939 Oct 06 13:00:16.440124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.440649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1326/2619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:16 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1478 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:16.441983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.442676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.458986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] Creating event network-changed:62f693b0-5327-4ba6-acce-b8ce6b787c19 for instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 on n-h2-860556-1 Oct 06 13:00:16.461967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d476f3550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.466645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c7595866-c576-448f-b2eb-256a622cea69 req-62acbe68-34ea-4e74-9b40-77cd845d94a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047840 Oct 06 13:00:16.467928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1294/2620] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:16.475260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.477366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:16.511734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.512164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.512612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.513337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.521014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.522072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.671097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.681032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.683093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:16.699907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42dc5592-1fd4-4be8-a9e2-25ed90e2169d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.230474 Oct 06 13:00:16.701390 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1295/2621] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:16 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:16.729870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use.", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:16.730689 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.730689 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050 HTTP/1.1 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:16.733398 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: exception: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.734825 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3567e110-1af5-4e04-bd82-977291ea5050'} Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:16.735632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.736768 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:16.738231 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 400 to user: Security Group 3567e110-1af5-4e04-bd82-977291ea5050 in use. Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-deb6616f-a26a-4aff-bca0-d06af430c5e0'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-baf0ead0-b99f-4108-af40-417deae9f283 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050" status: 400 len: 185 microversion: 2.1 time: 0.280238 Oct 06 13:00:16.739529 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1327/2622] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:16 2022] DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050 => generated 185 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:00:16.746690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.747193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:16.747320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:16.747696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:16.756802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.757280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.757893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.758786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.759349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.759787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.763318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:16.765776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.765776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.765776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.767562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:16.767562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:16.767562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:16.840923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:17.008027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:17.021021 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59cfaefd-3f5c-415d-b4bd-08cce316ea0d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.279051 Oct 06 13:00:17.022126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1296/2623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:16 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:17.060726 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7cb827c7-b574-4041-b95a-709016bb17c2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 204 len: 0 microversion: 2.1 time: 0.319342 Oct 06 13:00:17.061698 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1328/2624] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:16 2022] DELETE /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:17.072477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:17.076802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:17.086738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:17.087317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.087831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.088321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.088684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:17.089045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.089505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.092087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.099070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.100256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.102007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.103002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.103657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.104275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.575018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:17.576871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:17.588979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6262f8c-39c3-4b69-9535-cab8cf1a28bb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.509646 Oct 06 13:00:17.589202 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4de651d5-732e-40ca-8fc0-ab106b221c72 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1644 microversion: 2.1 time: 0.518345 Oct 06 13:00:17.590273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1297/2625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:17 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1644 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:17.600055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:17.602761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:17.609894 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1329/2626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:17 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:17.621225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:17.621919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:17.627722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.635118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:17.636642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.637526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.637686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.638329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.638792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.639226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.639721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.640436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:17.645087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:17.646526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:17.651963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.137623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:18.148382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75369cb9-5e02-4d58-9911-51b6558141c1 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1478 microversion: 2.1 time: 0.537291 Oct 06 13:00:18.162207 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1330/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:17 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1478 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:18.179061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:18.180000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:18.189359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.190150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.190774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.191680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.192305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.192907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.307866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:18.318936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4248a52-2049-4507-b495-9aa9c5b86f84 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1679 microversion: 2.1 time: 0.727344 Oct 06 13:00:18.334226 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1298/2628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:17 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1679 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:18.342309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:18.343076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:18.353001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.353852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.354920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.355892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.356551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.357480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.393486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:18.523723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0184565b-63ac-475c-a529-c6d52eea5dfd tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 204 len: 0 microversion: 2.1 time: 0.187489 Oct 06 13:00:18.529461 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1299/2629] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:18 2022] DELETE /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:18.562536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:18.564785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:18.566068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:18.579735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.580386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.582706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.583459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.583919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.586621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.593704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:18.598650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:18.629496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff16ca04-a551-43f2-bfc2-259b021be43d tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.462009 Oct 06 13:00:18.630978 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1331/2630] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:18 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:18.638440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:18.639414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:18.656622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.659214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.659991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:18.661038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:18.662662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:18.663624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.009240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.018459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b54be7e-54df-4b70-91b6-9b8740d7fd9f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.475047 Oct 06 13:00:19.019361 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1300/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:18 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.024149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:19.024961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:19.032224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.032795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.033313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.034122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.034710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.035336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.094109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.102566 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f629221-d6c3-47f3-b691-24e9d8e68433 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1680 microversion: 2.1 time: 0.470736 Oct 06 13:00:19.117186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1332/2632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:18 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1680 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.140839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:19.146988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:19.156642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.157414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.158822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.159819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.160393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.161098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.483100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.498896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:19.516977 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0eda4843-e0f3-43b9-b653-c06f34e6ec85 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1644 microversion: 2.1 time: 0.494986 Oct 06 13:00:19.517896 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1301/2633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:19 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1644 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.549414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:19.551203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:19.571143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.571945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.573195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.574114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.574733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.575361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.592242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.602356 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99f4aca1-ac3e-4d8e-a173-515e2b6b94b9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.475599 Oct 06 13:00:19.605756 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1333/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:19 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.622889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:19.624005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:19.634040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.636209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.637412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.639653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.640960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.642650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.732696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffe6199a46f4191a20ba08904b17dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec72636dea9428ca82392552f8bf5e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.741199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8500ab07-224c-4a65-9b3d-b4c8eeeb413b tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 200 len: 1307 microversion: 2.1 time: 0.217099 Oct 06 13:00:19.741796 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1302/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:19 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.762237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e1a287-ca95-4127-b45d-76409bc9ecb4", "name": "network-vif-deleted", "tag": "e7912191-20df-448f-ad7d-dfc8d02d55a2"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:19.772483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.773314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.774006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.790802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cede20d462824bc28ca072948a075ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf9170d5cb462abebc8ad2bea567ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.799740 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] Creating event network-vif-deleted:e7912191-20df-448f-ad7d-dfc8d02d55a2 for instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 on n-h1-860556-1 Oct 06 13:00:19.806482 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b63a9e5-fb81-400e-b44c-1589ede655a0 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 200 len: 1612 microversion: 2.1 time: 0.199342 Oct 06 13:00:19.806727 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2c13e3b9-e0f0-4e9e-889b-3d1d7a0e2b92 req-1213d006-1459-44c0-ac6c-268957895af2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050646 Oct 06 13:00:19.808826 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1303/2636] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:19.813402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1334/2637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:19 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 1612 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:19.817316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:19.818353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:19.825943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.826728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.827400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.828453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:19.829127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:19.830536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:19.909406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.920053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.922332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:19.927767 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25a577a6-b1d2-4681-8da4-3055390be5bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.117330 Oct 06 13:00:19.928647 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1304/2638] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:19 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:20.045806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:20.046444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:20.053587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.054087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.054531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.055289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.055703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.056121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.128930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:20.129547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:20.135652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:20.150333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.155246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.155728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.156492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.158732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.159184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.383370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:20.395953 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0105fac7-822f-4f55-af26-2c71ffe8ecd4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.357292 Oct 06 13:00:20.398701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1335/2639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:20 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:20.443252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:20.459966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-06002cbf-ba0d-4e89-ad7a-ac5dd39ff7b8 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1680 microversion: 2.1 time: 0.334760 Oct 06 13:00:20.461495 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1305/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:20 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:20.544264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:20.544893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:20.555031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.555519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.555960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.557270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.557676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.558129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.631940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:20.632692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:20.642964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.643456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.643891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:20.644602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:20.645053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:20.645477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.346980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:21.362705 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f0ec2341-416a-4007-9685-17f67a0fbcb4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1644 microversion: 2.1 time: 0.822182 Oct 06 13:00:21.363830 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1336/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:20 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1644 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:21.375899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:21.376614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] [instance: f3e1a287-ca95-4127-b45d-76409bc9ecb4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:21.385756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.386399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.386691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.387401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.387865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.388294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.408918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] HTTP exception thrown: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Request method failure captured: Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 HTTP/1.1 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtFJPLq-wKiUzM9CxRGKRF8WexUOToLfOssnTqtsrYncTmoIBTacZE_7HV4g83rwA_Mi0dsjP8IdcD8F2bfWV4FX27RCaFq0zGbHIIJ0KmoEfxcfl8RUj1UtHv8s5j-2xT0z1iolAbtek64mQWhKZaTRK3cMoUKO7kzIerRNdiaHy2c Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 7ec72636dea9428ca82392552f8bf5e8 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:21.410662 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7ec72636dea9428ca82392552f8bf5e8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ec72636dea9428ca82392552f8bf5e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7ec72636dea9428ca82392552f8bf5e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ec72636dea9428ca82392552f8bf5e8"}]}] Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 7ec72636dea9428ca82392552f8bf5e8 Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-296624823 Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerDiagnosticsNegativeTest-296624823-project Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: bffe6199a46f4191a20ba08904b17dae Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-296624823-project Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. Oct 06 13:00:21.412034 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f3e1a287-ca95-4127-b45d-76409bc9ecb4'} Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:21.412800 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. Oct 06 13:00:21.414013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.415114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] Returning 404 to user: Instance f3e1a287-ca95-4127-b45d-76409bc9ecb4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:21.415114 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6783bdb3-c9fb-495a-bb72-f0ab5d860ad6 tempest-ServerDiagnosticsNegativeTest-296624823 tempest-ServerDiagnosticsNegativeTest-296624823-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4" status: 404 len: 111 microversion: 2.1 time: 0.047101 Oct 06 13:00:21.415114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1337/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:21 2022] GET /compute/v2.1/servers/f3e1a287-ca95-4127-b45d-76409bc9ecb4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:21.420398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:21.426013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:21.436743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.438485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.438932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.439653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.443593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.444056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.455736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:21.472325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b9f07ea-427c-41df-92fb-45fa26ddb4c7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.842513 Oct 06 13:00:21.475510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] HTTP exception thrown: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Request method failure captured: Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b HTTP/1.1 Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDAB7y1mHBmPHDtXyyppWe73Div1LsiamFo8d7KnWl9v-Mc6VT6M5OkNOkok7ZjOVqCH7hVlNpfS2yuBxoJ5kXEmhHZZ1n2LcjDOKlfnn8_FwzuICONPvY6BtRH3wl8tdjElWzKTWpiXNjbJ0Jj7d07CcaV0kW_RAeTqh2Wzdl3MAI Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:21.478299 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00cf9170d5cb462abebc8ad2bea567ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}] Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cede20d462824bc28ca072948a075ed3 Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:21.480414 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f9939237-2dc6-4099-bf94-a1851974517b'} Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:21.481495 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:21.484376 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:21.488267 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1306/2643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:20 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:21.489299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Returning 404 to user: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:21.490649 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5682d26a-688c-4a99-beac-a97c0f753f60 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 404 len: 111 microversion: 2.1 time: 0.076836 Oct 06 13:00:21.499220 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1338/2644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:21 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:21.505436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:21.506983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:21.508017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:21.511349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:21.526457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.527255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.527918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.529415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.530138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.530793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.531644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.533415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.534608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.536298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.539562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.546091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.677869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:21.697167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:21.699266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:21.718655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b916386-c583-4e2e-9c82-7689d36285ef tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.229254 Oct 06 13:00:21.721939 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1307/2645] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:21 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:21.730765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:21.731884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:21.745561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.755847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.757398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.760978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:21.763212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:21.763998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:21.991575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:22.050230 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-13d8437c-5ae0-4417-a4c7-d637bfd83fce tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1612 microversion: 2.1 time: 0.326411 Oct 06 13:00:22.051708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1308/2646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:21 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1612 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:22.062390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ad96418-a307-4129-9d36-905fc18d1b99 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '.version_select at 0x7f7d4759f8b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:22.108363 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ad96418-a307-4129-9d36-905fc18d1b99 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203017400" status: 202 len: 0 microversion: 2.1 time: 0.054842 Oct 06 13:00:22.110709 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1309/2647] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203017400 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:22.116468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9939237-2dc6-4099-bf94-a1851974517b", "name": "network-vif-deleted", "tag": "1ac56104-37e1-498b-b1a3-432deb1b78b4"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:22.139192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:22.152047 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e598d91-6ea1-4020-9473-fb231d5cd11d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.651234 Oct 06 13:00:22.166983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.169232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.170324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:22.171333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1339/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:21 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:22.183497 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] Creating event network-vif-deleted:1ac56104-37e1-498b-b1a3-432deb1b78b4 for instance f9939237-2dc6-4099-bf94-a1851974517b on n-h1-860556-1 Oct 06 13:00:22.189269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9a119caa-d3aa-4fcc-a4ec-e852b14e2484 req-70da2c17-a15b-43e9-ad2e-9d204b6d19b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077071 Oct 06 13:00:22.190163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1310/2649] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:22.243985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bade59a5-d480-4187-87bb-4d4eb29e1741", "name": "network-vif-deleted", "tag": "d96e48db-d849-4633-ab2a-d8f101b80f47"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:22.266008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.268891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.269613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:22.314478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] Creating event network-vif-deleted:d96e48db-d849-4633-ab2a-d8f101b80f47 for instance bade59a5-d480-4187-87bb-4d4eb29e1741 on n-h2-860556-1 Oct 06 13:00:22.321122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bd7bcb7f-5deb-44f7-bcff-7b95c725e8f4 req-56a3c7da-80dc-4709-b5fa-80a7b84096af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080851 Oct 06 13:00:22.322971 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1340/2650] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:22.388808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:22.389660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:22.406623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.407975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.408611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:22.410457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.411141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.411732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:22.505218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:22.506277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:22.523731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.526968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.529127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:22.530066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:22.532078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:22.533978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.020444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.033681 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6fff4bd6-a756-423a-bfa4-4340efef1222 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1465 microversion: 2.1 time: 0.650330 Oct 06 13:00:23.034932 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1311/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:22 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1465 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:23.036927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.049296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:23.050705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:23.051839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-09ae6b11-db7d-4297-941e-f1d7429ec201 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.552045 Oct 06 13:00:23.060477 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1341/2652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:22 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:23.081335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:23.085436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.089942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:23.092037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.094440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.095660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.098562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.100878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.115784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.116286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.116722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.117454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.117956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.118385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.262774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.263845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.264988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.265835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lazy-loading 'fault' on Instance uuid bade59a5-d480-4187-87bb-4d4eb29e1741 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:23.404514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.415728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.418193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.425601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45a9bfbe-e260-44c8-8087-cf71a250e6a2 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.389243 Oct 06 13:00:23.438205 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1312/2653] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:23 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:23.455924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:23.456884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:23.465193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.465882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.466554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.467549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:23.468290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:23.469049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:23.514987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ac89cfe31446eeaec958ae0acaf663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb9c2997ff14b6b92702ea515b119c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.525329 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-57db6e10-171e-44f3-b176-87c4a29d044c tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 200 len: 1330 microversion: 2.1 time: 0.450133 Oct 06 13:00:23.538316 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1342/2654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:23 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 1330 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:23.742703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:23.754694 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15be3ffc-a547-4609-8df5-3ad175ba4753 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.314552 Oct 06 13:00:23.755994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1313/2655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:23 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:24.056570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.057976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:24.065617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.079009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.080242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.080647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:24.080945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.081859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.082466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.083024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.092844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.093690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.094407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.095300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.095925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.096702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.162680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.163218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.166085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.168936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lazy-loading 'fault' on Instance uuid dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:24.271743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:24.282932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96ae60a7-dbd4-4af9-bab3-5593bc72e91f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 200 len: 1305 microversion: 2.1 time: 0.227536 Oct 06 13:00:24.284207 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1343/2656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:24 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:24.298203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb6b39e-2549-4cb7-b92d-ef831a5e2c91", "name": "network-vif-deleted", "tag": "62f693b0-5327-4ba6-acce-b8ce6b787c19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:24.324374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.324860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.325293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.351426 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] Creating event network-vif-deleted:62f693b0-5327-4ba6-acce-b8ce6b787c19 for instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 on n-h2-860556-1 Oct 06 13:00:24.364341 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a6157e13-c108-4462-bc15-ce4b0f0c5655 req-d2dd43c2-443e-4cf7-a8de-f014af0c604c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078026 Oct 06 13:00:24.364990 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1344/2657] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:24.423091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:24.446612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-591ed1f7-3b2e-4ac5-9e31-d4e5d805f3b4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.372021 Oct 06 13:00:24.458213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1314/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:24 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:24.462133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.462133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:24.475936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.476351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.476804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.477554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.478066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.478594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.483199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:24.550612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.551625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] [instance: bade59a5-d480-4187-87bb-4d4eb29e1741] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:24.563643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.564398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.564859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.565603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.566209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.566660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.591126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] HTTP exception thrown: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Request method failure captured: Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 HTTP/1.1 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtCLGG6AKHEUKvXUhQCh7BTvgLuyJmWS5Z5-2qw9YVwjrsO1wfPGjb_yRtmVPOztnocb5jwPEjpIAOmmqhw82I_ncgtsZGaDRoemkfmyyListaeMYdstHyMaBOKUVio8QAoo2TscKy99jTW6etRUZfXcHG3g5cY40jBNFHxZDTq4Dro Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9bb9c2997ff14b6b92702ea515b119c0 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:24.595312 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bb9c2997ff14b6b92702ea515b119c0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bb9c2997ff14b6b92702ea515b119c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bb9c2997ff14b6b92702ea515b119c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bb9c2997ff14b6b92702ea515b119c0"}]}] Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9bb9c2997ff14b6b92702ea515b119c0 Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-526628732 Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesAdminNegativeTest-526628732-project Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 98ac89cfe31446eeaec958ae0acaf663 Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesAdminNegativeTest-526628732-project Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. Oct 06 13:00:24.596870 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'bade59a5-d480-4187-87bb-4d4eb29e1741'} Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:24.598514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. Oct 06 13:00:24.599962 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:24.601239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Returning 404 to user: Instance bade59a5-d480-4187-87bb-4d4eb29e1741 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:24.605025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:24.606301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97d3ae34-4698-475b-a82f-8a0766c83ade tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741" status: 404 len: 111 microversion: 2.1 time: 0.052146 Oct 06 13:00:24.613163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1315/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:24 2022] GET /compute/v2.1/servers/bade59a5-d480-4187-87bb-4d4eb29e1741 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:24.621925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:24.623436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:24.626097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9e088ee4-6dc3-4cf8-adcf-d3c2e7815f05 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] Calling method '.version_select at 0x7f7d44d2b3a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.642861 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa0a45ed-7729-4ed0-9f41-0b4a91f5a6a6 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1447 microversion: 2.75 time: 0.185869 Oct 06 13:00:24.643483 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1345/2660] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:24 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:24.686113 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9e088ee4-6dc3-4cf8-adcf-d3c2e7815f05 tempest-VolumesAdminNegativeTest-526628732 tempest-VolumesAdminNegativeTest-526628732-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267740942" status: 202 len: 0 microversion: 2.1 time: 0.071290 Oct 06 13:00:24.693436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1316/2661] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267740942 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:24.780725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:24.781668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:24.794743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.795732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.799383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:24.801831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:24.806303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:24.809940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.095762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:25.112297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dddf412c-daf6-408b-880f-d58d3128e6c5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.336540 Oct 06 13:00:25.117989 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1346/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:24 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:25.308186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:25.309075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:25.323016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.327323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.327827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.328624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.330319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.330801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.383587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 HTTP/1.1 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:25.386019 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:25.387338 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'dbb6b39e-2549-4cb7-b92d-ef831a5e2c91'} Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:25.388079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:25.389238 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:25.391938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:25.393003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-80c03ba2-6ea4-475c-ba85-dcf7e5dbd368 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 404 len: 111 microversion: 2.1 time: 0.090207 Oct 06 13:00:25.394162 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1317/2663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:25 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:25.404669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-962ca55f-c87c-49b4-bf50-6f156da6ff0c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d47691040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:25.473810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:25.474707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:25.486221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.486739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.487181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.487922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.488392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.488834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.904429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:25.934933 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3460592a-220a-4bef-b139-7b4089c57315 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.464813 Oct 06 13:00:25.936925 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1318/2664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:25 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:25.966496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:25.969525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:25.980130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-962ca55f-c87c-49b4-bf50-6f156da6ff0c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6" status: 202 len: 0 microversion: 2.1 time: 0.581955 Oct 06 13:00:25.981457 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1347/2665] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:25 2022] DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:25.985111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.985876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.986493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.987381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:25.988011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:25.988656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:25.989308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1f1fb3d-6160-4c7f-8451-b160dda433fc tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d4771dd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:26.205380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:26.230576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:26.232153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:26.251136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0893910e-6f50-45f2-a003-62be75837125 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1453 microversion: 2.75 time: 0.311966 Oct 06 13:00:26.253550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1319/2666] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:25 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1453 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:26.264632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:26.265277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:26.281246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:26.289357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:26.290032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:26.290817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:26.291339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:26.291956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:26.642161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:26.654248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56ad5d3a-6ccd-4010-b943-98b8f488ebe6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.399371 Oct 06 13:00:26.655158 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1320/2667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:26 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:26.689989 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1f1fb3d-6160-4c7f-8451-b160dda433fc tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050" status: 202 len: 0 microversion: 2.1 time: 0.704171 Oct 06 13:00:26.691353 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1348/2668] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:25 2022] DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:26.704424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e909552-9171-4656-9e68-223b66af70e2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'create', calling method: .version_select at 0x7f7d3f2b4820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-952721536", "description": "tempest-description-353163334"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:26.961529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:26.962715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:26.997827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:27.001702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:27.004058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:27.008889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:27.011217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:27.012938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:27.759365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e909552-9171-4656-9e68-223b66af70e2 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.058527 Oct 06 13:00:27.766460 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1321/2669] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:00:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:27.770923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:27.771702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:27.779690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:27.781253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:27.782079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:27.782686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:27.783219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:27.784004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:27.850827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:27.879452 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fcc038a-be80-4d0c-90dc-28a92e6435e8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.918104 Oct 06 13:00:27.882424 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1349/2670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:26 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:27.937627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:27.957155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:27.959015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:27.970536 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9224038-0941-48af-8b72-e850fbc50195 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1438 microversion: 2.75 time: 0.204125 Oct 06 13:00:27.971392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1322/2671] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:27 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1438 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:27.976350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:27.982690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:28.011308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:28.018535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:28.023541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:28.024606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:28.025248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:28.026703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:28.177988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-38252669", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:28.284703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:00:28.285118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:00:28.298609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:00:28.299291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:00:28.299902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:00:28.310116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:28.310970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:28.311612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:28.315806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:28.316517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:28.317144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:28.358765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Getting quotas for project 257019a6c0b04603a673e520f6e44b99. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:00:28.378226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Getting quotas for user 932d510ec1ac4cda9d88e94a2cf996bb and project 257019a6c0b04603a673e520f6e44b99. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:00:28.400047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:00:28.403534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:00:28.501880 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b31578a-9755-4faf-ae2f-ff18e070847a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.618373 Oct 06 13:00:28.502890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1350/2672] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:00:28.516052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1bfd18b-4d0e-4767-9afc-12020d1b590c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Action: 'update', calling method: .version_select at 0x7f7d476a8c10>, body: {"security_group": {"name": "tempest-sg-hth-960157069", "description": "tempest-description-hth-2069999939"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:28.659445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:28.670654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-432d9ff6-4508-4a7c-80d0-29f884bee5c4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.697980 Oct 06 13:00:28.676037 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1323/2673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:27 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:29.016512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1bfd18b-4d0e-4767-9afc-12020d1b590c tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31" status: 200 len: 217 microversion: 2.1 time: 0.512129 Oct 06 13:00:29.017082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1351/2674] 10.222.0.26 () {60 vars in 1290 bytes} [Thu Oct 6 13:00:28 2022] PUT /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31 => generated 217 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:29.029824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:29.030731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:29.037613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:29.042675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:29.062248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.063193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.064284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.066815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.068583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.070837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.091346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:29.188993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:29.211255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:29.219239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:29.239666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3ded678-1ffc-443c-ae73-c28fe58367ec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1450 microversion: 2.91 time: 0.221050 Oct 06 13:00:29.243142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1352/2675] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:29 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1450 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:29.264259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:29.274274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:00:29.274696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:00:29.275093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:29.275257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:00:29.276453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:00:29.277000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:00:29.290598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.291462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.292139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.293208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.301131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.303008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.432259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:29.445815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.446328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.446768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.452068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.454264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.456151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:29.859090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:29.885445 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73e9a4d9-7c0e-40bd-b4ce-57b48bf0cc98 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d/action" status: 202 len: 1942 microversion: 2.75 time: 1.207566 Oct 06 13:00:29.915858 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1324/2676] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:00:28 2022] POST /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d/action => generated 1942 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 06 13:00:29.927845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6621a172-476b-4563-9c66-5124c2395c67 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f306ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:29.935895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:29.953894 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f760a602-d441-49c6-8b0b-d6b2f194c056 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1515 microversion: 2.1 time: 0.705845 Oct 06 13:00:29.956333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1353/2677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:29 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1515 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:29.977105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:29.979074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:29.997000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:29.997863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:29.999610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.000555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:30.003432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:30.004199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.136303 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6621a172-476b-4563-9c66-5124c2395c67 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31" status: 200 len: 217 microversion: 2.1 time: 0.219198 Oct 06 13:00:30.137498 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1325/2678] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:00:29 2022] GET /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31 => generated 217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:30.144696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:30.145563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:30.160946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:30.162311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:30.165147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.168009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:30.169265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:30.169960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.366962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:30.377313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78570a79-72c6-4088-ba4b-8041da67e653 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.418615 Oct 06 13:00:30.378865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:30.396283 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1354/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:29 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:30.405611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bcd7e3ee-175c-4c6e-b50e-8f8d263babc7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d47650ee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:30.420738 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e3060582-39b8-4a69-9922-04b83608486f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.279893 Oct 06 13:00:30.423194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1326/2680] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:30 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:30.434710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:30.436473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:30.453936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:30.454373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:30.454817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.455541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:30.456260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:30.456705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:30.932320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:30.942492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:30.950614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:30.958603 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e13f228-321f-4828-b16a-89c617effd87 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1502 microversion: 2.91 time: 0.534069 Oct 06 13:00:30.962085 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1327/2681] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:30 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1502 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:30.982810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:30.983442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:31.002652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.003151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.003644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.004285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.004734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.005158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.391731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:31.400655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1933dcf-d7df-487f-ba0f-72bf2451a064 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.423915 Oct 06 13:00:31.406237 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1328/2682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:30 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:31.412388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.415178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:31.425541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.426371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.427002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.428735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.429392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.430063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.442307 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bcd7e3ee-175c-4c6e-b50e-8f8d263babc7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31" status: 202 len: 0 microversion: 2.1 time: 1.042653 Oct 06 13:00:31.443621 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1355/2683] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:30 2022] DELETE /compute/v2.1/os-security-groups/2d541a0f-e5b5-43ce-9794-7b97830a2a31 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:31.452917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.453944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:31.468960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.471744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.472379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.474896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.475565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.477964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.520686 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 HTTP/1.1 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:31.526372 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.528035 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dbb6b39e-2549-4cb7-b92d-ef831a5e2c91'} Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:31.528934 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.530262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.533483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:31.536171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0eeb1263-c973-43c1-87d6-80715d7aa16f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 404 len: 111 microversion: 2.1 time: 0.087122 Oct 06 13:00:31.538847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1356/2684] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:31 2022] DELETE /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:00:31.550328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.553190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:31.568122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.568746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.569188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.571714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.572255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.576114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.663698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:31.679093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-58474d9a-6218-43fb-adb2-99e3750eb98d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.271178 Oct 06 13:00:31.682615 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1329/2685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:31 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:31.692809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.695422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: dbb6b39e-2549-4cb7-b92d-ef831a5e2c91] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:31.711309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.714709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.715467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.716383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:31.718668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:31.719288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:31.759084 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 HTTP/1.1 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:31.763172 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.764580 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'dbb6b39e-2549-4cb7-b92d-ef831a5e2c91'} Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:31.765425 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. Oct 06 13:00:31.766817 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.770394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Instance dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:31.772426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:31.772964 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-905e6b3b-b814-453c-bfaa-092dd9d8719f tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91" status: 404 len: 111 microversion: 2.1 time: 0.087167 Oct 06 13:00:31.775101 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1330/2686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:31 2022] GET /compute/v2.1/servers/dbb6b39e-2549-4cb7-b92d-ef831a5e2c91 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:31.787780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3eae2820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.832784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:31.833622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 3567e110-1af5-4e04-bd82-977291ea5050 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:31.834401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.834401 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050 HTTP/1.1 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:31.836468 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.838068 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3567e110-1af5-4e04-bd82-977291ea5050'} Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.839146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:31.840925 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.842436 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] Oct 06 13:00:31.844036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.845707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 3567e110-1af5-4e04-bd82-977291ea5050 does not exist Oct 06 13:00:31.845707 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-11eb8e82-3248-4cdb-ab4f-89a7620c2061'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:31.846828 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6cf4349-7cb2-48e6-bfed-e598afb3e2bb tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050" status: 404 len: 194 microversion: 2.1 time: 0.067077 Oct 06 13:00:31.847860 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1331/2687] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:31 2022] DELETE /compute/v2.1/os-security-groups/3567e110-1af5-4e04-bd82-977291ea5050 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:31.855714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d475b1790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.877192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65470b77-154c-4ed7-ae17-46a6c0eed983 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.337005 Oct 06 13:00:31.899064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1357/2688] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:31 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:31.912634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:31.913515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:31.914282 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.914282 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 HTTP/1.1 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:31.916584 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.918037 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6'} Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.918853 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:31.920466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.921482 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] Oct 06 13:00:31.924339 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:31.926904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 does not exist Oct 06 13:00:31.926904 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-9033f68d-fada-430b-9f9c-c03a2f846534'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:31.928977 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f37a153-a1fa-4037-b2d4-7159d0d97a0d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6" status: 404 len: 194 microversion: 2.1 time: 0.077244 Oct 06 13:00:31.930005 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1332/2689] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:31 2022] DELETE /compute/v2.1/os-security-groups/b9e6daf6-9cc5-405c-88c6-31fbc1cd46e6 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:00:31.939079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d476c2dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.990615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:31.991349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.006301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.011163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.014325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 807165d4-4160-4596-980e-6628eca36704 does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:32.014927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 807165d4-4160-4596-980e-6628eca36704 not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:32.015573 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.015573 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704 HTTP/1.1 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:32.017619 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.018954 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '807165d4-4160-4596-980e-6628eca36704'} Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.019764 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:32.021256 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.022704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 807165d4-4160-4596-980e-6628eca36704 does not exist Oct 06 13:00:32.025242 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-80ecb95f-52cd-422e-8444-5d57bb464eb7'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.026671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.026912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1bf20013-784e-4cea-99cb-88a308a7ba06 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704" status: 404 len: 194 microversion: 2.1 time: 0.084046 Oct 06 13:00:32.027052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.027052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.027052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.027442 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1358/2690] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:31 2022] DELETE /compute/v2.1/os-security-groups/807165d4-4160-4596-980e-6628eca36704 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:32.033857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d476afc10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.109325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:32.109968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 034c2751-d41b-400b-9751-a65bb0bf9d21 not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:32.110486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.110486 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21 HTTP/1.1 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:32.112309 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.113593 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '034c2751-d41b-400b-9751-a65bb0bf9d21'} Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.114436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:32.115514 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.120916 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 034c2751-d41b-400b-9751-a65bb0bf9d21 does not exist Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-5dbdaa06-41d9-4b8b-97a7-94258cd3e3f9'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ee1fb01-6079-4e2d-a2c8-5689825bfa76 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21" status: 404 len: 194 microversion: 2.1 time: 0.090746 Oct 06 13:00:32.122455 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1359/2691] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:32 2022] DELETE /compute/v2.1/os-security-groups/034c2751-d41b-400b-9751-a65bb0bf9d21 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:32.138324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.140078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.149295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.151228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.152459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.153196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.153662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.156627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.185174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:32.200034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:32.201838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:32.209521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] HTTP exception thrown: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.210917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-29afdbee-31fe-41d5-b7e7-0d5d0ff01195 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1508 microversion: 2.91 time: 0.225582 Oct 06 13:00:32.211490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1333/2692] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:31 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:32.223119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3eae2dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Request method failure captured: Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b HTTP/1.1 Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDAB7y1mHBmPHDtXyyppWe73Div1LsiamFo8d7KnWl9v-Mc6VT6M5OkNOkok7ZjOVqCH7hVlNpfS2yuBxoJ5kXEmhHZZ1n2LcjDOKlfnn8_FwzuICONPvY6BtRH3wl8tdjElWzKTWpiXNjbJ0Jj7d07CcaV0kW_RAeTqh2Wzdl3MAI Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:32.224767 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00cf9170d5cb462abebc8ad2bea567ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}] Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cede20d462824bc28ca072948a075ed3 Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.226065 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f9939237-2dc6-4099-bf94-a1851974517b'} Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.226804 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.227926 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.235585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Returning 404 to user: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.236473 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2f87aee-ec59-4a1c-b43c-27430c373b97 tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 404 len: 111 microversion: 2.1 time: 0.118610 Oct 06 13:00:32.238260 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1360/2693] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:32 2022] DELETE /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:32.248229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.253868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] [instance: f9939237-2dc6-4099-bf94-a1851974517b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.267203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.270243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.270934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.271880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.272563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:32.273169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group 9385d37b-560a-40ba-919d-c325aab16fb3 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:32.273690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.273690 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.273952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.274720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3 HTTP/1.1 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:32.276712 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.278286 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '9385d37b-560a-40ba-919d-c325aab16fb3'} Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.279124 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:32.280221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.282144 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] Oct 06 13:00:32.284539 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.288027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group 9385d37b-560a-40ba-919d-c325aab16fb3 does not exist Oct 06 13:00:32.288027 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-ad81b5af-ab15-4e1b-89b6-82aff27f5c26'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.289007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9baf690b-3166-420c-8ce5-6660249ec5e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3" status: 404 len: 194 microversion: 2.1 time: 0.071004 Oct 06 13:00:32.293678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1334/2694] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:32 2022] DELETE /compute/v2.1/os-security-groups/9385d37b-560a-40ba-919d-c325aab16fb3 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:32.302524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3f3063a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.324054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] HTTP exception thrown: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Request method failure captured: Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b HTTP/1.1 Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDAB7y1mHBmPHDtXyyppWe73Div1LsiamFo8d7KnWl9v-Mc6VT6M5OkNOkok7ZjOVqCH7hVlNpfS2yuBxoJ5kXEmhHZZ1n2LcjDOKlfnn8_FwzuICONPvY6BtRH3wl8tdjElWzKTWpiXNjbJ0Jj7d07CcaV0kW_RAeTqh2Wzdl3MAI Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:32.326061 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00cf9170d5cb462abebc8ad2bea567ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00cf9170d5cb462abebc8ad2bea567ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00cf9170d5cb462abebc8ad2bea567ee"}]}] Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 00cf9170d5cb462abebc8ad2bea567ee Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-285091045 Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cede20d462824bc28ca072948a075ed3 Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-285091045-project Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.327349 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f9939237-2dc6-4099-bf94-a1851974517b'} Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.328048 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. Oct 06 13:00:32.329275 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.330338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:00:32.330428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Neutron security group c55ca3a7-4833-4272-87c7-c185ffe5229e not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:00:32.331276 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.331276 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.332081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] Returning 404 to user: Instance f9939237-2dc6-4099-bf94-a1851974517b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.333072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80e0d906-bdba-451b-83e2-6054605c605b tempest-AttachSCSIVolumeTestJSON-285091045 tempest-AttachSCSIVolumeTestJSON-285091045-project] 10.222.0.26 "GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b" status: 404 len: 111 microversion: 2.1 time: 0.091059 Oct 06 13:00:32.333716 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1361/2695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:32 2022] GET /compute/v2.1/servers/f9939237-2dc6-4099-bf94-a1851974517b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e HTTP/1.1 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:00:32.334855 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.336432 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c55ca3a7-4833-4272-87c7-c185ffe5229e'} Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.337350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:00:32.339350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.340664 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] Oct 06 13:00:32.342209 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:00:32.345402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Security group c55ca3a7-4833-4272-87c7-c185ffe5229e does not exist Oct 06 13:00:32.345402 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-305e9e22-3d74-43c6-8165-56417441d9d2'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:32.345402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d061a4af-353c-4ec1-a5b4-382e5de621b6 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e" status: 404 len: 194 microversion: 2.1 time: 0.049858 Oct 06 13:00:32.345402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1335/2696] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:32 2022] DELETE /compute/v2.1/os-security-groups/c55ca3a7-4833-4272-87c7-c185ffe5229e => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:32.353352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.353987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.365439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.366112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.366627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.367395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.367927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.368420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.417189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:32.435300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.436495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.442967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.452225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.452783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.453519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.454359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.454805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.576542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9691012d-f69a-4b3c-930f-fdf0d556b76d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 204 len: 0 microversion: 2.1 time: 0.226572 Oct 06 13:00:32.578368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1362/2697] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:32 2022] DELETE /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:32.591172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.592224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.607191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.607714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.608164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.608897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.609361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.609816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.898248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:32.910701 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8338dca8-9c6e-4c49-b89b-9a8127bfd134 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.481158 Oct 06 13:00:32.911297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1336/2698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:32 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:32.920798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:32.923564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:32.944426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.948029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.948714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:32.950828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:32.951492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:32.951932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.171628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:33.186669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b06dd15-a6cf-463b-b74b-424c7fd10b1d tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1646 microversion: 2.1 time: 0.601290 Oct 06 13:00:33.189243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1363/2699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:32 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1646 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:33.200685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:33.201598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:33.214354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.215076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.215751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.216625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.217493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.218136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.396410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:33.437502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a413b523-853f-4396-9a06-5a64f5b893b4 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.245066 Oct 06 13:00:33.450005 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1364/2700] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:33 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:33.463112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:33.463112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:33.470952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.471867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.472456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.473437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.474099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.474614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.526835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:33.535535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2df6ea31-2e3f-4b96-baea-e5c5d0fcf7db tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.621605 Oct 06 13:00:33.536845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1337/2701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:32 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:33.596353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:33.611194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:33.613443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:33.620524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ce1b5c2-808c-4dab-bc9c-318eea7ab1a1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1529 microversion: 2.91 time: 0.172316 Oct 06 13:00:33.621338 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1365/2702] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1529 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:33.711364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:33.712294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:33.721071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.723633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.724497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.725809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.727052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.727722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.858601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lazy-loading 'services' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:33.894014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1fdd7a0-ac68-4a23-9458-187ec14eb095 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1934 microversion: 2.91 time: 0.242228 Oct 06 13:00:33.905882 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1338/2703] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1934 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:33.922138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:33.923173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:33.930332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.931304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.932517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.934126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.934981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.942447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.944128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:33.945365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:33.955400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.956117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.956863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:33.957805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:33.958466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:33.959096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.095551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lazy-loading 'services' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:34.130852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:34.135732 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a9adb5c5-d5ef-4276-9016-bc5200c1b0b6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1934 microversion: 2.91 time: 0.217161 Oct 06 13:00:34.137795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1366/2704] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1934 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:34.164037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:34.169718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.170746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.171536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.172457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.173431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.174068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.211821 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d05364b-dd9e-4178-8298-22bc0f3fc4f9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.052628 Oct 06 13:00:34.213520 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1367/2705] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Oct 6 13:00:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:00:34.219682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:34.220820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:34.227785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.229068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.229683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.230926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.231552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.232413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.797911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:34.808347 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d386c33-1a9f-4483-8a8e-0e18db47d3f3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.869749 Oct 06 13:00:34.822824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1339/2706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:33 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:34.830758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:34.831415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:34.838461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.839449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.839585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.840398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:34.840946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:34.841477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:34.877947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lazy-loading 'flavor' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:35.074135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:35.087179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9bb5bb37-588c-40ed-8d76-1909296bc168 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1646 microversion: 2.1 time: 0.867041 Oct 06 13:00:35.087857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1368/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:34 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1646 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:35.093028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:35.093650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:35.111458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.111957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.112399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.113103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.118671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.119821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.156483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:35.164480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7abed2c0-38cf-4ecd-b98e-4e0ec351e55a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action" status: 202 len: 0 microversion: 2.91 time: 0.340118 Oct 06 13:00:35.165309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1340/2708] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:00:34 2022] POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:35.180370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:35.181289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:35.193437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.196651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.197189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.197993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.198458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.198893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.206212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:35.284331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:35.331941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e05f6b9-f7f0-4898-809d-d6401443e4e1 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.242884 Oct 06 13:00:35.332737 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1369/2709] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:35 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:35.338986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41113534-cc14-42a5-895b-49aff31cc262", "name": "network-vif-unplugged", "status": "completed", "tag": "dfe46d27-1bed-4cdd-bbe1-5751d9410117"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:35.350937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.351389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.351830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.366059 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] Creating event network-vif-unplugged:dfe46d27-1bed-4cdd-bbe1-5751d9410117 for instance 41113534-cc14-42a5-895b-49aff31cc262 on n-h2-860556-1 Oct 06 13:00:35.372942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9c446c8e-bdec-4b33-adfa-193b3bdbdca1 req-22bf6cfa-9b4d-4798-8b24-eebbbe1131c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038836 Oct 06 13:00:35.374188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1370/2710] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:35.379883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:35.380587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:35.387332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.387983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.388730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.389786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.390219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.390743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.560960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:35.570639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:35.572340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:35.579169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6244ab6d-af89-451c-a4db-36717d55e5e3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.203501 Oct 06 13:00:35.579964 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1371/2711] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:35 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:35.602994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:35.613340 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f32f15d2-2265-47b8-92a3-a3b6e84a2ae3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.445517 Oct 06 13:00:35.618007 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1341/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:35 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:35.836595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:35.837291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:35.850345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.850842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.854651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:35.855986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:35.856415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:35.856864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.115442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:36.117537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:36.162098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.163448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.164305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.165358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.166992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.167988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.510397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:36.520572 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d54eb2d8-f5bd-4755-92a9-a4d045a00880 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.688083 Oct 06 13:00:36.521354 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1372/2713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:35 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:36.533981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:36.533981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:36.536237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.537804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.539082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.540021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.541634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.542303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.738248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:36.772322 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efac0db2-18d7-4920-b02c-69e1fd5bfeba tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.249700 Oct 06 13:00:36.774171 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1373/2714] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:36 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:36.781221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:36.782322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:36.799703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.814308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.815121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.816118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.816761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.817383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.922997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:36.941498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38729c53-90ab-4e06-b4cf-2efc4edabbf7 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1646 microversion: 2.1 time: 0.832654 Oct 06 13:00:36.953895 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1342/2715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:36 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1646 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:36.953895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:36.953895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:36.963235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.963235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.963235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:36.966814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:36.968686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:36.969436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:37.091425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:37.111708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:37.114380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:37.125003 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-911c7b9d-ad4f-4fb1-af07-bb6582b6f4cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.349097 Oct 06 13:00:37.139710 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1374/2716] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:36 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:37.157649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc66a497-dbfe-4e82-aadc-0d6beaa6c74c", "name": "network-vif-deleted", "tag": "a0cec150-2588-4936-b6f3-abd0ea36573c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:37.183566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:37.184063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:37.184493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:37.200916 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] Creating event network-vif-deleted:a0cec150-2588-4936-b6f3-abd0ea36573c for instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c on n-h2-860556-1 Oct 06 13:00:37.216233 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0cea5cd0-acda-433a-899b-1a39bf2b1118 req-a78b50ec-a8c1-47c1-9616-f7f09f01770b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074723 Oct 06 13:00:37.220783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1375/2717] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:37.546882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:37.547572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:37.554545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:37.555047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:37.555485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:37.556349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:37.556826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:37.557299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:37.907321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:37.919711 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73bc0e9d-6b26-4bc4-86cd-e6260169246e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1532 microversion: 2.1 time: 0.976289 Oct 06 13:00:37.920718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1343/2718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:36 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1532 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:37.925532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:37.929984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:37.937535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:37.938482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:37.939155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:37.939970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:37.940688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:37.941424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.122920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:38.206043 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41297067-657e-4969-b950-b7c64eef4aaf tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.283513 Oct 06 13:00:38.207324 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1344/2719] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:37 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:38.219426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:38.230357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:38.231002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:38.231453 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-713eedee-6324-4438-ba24-cb477504f153 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.686866 Oct 06 13:00:38.232052 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1376/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:37 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:38.248134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:38.248550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.248764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:38.249381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.250053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.251215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.256395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.257076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.264994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.265507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.265995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.266865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.277076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.277866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.342157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.343017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.343483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.344945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lazy-loading 'fault' on Instance uuid bc66a497-dbfe-4e82-aadc-0d6beaa6c74c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:38.468630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2c67f80b24481b9b7e1b2ecc6f481c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e65666907a4c2db886bfe58fdd71c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:38.477710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77bab072-bf92-4eea-b08e-cc53d2ec90e4 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 200 len: 1306 microversion: 2.1 time: 0.269223 Oct 06 13:00:38.478405 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1345/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:38 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:38.484087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:38.501518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:38.503855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:38.516414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9800bd0-ed79-41a3-a230-4c65922989db tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.281998 Oct 06 13:00:38.520726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1377/2722] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:38 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:38.956675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:38.957312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:38.965639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:38.967109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.967618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.969170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:38.971787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:38.973288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:38.973988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.241214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:39.242779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:39.250714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:39.253355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.254766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.255534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.256749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.259142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.260054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.474472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:39.479245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:39.490693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-645690b8-2c2a-41d4-98eb-64f1db438b73 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1532 microversion: 2.1 time: 0.539632 Oct 06 13:00:39.491983 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1346/2723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:38 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1532 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:39.499104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:39.506619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:39.513653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.514217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.514643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.515367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.515952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.516390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.533415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8beb40e-d9d6-41a4-9617-3e738bf7f7fe tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.296549 Oct 06 13:00:39.555459 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1378/2724] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:39 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:39.562677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:39.563439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] [instance: bc66a497-dbfe-4e82-aadc-0d6beaa6c74c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:39.574493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.575383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.576695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.578418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.579418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.580066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.606483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] HTTP exception thrown: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Request method failure captured: Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c HTTP/1.1 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtEaTu3KnkRikDsWporAg0lJH51Mz9qsa0o1kpjiEBnbh6M4prZAcKzBRAvXtGR2YsuRSMGmv__NcUpAB-vRvzij7N1doabQXMvx5onUq9L-t6HLsns3aJHgEMb4_U3fGKlNR32kDJCE-IkVW9JDIflEOPsrewowG6Dhr4mwKU68ooI Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:00:39.609508 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3e65666907a4c2db886bfe58fdd71c1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3e65666907a4c2db886bfe58fdd71c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3e65666907a4c2db886bfe58fdd71c1"}]}] Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b3e65666907a4c2db886bfe58fdd71c1 Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-597641936 Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7e2c67f80b24481b9b7e1b2ecc6f481c Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupsTestJSON-597641936-project Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. Oct 06 13:00:39.610867 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'bc66a497-dbfe-4e82-aadc-0d6beaa6c74c'} Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:00:39.611991 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. Oct 06 13:00:39.613162 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:00:39.616941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Returning 404 to user: Instance bc66a497-dbfe-4e82-aadc-0d6beaa6c74c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:00:39.618245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a100c82c-5d8e-404f-9f92-7ccf500359ed tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c" status: 404 len: 111 microversion: 2.1 time: 0.061540 Oct 06 13:00:39.619979 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1379/2725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:39 2022] GET /compute/v2.1/servers/bc66a497-dbfe-4e82-aadc-0d6beaa6c74c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:00:39.627001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:39.628008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:39.643783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.645448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.647252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.648221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:39.650581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:39.651521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:39.855377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:39.870405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:39.871877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:39.880806 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4954122-874d-4cac-8185-988d1a9f83c5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.258660 Oct 06 13:00:39.881358 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1380/2726] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:39 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:39.890141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d124bf8d-6fc3-4733-987c-ce98de712572 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d47616f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:40.018643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:40.036884 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-374a5dac-8c5e-43c9-bc77-c611ca7414ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.542624 Oct 06 13:00:40.037797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1347/2727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:39 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:40.067651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41113534-cc14-42a5-895b-49aff31cc262", "name": "network-vif-plugged", "status": "completed", "tag": "dfe46d27-1bed-4cdd-bbe1-5751d9410117"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:40.093993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:40.094510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:40.095266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:40.132872 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] Creating event network-vif-plugged:dfe46d27-1bed-4cdd-bbe1-5751d9410117 for instance 41113534-cc14-42a5-895b-49aff31cc262 on n-h2-860556-1 Oct 06 13:00:40.144310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-242f9ab9-0a3a-4f75-8ab3-7a8969b49703 req-3d48a917-d947-48be-9271-6f385e5a19bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087229 Oct 06 13:00:40.145815 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1348/2728] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:40.521236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:40.522953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:40.532110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:40.533155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:40.534568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:40.535735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:40.536396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:40.537099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:40.766989 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d124bf8d-6fc3-4733-987c-ce98de712572 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/48f40ba9-f808-41df-a3ac-0ff2970e7f41" status: 202 len: 0 microversion: 2.1 time: 0.880492 Oct 06 13:00:40.768580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1381/2729] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:39 2022] DELETE /compute/v2.1/os-security-groups/48f40ba9-f808-41df-a3ac-0ff2970e7f41 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:40.797726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:40.798740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:40.806436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:40.807253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:40.807900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:40.808853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:40.809519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:40.810173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:41.399424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:41.453916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:41.466319 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6bae5c99-a9b5-41ae-9b51-fd048dd0c64a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.953570 Oct 06 13:00:41.477617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6933eac-0289-47b7-8889-b9e15bdb080f tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.707822 Oct 06 13:00:41.490269 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1349/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:40 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:41.496912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0cc8fd1-2dde-45f6-a08d-420ccf9e3ec9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] Calling method '.version_select at 0x7f7d3ea9c8b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:41.507684 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1382/2731] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:40 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:41.513528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:41.517378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:41.528904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:41.532615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:41.533086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:41.534013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:41.534393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:41.534838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:41.697254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:41.710441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:41.712204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:41.719527 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e67a7965-f12a-4a5f-9da6-8de1d4c9ae33 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.210684 Oct 06 13:00:41.720681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1383/2732] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:41 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:41.726941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:41.727798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:41.736364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:41.737096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:41.737786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:41.738988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:41.739679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:41.740348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:42.025563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:42.036787 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95ca44b1-114c-467d-b534-3529968ed4ac tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1521 microversion: 2.1 time: 0.313565 Oct 06 13:00:42.053818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1384/2733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:41 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:42.174817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-plugged", "status": "completed", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:42.191555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0cc8fd1-2dde-45f6-a08d-420ccf9e3ec9 tempest-SecurityGroupsTestJSON-597641936 tempest-SecurityGroupsTestJSON-597641936-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/95af230a-c25b-483b-8c9d-d89661cb3b70" status: 202 len: 0 microversion: 2.1 time: 0.699588 Oct 06 13:00:42.192219 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1350/2734] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:00:41 2022] DELETE /compute/v2.1/os-security-groups/95af230a-c25b-483b-8c9d-d89661cb3b70 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:00:42.193425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:42.194266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:42.194975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:42.222248 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] Creating event network-vif-plugged:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h2-860556-1 Oct 06 13:00:42.234507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ff07a1c6-1525-4930-b5ce-2fc1717bf9de req-3b3256f9-2191-4e69-8e18-5f5a59a0ac03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064106 Oct 06 13:00:42.235819 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1385/2735] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:42.490945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:42.491564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:42.500580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:42.501219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:42.502264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:42.505436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:42.506208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:42.506814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:42.529516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:42.531778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:42.551000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:42.554049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:42.555001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:42.557495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:42.558220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:42.558962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.038475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:43.066943 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c4fe402-80d7-4b34-b621-d4b69fddce0d tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.547508 Oct 06 13:00:43.114941 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1386/2736] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:42 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:43.128177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:43.129281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:43.145364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.147386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.148673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.150593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.153476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.154401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.293242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:43.308403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:43.312423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03e9c51c-af36-4357-90eb-7d2d9555e253 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.825273 Oct 06 13:00:43.313543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1351/2737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:42 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:43.318379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:43.319192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:43.323009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:43.324856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:43.331448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.331955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.332402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.333125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.333595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.334077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.360330 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c415cf6-4aae-4b73-9970-c4d1770f9540 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.242483 Oct 06 13:00:43.374199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1387/2738] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:43 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:43.761591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:43.777526 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec31aef3-31cc-4502-a09c-c365245093a0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1506 microversion: 2.1 time: 0.462626 Oct 06 13:00:43.778927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1352/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:43 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:43.808962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:43.809926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:43.820337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.820788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.821231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.822585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:43.823102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:43.823557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:43.843871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:44.110706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:44.111305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:44.118293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.119444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.119889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.120604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.121042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.121472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.190482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:44.381222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:44.454651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad9bfd60-6721-41f3-aa2a-5d5371efb7a3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.350978 Oct 06 13:00:44.455699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1353/2740] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:44 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:44.475165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:44.483735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:44.490536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.493524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.494996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.495980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.496897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.499355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.563938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:44.574081 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1be2255c-8f43-440d-8263-6be1d747ea4c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 200 len: 1506 microversion: 2.1 time: 0.770654 Oct 06 13:00:44.594978 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1388/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:43 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 1506 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:44.599004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:44.606750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:44.623352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.623852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.624299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.625021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.625488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.626011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.824711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:44.837196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:44.840030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:44.852407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24dea8b0-6a3c-40a8-a001-8eeb39fb48a6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.259015 Oct 06 13:00:44.870503 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1389/2742] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:44 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:44.881881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:44.882814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:44.895505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.901425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.902031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.902988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:44.903553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:44.904245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:44.955803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:00:45.094992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4a6444b-d661-4a14-9c5f-3a7ff6f7b9dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 204 len: 0 microversion: 2.1 time: 0.222658 Oct 06 13:00:45.096179 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1390/2743] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:00:44 2022] DELETE /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:00:45.257124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:45.291811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da02e20a-f8c1-4666-b876-f9665000f925 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.823295 Oct 06 13:00:45.293265 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1354/2744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:44 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:45.361827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-576689316", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d177263e-a196-42a7-8555-65753d4f2ed0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:45.486987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:45.487698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:45.499218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] validate_networks() for [('d177263e-a196-42a7-8555-65753d4f2ed0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:00:45.502709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:45.512591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:45.519301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:45.520163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:45.520679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:45.521165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:45.905773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:45.979985 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f20d1fd2-0d8a-4337-9b88-817a11128322 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.496156 Oct 06 13:00:45.981165 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1355/2745] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:45 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:45.991266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:45.992307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:46.003418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:46.004710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:46.005925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:46.007531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:46.008429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:46.010144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:46.169518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:46.178840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:46.192059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:46.198286 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ab14897-3e4c-4388-a1a7-cfa9667c1eae tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.215467 Oct 06 13:00:46.199058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1356/2746] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:45 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:46.322340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:46.323144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:46.332556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:46.338026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:46.341447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:46.345905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:46.348262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:46.349857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:46.761969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:46.770771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f71909f5-f941-45ec-b6bf-990276fe6258 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.453497 Oct 06 13:00:46.776675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1357/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:46 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:47.016149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:47.016689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:47.025162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:47.030990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:47.032912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:47.036457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:47.038081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:47.039978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:47.053215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:48.045010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:48.084748 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0c0ca596-807b-4b80-95cd-8e0792acf254 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 1.072304 Oct 06 13:00:48.087896 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1358/2748] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:47 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:48.099783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:48.120165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:48.134130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.140580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.141362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.144101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.145936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.147723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.356171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:48.371277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:48.375581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:48.381376 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee79a58b-5d1a-40a0-9556-cf7030119d45 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.291598 Oct 06 13:00:48.383319 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1359/2749] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:48 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:48.390545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:48.391170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:48.405223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.405767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.406881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.407649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.408122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.409107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.607724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:00:48.607724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:00:48.607724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:00:48.607724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:00:48.607724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:00:48.635180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.642527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.643346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.644551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:48.645291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:48.646354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:48.693919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:00:48.701058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for user 72051080ff9c4e9d80df2ff14b828464 and project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:00:48.718218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:00:48.720787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:00:48.788415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0fb80020-748d-48d7-82a8-6d1c6c221ee6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428119 Oct 06 13:00:48.790359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1391/2750] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:00:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:00:48.802742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b6d2762-5093-4e04-9312-ccf0ba155a52 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:48.803594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b6d2762-5093-4e04-9312-ccf0ba155a52 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:49.086448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b6d2762-5093-4e04-9312-ccf0ba155a52 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:49.096661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b6d2762-5093-4e04-9312-ccf0ba155a52 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1217 microversion: 2.1 time: 0.297747 Oct 06 13:00:49.131305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1392/2751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:48 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:49.148652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:49.163905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:49.207996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:49.216881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:49.219303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:49.223596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:49.229239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:49.231189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:49.232484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:49.237646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:49.270691 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91e8375b-18d9-4c01-9750-9a78f1fd8641 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.885608 Oct 06 13:00:49.283318 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1360/2752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:48 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:49.411863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:49.412909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:49.433492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:49.434282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:49.438751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:49.442127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:49.443112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:49.443819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:49.773143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:49.784132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:49.799292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:49.800761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:49.816199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-109411db-7810-485d-94c9-efb2d3c47df3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.404853 Oct 06 13:00:49.817357 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1361/2753] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:49 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:49.829819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41113534-cc14-42a5-895b-49aff31cc262", "name": "network-vif-deleted", "tag": "dfe46d27-1bed-4cdd-bbe1-5751d9410117"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:49.862304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:49.862579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31ebcca6-682f-4fda-b43f-b8745839b29c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.728469 Oct 06 13:00:49.863942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1393/2754] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:49 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:49.866184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:49.869290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:49.894277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] Creating event network-vif-deleted:dfe46d27-1bed-4cdd-bbe1-5751d9410117 for instance 41113534-cc14-42a5-895b-49aff31cc262 on n-h2-860556-1 Oct 06 13:00:49.906096 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-edb7780c-3159-4442-b271-0ec4b24f096a req-a124498c-aeb1-4bca-bf54-2d28bc90f189 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087019 Oct 06 13:00:49.907323 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1362/2755] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:50.140989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:50.146014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:50.195399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.199390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.201691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:50.206516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.210670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.212454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:50.311854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:50.312600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:50.344472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.345129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.347447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:50.349270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.354730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.356095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:50.558053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:50.569693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-def2e0fc-0c56-45d5-9392-18f8661a8132 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1221 microversion: 2.1 time: 0.439330 Oct 06 13:00:50.570766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1394/2756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:50 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1221 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:50.850057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:50.850824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:50.869918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.877277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.883526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:50.890416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:50.891517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:50.894913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:51.088831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:51.104887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:51.116219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:51.141261 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56014a18-d08b-4874-a5de-e761cdceeec2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.292929 Oct 06 13:00:51.145194 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1395/2757] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:50 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:51.170596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:51.176662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:51.199773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:51.210116 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f6d93f1c-5989-4874-83f1-4e1b852f350d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.905083 Oct 06 13:00:51.217375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:51.221526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1363/2758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:50 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:51.222937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:51.225673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:51.229125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:51.232332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:51.233051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:51.427964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:51.510974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba6d8087-b0fc-49bd-a039-74b264e42798 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.359240 Oct 06 13:00:51.534374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1396/2759] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:51 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:51.593150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:51.594540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:51.606358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:51.607194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:51.616233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:51.617331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:51.618106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:51.619369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.175028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:52.176372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:52.191758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.192278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.192742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.193456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.198073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.198591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.392365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:52.409775 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17f930a7-6328-4c21-aaea-e3f4d41a27aa tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1269 microversion: 2.1 time: 0.820977 Oct 06 13:00:52.414013 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1364/2760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:51 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1269 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:52.425180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:52.427323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:52.444171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.445003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.447217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.450557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.451390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.451696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.876814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:52.890603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:52.893257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:52.910504 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6fa43ba2-1906-433a-a5b0-f6682e27a238 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.739939 Oct 06 13:00:52.914714 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1397/2761] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:52 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:52.921405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:52.922376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:52.930650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.931948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.932632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:52.933497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:52.934274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:52.935114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:53.517798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:53.592323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6136add4-7233-4e22-9ddf-b23addd93059 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.675213 Oct 06 13:00:53.602679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1398/2762] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:52 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:53.629110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:53.637786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:53.652481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:53.653177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:53.653829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:53.654710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:53.655332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:53.656036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:53.846210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:53.888609 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0ae6981-daa4-4039-914d-0428ebe24a30 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.470280 Oct 06 13:00:53.891270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1365/2763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:52 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:53.950960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:53.957845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:53.982313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:53.984362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:53.984362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:53.984850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:53.985879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:53.986735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:54.194899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:54.210893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b8539a50-0b56-4f76-84ba-80774a05874c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1275 microversion: 2.1 time: 0.606842 Oct 06 13:00:54.213402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1399/2764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:53 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1275 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:54.532335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:54.556465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:54.563077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:54.575970 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e98398c9-c2d4-4bbe-ba00-3bf53b2d9762 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.633330 Oct 06 13:00:54.580628 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1366/2765] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:53 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:00:54.633695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:54.636580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:54.654826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:54.655375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:54.655763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:54.662732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:54.668221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:54.668905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:54.924085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:54.925193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:54.940597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:54.941833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:54.947635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:54.948581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:54.949178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:54.949761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:55.038299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:55.082530 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-175623ea-cbe2-429d-b2a8-b8d5123004c2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.462341 Oct 06 13:00:55.085941 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1400/2766] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:54 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:55.241396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:55.242396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:55.256661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:55.258806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:55.260952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:55.262306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:55.263088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:55.263796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:55.639540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:55.655128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-990777c6-fed0-4c8a-a3a7-49e024de5a4f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1275 microversion: 2.1 time: 0.418960 Oct 06 13:00:55.658056 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1401/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:55 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:55.671320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:55.672550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:55.695794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:55.697873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:55.698418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:55.699667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:55.702242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:55.710958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:55.883064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:55.922375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f38c794-6f40-452c-ac39-02de1aa33cd6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.983476 Oct 06 13:00:55.938519 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1367/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:54 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:56.273407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:56.286630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:56.288266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:56.316351 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21cece6a-f7fd-4a6e-8932-b8d4382de162 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.650282 Oct 06 13:00:56.322875 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1402/2769] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:55 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:56.327414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:56.328041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:56.355343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:56.356099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:56.357905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:56.359501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:56.361637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:56.363472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:56.371536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-890806948", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8c48b9cf-e5b2-4a88-ae77-5ce2fe25bc25"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:00:56.439875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:56.523841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] validate_networks() for [('8c48b9cf-e5b2-4a88-ae77-5ce2fe25bc25', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:00:56.570510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:56.624307 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-03c63e7a-3499-42d5-a6a8-6d0e13a101c3 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.299276 Oct 06 13:00:56.638730 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1403/2770] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:56 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:56.684359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:56.685822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:56.703825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:56.708861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:56.709644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:56.711207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:56.712741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:56.713261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:57.129962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:57.143817 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1780277e-5521-4cf2-b0d7-f715860e3b8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1275 microversion: 2.1 time: 0.461313 Oct 06 13:00:57.144460 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1404/2771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:56 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1275 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:00:57.155069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:57.159324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:57.173411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:57.174163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:57.174930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:57.177715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:57.180677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:57.192334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:58.426727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:58.444684 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bb700b06-41cc-4654-a452-ade55557a07e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.297902 Oct 06 13:00:58.449530 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1405/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:57 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:00:58.470051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:58.470871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:58.479637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:58.480409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:58.481631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:58.484558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:58.485593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:58.486279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:58.661324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:00:58.662335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:00:58.663017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:00:58.663843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:00:58.665096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:00:58.673642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:58.715739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:58.722179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:58.723762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:58.726739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:58.727327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:58.727909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:58.801291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Getting quotas for project 21d4c3e3fd93446491476dbe36b3a9d0. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:00:58.824424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Getting quotas for user 3b1c3b6afd0141dc9864adb77f40553a and project 21d4c3e3fd93446491476dbe36b3a9d0. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:00:58.866633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Going to run 2 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:00:58.879232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 652dad92-c5b0-4027-88c9-0975f5790669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:00:58.887367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:58.910516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:58.913671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:58.930672 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c91fdb75-b730-46bc-8415-dd79286cfa62 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.479194 Oct 06 13:00:58.942585 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1406/2773] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:58 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:58.967773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:58.970503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:58.985992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=652dad92-c5b0-4027-88c9-0975f5790669,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:00:58.998670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:58.999661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.001979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.003957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.005381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.006091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.098577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:00:59.205141 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d250a89b-99ed-411a-98f6-ba1431d97013 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.137330 Oct 06 13:00:59.205646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1368/2774] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:00:59.225275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:59.235998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:59.259592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.266499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.267281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.269653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.272712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.275534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.279356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:00:59.339311 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c57e226-3990-4f76-a9bc-4c3e9a6d3255 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.384311 Oct 06 13:00:59.343948 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1407/2775] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:00:58 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:00:59.356315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:59.379240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:00:59.391271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Searching by: {'deleted': False, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:00:59.449896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.452091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.453358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.458667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.461150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.462711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.507669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2016dcd-39ee-4da0-8b5e-99dc8d3ddf1e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.162200 Oct 06 13:00:59.508374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1408/2776] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:00:59 2022] GET /compute/v2.1/servers => generated 675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:00:59.549142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:00:59.552314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:00:59.578137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.578659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.579177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:00:59.579910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:00:59.583016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:00:59.583675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.174137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:01.194645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2d68337-1273-4055-add2-c15b9f6fbbcd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 1.987856 Oct 06 13:01:01.198501 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1369/2777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:59 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:01.208860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:01.214589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:01.241603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.242100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.242564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.243940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.244430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.245066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.372071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:01.387354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-772124b9-20a0-4695-b5a0-ac312cf896e5 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.858548 Oct 06 13:01:01.388794 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1409/2778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:00:59 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:01.410464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:01.411312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:01.440150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.440956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.441706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.447250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.454280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.456927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.469656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:01.478370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fdf33b4d-715e-48e7-b2d8-390a3bc81dcb tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1223 microversion: 2.1 time: 0.278143 Oct 06 13:01:01.479003 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1370/2779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:01 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1223 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:01.499674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:01.500539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:01.508027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.508736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.509991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:01.511058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:01.511686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:01.512939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.232473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:02.243161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:02.250335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:02.264202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9db44ffe-87f4-45fd-a1a6-2ca022e41be4 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.872627 Oct 06 13:01:02.264816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1410/2780] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:01 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:02.281846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:02.281846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:02.313090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.314774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.315240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.315979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.316450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.316888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.360781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:01:02.404938 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-110cd774-0717-47c2-8560-d4fb126aba75 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1929 microversion: 2.75 time: 0.908786 Oct 06 13:01:02.406064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1371/2781] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:01 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1929 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:02.416469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:02.422225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:02.439305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.440070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.440639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.448009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.448939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.449512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.870471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:02.886093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9e77f47-aaef-478c-9f9f-99bd0e94b223 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 0.473529 Oct 06 13:01:02.902475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1372/2782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:02 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:02.916792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:02.917730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:02.922566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:02.925117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.925831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.926437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.927327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:02.927945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:02.928697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:02.944151 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00fbf8a0-7a6b-48e9-b641-fa7523032ef3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 0.673350 Oct 06 13:01:02.954155 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1411/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:02 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:03.108067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:03.123482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8063dcab-251c-4f65-ac00-54aeac79607c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1271 microversion: 2.1 time: 0.219534 Oct 06 13:01:03.124081 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1373/2784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:02 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:03.297777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:03.298728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:03.311726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.321894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.327620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:03.328531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.329073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.329970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:03.438316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:03.439649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:03.456649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.457155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.457597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:03.458357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.462805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.463268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:03.499824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:03.523280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:03.535533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:03.547892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53c5443a-d2b9-48f4-ae35-0d0a01e510b9 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1556 microversion: 2.91 time: 0.259044 Oct 06 13:01:03.552760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1412/2785] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:03 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1556 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:03.918326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:03.919227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:03.940229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.942074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.942544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:03.948893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:03.951257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:03.953257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:04.518626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:01:04.570512 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac4fd696-0ace-407a-974a-f4ff30c21f7c tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1935 microversion: 2.75 time: 1.135259 Oct 06 13:01:04.571231 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1374/2786] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:03 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1935 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:04.597839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:04.597839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:04.621516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:04.623199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:04.623658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:04.625977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:04.627444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:04.628340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:04.643516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:04.975134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:04.987086 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87f25163-4700-4ea1-bba0-ad8655703ccf tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.075073 Oct 06 13:01:04.989860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1413/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:03 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:04.997719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:05.004826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:05.020461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.022251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.022904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.026588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.027300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.027939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.320612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:05.332611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:05.336665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4492788-d8fa-4a73-9427-4507cef1c361 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1277 microversion: 2.1 time: 0.343875 Oct 06 13:01:05.339009 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1414/2788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:04 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:05.353578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3edafb5b-2e74-447f-b08b-20a09d4ea83b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 0.779579 Oct 06 13:01:05.354156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53273278-4088-4090-9af4-808ffe05bb30", "tag": "4222510b-29b7-4889-b6a4-5e2d104bcb17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:05.376289 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1375/2789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:04 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:05.385012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:05.388788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:05.405062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.405441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.407210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.407884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.408434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.409263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.409952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.410519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.412043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.437295 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] Creating event network-changed:4222510b-29b7-4889-b6a4-5e2d104bcb17 for instance 53273278-4088-4090-9af4-808ffe05bb30 on n-h2-860556-1 Oct 06 13:01:05.450271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f5bf6fad-5ccc-4ccf-b69a-1630fcead241 req-2079d470-1f9c-4b34-b8d6-c3d53a9c3743 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106300 Oct 06 13:01:05.451489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1415/2790] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:05.605348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:05.606937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:05.616932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:05.621985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.622481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.622913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.623625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:05.624077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:05.624501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:05.632183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:05.633892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:05.654632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb3bc954-9dc9-4d04-a45c-5624e0a80095 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.276654 Oct 06 13:01:05.656503 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1376/2791] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:05 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:06.020136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:06.021082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:06.035099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.036944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] Lazy-loading 'services' on Instance uuid 13daf91f-46da-4f84-9035-69f908ac2e4d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:01:06.037472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.040271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:06.044611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.045550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.047812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:06.094434 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2b658d4-143a-43d3-9b06-b2d83ed6b7f2 tempest-ServersAdmin275Test-270336362 tempest-ServersAdmin275Test-270336362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1920 microversion: 2.75 time: 0.493251 Oct 06 13:01:06.109777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1416/2792] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:05 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1920 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:06.156945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:06.157635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:06.168909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.170208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.174905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:06.184232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.184976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.185613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:06.298104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:01:06.633358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ed70d6a-e7b4-45b1-8848-4dc8b375d213 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 204 len: 0 microversion: 2.75 time: 0.481946 Oct 06 13:01:06.637529 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1417/2793] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:01:06 2022] DELETE /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:01:06.647821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:06.648573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:06.667526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.668125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.668563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:06.669283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:06.669784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:06.675369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:07.086737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:07.091206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:07.116125 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7224c544-7a6b-4694-b7e7-29b7a880b336 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1277 microversion: 2.1 time: 0.477117 Oct 06 13:01:07.139268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1418/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:06 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1277 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:07.151339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:07.155712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:07.171261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:07.173614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:07.181542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:07.182629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:07.186439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:07.187205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:07.921922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:07.932695 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d670aab3-32c3-4c6b-8381-e0398a64e8dc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.917572 Oct 06 13:01:07.959447 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1377/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:06 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:07.965107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:07.974087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:07.984541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:08.010001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.013264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.016672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.017627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.019938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.020564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.419676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:08.429246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:08.442538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:08.461145 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27242e33-9824-4151-8688-e56bdc031d89 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1444 microversion: 2.75 time: 0.500346 Oct 06 13:01:08.472471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:08.481928 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7ad9615-295a-4add-bc42-11c0d294ec26 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 1.341081 Oct 06 13:01:08.482142 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1378/2796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:07 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1444 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:08.486631 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1419/2797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:07 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:08.490060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:08.490676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:08.501570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:08.503081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:08.523763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.527772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.528487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.529097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.530054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.530232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.530752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.531046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.531554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:08.532039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:08.532303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.532465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:08.758939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:08.852386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:09.417379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.439875 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4953fe6-08e5-4388-af96-6a3e02410797 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1277 microversion: 2.1 time: 0.948417 Oct 06 13:01:09.453765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1420/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:08 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1277 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:09.464586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:09.466798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:09.489476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:09.498955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:09.499477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:09.499919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:09.503174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:09.503788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:09.504234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:09.647155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.656958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.663433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.681790 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c52f1544-787a-4554-9bba-ea65cfac7b04 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 1.198267 Oct 06 13:01:09.684041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1379/2799] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:08 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:09.695428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:09.697278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:09.719403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:09.721521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:09.723985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:09.728045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:09.728921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:09.729577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:09.948408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.966308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:09.970715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4deb932edd42ab89afe97e2c791e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff413d5b2509412c88ab326dfe2d2f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:10.010124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c63e44f-61ad-4742-a361-6691b13799bb tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 200 len: 1444 microversion: 2.75 time: 0.316861 Oct 06 13:01:10.026360 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1380/2800] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:09 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 1444 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:10.034037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:10.034714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:10.052563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.053097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.058963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.060161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.060886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.061244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.508461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:10.532088 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2945094-5716-482e-9e90-e654a46895cc tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1527 microversion: 2.1 time: 1.085917 Oct 06 13:01:10.533062 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1421/2801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:09 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1527 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:10.547610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:10.550762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:10.580001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.588156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.589564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.598823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.599583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.600208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.791663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:10.805408 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-277befe9-76f1-4fac-9dcc-1c30ef1bb167 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1277 microversion: 2.1 time: 0.269070 Oct 06 13:01:10.822393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1422/2802] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:10 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:10.822393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:10.822393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:10.829548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.830154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.830798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.831625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:10.832208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:10.832885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:10.883145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:10.891552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-46d6b90c-d596-482b-a52d-5a74c01c691d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 0.876457 Oct 06 13:01:10.906243 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1381/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:10 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:11.049168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:11.050260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] [instance: 13daf91f-46da-4f84-9035-69f908ac2e4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:11.070393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.075209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:11.084488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.089403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:11.091189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.093536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.094271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:11.095315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:11.101838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:11.119710 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4885de0e-92e3-488b-b337-f2a25a995cec tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.303871 Oct 06 13:01:11.137222 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] HTTP exception thrown: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. Oct 06 13:01:11.143217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1423/2804] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:10 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Request method failure captured: Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d HTTP/1.1 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE-oSygm-AlJYWcMrGVzhpfKqjoXE-ONrXaUrtie43Ig75rtZwWT0ERdfYrmmLz54xGup88X-Q0sg5z-aK_dyGZWBOfT74nql0ow8BQzXaAvESRi5k9UqfVivUyz5NqvdKHKZll-SZj_fV0PTogDpUj_YK42a8qKVwbmVpEVHRzykI Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.75 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: ff413d5b2509412c88ab326dfe2d2f98 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdmin275Test-388381961 Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:11.144128 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff413d5b2509412c88ab326dfe2d2f98", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff413d5b2509412c88ab326dfe2d2f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff413d5b2509412c88ab326dfe2d2f98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff413d5b2509412c88ab326dfe2d2f98"}]}] Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdmin275Test-388381961 Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: ff413d5b2509412c88ab326dfe2d2f98 Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdmin275Test-388381961 Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdmin275Test-388381961-project Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3e4deb932edd42ab89afe97e2c791e70 Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdmin275Test-388381961-project Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. Oct 06 13:01:11.145521 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '13daf91f-46da-4f84-9035-69f908ac2e4d'} Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:11.146437 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. Oct 06 13:01:11.147708 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:11.158226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] Returning 404 to user: Instance 13daf91f-46da-4f84-9035-69f908ac2e4d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:11.159509 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2544ed7d-9b20-44b1-8ac0-2820d362c996 tempest-ServersAdmin275Test-388381961 tempest-ServersAdmin275Test-388381961-project] 10.222.0.26 "GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d" status: 404 len: 111 microversion: 2.75 time: 0.123969 Oct 06 13:01:11.161073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1382/2805] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:11 2022] GET /compute/v2.1/servers/13daf91f-46da-4f84-9035-69f908ac2e4d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 13:01:11.561279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:11.563434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:11.595438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.596757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.599720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:11.603317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.604966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.608463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:11.835626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:11.836403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:11.853949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.854700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.855272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:11.856192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:11.857097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:11.859333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:13.286592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.298419 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d59470c5-5f29-491a-9320-adb96e566f10 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1509 microversion: 2.1 time: 1.743593 Oct 06 13:01:13.303695 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1424/2806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:11 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1509 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:13.320377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:13.320928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:13.335992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:13.336512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:13.337603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:13.342735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:13.343219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:13.343666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:13.564513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.608172 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca1cfbd6-742d-4187-96b1-02af6e9f404e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 1.776648 Oct 06 13:01:13.608969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1383/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:11 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:01:13.615150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:13.616131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:13.626435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:13.627910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:13.629024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:13.630135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:13.633291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:13.634210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:13.669048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.684955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00d8aae8-28ae-4022-97cd-6884a2c19d71 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 0.378906 Oct 06 13:01:13.685600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1425/2808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:13 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:13.760782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.771764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.775864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:13.802324 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-182e7924-42a3-4be0-9fd3-6bc0dca1d1e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.191994 Oct 06 13:01:13.804545 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1384/2809] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:13 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:13.988697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53273278-4088-4090-9af4-808ffe05bb30", "name": "network-vif-plugged", "status": "completed", "tag": "4222510b-29b7-4889-b6a4-5e2d104bcb17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:14.013584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:14.019715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:14.021927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:14.022587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:14.055682 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] Creating event network-vif-plugged:4222510b-29b7-4889-b6a4-5e2d104bcb17 for instance 53273278-4088-4090-9af4-808ffe05bb30 on n-h2-860556-1 Oct 06 13:01:14.068843 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3de9b372-f5de-4938-b317-701a6c1424c7 req-3351ad32-e45b-4969-8622-d7a0996d65de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084539 Oct 06 13:01:14.070240 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1426/2810] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:14.338725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:14.340162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:14.368271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:14.369337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:14.371718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:14.374930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:14.377113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:14.377687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:14.634480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:14.635294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:14.668148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:14.672372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:14.672870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:14.678740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:14.680299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:14.684356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:14.886733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:14.902817 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9eb14836-7d08-409a-a2e5-28f9903a8070 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1509 microversion: 2.1 time: 0.569580 Oct 06 13:01:14.907793 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1385/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:14 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:14.924004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:14.932783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:14.998983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.001185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.006266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.018798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.019302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.019742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.366327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:15.381318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ffa6920-508d-4efd-b8c2-10864d9bfa70 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 0.752039 Oct 06 13:01:15.382902 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1427/2812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:14 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:15.394354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:15.395803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:15.417077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.417933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.418509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.419240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.419830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.420559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.683401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:15.702329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:15.704986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:15.719605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dbb8385-51fc-45b4-8d3c-590c12e1267d tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.333651 Oct 06 13:01:15.733800 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1428/2813] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:15 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:15.733800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a713e3-e68f-404d-892e-4d78536aa5f5", "tag": "4f7ff207-767b-4a67-aad0-68d78cc5f79a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:15.753730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.754292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.754988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.767660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:15.780928 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] Creating event network-changed:4f7ff207-767b-4a67-aad0-68d78cc5f79a for instance 30a713e3-e68f-404d-892e-4d78536aa5f5 on n-h1-860556-1 Oct 06 13:01:15.788259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02ca2fff-ecb8-4c49-8211-bb191cd64e93 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1317 microversion: 2.1 time: 0.874134 Oct 06 13:01:15.789342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1386/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:14 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:15.803289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8b3e2f2e-513d-42cc-bb1f-538c59d1297f req-76219819-df7c-4c92-9a2d-af51b4044a60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064438 Oct 06 13:01:15.804306 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1429/2815] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:15.930371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:15.932381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:15.943228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.945025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.950215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:15.953315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:15.953967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:15.954522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.111001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-unplugged", "status": "completed", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:16.130956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.133394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.134060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.166530 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] Creating event network-vif-unplugged:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h2-860556-1 Oct 06 13:01:16.202594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6ef52176-8863-412f-99f9-8f6eb348a908 req-ee460059-8f7e-4776-885d-0d8a85c6ef43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095791 Oct 06 13:01:16.210718 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1430/2816] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:01:16.293345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652dad92-c5b0-4027-88c9-0975f5790669", "tag": "d9bfabe5-429d-4a09-a3c7-2929f0d3e214"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:16.335442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.335856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.341624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.391878 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] Creating event network-changed:d9bfabe5-429d-4a09-a3c7-2929f0d3e214 for instance 652dad92-c5b0-4027-88c9-0975f5790669 on n-h2-860556-1 Oct 06 13:01:16.406423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d47098be-a42e-4c40-b113-4fbd71c7631f req-176667d1-4e2d-4cb7-91af-b8a90994dc51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117684 Oct 06 13:01:16.408743 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1431/2817] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:01:16.431613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:16.435541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:16.455514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.458889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.459623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.460486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.463965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.465186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.495481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:16.514057 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8270655d-6350-4561-b628-a3a85dc33285 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1512 microversion: 2.1 time: 0.588594 Oct 06 13:01:16.522476 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1387/2818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:15 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1512 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:16.563297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:16.565835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:16.577093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.578214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.579075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:16.582086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:16.582086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:16.582086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.099560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:18.113462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a33ca9a7-d20c-4915-8fa1-e408b7045908 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1452 microversion: 2.1 time: 1.568820 Oct 06 13:01:18.118027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1388/2819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:16 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1452 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:01:18.150910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:18.154487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:18.187635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.188012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:18.189370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.190800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.192187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.193714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.194364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.199171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2bb2ec39-aca4-436c-9d4c-4d50558452b0 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 1.787101 Oct 06 13:01:18.213335 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1432/2820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:16 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:18.234208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:18.240542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:18.265050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.272251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.272874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.281049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.281049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.281049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.492305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:18.509482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:18.518332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:18.533200 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb465ee2-8013-4878-8765-22a8e4dcb7bf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.413817 Oct 06 13:01:18.536525 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1389/2821] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:18 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:18.550283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:18.551517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:18.573573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.582446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.583289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.584069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.584550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.584986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.672729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lazy-loading 'flavor' on Instance uuid 69deb394-39d0-4415-9693-ce716eb374b0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:01:18.696850 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'shelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state shelved_offloaded Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 14 Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:18.699537 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: {"shelve": {}} Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:01:18.701179 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'shelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state shelved_offloaded Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'shelve': {}}} Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:18.702069 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state shelved_offloaded Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:18.705060 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:18.706488 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state shelved_offloaded Oct 06 13:01:18.706488 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:18.706488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'shelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state shelved_offloaded {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:18.706488 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a0a7d2ed-663e-4564-986c-0eac1d2d6278 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 155 microversion: 2.1 time: 0.161981 Oct 06 13:01:18.706488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1390/2822] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:01:18 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 155 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:18.713802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:18.714380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:18.736125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.736632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.737078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.737848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:18.738317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:18.738748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:18.870087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129614) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 13:01:19.012051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:19.089037 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5b5fd2ab-184c-4dba-930f-178d3b2ac4f6 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.381821 Oct 06 13:01:19.094174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1391/2823] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:01:18 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:01:19.111932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:19.114458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:19.139639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:19.141960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:19.144903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:19.152029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:19.155621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:19.158794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:19.389175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:19.401987 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-037f1104-133b-49fc-b422-caadb2375beb tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1508 microversion: 2.1 time: 1.184420 Oct 06 13:01:19.405103 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1433/2824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:18 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1508 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:19.442526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:19.443731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:19.460256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:19.466415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:19.468044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:19.468962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:19.469587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:19.470216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:20.299040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:20.328643 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1fe65b2-aa40-4637-b2ce-8fdcbc135750 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1460 microversion: 2.1 time: 1.230168 Oct 06 13:01:20.330836 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1392/2825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:19 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1460 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:20.350431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:20.351816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:20.375837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:20.376980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:20.377610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:20.381288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:20.382003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:20.382628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:20.970817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:20.985091 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f545d39f-5329-4d48-ac15-96f272dd54f5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 1.578574 Oct 06 13:01:20.999943 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1434/2826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:19 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:21.041154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:21.042374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:21.077707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.080745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.081415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:21.081559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:21.085257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.088696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.092937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:21.095125 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41dd8c2c-1b7f-4033-a8d4-5e74cf8cdb6e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1508 microversion: 2.1 time: 0.761712 Oct 06 13:01:21.109516 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1393/2827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:20 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1508 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:21.447629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:21.465482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:21.466889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:21.518154 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac98743a-0e12-4076-a9f3-c3d27696070b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.516213 Oct 06 13:01:21.518772 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1435/2828] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:21 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:21.575501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:21.578141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:21.613303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.619948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.620786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:21.624991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.629837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.630787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:21.865523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce1cc6fd-3945-40e6-9ff4-faaeafcf68d0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "PUT /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1080 microversion: 2.1 time: 0.313969 Oct 06 13:01:21.879262 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1436/2829] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:01:21 2022] PUT /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1080 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:21.896142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:21.910830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:21.942378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.947192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.950601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:21.953792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:21.955843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:21.957635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:22.017237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:22.117439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1352788130", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a3976e54-2526-447e-9882-cadece24aa4d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:22.278827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] validate_networks() for [('a3976e54-2526-447e-9882-cadece24aa4d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:01:22.534954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:22.560369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f846de3-3e49-4d59-a912-3e1087f535d0 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1460 microversion: 2.1 time: 0.679165 Oct 06 13:01:22.589216 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1437/2830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:21 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1460 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:22.613796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:22.623313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:22.645781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:22.646701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:22.651527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:22.660898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:22.662940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:22.664239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:23.023850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:23.065904 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a9954a2-4947-4d98-a5ba-ac6d7b6ddfa3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1506 microversion: 2.1 time: 0.465952 Oct 06 13:01:23.107127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1438/2831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:22 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:23.121607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:23.123222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:23.134741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:23.136289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:23.137394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:23.138957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:23.140084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:23.141535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:23.638351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:23.653272 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e3ccaad-e158-4967-9f6f-6506e0bd6d10 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 0.543367 Oct 06 13:01:23.678326 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1439/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:23 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:24.132396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f22e1898-6026-4c4d-b75e-be77c4b9caa3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Calling method '.version_select at 0x7f7d475bf550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.179723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f22e1898-6026-4c4d-b75e-be77c4b9caa3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f22e1898-6026-4c4d-b75e-be77c4b9caa3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/b953169c-427b-4822-a5f3-21895ccc704d/metadata/os_distro HTTP/1.1 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:24.188478 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'image_id': 'b953169c-427b-4822-a5f3-21895ccc704d', 'id': 'os_distro'} Oct 06 13:01:24.189872 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:24.192074 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b953169c-427b-4822-a5f3-21895ccc704d Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:24.193212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b953169c-427b-4822-a5f3-21895ccc704d could not be found. Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:24.194536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:24.195672 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.200721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f22e1898-6026-4c4d-b75e-be77c4b9caa3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:24.201888 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f22e1898-6026-4c4d-b75e-be77c4b9caa3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "DELETE /compute/v2.1/images/b953169c-427b-4822-a5f3-21895ccc704d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.512306 Oct 06 13:01:24.202702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1440/2833] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Oct 6 13:01:23 2022] DELETE /compute/v2.1/images/b953169c-427b-4822-a5f3-21895ccc704d/metadata/os_distro => generated 62 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:24.212108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.217759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:24.231748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.232416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.233146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.237082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.237835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.238580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.360664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:24.370946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:24.378592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:24.381603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:01:24.382107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:01:24.382703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:01:24.383121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:01:24.385245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:01:24.390939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0dbd9e70-ea09-41f6-9ec8-55f3dfb097fe tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.186974 Oct 06 13:01:24.418340 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1441/2834] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:24 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:24.425311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.425860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.428990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.430022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:24.434534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.440380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.440900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.441356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.456676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.458357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.459075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.460686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.462660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.468826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.496834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:24.513458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for user d9bc79cb12634352b8fc75ea5bd40a61 and project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:24.544657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:01:24.550584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:01:24.668599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-368fbce1-a299-48fe-a1d4-bfcdd58eb36b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.555246 Oct 06 13:01:24.669318 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1394/2835] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:01:24.691430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.693055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:24.713821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.720608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.721100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.721928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:24.722417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:24.722858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:24.740491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:24.749106 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16e7e4b2-ea3f-4010-bf9b-32684ab53283 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1506 microversion: 2.1 time: 0.329358 Oct 06 13:01:24.772064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1442/2836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:24 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:24.780970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4e2b9dd-3da1-4c31-b450-30ffb67b35d5 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Calling method '.version_select at 0x7f7d475bf4c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.826377 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c4e2b9dd-3da1-4c31-b450-30ffb67b35d5 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4e2b9dd-3da1-4c31-b450-30ffb67b35d5 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/images/6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2/metadata/os_version HTTP/1.1 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:24.830298 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'image_id': '6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2', 'id': 'os_version'} Oct 06 13:01:24.832157 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:24.833032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2 Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:24.834132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2 could not be found. Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:24.835300 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:24.836432 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:24.842664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4e2b9dd-3da1-4c31-b450-30ffb67b35d5 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:24.843871 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4e2b9dd-3da1-4c31-b450-30ffb67b35d5 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "GET /compute/v2.1/images/6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.070642 Oct 06 13:01:24.844677 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1443/2837] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Oct 6 13:01:24 2022] GET /compute/v2.1/images/6f538bf6-6d75-4151-91ab-c1b4fbdd3bd2/metadata/os_version => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:24.856091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4058c33-8238-4b0c-8e23-24d4de0e652e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:24.864836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4058c33-8238-4b0c-8e23-24d4de0e652e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.143681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b4058c33-8238-4b0c-8e23-24d4de0e652e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:25.154420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4058c33-8238-4b0c-8e23-24d4de0e652e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1208 microversion: 2.1 time: 0.307081 Oct 06 13:01:25.157226 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1444/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:24 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1208 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:25.171639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:25.172476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.189423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.191206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.191778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.193099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.199007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.200775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.386911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:25.410768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d31db2d5-9940-433e-9f78-7c93e4d7e4da tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.728555 Oct 06 13:01:25.430916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1395/2839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:24 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:25.444551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:25.452122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.471988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.473843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.474533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.476092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.481689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.483744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.670619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:01:25.672766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:01:25.673380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:01:25.676156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:01:25.676717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:01:25.824996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.842704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.843535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.845680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.846805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.847459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.848086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.855385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:25.875513 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3e058ec-b512-44a1-b995-3359649fdecf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 0.715257 Oct 06 13:01:25.894087 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1445/2840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:25 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:25.907261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc194932-002a-439e-9110-455488cef3dd tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Calling method '.version_select at 0x7f7d3e720c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:25.911286 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d74e8452-c7ae-4f27-ae6f-1a740bbcdf68 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "POST /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30/action" status: 202 len: 1112 microversion: 2.1 time: 0.477995 Oct 06 13:01:25.913160 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1396/2841] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:01:25 2022] POST /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30/action => generated 1112 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 06 13:01:25.928813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:25.929804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.946238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.947990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.950271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.951369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.953823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:25.954567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:25.956583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-dc194932-002a-439e-9110-455488cef3dd tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc194932-002a-439e-9110-455488cef3dd tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/images/a6b6cd00-09b5-44ec-a883-3fcb544bbc6c/metadata HTTP/1.1 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:25.959506 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'image_id': 'a6b6cd00-09b5-44ec-a883-3fcb544bbc6c'} Oct 06 13:01:25.960833 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:25.961693 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6b6cd00-09b5-44ec-a883-3fcb544bbc6c Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:25.962791 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6b6cd00-09b5-44ec-a883-3fcb544bbc6c could not be found. Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:25.966594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:25.970460 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:25.973970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc194932-002a-439e-9110-455488cef3dd tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:25.975083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc194932-002a-439e-9110-455488cef3dd tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "GET /compute/v2.1/images/a6b6cd00-09b5-44ec-a883-3fcb544bbc6c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079812 Oct 06 13:01:25.982335 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1446/2842] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 13:01:25 2022] GET /compute/v2.1/images/a6b6cd00-09b5-44ec-a883-3fcb544bbc6c/metadata => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:25.988585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:25.989809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:25.998280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:25.999132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.000599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.001617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:26.002358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.003121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.148832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:26.163323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:26.167247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:26.184434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c3fe8b44-bc47-4cd0-a877-0f39c9ecb7b3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.269583 Oct 06 13:01:26.185041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1397/2843] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:25 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:26.198922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdf680fd-a2e4-4ce9-8698-712e78cac95f tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Action: 'update_all', calling method: .version_select at 0x7f7d3ea1b1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:26.241600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-cdf680fd-a2e4-4ce9-8698-712e78cac95f tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdf680fd-a2e4-4ce9-8698-712e78cac95f tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/images/5941340f-e8b6-46c4-b28a-3fc156f4b830/metadata HTTP/1.1 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 57 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:26.261422 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:01:26.263194 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'image_id': '5941340f-e8b6-46c4-b28a-3fc156f4b830', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.264093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5941340f-e8b6-46c4-b28a-3fc156f4b830 Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.265368 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5941340f-e8b6-46c4-b28a-3fc156f4b830 could not be found. Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:26.266750 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:26.268001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.269989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdf680fd-a2e4-4ce9-8698-712e78cac95f tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:26.269989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdf680fd-a2e4-4ce9-8698-712e78cac95f tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "PUT /compute/v2.1/images/5941340f-e8b6-46c4-b28a-3fc156f4b830/metadata" status: 404 len: 62 microversion: 2.1 time: 0.075305 Oct 06 13:01:26.269989 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1398/2844] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:01:26 2022] PUT /compute/v2.1/images/5941340f-e8b6-46c4-b28a-3fc156f4b830/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:26.273465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:26.284416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:26.301372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:26.302130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.302790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.303702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:26.304318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.304908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.395756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:26.421787 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b7b9ee5-a159-4642-a127-38980206150c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.437582 Oct 06 13:01:26.429041 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1447/2845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:25 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:26.439909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-880670a1-6f0b-4b83-895a-a246200572c3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Action: 'update', calling method: .version_select at 0x7f7d476a84c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:26.498827 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-880670a1-6f0b-4b83-895a-a246200572c3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-880670a1-6f0b-4b83-895a-a246200572c3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/images/5778355d-47c3-4d87-a43a-c625ae234d0e/metadata/os_distro HTTP/1.1 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 30 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:26.506935 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: {"meta": {"os_distro": "alt"}} Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:01:26.508292 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'image_id': '5778355d-47c3-4d87-a43a-c625ae234d0e', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.509178 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5778355d-47c3-4d87-a43a-c625ae234d0e Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.510318 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5778355d-47c3-4d87-a43a-c625ae234d0e could not be found. Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:26.511523 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:26.512653 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.520147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-880670a1-6f0b-4b83-895a-a246200572c3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:26.522666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-880670a1-6f0b-4b83-895a-a246200572c3 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "PUT /compute/v2.1/images/5778355d-47c3-4d87-a43a-c625ae234d0e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.091768 Oct 06 13:01:26.532952 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1448/2846] 10.222.0.26 () {60 vars in 1310 bytes} [Thu Oct 6 13:01:26 2022] PUT /compute/v2.1/images/5778355d-47c3-4d87-a43a-c625ae234d0e/metadata/os_distro => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:26.551483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:26.552119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:26.581605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:26.593277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19652ff7-2dd9-4e2d-8e47-67d1e47a19cb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1260 microversion: 2.1 time: 0.328387 Oct 06 13:01:26.595908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1399/2847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:26 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1260 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:26.603192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:26.603856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.604298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.620114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:26.620868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:26.621328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:26.636115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2faf24f9-fad3-469a-9cb3-d8ae3c62e236 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Action: 'create', calling method: .version_select at 0x7f7d3f277e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:26.691626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2faf24f9-fad3-469a-9cb3-d8ae3c62e236 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] HTTP exception thrown: Image not found. Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2faf24f9-fad3-469a-9cb3-d8ae3c62e236 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Request method failure captured: Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/images/165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0/metadata HTTP/1.1 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 57 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGiPhy35MjbUGH4uzI1_KJBfdMWTJUCnlr47Y3vX8mn616VLkPu8oXUg0E_w4Op3wyQvIbbUCLLPPHHTGOM0DEJazx3NR0nPHArsO2mTu-nh0GwvDKhkSXlvltmnkfI918l2HwUkCctjwjd09OCZoYIscELBXIPtDf2O13lKMgg8rM Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:26.694250 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c5eb2a2179401eabf27c799c2cf076", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c5eb2a2179401eabf27c799c2cf076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c5eb2a2179401eabf27c799c2cf076"}]}] Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 89c5eb2a2179401eabf27c799c2cf076 Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200 Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ff98f78b5b41463e8ea6ef924a224e0a Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1777264200-project Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:01:26.695916 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'image_id': '165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.696926 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0 Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:01:26.698352 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0 could not be found. Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:26.699692 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:01:26.701044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:26.702655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2faf24f9-fad3-469a-9cb3-d8ae3c62e236 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:26.702655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2faf24f9-fad3-469a-9cb3-d8ae3c62e236 tempest-ImagesMetadataNegativeTestJSON-1777264200 tempest-ImagesMetadataNegativeTestJSON-1777264200-project] 10.222.0.26 "POST /compute/v2.1/images/165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080905 Oct 06 13:01:26.702655 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1400/2848] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Oct 6 13:01:26 2022] POST /compute/v2.1/images/165ee07e-b2b2-47b3-a5c4-1fab33e4b4e0/metadata => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:26.989829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1802597072", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "2afa6420-716f-474d-b2c7-a93ecf6eda53"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:27.181925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] validate_networks() for [('2afa6420-716f-474d-b2c7-a93ecf6eda53', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:01:27.915787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:27.924969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96dbf89e-74df-4f17-83b9-2c5f241c0d6a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 1.388299 Oct 06 13:01:27.945573 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1449/2849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:26 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:27.956411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:27.959902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:27.968826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:27.969500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:27.970240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:27.971172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:27.971882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:27.972466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.073362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:29.087771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99d8eee0-edb1-4642-b911-dc08593310c1 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 1.139515 Oct 06 13:01:29.091814 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1450/2850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:27 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:29.103772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:29.154039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.155788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.160192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.219839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] Creating event network-changed:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h1-860556-1 Oct 06 13:01:29.241563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1137203b-cdc9-4f49-b423-a07f69e926bb req-0d55746f-a38e-475d-b5a2-52af7e400cb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148089 Oct 06 13:01:29.243831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1451/2851] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:29.265786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:29.266537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:29.301205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.301800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.305428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.310327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.311401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.312093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.380196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:01:29.381667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:01:29.383824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:01:29.384618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:01:29.385262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:01:29.407109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.410891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.415934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.422085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.426495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.429673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.503449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Getting quotas for project ab7fa2ec3b9243b58610250907ea9c73. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:29.517927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Getting quotas for user f28f44f509374131894128efad3281e5 and project ab7fa2ec3b9243b58610250907ea9c73. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:29.552760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:01:29.561231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:01:29.675892 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60464a6e-bc2c-422a-9ce2-a2168084f371 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.838500 Oct 06 13:01:29.680936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1401/2852] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:01:29.689269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:29.690294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:29.701522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.702551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.703213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:29.704720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:29.705379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:29.706127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:30.124672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:30.137544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:30.139052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:30.157848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c9ea339-c161-4350-9bba-6750869aca17 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.907575 Oct 06 13:01:30.158436 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1452/2853] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:29 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:30.200291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:30.200904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:30.236204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:30.236716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:30.237162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:30.237916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:30.238380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:30.238812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:31.076183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:31.092589 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e842c2ce-2c2a-4a98-b7f5-de4246f06f8f tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 1.406061 Oct 06 13:01:31.094322 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1402/2854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:29 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:31.536893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:31.547129 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fba3ed92-3e06-45ae-80a2-d2c81fdb919f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 1.351162 Oct 06 13:01:31.556381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1453/2855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:30 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:31.577190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:31.590970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:31.621680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:31.622560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:31.628377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:31.630603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:31.631637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:31.633611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:31.838749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-438e5395-d1cb-4261-890f-a2d44b0c75e9 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Action: 'create', calling method: .version_select at 0x7f7d3eae2dc0>, body: {"keypair": {"name": "tempest-keypair-265486591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJVZ0JxOr7a9GGoy0k3CCBphftGKteoPy5ZjJyB/kWmWHPCSui55W+VTHqlml/Q9G9MwXfFOU48AZBG3xL7fIScHl1gITLcNr1SM8g8xASNdWM5tl64uQsiQAVy9YadxA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:31.883063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-438e5395-d1cb-4261-890f-a2d44b0c75e9 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Getting quotas for project 2570fcfed5384a709d390737306e0d3c. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:31.895580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-438e5395-d1cb-4261-890f-a2d44b0c75e9 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Getting quotas for user 8a6007f23e7443d68385fd3b5f9c0d4c and project 2570fcfed5384a709d390737306e0d3c. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:31.910641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:31.988670 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-438e5395-d1cb-4261-890f-a2d44b0c75e9 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.893060 Oct 06 13:01:31.993811 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1403/2856] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:32.003984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:32.014876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:32.040179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:32.040512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:32.042678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:32.049235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:32.050031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:32.050638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:32.329199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:32.339727 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16cd9023-75a0-4b3e-8860-a5d3522a876e tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1276 microversion: 2.1 time: 0.348958 Oct 06 13:01:32.356635 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1404/2857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:31 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:32.389180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a713e3-e68f-404d-892e-4d78536aa5f5", "name": "network-vif-plugged", "status": "completed", "tag": "4f7ff207-767b-4a67-aad0-68d78cc5f79a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:32.451238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:32.452374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:32.454494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:32.504153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] Creating event network-vif-plugged:4f7ff207-767b-4a67-aad0-68d78cc5f79a for instance 30a713e3-e68f-404d-892e-4d78536aa5f5 on n-h1-860556-1 Oct 06 13:01:32.520751 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ad8fd875-64ba-4c20-a754-46ba7eceb0b5 req-291e03fa-7c2f-49e5-b34e-fce4e1313fa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161886 Oct 06 13:01:32.532566 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1405/2858] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:32.538442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:32.544929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:32.569380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:32.570073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:32.575870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:32.584132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:32.587324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:32.589401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:33.103898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:33.115094 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9498d316-662d-4642-9557-90ed3db90121 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 1.557490 Oct 06 13:01:33.128781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1454/2859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:31 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:33.315880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af8db74d-9b1a-4dda-aa05-e1c7a357e8a2 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e708c10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIuCE7PgF6emIZokNHUNdmqWxWR2un4CnIW+5fcf+6bZjMFb1ZCMVb6A+9KkzfvIcJBzUvgmbE4O6LLRRzh+Wt4y2Et6K4lgkvixA6S/S4sj62d/mnM+rroBMtwlNvBgw=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af8db74d-9b1a-4dda-aa05-e1c7a357e8a2 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 257 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:33.321846 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:33.323368 n-d-860556-1 devstack@n-api.service[129615]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIuCE7PgF6emIZokNHUNdmqWxWR2un4CnIW+5fcf+6bZjMFb1ZCMVb6A+9KkzfvIcJBzUvgmbE4O6LLRRzh+Wt4y2Et6K4lgkvixA6S/S4sj62d/mnM+rroBMtwlNvBgw=="}} Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIuCE7PgF6emIZokNHUNdmqWxWR2un4CnIW+5fcf+6bZjMFb1ZCMVb6A+9KkzfvIcJBzUvgmbE4O6LLRRzh+Wt4y2Et6K4lgkvixA6S/S4sj62d/mnM+rroBMtwlNvBgw=='}}} Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:33.324200 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:33.325399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:01:33.327132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:01:33.328456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 06 13:01:33.328456 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:33.328456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af8db74d-9b1a-4dda-aa05-e1c7a357e8a2 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:33.328456 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af8db74d-9b1a-4dda-aa05-e1c7a357e8a2 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.193202 Oct 06 13:01:33.336837 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1455/2860] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:33 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:01:33.394083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:33.394800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:33.416991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:33.417519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:33.418003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:33.418740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:33.419205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:33.419633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:33.705346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:33.714857 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3643c09a-fcae-4f6c-a4cc-12b3efac8346 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1319 microversion: 2.1 time: 1.180365 Oct 06 13:01:33.722815 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1406/2861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:32 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1319 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:33.745929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:33.746805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:33.765795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:33.766310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:33.766734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:33.767455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:33.767914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:33.786421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:33.863961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:33.881057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:33.887826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:33.918359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b0bb55e-74c0-410c-b082-1e9d9b5ce1af tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.580330 Oct 06 13:01:33.954201 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1456/2862] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:33.982620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:33.986823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:34.019862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:34.022552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:34.025990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:34.030626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:34.031833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:34.032955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:34.763877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:34.784758 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-24c09a11-100f-4b17-ab35-97d8a20a5393 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 1.060379 Oct 06 13:01:34.797056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:34.802682 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1407/2863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:33 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:34.815126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3ea523a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244818877", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:34.815542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b0b1002-5c18-4dec-af89-3c0fddc08be4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.851714 Oct 06 13:01:34.816173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1457/2864] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:33 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:34.845571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:34.846663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:34.870795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:34.880677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:34.880677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:34.880677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:34.880677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:34.880677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:34.939044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:34.970619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for user c14d863250f7405a91ca5639fad7344b and project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:35.070083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 2167 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244818877", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:01:35.109199 n-d-860556-1 devstack@n-api.service[129614]: exception: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1244818877', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:35.112270 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:35.116163 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:35.119313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:35.120570 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-adeead97-12dd-497b-b846-5107d218f72f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.316485 Oct 06 13:01:35.121170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1408/2865] 10.222.0.26 () {60 vars in 1160 bytes} [Thu Oct 6 13:01:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:01:35.126125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:35.129154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:35.152244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:35.185246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:35.187495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:35.190468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:35.196973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:35.202131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:35.203013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:35.811903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:35.824670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a64ad486-78ff-4f63-a5d6-760b5b1b00b2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 1.006202 Oct 06 13:01:35.831153 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1458/2866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:34 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:35.837250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652dad92-c5b0-4027-88c9-0975f5790669", "name": "network-vif-plugged", "status": "completed", "tag": "d9bfabe5-429d-4a09-a3c7-2929f0d3e214"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:35.871554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:35.876334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:35.876987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:35.909220 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] Creating event network-vif-plugged:d9bfabe5-429d-4a09-a3c7-2929f0d3e214 for instance 652dad92-c5b0-4027-88c9-0975f5790669 on n-h2-860556-1 Oct 06 13:01:35.919935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0bbf6b54-728d-4e10-b23c-1d2c8c408f6a req-ee7e2179-afa9-4715-a271-f115d8f7533f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087536 Oct 06 13:01:35.925268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1459/2867] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:35.933294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:35.942913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:35.961191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:35.962604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:35.963219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:35.964143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:35.964758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:35.965336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.313027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:36.338856 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bf09df9-898f-404c-ae60-2d60c92e6cc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 1.213078 Oct 06 13:01:36.342791 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1409/2868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:35 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:36.356390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:36.357308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:36.368876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.369689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.370350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.371468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.383423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.385722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.622251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:36.641579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:36.645272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:36.654104 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-461f9168-ecf1-41b0-a037-77a9146e0027 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.307327 Oct 06 13:01:36.655607 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1410/2869] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:36 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:36.662067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b824a77-884e-41e9-b2a6-e7094fb7b4f4 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e9ab790>, body: {"keypair": {"name": "tempest-keypair-409613155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/7wTYtmfKWUNdMsoh1PUDiiyhR//BHXrG2CiwOxzNwXrDlmBeNoXcyr0KEHlsfzQbcL+uTxXX0gd4O+MnIMD7Tst3RHTKAaI+svyYPml3IlZqd13UkEIkem7zMrchTug=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:36.680719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8b824a77-884e-41e9-b2a6-e7094fb7b4f4 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:36.689852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8b824a77-884e-41e9-b2a6-e7094fb7b4f4 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for user c14d863250f7405a91ca5639fad7344b and project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:36.722497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:36.730937 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b824a77-884e-41e9-b2a6-e7094fb7b4f4 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073940 Oct 06 13:01:36.731966 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1411/2870] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:36.737918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-581be0e2-6898-4934-b6df-990843ef6922 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 200 len: 1505 microversion: 2.1 time: 0.809299 Oct 06 13:01:36.750007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:36.750007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:36.751409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1460/2871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:35 2022] GET /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 1505 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:36.761540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.761540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.761540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.762084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.762343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.762783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.769338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:36.770613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:36.782047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.782523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.783021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.783926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:36.790361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:36.790361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:36.802397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:37.433062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:37.441122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:37.446482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e393f63-7241-4ff6-b6a9-87e87804884e tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.712717 Oct 06 13:01:37.447247 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1412/2872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:36 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:37.453284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e941820>, body: {"keypair": {"name": "tempest-keypair-409613155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5NKDEASCqzhFOOLBgaEu+FEVblAGugUL9Or/IQx7GBb2iiW3Lp9rLLojX94+vXIiuZgjUiUyE5Kn4sBY/T4luYPkOWgFv8N/L5H4M7cs7X5Yy+N0Dcdh+qGYE77h4BA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:37.463059 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c5799f3-b349-4ae7-9565-5fe9bc4bd0eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.710122 Oct 06 13:01:37.463978 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1461/2873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:36 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:37.470943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:37.471555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 652dad92-c5b0-4027-88c9-0975f5790669] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:37.472884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:37.478338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for user c14d863250f7405a91ca5639fad7344b and project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:37.485266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.485798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.486277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.486981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.487450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.487897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.511879 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] HTTP exception thrown: Key pair 'tempest-keypair-409613155' already exists. Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 272 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: {"keypair": {"name": "tempest-keypair-409613155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5NKDEASCqzhFOOLBgaEu+FEVblAGugUL9Or/IQx7GBb2iiW3Lp9rLLojX94+vXIiuZgjUiUyE5Kn4sBY/T4luYPkOWgFv8N/L5H4M7cs7X5Yy+N0Dcdh+qGYE77h4BA=="}} Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: exception: Key pair 'tempest-keypair-409613155' already exists. Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-409613155', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5NKDEASCqzhFOOLBgaEu+FEVblAGugUL9Or/IQx7GBb2iiW3Lp9rLLojX94+vXIiuZgjUiUyE5Kn4sBY/T4luYPkOWgFv8N/L5H4M7cs7X5Yy+N0Dcdh+qGYE77h4BA=='}}} Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result.read() Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c14d863250f7405a91ca5639fad7344b-tempest-keypair-409613155' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 06 13:01:37.530896 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi session.flush() Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result.read() Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 06 13:01:37.535291 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c14d863250f7405a91ca5639fad7344b-tempest-keypair-409613155' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 6, 13, 1, 37, 500179), 'updated_at': None, 'name': 'tempest-keypair-409613155', 'user_id': 'c14d863250f7405a91ca5639fad7344b', 'fingerprint': '74:cd:a4:76:77:81:aa:5e:fd:3f:31:d3:21:01:8f:53', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5NKDEASCqzhFOOLBgaEu+FEVblAGugUL9Or/IQx7GBb2iiW3Lp9rLLojX94+vXIiuZgjUiUyE5Kn4sBY/T4luYPkOWgFv8N/L5H4M7cs7X5Yy+N0Dcdh+qGYE77h4BA==', 'type': 'ssh'}] Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi keypair.create() Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 165, in create Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._create() Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 169, in _create Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 141, in _create_in_db Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-409613155' already exists. Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 06 13:01:37.539936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-409613155' already exists. Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-409613155' already exists. Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 409 to user: Key pair 'tempest-keypair-409613155' already exists. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:37.547377 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c314e9b-db70-4102-93d7-daf78eb90b17 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.095834 Oct 06 13:01:37.548852 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1413/2874] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:37 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:01:37.557815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4c1490-aa60-469a-aa91-92cc9da47d35", "tag": "5a67bd90-fd77-4d47-9dd1-6daa353e6020"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:37.569154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.569777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.570298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.575417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:37.592017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] Creating event network-changed:5a67bd90-fd77-4d47-9dd1-6daa353e6020 for instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 on n-h1-860556-1 Oct 06 13:01:37.598424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-eb9168fd-1315-46d7-af9d-61df275c6547 req-d54494c5-7060-4acc-8c2f-cf46b02985f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048079 Oct 06 13:01:37.599076 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1414/2875] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:37.606713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:37.608111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:37.618420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.619173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.620021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.621176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.621871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.622314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.788237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:37.798242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d76c12e9-2fa3-4d0f-8eb6-b8027be1f988 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669" status: 200 len: 1319 microversion: 2.1 time: 0.333162 Oct 06 13:01:37.799398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1462/2876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:37 2022] GET /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:37.804873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:37.816513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.817008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.817445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.829840 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] Creating event network-changed:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:01:37.846280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b5378a59-dab0-4ad1-acf1-8f962badd7e5 req-a7128fa4-f5a2-4d99-8309-709d8baa359b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045256 Oct 06 13:01:37.846858 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1463/2877] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:37.857929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:37.865141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:37.878347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.878821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.879448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:37.880328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:37.880956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:37.881578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:38.139330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:38.147369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7828130b-eb7c-4eb5-8e2f-8714755f1913 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.546812 Oct 06 13:01:38.158152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1415/2878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:37 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:38.168777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-811a3337-4227-4f37-9bca-b70fdf38a56d tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Calling method '.version_select at 0x7f7d3eab6160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:38.208680 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-811a3337-4227-4f37-9bca-b70fdf38a56d tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409613155" status: 202 len: 0 microversion: 2.1 time: 0.049226 Oct 06 13:01:38.209202 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1416/2879] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409613155 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:01:38.220337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:38.220951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:38.234332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:38.235007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:38.235453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:38.236179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:38.236640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:38.237069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:38.301434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:38.321191 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c049006-0bbc-4836-9339-90f31d9e3b9c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.469123 Oct 06 13:01:38.321994 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1464/2880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:37 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:38.337144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dabc4808-a2ba-4518-b20d-5c0691e973a5 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d476a8c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNwkwQj4Vw5/ulCJSHkUaSzgiKFKcWUDJcG0Gm0PL/6S5wQjmh/+Wqcxza7mZZ8wCitp/M9Ir8oZUkdsDHkUaByFKsjwyF0zyoArpi0JF5o/m/K3o7nzr7mtBKenSuF0g=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dabc4808-a2ba-4518-b20d-5c0691e973a5 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 247 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNwkwQj4Vw5/ulCJSHkUaSzgiKFKcWUDJcG0Gm0PL/6S5wQjmh/+Wqcxza7mZZ8wCitp/M9Ir8oZUkdsDHkUaByFKsjwyF0zyoArpi0JF5o/m/K3o7nzr7mtBKenSuF0g=="}} Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNwkwQj4Vw5/ulCJSHkUaSzgiKFKcWUDJcG0Gm0PL/6S5wQjmh/+Wqcxza7mZZ8wCitp/M9Ir8oZUkdsDHkUaByFKsjwyF0zyoArpi0JF5o/m/K3o7nzr7mtBKenSuF0g=='}}} Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '' Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:01:38.341272 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:01:38.345599 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:38.348992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dabc4808-a2ba-4518-b20d-5c0691e973a5 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:38.350073 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dabc4808-a2ba-4518-b20d-5c0691e973a5 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.027188 Oct 06 13:01:38.351509 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1465/2881] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:38 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:01:38.364052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e734af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-34870116", "public_key": " "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:38.407165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:38.420609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for user c14d863250f7405a91ca5639fad7344b and project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:38.423349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:38.440054 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] [c3929226-24b4-48bb-a426-f89436fcc398] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:01:38.443832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:38.445454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:38.468494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8082e43-49a8-45c3-9f6f-92753238192a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.257733 Oct 06 13:01:38.482423 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1417/2882] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:38 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:38.513707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ef27ad86-1c54-4967-9989-d38377c70d71"}], "security_groups": [{"name": "tempest-securitygroup--1985978223"}], "key_name": "tempest-keypair-265486591", "user_data": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:38.725991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] validate_networks() for [('ef27ad86-1c54-4967-9989-d38377c70d71', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:01:39.234370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:01:39.234802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:01:39.235282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:01:39.235753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:01:39.236174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:01:39.245222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.245644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.246116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.246846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.247303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.247734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.265236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Getting quotas for project 2570fcfed5384a709d390737306e0d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:39.273048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Getting quotas for user 8a6007f23e7443d68385fd3b5f9c0d4c and project 2570fcfed5384a709d390737306e0d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:39.288201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:01:39.291160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:01:39.346443 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1d1e88be-c673-4dce-87a2-5c859569ad43 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.862292 Oct 06 13:01:39.347485 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1418/2883] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:01:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:01:39.358852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:39.359508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:39.366021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.366522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.366973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.367722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.368189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.368627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.447864 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] [c3929226-24b4-48bb-a426-f89436fcc398] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53160. Oct 06 13:01:39.457956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 93 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-34870116", "public_key": " "}} Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: exception: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-34870116', 'public_key': ' '}}} Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:39.461041 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:39.466115 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:39.469928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:39.471245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79a43dc0-39dc-47e3-9685-4bf5b6569530 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 1.113681 Oct 06 13:01:39.482821 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1466/2884] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Oct 6 13:01:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 1126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:01:39.487959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:39.489463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:39.497193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.498025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.499625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.500575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.501511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.502319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.650045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:39.658841 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81979a94-9af8-4b73-ba20-7a905757be01 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.303862 Oct 06 13:01:39.659429 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1419/2885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:39 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:39.664212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:39.665643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 652dad92-c5b0-4027-88c9-0975f5790669] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:39.673775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.674661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.675469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.677088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.677963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.678645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.788036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:39.802503 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0cbae72-dcf4-4636-8b7b-fe5cb6a78cac tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.318296 Oct 06 13:01:39.824567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1467/2886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:39 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:39.834509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:39.842275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:39.851542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.853085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.853769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.854887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:39.855544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:39.859265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:39.991997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.002200 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e019897b-9f15-415d-b702-3c3e4da2a2fa tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669" status: 200 len: 1506 microversion: 2.1 time: 0.341321 Oct 06 13:01:40.009377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1420/2887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:39 2022] GET /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:40.033827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.034564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.044479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.050363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.050576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.051281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.051747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.052172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.088653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.100746 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a72d007e-fedf-4729-8b0b-7a5d3c216238 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.274723 Oct 06 13:01:40.103133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1468/2888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:39 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:40.108460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a498953c-f803-4e81-b2d7-43982b6267d1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.109427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a498953c-f803-4e81-b2d7-43982b6267d1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.242811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a498953c-f803-4e81-b2d7-43982b6267d1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.250262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a498953c-f803-4e81-b2d7-43982b6267d1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1225 microversion: 2.1 time: 0.145769 Oct 06 13:01:40.250894 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1469/2889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:40 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:40.256742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d993f91-841e-4bce-bd95-2278841b1ea0 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e708e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu05cKmeGryAlf1KUmpgJ62Z1CmP7fWwoYEbcXHD9lqJ3C3wgX5in8RnVi6JDq06GimQ4bjfW8AH/emufSJP6T7MTGmKZz2nkcFX2UESXAuvC2sYTZaOl0L8dCdTq9o8A=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d993f91-841e-4bce-bd95-2278841b1ea0 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 507 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu05cKmeGryAlf1KUmpgJ62Z1CmP7fWwoYEbcXHD9lqJ3C3wgX5in8RnVi6JDq06GimQ4bjfW8AH/emufSJP6T7MTGmKZz2nkcFX2UESXAuvC2sYTZaOl0L8dCdTq9o8A=="}} Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu05cKmeGryAlf1KUmpgJ62Z1CmP7fWwoYEbcXHD9lqJ3C3wgX5in8RnVi6JDq06GimQ4bjfW8AH/emufSJP6T7MTGmKZz2nkcFX2UESXAuvC2sYTZaOl0L8dCdTq9o8A=='}}} Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 06 13:01:40.262018 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d993f91-841e-4bce-bd95-2278841b1ea0 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:40.265358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d993f91-841e-4bce-bd95-2278841b1ea0 tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011578 Oct 06 13:01:40.268224 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1470/2890] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:40 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:01:40.277034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.277877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.286074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.286710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.287275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.288626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.289658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.290371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.320162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.331625 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e4c1ad8-7cbe-4098-a1f4-d6d58bf96f78 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.321075 Oct 06 13:01:40.337876 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1421/2891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:40 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:40.345118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.350633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 652dad92-c5b0-4027-88c9-0975f5790669] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.358829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.359330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.359774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.360494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.361232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.364876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.397347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 652dad92-c5b0-4027-88c9-0975f5790669] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:01:40.435454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.445940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.447873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:40.450918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:40.454323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-818798c0-d951-4f68-9b35-1b148edccd1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.184957 Oct 06 13:01:40.454907 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1471/2892] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:40 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:40.460469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Action: 'create', calling method: .version_select at 0x7f7d3e708310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-605617305", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:40.489227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:40.496705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Getting quotas for user c14d863250f7405a91ca5639fad7344b and project 41fdff42bc534b4693ad38904b5a3612. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:40.517920 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 117 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-605617305", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: exception: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-605617305', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 06 13:01:40.519861 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c639e2c-0c17-4de6-8b68-ddc7643f72ff tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065264 Oct 06 13:01:40.527396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1472/2893] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:01:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:01:40.532164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-716b6dbc-c1c1-468b-b68d-2918874988cf tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "DELETE /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669" status: 204 len: 0 microversion: 2.1 time: 0.192683 Oct 06 13:01:40.532164 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1422/2894] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:01:40 2022] DELETE /compute/v2.1/servers/652dad92-c5b0-4027-88c9-0975f5790669 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:01:40.535302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94fbf681-d765-4f6e-b53d-7af2dcd18d4f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Calling method '.version_select at 0x7f7d3e6d08b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.537531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.538154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.540644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:40.553312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.558838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-94fbf681-d765-4f6e-b53d-7af2dcd18d4f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.559588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.560358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94fbf681-d765-4f6e-b53d-7af2dcd18d4f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Request method failure captured: Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-626471334 HTTP/1.1 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGpxpxcvyW21iC85Ap96UTexneHzrItltG4EmXNF5Vsml0lE5wsDQiuUiZ1NwGlx7t6LUGU3_vILG-ZsYO2_8dlOS9U4MdA5mEm2BL1U1cDYE2jk2lrKBRkWZcb7w0XcI_UMvpyt9k4oyfqP7e-Nvco-H3NHPwDyivEsZi_JwZFe8Q Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41fdff42bc534b4693ad38904b5a3612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41fdff42bc534b4693ad38904b5a3612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41fdff42bc534b4693ad38904b5a3612"}]}] Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 41fdff42bc534b4693ad38904b5a3612 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-884007128 Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-KeyPairsNegativeTestJSON-884007128-project Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: exception: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'tempest-keypair-non-existent-626471334'} Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise self.value Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 151, in get_by_name Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 133, in _get_from_db Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.560632 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94fbf681-d765-4f6e-b53d-7af2dcd18d4f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] Returning 404 to user: Keypair tempest-keypair-non-existent-626471334 not found for user c14d863250f7405a91ca5639fad7344b {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:01:40.567000 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-94fbf681-d765-4f6e-b53d-7af2dcd18d4f tempest-KeyPairsNegativeTestJSON-884007128 tempest-KeyPairsNegativeTestJSON-884007128-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-626471334" status: 404 len: 144 microversion: 2.1 time: 0.031921 Oct 06 13:01:40.569726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1473/2895] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 13:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-626471334 => generated 144 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:01:40.572236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.572898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.573724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.608558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 30a713e3-e68f-404d-892e-4d78536aa5f5] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:01:40.691980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.693133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.700727 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96870c16-af10-4512-99e3-44c07bc29031 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5" status: 204 len: 0 microversion: 2.1 time: 0.166991 Oct 06 13:01:40.701403 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1423/2896] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:01:40 2022] DELETE /compute/v2.1/servers/30a713e3-e68f-404d-892e-4d78536aa5f5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:01:40.726837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.729596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.730350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.731318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.731999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.733048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.832484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:40.833335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:40.849820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.853144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.857456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:40.860867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:40.863543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:40.864073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.028054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:41.036206 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c13b6d74-b349-46a1-a46a-f3d858dba0fc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.350444 Oct 06 13:01:41.042506 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1474/2897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:40 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:01:41.042506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1222863157", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8c48b9cf-e5b2-4a88-ae77-5ce2fe25bc25"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:41.089441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:41.100180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c722450-70fd-48e8-99db-4e194004da44 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.272048 Oct 06 13:01:41.104287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1424/2898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:40 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:41.125424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:41.127743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:41.141755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] validate_networks() for [('8c48b9cf-e5b2-4a88-ae77-5ce2fe25bc25', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:01:41.144181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.144684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.145307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.145857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.146312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.146754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.395804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:41.413180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17afbde2-1a8e-4ad6-b24c-267bf44507ff tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.291909 Oct 06 13:01:41.413859 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1425/2899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:41 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:01:41.443740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:41.444385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:41.456615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.457163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.457609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.459908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.460540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.461601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.632883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:41.642868 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e267d907-9134-434f-893b-8671abb039bf tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1229 microversion: 2.1 time: 0.227991 Oct 06 13:01:41.643945 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1426/2900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:41 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1229 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:41.649938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:41.651013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:41.657679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.658457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.659069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.660084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.660206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.660640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.961761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:01:41.962335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:01:41.962645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:01:41.963054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:01:41.963464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:01:41.982003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.982481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.982922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.983657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:41.984112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:41.984538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:41.996915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.005863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30ab0b4a-ec19-41e0-9988-cee7838dea59 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.360138 Oct 06 13:01:42.010382 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1427/2901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:41 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:42.015316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:42.016083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:42.046494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Getting quotas for project 21d4c3e3fd93446491476dbe36b3a9d0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:01:42.049702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.050250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.050670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.051997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.052533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.052912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.062676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Getting quotas for user 3b1c3b6afd0141dc9864adb77f40553a and project 21d4c3e3fd93446491476dbe36b3a9d0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:01:42.106537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Going to run 2 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:01:42.113997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:01:42.197136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.197774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=022843ae-fcf5-42b2-a16c-1bbdfa1377f8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:01:42.206392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.208047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.214805 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4aaea50-a263-4877-94ad-65cea692bd0c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.203345 Oct 06 13:01:42.225914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1428/2902] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:42 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:42.242394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:42.243107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:42.252334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.262661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.263504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.264365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.264916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.265404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.326632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb9b54cc-61a5-42ea-8544-d5ea92fd82b7 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.288767 Oct 06 13:01:42.330660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1475/2903] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:01:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1292 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:01:42.357416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:42.363549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:42.373236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.373946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.375268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.376943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.377823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.378412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.735331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.739404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:42.755478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.756503 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e54bdf2-8b0b-4934-8203-eee9dc685608 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.529362 Oct 06 13:01:42.757565 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1429/2904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:42 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:42.763032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:42.774753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-174f8552-932a-4146-a7dc-d9736d8dc4d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.442533 Oct 06 13:01:42.776598 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1476/2905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:42 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:42.777803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:42.784514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:42.786149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Searching by: {'deleted': False, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:01:42.790403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:42.801173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.803549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.809158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.810887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.812826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.817790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.857469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.858023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.858480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.859210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:42.859675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:42.860096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:42.959558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:01:43.077481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59a61fdb-551e-4d94-ba50-a3012b2fb4b9 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.313954 Oct 06 13:01:43.080192 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1430/2906] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:01:42 2022] GET /compute/v2.1/servers => generated 1335 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:43.116482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.119376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.131516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.156114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.156583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.157039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.157854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.158508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.159241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.159774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-050e0918-b4b5-4382-863d-d6cab7261698 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.380965 Oct 06 13:01:43.167675 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1477/2907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:42 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:43.172614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.180865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.194719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.195644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.196773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.199708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.200268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.201353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.334393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.377702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1bcea8c1-d5ba-40ab-8862-2134dafb8b7e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1229 microversion: 2.1 time: 0.293992 Oct 06 13:01:43.380827 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1431/2908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1229 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:43.417197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41551d28-9b0c-4b9d-bca6-89b82f886ffc tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.418177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41551d28-9b0c-4b9d-bca6-89b82f886ffc tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.498803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.509532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b963588-da76-4a18-af07-12432c37001d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.340551 Oct 06 13:01:43.513346 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1478/2909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:43.518304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.531786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.548015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.552445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.553181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.554169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.554887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.556136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.611928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41551d28-9b0c-4b9d-bca6-89b82f886ffc tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.619504 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41551d28-9b0c-4b9d-bca6-89b82f886ffc tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1218 microversion: 2.1 time: 0.215173 Oct 06 13:01:43.620092 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1432/2910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:43.676104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.688097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.690828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:43.698373 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f584165-b7f4-4ec5-a6d6-4dce06e6b3b6 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.183413 Oct 06 13:01:43.706620 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1479/2911] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:43.781260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.781920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.805365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.806189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.813252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:43.814107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:43.815450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.817165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.818151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.818661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.825297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.827457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.828389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:43.831367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:43.835014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:43.838810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.158743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:44.170772 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3302ab62-4232-4cff-97cd-e1e3dd389af3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.362679 Oct 06 13:01:44.186958 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1480/2912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:44.188203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:44.195708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652dad92-c5b0-4027-88c9-0975f5790669", "name": "network-vif-deleted", "tag": "d9bfabe5-429d-4a09-a3c7-2929f0d3e214"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:44.207731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-acaa9a0d-0a51-4647-9ba3-6b460154a470 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.431742 Oct 06 13:01:44.208336 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1433/2913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:43 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:44.218511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:44.219403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:44.223940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.224569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.225112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.238339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.239103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.243673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] Creating event network-vif-deleted:d9bfabe5-429d-4a09-a3c7-2929f0d3e214 for instance 652dad92-c5b0-4027-88c9-0975f5790669 on n-h2-860556-1 Oct 06 13:01:44.243875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.244472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.244958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.245397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.251568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e0f302af-281e-4a11-adeb-b0a2d0837e3a req-531e4f6e-8243-44ec-86cd-9a97ecc61b45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061213 Oct 06 13:01:44.252886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1481/2914] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:44.407859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:44.408801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:44.442061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.452328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.453095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.455411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.456069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.459147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.663853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:44.686938 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bfa368bc-784a-4744-a9d5-b0fc81db4fa1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1229 microversion: 2.1 time: 0.280480 Oct 06 13:01:44.689691 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1482/2915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:44 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1229 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:44.708985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:44.721389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:44.731190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:44.746235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.747010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.747676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.748623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.749286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.749967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.752361 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b66c06ea-9360-404c-9f7a-b7c5fd85f847 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.538657 Oct 06 13:01:44.758905 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1434/2916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:44 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:44.768372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:44.769249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:44.788481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.788981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.789992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:44.790715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:44.791176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:44.791826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.007836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.030697 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b7b14f4-bc90-4599-a6d7-4e82ceda710c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1214 microversion: 2.1 time: 0.269693 Oct 06 13:01:45.043675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1435/2917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:44 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:45.062183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:45.062801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.071012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.086264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.099851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.103985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.105394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.106282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.106740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.109593 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b11235da-5e85-46ae-8b22-f1005a9e499d tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.417107 Oct 06 13:01:45.110419 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1483/2918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:44 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:45.200747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:45.202308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.219534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.220576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.221802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.223258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.223993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.224652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.253194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.266376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.267943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.275713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c02357c5-7cdd-4242-aa84-f26292520033 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1536 microversion: 2.91 time: 0.231106 Oct 06 13:01:45.289868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1436/2919] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1536 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:45.299523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:45.300153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.308569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.309073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.309519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.310442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.310938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.311339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.475212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.487066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b702eb16-a8fd-4a90-a357-82d9dd1bebdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.289980 Oct 06 13:01:45.488096 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1484/2920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:01:45.495564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:45.499430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.507908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.509358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.510016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.510935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.514485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.534290 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3010f4db-ff87-4821-bcce-5e457c52839a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.243673 Oct 06 13:01:45.545809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1437/2921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:45.546077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.546077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.678135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860556-1". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 13:01:45.712684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:45.714007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.735610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.736453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.738143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.740096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.741582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.747033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.832867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:45.956984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:45.960547 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb1a5a02-339a-4137-b2b4-febb872e6395 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action" status: 202 len: 0 microversion: 2.91 time: 0.469827 Oct 06 13:01:45.965033 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1485/2922] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:01:45 2022] POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:01:45.975465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-957b5da7-9560-4216-a313-44833f4a2979 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1229 microversion: 2.1 time: 0.266788 Oct 06 13:01:45.983255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:45.984210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:45.985261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1438/2923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1229 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:45.991180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.991988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.992571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:45.993367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:45.993984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:45.994508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.003571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:46.005360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:46.025256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.025946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.031963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.032807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.033297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.033783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.157759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.168029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.169605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.175945 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-693d60b6-b59b-444f-937e-f35f233254de tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1544 microversion: 2.91 time: 0.189361 Oct 06 13:01:46.189784 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1439/2924] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1544 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:46.189784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:46.189784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:46.192424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.193179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.193669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.195088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.196401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.197010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.297191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.313058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e20b052-3579-4364-993e-be0d1765e057 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1270 microversion: 2.1 time: 0.131662 Oct 06 13:01:46.313794 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1440/2925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:46 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:46.321639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:46.322566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:46.324275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.332741 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6865f4ed-f17f-4682-9d92-1d14af523e13 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.369448 Oct 06 13:01:46.333322 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1486/2926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:45 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:46.334711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.335315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.335862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.336767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.337335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.337897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.516239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:46.517309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:46.524679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.525478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.526105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.528154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.528818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.529399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.604253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:46.614213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28ca7b03-d261-4a2c-bdac-7160565efcc1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.299007 Oct 06 13:01:46.633170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1441/2927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:46 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:46.637940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:46.638768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:46.645872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.646373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.647658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:46.647978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:46.648450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:46.650021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.442470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.452984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dd06f56-76c8-42ec-b0e1-cb5f4b5d440d tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1517 microversion: 2.1 time: 0.820168 Oct 06 13:01:47.457263 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1442/2928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:46 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1517 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:47.472483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:47.473361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:47.485117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.494342 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86131272-f21e-4a66-974a-9cf690f11d23 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.988575 Oct 06 13:01:47.499173 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1487/2929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:46 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:47.501598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.503771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.503771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.503771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.503771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.514680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:47.515540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:47.532438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.550412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.553781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.555814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.558615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.559037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.559690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.745483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.757176 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab7dd1b2-01e1-4ca2-8b43-75910403ae9b tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1221 microversion: 2.1 time: 0.295980 Oct 06 13:01:47.757806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1443/2930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:47 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1221 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:47.781996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:47.783207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:47.790923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.806725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.819755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:47.830374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.831670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.832128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.839931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.843382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f86a97d0-08d2-47b1-a580-df104b07ea86 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1486 microversion: 2.91 time: 0.338219 Oct 06 13:01:47.845151 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1488/2931] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:47 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1486 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:47.852349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.852903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.877720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:47.884491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:47.901999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.902691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.904032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:47.908060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:47.908757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:47.909801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.174503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:48.188769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2743b8e2-8d40-440a-8d67-4a264a5e8e8e tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1288 microversion: 2.1 time: 0.426842 Oct 06 13:01:48.211669 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1444/2932] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:47 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1288 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:48.226140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "name": "network-vif-plugged", "status": "completed", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:48.256775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.258097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.269827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.300228 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] Creating event network-vif-plugged:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:01:48.320326 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-928bc570-359e-4320-9054-b5a1000e53d8 req-e5f58fd1-a95c-4484-afc7-e9458946f70c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102383 Oct 06 13:01:48.324069 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1445/2933] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:48.338548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:48.339896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:48.379168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.380607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.384317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.389093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.389953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.390105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.476754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:48.500723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6101690d-40bc-4b05-960c-f230ebe9bc36 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.653147 Oct 06 13:01:48.502701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1489/2934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:47 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:48.524944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a713e3-e68f-404d-892e-4d78536aa5f5", "name": "network-vif-deleted", "tag": "4f7ff207-767b-4a67-aad0-68d78cc5f79a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:48.577442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.583466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.587213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.964309 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] Creating event network-vif-deleted:4f7ff207-767b-4a67-aad0-68d78cc5f79a for instance 30a713e3-e68f-404d-892e-4d78536aa5f5 on n-h1-860556-1 Oct 06 13:01:48.971309 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5df3b4e4-440d-4dbc-9a2f-b6c726a72a12 req-83a44052-0453-4049-9119-2474cc365a9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.467057 Oct 06 13:01:48.972578 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1490/2935] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:48.977989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:48.979038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:48.987667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.988439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.989111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:48.990290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:48.991011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:48.991681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.116617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.142842 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f37e9ef2-8034-4914-9dfa-82ab5102a468 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.814346 Oct 06 13:01:49.143570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1446/2936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:48 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:49.153815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:49.154869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:49.193340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.196299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.197451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.200243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.218677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.219440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.314955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.324252 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30bb1b00-bf3b-4949-8e2a-aac71148d4ee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.350225 Oct 06 13:01:49.328648 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1491/2937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:48 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:49.345758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:49.346677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:49.361444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.364265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.373529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.376749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.377609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.377760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.544351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.559350 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-467e043b-34d1-434f-81ac-006b2b146da5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1285 microversion: 2.1 time: 0.229414 Oct 06 13:01:49.575956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1492/2938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:49 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:49.583410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:49.585456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:49.593518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.594466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.595809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.597111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.597725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.598195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.615829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.624216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:49.628352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eaf7d64c-f3ac-4630-adcf-ed9b9ae73708 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.483578 Oct 06 13:01:49.628950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1447/2939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:49 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:49.647346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:49.648010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:49.659713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.660218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.660906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.662365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.663027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.663705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.729603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.760468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.761468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.762575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:49.768628 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fce9a8bf-c229-4e63-aa6d-9986acdf37e0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1486 microversion: 2.91 time: 0.191119 Oct 06 13:01:49.769205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e477b728-43d5-4cbd-8bea-218e7911b606 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1276 microversion: 2.1 time: 0.126372 Oct 06 13:01:49.781774 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1448/2940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:49 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:49.783655 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1493/2941] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:49 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:49.796752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:49.797378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:49.803417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.803913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.804349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:49.811073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:49.811627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:49.812069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.025800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:50.039641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85c0c3c5-f399-42b4-b3e6-85816762791f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.256580 Oct 06 13:01:50.042755 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1449/2942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:49 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:50.187688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:50.189189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:50.219350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.224997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.225480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.231434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.231950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.232400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.362583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:50.365237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:50.385103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.391549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.392390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.395745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.396566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.398069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.867035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:50.878678 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b2a300b-cb56-4188-8494-6a1c9138b819 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.524457 Oct 06 13:01:50.896477 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1450/2943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:50 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:50.903762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:50.904362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:50.926376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.927130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.930788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.931751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:50.932390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:50.932989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:50.972674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:50.981990 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18bd9acf-2603-496e-a594-88a55aa52f42 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 0.812893 Oct 06 13:01:50.982579 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1494/2944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:50 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:51.006422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:51.007388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:51.015603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.016422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.017173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.018225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.018919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.019561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.108280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.119731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e754e84d-9a87-45e4-9bab-8c3dd578bfad tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1283 microversion: 2.1 time: 0.220742 Oct 06 13:01:51.120339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1451/2945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:50 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:51.138900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:51.139609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:51.148450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.149844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.151253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.152770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.153419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.154160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.587727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.604982 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c80d971-f9cd-4db5-9f59-e36fa761b9d4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.604853 Oct 06 13:01:51.606080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1495/2946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:50 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:51.611478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:51.612977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:51.621786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.622633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.623092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.624068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.624814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.625462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.736898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.746143 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d71cba6-0172-4a05-b8c3-47663362a37c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.624337 Oct 06 13:01:51.747487 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1452/2947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:51 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:51.752143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-plugged", "status": "completed", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:51.762619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.763371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.763816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.777327 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] Creating event network-vif-plugged:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h1-860556-1 Oct 06 13:01:51.782990 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ff6de929-5e80-4f59-863f-e2cc4e0fbe86 req-2b243f96-c615-4144-9ec9-437d5652a909 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034002 Oct 06 13:01:51.783902 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1453/2948] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:51.789980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:51.791082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:51.799282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.800039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.800496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.801383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.801985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.802436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.848736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.860700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.874346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:51.893274 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7adda8cd-9508-411d-9461-4fc1b578ba82 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.285835 Oct 06 13:01:51.899812 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1496/2949] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:51 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:51.906257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:51.910484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:51.921048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.921587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.924461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:51.925234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:51.925714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:51.926213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:52.026894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:52.092140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=16 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:52.461482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:52.479363 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d43f9d3-44d1-4b55-b47d-9e251b5a0547 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1324 microversion: 2.1 time: 0.688432 Oct 06 13:01:52.483348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1454/2950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:51 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:52.507905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:52.509977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:52.530155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:52.530509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:52.532678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:52.533481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:52.535662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:52.536128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:52.667583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:52.680327 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c438132e-5fb2-4a20-9f6f-73d43844da13 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.777961 Oct 06 13:01:52.700668 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1497/2951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:51 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:52.724320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:52.724995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:52.738078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:52.738587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:52.739037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:52.739747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:52.740215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:52.740647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:52.908195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:53.478830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:53.488143 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef55cd5c-0074-47af-8cd4-a107499620af tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1283 microversion: 2.1 time: 0.785723 Oct 06 13:01:53.493786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1498/2952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:52 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1283 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:53.504013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:53.504800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:53.521365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:53.522169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:53.522796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:53.524230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:53.524853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:53.525452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:53.619439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=36 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:53.728765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:53.743305 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-391b87e6-af78-4534-b952-d858ee743133 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1518 microversion: 2.1 time: 1.258486 Oct 06 13:01:53.744054 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1455/2953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:52 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1518 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:53.748703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:53.749314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:53.779221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:53.779715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:53.780206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:53.780849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:53.781304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:53.781730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:54.408062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:54.419168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f05437ca-43f2-415b-8dcd-91d8b2d943ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.923894 Oct 06 13:01:54.421128 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1499/2954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:53 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:54.428216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:54.429400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:54.439593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:54.440552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:54.441476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:54.442917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:54.445009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:54.447995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:54.760114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:54.773335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:54.778277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08ae6673-68fd-4e2f-8f8f-da661703345a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 1.030303 Oct 06 13:01:54.782128 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1456/2955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:53 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:54.805354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:54.806857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:54.830119 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92382858-2e53-4087-8832-6040b1200725 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.407439 Oct 06 13:01:54.834774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1500/2956] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:54 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:54.841380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022843ae-fcf5-42b2-a16c-1bbdfa1377f8", "tag": "602e3866-98fa-4dd3-8346-f2675d44e64d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:54.886960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:54.889595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:54.894712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:54.897879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:54.949507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] Creating event network-changed:602e3866-98fa-4dd3-8346-f2675d44e64d for instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 on n-h1-860556-1 Oct 06 13:01:54.971333 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9814b0b8-904b-4589-8f49-dff5319d268e req-b486ad46-6792-42dc-ac10-eaeeb2ded163 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135001 Oct 06 13:01:54.981345 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1501/2957] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:55.001965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:55.004129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:55.023518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.029184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.030932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.031780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.033268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.038150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.102495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca88ab2a-5794-43c8-b035-a4a1e60d8d2a tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e74ad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-314625273", "description": "tempest-description-1715393615"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:55.662096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:55.668894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:01:55.678558 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b9a1402-be1e-42f2-9f0b-847e9e02b3d5 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1520 microversion: 2.1 time: 0.690416 Oct 06 13:01:55.680711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1502/2958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:54 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1520 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:55.687503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:55.688500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:55.698345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.699185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.699845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.700776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.701939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.702613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.912599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca88ab2a-5794-43c8-b035-a4a1e60d8d2a tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.129129 Oct 06 13:01:55.915720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1457/2959] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:01:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:55.920769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53273278-4088-4090-9af4-808ffe05bb30", "name": "network-vif-unplugged", "status": "completed", "tag": "4222510b-29b7-4889-b6a4-5e2d104bcb17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:55.939026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.939763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.940228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.953272 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] Creating event network-vif-unplugged:4222510b-29b7-4889-b6a4-5e2d104bcb17 for instance 53273278-4088-4090-9af4-808ffe05bb30 on n-h2-860556-1 Oct 06 13:01:55.960957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-368b72dd-6c73-4f36-949f-3a5aae13927b req-6dda3083-a8ee-4f04-ad1b-d51b582b5fc7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045750 Oct 06 13:01:55.961931 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1458/2960] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:55.967984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:55.969147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:55.975797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.976305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.977044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:55.977817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:55.978274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:55.978712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.127616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:56.136523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95da2280-7428-4573-a88c-5551838d1bf3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.454507 Oct 06 13:01:56.142658 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1503/2961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:55 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:56.142658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:56.143995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:56.149987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:56.150890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:56.151376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.152530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:56.153015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:56.153637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.634150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:56.655314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59772dc6-4478-412e-8192-6afb5fcaac12 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.691647 Oct 06 13:01:56.674751 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1459/2962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:55 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:56.681958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371bde92-02d4-41c4-92d8-265fb5096838", "tag": "6e9441c5-43d0-4ffe-b165-2a0671cd9c1c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:56.692496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:56.697196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:56.697998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.720587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] Creating event network-changed:6e9441c5-43d0-4ffe-b165-2a0671cd9c1c for instance 371bde92-02d4-41c4-92d8-265fb5096838 on n-h2-860556-1 Oct 06 13:01:56.725860 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-39814731-7508-43d5-9e53-f8b18e4b5bd3 req-8bfcf8d5-b0a6-4820-bda6-60bc11aa9a43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049457 Oct 06 13:01:56.727577 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1460/2963] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:56.762929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:56.765518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:56.778790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:56.797809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15dbe803-af78-4a84-aea5-0efe937e62b3 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.656144 Oct 06 13:01:56.798621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:56.802643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:56.815711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1504/2964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:56 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:56.819326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.819326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:56.819326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:56.819326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:56.826427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f143044-40ee-413b-9fdd-4d9c3b2c54ec tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'create', calling method: .version_select at 0x7f7d47650af0>, body: {"pool": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:57.258824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:57.270877 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ebe7472-10f3-4ea3-ad27-4639c774ea48 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.538939 Oct 06 13:01:57.274482 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1461/2965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:56 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:57.287997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:57.291909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:57.320588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:57.327453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:57.328610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:57.331465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:57.332863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:57.338533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:57.848386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:57.862235 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14cd735a-e5f5-4390-8373-c1fa76a24843 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.581310 Oct 06 13:01:57.864881 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1462/2966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:57 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:01:57.877682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:57.880257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:57.904095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:57.905069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:57.906616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:57.908717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:57.911110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:57.912648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:58.112079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:58.127586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:58.131362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:01:58.142478 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08c8caf9-9e69-4a9e-976d-58ed2dcb3f47 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.276218 Oct 06 13:01:58.147113 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1463/2967] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:01:57 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:01:58.161067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4198f6b4-9bb1-43af-abae-27e6c95d9800 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e75e5e0>, body: {"security_group_rule": {"parent_group_id": "3fdf5cb4-b65d-44d8-bdc7-7e08629f7cbf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:01:59.827509 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4198f6b4-9bb1-43af-abae-27e6c95d9800 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.677030 Oct 06 13:01:59.829073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1464/2968] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:01:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:01:59.834981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:01:59.835793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:01:59.843939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:59.844684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:59.845316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:01:59.846243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:01:59.846872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:01:59.847891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.208554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:00.217240 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8f7ed7e-70d2-4a6c-9dc9-50607472a74b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.387022 Oct 06 13:02:00.217860 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1465/2969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:01:59 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:00.222321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:00.222935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:00.229598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.230120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.230565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.231270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.231734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.232190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.559739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:00.570728 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eafa39ff-d641-4426-81aa-afb6ec3f547c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.350988 Oct 06 13:02:00.571301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1466/2970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:00 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:00.579331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:00.580162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:00.587629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:00.589599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.590244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.590982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.591703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.593070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.594056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.854258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:00.866198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee3ee66b-5b40-4c7a-a2f7-5c9aaffdae96 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.291779 Oct 06 13:02:00.868777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1467/2971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:00 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:00.879619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4c1490-aa60-469a-aa91-92cc9da47d35", "name": "network-vif-plugged", "status": "completed", "tag": "5a67bd90-fd77-4d47-9dd1-6daa353e6020"}, {"server_uuid": "53273278-4088-4090-9af4-808ffe05bb30", "name": "network-vif-plugged", "status": "completed", "tag": "4222510b-29b7-4889-b6a4-5e2d104bcb17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:00.910140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.910710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.911213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.918163 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f143044-40ee-413b-9fdd-4d9c3b2c54ec tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.096521 Oct 06 13:02:00.932462 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1505/2972] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 13:01:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:00.932462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:00.932462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:00.940370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Creating event network-vif-plugged:5a67bd90-fd77-4d47-9dd1-6daa353e6020 for instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 on n-h1-860556-1 Oct 06 13:02:00.941235 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] Creating event network-vif-plugged:4222510b-29b7-4889-b6a4-5e2d104bcb17 for instance 53273278-4088-4090-9af4-808ffe05bb30 on n-h2-860556-1 Oct 06 13:02:00.941456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.942100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.942790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.943703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.944243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.944748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.959614 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-16fa4c4a-89b2-4726-b34f-4b3bd21c852a req-a4fd1794-0404-40ea-a023-fd354589de23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087981 Oct 06 13:02:00.961655 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1468/2973] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:00.971943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:00.972870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:00.983395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.983953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.984454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:00.985288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:00.985938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:00.986623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.035896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:01.327720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.332737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.340785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-414d4f36-373a-435f-8ffc-817bddbe4025 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.376424 Oct 06 13:02:01.342523 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1469/2974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:00 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:01.343410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a775f5b6-10be-4299-af85-c51876eb46cc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.423026 Oct 06 13:02:01.344344 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1506/2975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:00 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:01.348705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:01.349391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:01.349707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb8a2fc-537d-452d-895d-0e341f9082d1", "tag": "647989af-2207-4cb6-a08b-5f3d0fece9c3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:01.362813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.363324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.363779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.365001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.365478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.366089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.370654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.371354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.371800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.397472 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] Creating event network-changed:647989af-2207-4cb6-a08b-5f3d0fece9c3 for instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 on n-h1-860556-1 Oct 06 13:02:01.405007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ca3728d8-c12f-460c-b0bc-1cb711f43436 req-5dfc7c85-034d-4e1f-a6ba-b8205395a566 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059254 Oct 06 13:02:01.405944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1507/2976] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:01.411537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a9ec92d-049f-4906-8fdb-e33cfe5d749c tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d475e3700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1709739902", "description": "tempest-description-1287252668"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:01.457174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.467385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.470561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.479065 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-559f9fa7-272d-4713-83ff-7604517ed558 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.135007 Oct 06 13:02:01.489077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1470/2977] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:01 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:01.496200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:01.497148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:01.505223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.505978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.506597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.517421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.521783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.522421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.676210 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a9ec92d-049f-4906-8fdb-e33cfe5d749c tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.268826 Oct 06 13:02:01.677046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1508/2978] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:01.685057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1921253624", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "2afa6420-716f-474d-b2c7-a93ecf6eda53"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:01.775419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:01.785081 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-40ca7541-8d7b-4ed5-8643-1943eba4fea2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.294225 Oct 06 13:02:01.786110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1471/2979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:01 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:01.808083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] validate_networks() for [('2afa6420-716f-474d-b2c7-a93ecf6eda53', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:02:01.811375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:01.812001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:01.820251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.820520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.821367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:01.822178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:01.822823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:01.823264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.083567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:02.095256 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db251452-ff51-41ce-81f9-714616a9fffe tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1523 microversion: 2.1 time: 0.307571 Oct 06 13:02:02.096110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1472/2980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:01 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:02.116744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78979c85-d34c-436d-81a2-1301a0b38862 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e9b9f70>, body: {"security_group_rule": {"parent_group_id": "b91ece2a-047a-4f8c-9b46-a8583a56d4a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:02.494481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78979c85-d34c-436d-81a2-1301a0b38862 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.397010 Oct 06 13:02:02.495095 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1473/2981] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:02 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:02.505884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:02:02.506535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:02:02.506776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:02:02.512099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb328318-fba0-4dfd-832e-e62494ee7535 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:02.512934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:02:02.513359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:02:02.520439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-eb328318-fba0-4dfd-832e-e62494ee7535 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. Oct 06 13:02:02.529387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.529940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.530387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.531127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.531590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.532026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb328318-fba0-4dfd-832e-e62494ee7535 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/668837b7-4a3e-4319-b1f5-f6f24daf33a2/action HTTP/1.1 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 15 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: {"os-stop": {}} Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '668837b7-4a3e-4319-b1f5-f6f24daf33a2', 'body': {'os-stop': {}}} Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:02.537582 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. Oct 06 13:02:02.542098 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:02.546437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb328318-fba0-4dfd-832e-e62494ee7535 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 668837b7-4a3e-4319-b1f5-f6f24daf33a2 has no mapping to a cell. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:02.547607 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb328318-fba0-4dfd-832e-e62494ee7535 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/668837b7-4a3e-4319-b1f5-f6f24daf33a2/action" status: 404 len: 117 microversion: 2.1 time: 0.051570 Oct 06 13:02:02.553523 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1474/2982] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:02 2022] POST /compute/v2.1/servers/668837b7-4a3e-4319-b1f5-f6f24daf33a2/action => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:02.557138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Getting quotas for project ab7fa2ec3b9243b58610250907ea9c73. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:02:02.560787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:02.562424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:02.568803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Getting quotas for user f28f44f509374131894128efad3281e5 and project ab7fa2ec3b9243b58610250907ea9c73. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:02:02.573271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.574154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.575046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.576330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.577340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.578718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.603100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:02:02.606033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:02:02.722820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a057779-d3f1-4a52-b8bc-a6f6e474d8c4 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044243 Oct 06 13:02:02.724172 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1509/2983] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:02:02.730704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:02.731692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:02.760621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.761475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.763420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.764407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.778771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.781485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.829170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:02.837465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b82145a-2984-4568-8413-c80e1e8d8db5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.281456 Oct 06 13:02:02.839144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1475/2984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:02 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:02.863947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:02.869389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:02.881017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.881517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.884417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:02.885373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:02.886279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:02.887399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.067899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.086403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b67da9d4-1504-4c1e-b9bf-c09cfafbbe94 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.360103 Oct 06 13:02:03.122708 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1510/2985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:02 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:03.131209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a03873dc-ff45-459e-a62c-b1794038d8fd tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d475e3700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-253680685", "description": "tempest-description-680382610"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:03.217262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.229257 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e131e6b3-4343-43be-9153-fe0f33b8f30e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.388345 Oct 06 13:02:03.229560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1476/2986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:02 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:03.242261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:03.242261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:03.260572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.261268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.261909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.262773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.263385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.263897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.477870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.489719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.494261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.510928 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00bf7773-5876-4e65-a882-c783f0297763 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.277549 Oct 06 13:02:03.514062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1477/2987] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:03 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:03.530347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:03.531017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:03.541546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.541546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.541546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.542733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.543223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.543665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.586761 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a03873dc-ff45-459e-a62c-b1794038d8fd tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.461242 Oct 06 13:02:03.587719 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1511/2988] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:03.592547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34a077e2-be78-47ab-8d5d-3deb9e40c76d tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:03.593180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34a077e2-be78-47ab-8d5d-3deb9e40c76d tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:03.787963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34a077e2-be78-47ab-8d5d-3deb9e40c76d tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.797158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34a077e2-be78-47ab-8d5d-3deb9e40c76d tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1224 microversion: 2.1 time: 0.208241 Oct 06 13:02:03.802841 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1512/2989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:03 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:03.811281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022843ae-fcf5-42b2-a16c-1bbdfa1377f8", "name": "network-vif-plugged", "status": "completed", "tag": "602e3866-98fa-4dd3-8346-f2675d44e64d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:03.857200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.859287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.861066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.880921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] Creating event network-vif-plugged:602e3866-98fa-4dd3-8346-f2675d44e64d for instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 on n-h1-860556-1 Oct 06 13:02:03.895805 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b18c7696-6401-48b5-9cea-0cf8e0c3f527 req-3c2de9dc-0b79-4bf2-aded-e1d7e592c5ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091399 Oct 06 13:02:03.896704 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1513/2990] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:03.904112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:03.904343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:03.905229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:03.913679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.914576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.914932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fcf55aa7-52db-42f3-93a6-9335e48f3b4b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.399621 Oct 06 13:02:03.915369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.915877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1478/2991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:03 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:03.918636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:03.920415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:03.922628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:03.927039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420f1dc1-70aa-4ff7-a44c-0f1e5b3a7afb tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3eb01e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1372628808", "description": "tempest-description-339031038"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:04.195237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:04.207457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2e16f48-a289-42ba-85e4-4b698c35e76b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1508 microversion: 2.1 time: 0.309374 Oct 06 13:02:04.208583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1514/2992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:03 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:04.215425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:04.216885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:04.224179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.224817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.225367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.226228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.227484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.228083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.288044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-420f1dc1-70aa-4ff7-a44c-0f1e5b3a7afb tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.370595 Oct 06 13:02:04.294250 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1479/2993] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:04.300597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:04.302045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:04.311086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.312177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.312641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.313347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.313829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.314263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.453233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:04.461612 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e28f89a4-0fdf-4b5e-bf85-d7e2fcf2e2e1 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.250609 Oct 06 13:02:04.462380 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1515/2994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:04 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:04.467176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:04.467588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:04.473369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.473995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.474514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.475286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.475820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.476466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.482438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:04.490870 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7cb0e28-3b30-4ee9-be77-d59dbc7a2765 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.194494 Oct 06 13:02:04.491569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1480/2995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:04 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:04.496198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:04.496860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:04.503367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.503854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.504291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.504985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.505437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.506049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.686021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:04.697950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ff9e307-c394-4857-9e35-4783d029df9c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.234303 Oct 06 13:02:04.698990 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1516/2996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:04 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:04.703763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:04.704375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:04.724700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:04.729994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.730724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.731333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.732219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:04.732834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:04.733440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:04.734222 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-747163e5-06d5-4cad-aa56-0397485849a7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 200 len: 1508 microversion: 2.1 time: 0.241450 Oct 06 13:02:04.742807 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1481/2997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:04 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:04.750773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc7e9687-0065-4a00-a805-1f3d21f6b79d tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e751430>, body: {"security_group_rule": {"parent_group_id": "45e7e3e7-1ca8-461e-b7a2-1d931ff561dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c7483692-bedd-415c-a287-b1750acfb33e"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:05.134043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:05.144045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-831f51a5-1918-44f2-9241-c2e5219c79dc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1308 microversion: 2.1 time: 0.443943 Oct 06 13:02:05.144958 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1517/2998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:04 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:05.150415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:05.151023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 8aee0a4c-7cef-4562-8231-c32c5773694b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.161472 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/8aee0a4c-7cef-4562-8231-c32c5773694b/action HTTP/1.1 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 15 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: {"suspend": {}} Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8aee0a4c-7cef-4562-8231-c32c5773694b', 'body': {'suspend': {}}} Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:05.163491 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:05.169651 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:05.169651 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:05.169651 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. Oct 06 13:02:05.169651 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:05.169651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 8aee0a4c-7cef-4562-8231-c32c5773694b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:05.170532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bba81821-2b3e-4395-a501-e9f352c79799 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/8aee0a4c-7cef-4562-8231-c32c5773694b/action" status: 404 len: 111 microversion: 2.1 time: 0.022362 Oct 06 13:02:05.171204 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1518/2999] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:05 2022] POST /compute/v2.1/servers/8aee0a4c-7cef-4562-8231-c32c5773694b/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:05.178029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:05.178974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.187450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.188151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.188616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.189394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.189973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.190508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.291292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:05.300023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:05.301478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:05.308072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a811ae5-6e00-473a-8ce4-b547587543f1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.135614 Oct 06 13:02:05.317937 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1519/3000] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:05 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:05.317937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:05.317937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.326733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.360579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:05.459860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99503989-d0bc-49f5-a234-82e71ace6453 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 204 len: 0 microversion: 2.1 time: 0.149684 Oct 06 13:02:05.461169 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1520/3001] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:05 2022] DELETE /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:05.475744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:05.477200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.486283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.487135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.487809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.488817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.489975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.490587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.795478 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc7e9687-0065-4a00-a805-1f3d21f6b79d tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.051500 Oct 06 13:02:05.797086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1482/3002] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:05.802505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:05.821845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:05.822409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.828204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-daf80177-15e4-43ae-92db-a2c579acc163 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1282 microversion: 2.1 time: 0.365185 Oct 06 13:02:05.828812 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1521/3003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:05 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1282 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:05.832956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.833454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.833928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.834647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.835108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.835543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.841774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:05.842400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:05.851084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.852126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.852577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:05.853295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:05.853776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:05.854218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:06.136287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:06.146279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e952d5a-75c7-4dbd-aaf4-232e50ccbb3c tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.308345 Oct 06 13:02:06.146870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1522/3004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:05 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:06.153882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2047277489", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d177263e-a196-42a7-8555-65753d4f2ed0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:06.166576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:06.181355 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2212caef-071c-4911-8116-1a8341536957 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.369473 Oct 06 13:02:06.199021 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1483/3005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:05 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:06.204727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:06.205706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:06.213387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:06.213926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:06.214371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:06.215078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:06.215536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:06.215964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:06.222616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] validate_networks() for [('d177263e-a196-42a7-8555-65753d4f2ed0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:02:06.587019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:06.595369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ec9c866-412c-4630-9817-8c7cab399abe tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.394576 Oct 06 13:02:06.595943 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1484/3006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:06 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:06.600390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2a2c1d9-63fe-4c81-9c21-079956efbf79 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e7028b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1404470085", "description": "tempest-description-1284068345"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:07.161459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2a2c1d9-63fe-4c81-9c21-079956efbf79 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.564355 Oct 06 13:02:07.162348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1485/3007] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:07.175380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371bde92-02d4-41c4-92d8-265fb5096838", "name": "network-vif-plugged", "status": "completed", "tag": "6e9441c5-43d0-4ffe-b165-2a0671cd9c1c"}, {"server_uuid": "7bb8a2fc-537d-452d-895d-0e341f9082d1", "name": "network-vif-plugged", "status": "completed", "tag": "647989af-2207-4cb6-a08b-5f3d0fece9c3"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:07.187499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.187986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.188675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.203152 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Creating event network-vif-plugged:6e9441c5-43d0-4ffe-b165-2a0671cd9c1c for instance 371bde92-02d4-41c4-92d8-265fb5096838 on n-h2-860556-1 Oct 06 13:02:07.203587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] Creating event network-vif-plugged:647989af-2207-4cb6-a08b-5f3d0fece9c3 for instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 on n-h1-860556-1 Oct 06 13:02:07.212807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7d35afdd-9346-463b-9917-b41ba4ccd1e4 req-3370dc6b-bedb-492e-8a75-7ffb1fb9f633 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040886 Oct 06 13:02:07.213799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1486/3008] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:07.219581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:07.220347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:07.229222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.230018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.230466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.231179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.231638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.232067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.260094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:02:07.261174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:02:07.262076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:02:07.262510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:02:07.262967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:02:07.273304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.274116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.274749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.276261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.277163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.277817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.302684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:02:07.312437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Getting quotas for user 72051080ff9c4e9d80df2ff14b828464 and project 5e3af87ea03245b6bfc4d8185d256292. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:02:07.328916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:02:07.332057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:02:07.395420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e328ff1b-545b-4205-b2d8-a94f10fb5b6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246806 Oct 06 13:02:07.396405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1523/3009] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:02:07.401113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:07.402035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:07.409671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.410195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.412283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.412763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.413249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.413691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.630804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:07.638602 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-acec5789-d52b-4ecd-aa6d-0362fc507e5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1488 microversion: 2.1 time: 0.423541 Oct 06 13:02:07.639392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1487/3010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:07 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1488 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:07.644504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:07.645281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:07.652241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.652958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.653572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.654592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.655211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.655796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.764425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:07.775354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:07.790976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:07.794939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:07.802881 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cdac16b-24de-4cdb-bfc8-c1af8579b8ff tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.378331 Oct 06 13:02:07.806107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1524/3011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:07 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:07.817289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:07.819271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:07.837590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.838246 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1ad5896-a13c-443c-963a-639413b3c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.188835 Oct 06 13:02:07.838551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.839279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.839534 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1488/3012] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:07 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:07.840495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:07.842231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:07.842863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:07.844728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5ecd4e6-5b89-4955-b191-99ea59e41fbb tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e709940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1657648129", "description": "tempest-description-1746761048"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:07.932873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:08.279784 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5ecd4e6-5b89-4955-b191-99ea59e41fbb tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.438957 Oct 06 13:02:08.284250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:08.290568 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1489/3013] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:08.292211 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c706dc6-b52b-4dc3-b1de-0660232af5ba tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.482447 Oct 06 13:02:08.306432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:08.306432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:08.306637 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1525/3014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:07 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:08.306637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:08.306637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.306904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.317237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.317746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.322839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.324062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.325109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.325967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.478248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:08.494665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0be0f97a-2c16-4b1d-bfb7-a3d525ab85e4 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1214 microversion: 2.1 time: 0.196648 Oct 06 13:02:08.495349 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1526/3015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:08 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:08.500908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:08.501521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:08.508356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.508845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.509283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.510004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.510633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.511366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.578235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:08.589994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-797f318c-46c5-4a86-ad76-0ae4edb9c5ce tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.298318 Oct 06 13:02:08.591137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1490/3016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:08 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:08.608358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:08.609007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:08.615730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.616425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.617602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.618617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.619204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.620423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.709346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:08.738864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:08.748476 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-817008a0-697a-4aa7-beb7-877ae6fd1530 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1318 microversion: 2.1 time: 0.252078 Oct 06 13:02:08.748684 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16a51251-fd24-413e-92df-dfbe3b79d446 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35/action" status: 202 len: 0 microversion: 2.1 time: 0.155928 Oct 06 13:02:08.753025 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1491/3017] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:08 2022] POST /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:08.758313 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1527/3018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:08 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:08.760081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:08.761569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:08.768799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.769667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.770429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.771550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.772238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.772979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.806171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lazy-loading 'flavor' on Instance uuid 69deb394-39d0-4415-9693-ce716eb374b0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:02:08.806973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53273278-4088-4090-9af4-808ffe05bb30", "name": "network-vif-deleted", "tag": "4222510b-29b7-4889-b6a4-5e2d104bcb17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:08.838947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.839434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.839948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.859921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] Creating event network-vif-deleted:4222510b-29b7-4889-b6a4-5e2d104bcb17 for instance 53273278-4088-4090-9af4-808ffe05bb30 on n-h2-860556-1 Oct 06 13:02:08.866860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1d596b22-18b2-4c0b-9ebd-72826b097132 req-9caa8c0b-f547-4c15-8d6f-f81c4771c246 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103338 Oct 06 13:02:08.874007 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1528/3019] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:08.880737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af33768e-8e99-4069-982f-1d7039fd09f0 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d475f1b80>, body: {"security_group_rule": {"parent_group_id": "99de6e18-1f86-4a01-b94e-6b85587d93ca", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e9618259-24bd-4443-8e26-4bcde7669f47"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:08.907502 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9857870b-c629-4193-9245-204935b902aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.152776 Oct 06 13:02:08.911356 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1492/3020] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:08 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:08.916150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064f249d-452f-4d91-9c2c-397ee9f49014", "tag": "1c4d9918-0996-45d1-8b51-357f7d0dd04f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:08.952350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:08.952844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:08.953293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:08.982490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] Creating event network-changed:1c4d9918-0996-45d1-8b51-357f7d0dd04f for instance 064f249d-452f-4d91-9c2c-397ee9f49014 on n-h2-860556-1 Oct 06 13:02:08.987989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6732dbe8-b3cd-4159-b5cb-5132e5e2a591 req-7cf0ecd4-9e10-4ee8-bde9-3e3aea90be5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077979 Oct 06 13:02:08.989064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1493/3021] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:08.994824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:08.995850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.002174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.002673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.003118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.003819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.004366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.004702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.229072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.236658 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4877967-cd66-4ded-b61e-6e9e8eb784c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 200 len: 1473 microversion: 2.1 time: 0.246554 Oct 06 13:02:09.237439 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1494/3022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:08 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 1473 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:09.242032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:09.242840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.249186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.249669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.250157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.251297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.251297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.251707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.369118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.377627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.379112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.384107 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0abc9ac-3905-4f2b-844c-3520b659c120 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.145679 Oct 06 13:02:09.384690 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1495/3023] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:09 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:09.389211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:09.389815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.396415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.397020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.397445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.398909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.399381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.405381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.405633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af33768e-8e99-4069-982f-1d7039fd09f0 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.529721 Oct 06 13:02:09.406727 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1529/3024] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:08 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:09.411523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1604292315"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:09.415305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.422369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.422865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.423519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.424480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.424947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.425389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.653004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.662145 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf03ad33-e9f8-4839-b85e-f248a5b98b95 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1513 microversion: 2.1 time: 0.276171 Oct 06 13:02:09.663293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1496/3025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:09 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:09.668486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:09.669297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.675970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.676718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.677331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.678302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.678915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.679589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.691956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2834fa1-c6c0-4d4b-8c78-b746de02ef90 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35/action" status: 202 len: 0 microversion: 2.1 time: 0.283810 Oct 06 13:02:09.692867 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1530/3026] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:09 2022] POST /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 13:02:09.701176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7cb7e0e-f99c-40ff-a63c-0a5096bf0778 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d475e3280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:09.926363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:09.935292 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27f7aac2-559f-44af-958c-5f8642ce668b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.270462 Oct 06 13:02:09.936134 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1497/3027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:09 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:09.950511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:09.951196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:09.957869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.958411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.958822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:09.959573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:09.960077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:09.960545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.032118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.041455 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-afbdd27d-e5a6-4367-95fd-6cd2340f72dd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1270 microversion: 2.1 time: 0.103872 Oct 06 13:02:10.050373 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1498/3028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:09 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:10.050373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.050373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:10.053052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.053551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.054198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.055866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.056480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.057166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.108007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7cb7e0e-f99c-40ff-a63c-0a5096bf0778 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e9618259-24bd-4443-8e26-4bcde7669f47" status: 202 len: 0 microversion: 2.1 time: 0.411421 Oct 06 13:02:10.109063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1531/3029] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:09 2022] DELETE /compute/v2.1/os-security-groups/e9618259-24bd-4443-8e26-4bcde7669f47 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:10.119728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50b59a23-eba3-4491-962f-8c8781d1dc28 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d47650d30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.189302 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-50b59a23-eba3-4491-962f-8c8781d1dc28 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.075840 Oct 06 13:02:10.190532 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1532/3030] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:10.197048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.198469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:10.207138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.208025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.208616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.209440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.210033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.210626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.251361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.261780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7759f835-9265-4fef-ad94-d4431f4cf62d tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1351 microversion: 2.1 time: 0.218568 Oct 06 13:02:10.262627 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1499/3031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1351 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:10.267580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70586052-c851-45c3-be63-8e0795891362 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e7779d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.367998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70586052-c851-45c3-be63-8e0795891362 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/99de6e18-1f86-4a01-b94e-6b85587d93ca" status: 200 len: 248 microversion: 2.1 time: 0.103435 Oct 06 13:02:10.378124 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1500/3032] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/os-security-groups/99de6e18-1f86-4a01-b94e-6b85587d93ca => generated 248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:10.385251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3896f968-8d45-4002-9d7c-d0cebf4607ac tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e777d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-450187565", "description": "tempest-description-51051782"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:10.412358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.423613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73dbac58-013a-4b9d-8d5f-eeace61b325c tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 200 len: 1504 microversion: 2.1 time: 0.231525 Oct 06 13:02:10.424763 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1533/3033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:10.430584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.431451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:10.438006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.438429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.438856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.439950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.440835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.440835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.856327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.864413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.865883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:10.870789 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cbf9f91b-84d5-4fb0-ac9f-919b709e5e1e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1529 microversion: 2.91 time: 0.444886 Oct 06 13:02:10.871383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1534/3034] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1529 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:10.875866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:10.876476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:10.882702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.883189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.883628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:10.884326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:10.884783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:10.885211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.068637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3896f968-8d45-4002-9d7c-d0cebf4607ac tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.687663 Oct 06 13:02:11.069249 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1501/3035] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:10 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:11.074286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.075049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.082400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.082903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.083356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.084069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.084559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.084996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.189091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:11.198427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49c6059a-686d-4eba-961d-3ba3ff088b2f tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 200 len: 1504 microversion: 2.1 time: 0.325994 Oct 06 13:02:11.198980 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1535/3036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:10 2022] GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:11.203800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.204419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.218325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.219682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.220205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.221081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.221617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.222132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.323182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lazy-loading 'services' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:02:11.338205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:11.341412 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-758767fb-dd59-4919-ba49-a0c31c9781ca tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1934 microversion: 2.91 time: 0.141155 Oct 06 13:02:11.342244 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1536/3037] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1934 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:11.346538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.347156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.348387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:11.355074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.355573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.356020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.357012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.357484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.358008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.359878 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a0ef98d-a120-46ad-8493-c50a029eb2d9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1496 microversion: 2.1 time: 0.289583 Oct 06 13:02:11.361881 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1502/3038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:11.367455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.368957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.375907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.376529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.377074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.377919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.378751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.379309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.480894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:11.488803 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c411c315-39b2-4c1c-a071-98cd376d03ab tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1276 microversion: 2.1 time: 0.125274 Oct 06 13:02:11.489384 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1503/3039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:11.494432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eeaaa805-fac4-4517-ba51-b7d670c09aa6 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e777a60>, body: {"security_group_rule": {"parent_group_id": "5a844667-ddd0-434d-8d35-83e738c3300c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:11.607883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:11.615770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f5e9d3f-ee7b-479d-96e3-a1a6b7e29a5c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.272652 Oct 06 13:02:11.616581 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1537/3040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:11.628646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a1f3b0eb-f102-4109-b1d7-6f0c409cd323 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d4771d940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.673710 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a1f3b0eb-f102-4109-b1d7-6f0c409cd323 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.049188 Oct 06 13:02:11.674314 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1538/3041] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:11.680650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.681229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.688592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.689161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.689632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.690550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.690976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.691601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.720986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:11.802517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d703a423-3223-4935-8e8e-e84e16a4f555 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "DELETE /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 204 len: 0 microversion: 2.1 time: 0.126663 Oct 06 13:02:11.803476 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1539/3042] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:11 2022] DELETE /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:11.810936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:11.811647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.817684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.818231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.818669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.819367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.819863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.820411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.927504 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eeaaa805-fac4-4517-ba51-b7d670c09aa6 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.437011 Oct 06 13:02:11.928225 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1504/3043] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:11.933497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:11.934372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:11.940752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.941345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.941974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.942759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:11.943297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:11.943802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:11.969722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lazy-loading 'flavor' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:02:12.186347 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dae6f5fe-8b46-43da-b2e3-3038e54af086 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action" status: 202 len: 0 microversion: 2.91 time: 0.256395 Oct 06 13:02:12.187715 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1505/3044] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:02:11 2022] POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:12.194154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:12.195831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.202414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.202904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.203337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.204221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.204676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.205099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.217672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.229941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-689d59c3-abea-48e2-b7d0-e7edf25f796e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1540 microversion: 2.1 time: 0.423316 Oct 06 13:02:12.230633 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1540/3045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:11 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1540 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:12.232227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lazy-loading 'flavor' on Instance uuid 69deb394-39d0-4415-9693-ce716eb374b0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:02:12.236424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.236934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.244118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.244878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.245543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.246522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.247208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.247858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.248231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'suspend' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state suspended Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 15 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: {"suspend": {}} Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'suspend' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state suspended Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'suspend': {}}} Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 06 13:02:12.249991 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state suspended Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state suspended Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'suspend' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state suspended {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b01383e8-9418-4f6b-9d7f-aa4b5e01d980 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 148 microversion: 2.1 time: 0.062397 Oct 06 13:02:12.254866 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1506/3046] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:12 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 148 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:02:12.257013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a162eb3-d78a-4120-b967-b6f3a7d143a9 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Action: 'create', calling method: .version_select at 0x7f7d3e7a6280>, body: {"security_group_rule": {"parent_group_id": "5a844667-ddd0-434d-8d35-83e738c3300c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:12.287240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:12.344738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:12.392098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ad41a8e-d71d-4c52-901f-e710f67c9ce5 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "DELETE /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 204 len: 0 microversion: 2.1 time: 0.160040 Oct 06 13:02:12.392706 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1541/3047] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:12 2022] DELETE /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:12.399151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.400018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.406709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.407198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.407639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.408476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.408965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.409499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.488671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.497163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.498640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.503574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfcb813d-4b89-4ad3-8bbc-ccfaccf9472b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.109433 Oct 06 13:02:12.504154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1542/3048] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:12.510063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.510561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.518825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.519322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.520030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.520475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.520932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.521359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.546443 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2a162eb3-d78a-4120-b967-b6f3a7d143a9 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.292895 Oct 06 13:02:12.547120 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1507/3049] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:12 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:12.551746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:12.552346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.560751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.561325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.561873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.562676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.563206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.563848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.609475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:12.610101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3f2f31ca-de81-4cec-861e-33d86af3a233 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104742 Oct 06 13:02:12.611590 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1543/3050] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:12.621481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.622627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.635164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.636194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.637449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.639410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.640850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.641356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.653649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d539f15a-f16b-4a02-af46-de77ab3980e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 202 len: 0 microversion: 2.1 time: 0.105229 Oct 06 13:02:12.657689 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1508/3051] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:12 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:12.660403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.661931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.671418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.671418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.671418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.672351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.672936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.673455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.845250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.853854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1516c190-b2b4-4ed0-aeeb-aeea1e6ab563 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 200 len: 1510 microversion: 2.1 time: 0.240695 Oct 06 13:02:12.869965 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1544/3052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:12.881573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f3f6679-fda2-4967-bbd7-5e6e6a8a75a1 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e6d0c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.889366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:12.897499 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27ecf071-4dfd-464b-89fa-be29d91afb09 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.241421 Oct 06 13:02:12.898898 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1509/3053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:12.920446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.921452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.927690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.928416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.929045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.930321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.930780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.931211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.942266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f3f6679-fda2-4967-bbd7-5e6e6a8a75a1 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/5a844667-ddd0-434d-8d35-83e738c3300c" status: 200 len: 662 microversion: 2.1 time: 0.070426 Oct 06 13:02:12.943369 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1545/3054] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/os-security-groups/5a844667-ddd0-434d-8d35-83e738c3300c => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:12.949129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:12.949863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:12.957368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.958123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.958939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:12.959879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:12.960528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:12.961136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:13.231787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:13.243154 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c7040b0-3045-49d9-982f-e1efedd01fa7 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.326429 Oct 06 13:02:13.243891 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1510/3055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:13.251036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09287195-db54-4774-ace2-850646d142ae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e702b80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:13.270928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:13.282363 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97ef50c1-28ec-46d6-9ea6-b4a3681ae953 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1502 microversion: 2.1 time: 0.337503 Oct 06 13:02:13.283616 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1546/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:12 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1502 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:13.290668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9cb662b-a9f5-4819-94e8-aa20c036c97d tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e6d0f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:13.318742 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09287195-db54-4774-ace2-850646d142ae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.072926 Oct 06 13:02:13.319321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1511/3057] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:13 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:13.535616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:13.536335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:13.548717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:13.550123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:13.551414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:13.552376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:13.553143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:13.553650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:13.741234 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9cb662b-a9f5-4819-94e8-aa20c036c97d tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/6f06624a-1df1-41d2-865c-6cc2e653a9b9" status: 202 len: 0 microversion: 2.1 time: 0.456240 Oct 06 13:02:13.744599 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1547/3058] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Oct 6 13:02:13 2022] DELETE /compute/v2.1/os-security-group-rules/6f06624a-1df1-41d2-865c-6cc2e653a9b9 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:13.754951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-848c9887-4b59-46dc-87a8-f2b67de2b629 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d47650940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:13.768635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:13.779795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:13.782500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:13.789754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b02456ea-3be8-44f8-afb3-d50cc72acad3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.258836 Oct 06 13:02:13.791186 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1512/3059] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:13 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:02:13.877040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:13.877952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:13.887582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:13.890967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:13.894359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:13.899952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:13.900650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:13.901269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:14.397361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:14.414683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcdb881e-8221-4ddd-993b-9182c84cee5a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 200 len: 1510 microversion: 2.1 time: 0.541894 Oct 06 13:02:14.418336 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1513/3060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:13 2022] GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:14.436099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:14.436714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:14.444437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:14.446651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:14.447098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:14.448203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:14.448669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:14.455470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:14.766015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:14.782964 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a77cef3c-af17-4c31-976c-ab30ca572c9b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.362822 Oct 06 13:02:14.783563 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1514/3061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:14 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:14.797050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:14.807656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:14.823065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:14.823753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:14.824375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:14.839216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:14.840954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:14.845567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.070501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-848c9887-4b59-46dc-87a8-f2b67de2b629 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5a844667-ddd0-434d-8d35-83e738c3300c" status: 202 len: 0 microversion: 2.1 time: 1.318639 Oct 06 13:02:15.072880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1548/3062] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:13 2022] DELETE /compute/v2.1/os-security-groups/5a844667-ddd0-434d-8d35-83e738c3300c => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:15.082267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:15.083057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:15.105384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.107914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.109174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.111492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.129216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.132558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.208956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:15.231535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d388d43-9d59-4cd0-abdb-e62ecc685479 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.435279 Oct 06 13:02:15.232550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1515/3063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:14 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:15.252699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8d9f7a1-35c2-448c-8c21-12c0faeda85a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e78b3a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:15.342921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8d9f7a1-35c2-448c-8c21-12c0faeda85a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.107028 Oct 06 13:02:15.343864 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1516/3064] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:15 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:15.354007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:15.363784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:15.371286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.377590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.382858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.384587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.388447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.389162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.551776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:15.571591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:15.576065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:15.589846 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e10913c7-e406-40e1-b567-89381e282fea tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.241310 Oct 06 13:02:15.607731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1517/3065] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:15 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:15.621873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4c1490-aa60-469a-aa91-92cc9da47d35", "name": "network-vif-plugged", "status": "completed", "tag": "5a67bd90-fd77-4d47-9dd1-6daa353e6020"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:15.634511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.635286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.635880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.639190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:15.655208 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] Creating event network-vif-plugged:5a67bd90-fd77-4d47-9dd1-6daa353e6020 for instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 on n-h1-860556-1 Oct 06 13:02:15.662679 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f351311-f748-470c-8e6b-2060a624a250 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1502 microversion: 2.1 time: 0.588599 Oct 06 13:02:15.664910 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1549/3066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:15 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1502 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:15.667561 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9b7ddb32-7228-48c5-bab8-db9555953a01 req-1db8aef5-13e8-475a-a63c-a58daa18c463 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056886 Oct 06 13:02:15.669671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb8a2fc-537d-452d-895d-0e341f9082d1", "tag": "647989af-2207-4cb6-a08b-5f3d0fece9c3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:15.671058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1518/3067] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:15.680558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e777af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:15.708762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.709333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.711971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.736223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] Creating event network-changed:647989af-2207-4cb6-a08b-5f3d0fece9c3 for instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 on n-h1-860556-1 Oct 06 13:02:15.758085 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-74a753ed-ca45-4a70-94d9-fc29a06d5932 req-b321cf43-a77a-46bd-91a4-a11b03a67d8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091307 Oct 06 13:02:15.765089 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1550/3068] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:15.772070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:15.772791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:15.795157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.795957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.796630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.797556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.798225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.800325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.874603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:02:15.875933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Neutron security group e9618259-24bd-4443-8e26-4bcde7669f47 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:02:15.876682 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] HTTP exception thrown: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.876682 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Request method failure captured: Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/e9618259-24bd-4443-8e26-4bcde7669f47 HTTP/1.1 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtHA-PiyOQjzp0eOj46MEjOVUPZhfJ9-7Z0P0TZN96tCU5N9PdXBPBbP5UoH_whfz7ZyZIZeaKn3iw82XKIs40zVyTmJQ3l6n5WV3v1_QvKpzBm-gd_i8zlcskDkv1a-SYgbAgsm_KLgWD7sAdcjo_xr7tCFLum5znWd_oVVEAXAbRY Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 27f84d5be2e045398cb677e4236350b8 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2087321211 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_27f84d5be2e045398cb677e4236350b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/27f84d5be2e045398cb677e4236350b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/27f84d5be2e045398cb677e4236350b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/27f84d5be2e045398cb677e4236350b8"}]}] Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2087321211 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 27f84d5be2e045398cb677e4236350b8 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2087321211 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupRulesTestJSON-2087321211-project Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f7df31c52a0b4c47b71bc968ba71b029 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2087321211-project Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e9618259-24bd-4443-8e26-4bcde7669f47'} Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:02:15.879094 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] Oct 06 13:02:15.884544 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:15.903991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Returning 404 to user: Security group e9618259-24bd-4443-8e26-4bcde7669f47 does not exist Oct 06 13:02:15.903991 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0b2cfa36-dc4d-4bfe-8e3d-73f0ed71b955'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:15.906739 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84c3a959-9f88-48fb-b80a-b7d88683d5f3 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e9618259-24bd-4443-8e26-4bcde7669f47" status: 404 len: 194 microversion: 2.1 time: 0.233613 Oct 06 13:02:15.907501 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1519/3069] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:15 2022] DELETE /compute/v2.1/os-security-groups/e9618259-24bd-4443-8e26-4bcde7669f47 => generated 194 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:15.925663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5cfd34-f02b-4b72-8714-c90899e0db59", "tag": "9c83aee0-67a0-41ff-bb39-6965ac886955"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:15.964789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:15.965869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:15.966284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:15.998831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] Creating event network-changed:9c83aee0-67a0-41ff-bb39-6965ac886955 for instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 on n-h1-860556-1 Oct 06 13:02:16.015128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3b7abf69-da2a-44ed-8850-42811f8f30bc req-166e309b-5ab0-4f03-b108-a0f0e65f821e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103980 Oct 06 13:02:16.018415 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1520/3070] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:16.040215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:16.046981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:16.069517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:16.070639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:16.074709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:16.077675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:16.078494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:16.080394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:16.144798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1c3b6afd0141dc9864adb77f40553a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4c3e3fd93446491476dbe36b3a9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:16.170842 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f44afd88-0685-44f5-8bbf-5c5e19838e4a tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 200 len: 1468 microversion: 2.1 time: 0.404226 Oct 06 13:02:16.181692 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1551/3071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:15 2022] GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 1468 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:16.199720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-68cfdea1-41c0-4b5d-880e-8bb3febb1693 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d475e30d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:16.810417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:16.833414 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-131662fa-7adf-4681-8342-d9a6d766c778 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.811820 Oct 06 13:02:16.849917 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1521/3072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:16 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:16.872215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:16.872931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:16.885636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:16.887120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:16.887965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:16.890095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:16.890815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:16.891495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.231382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-68cfdea1-41c0-4b5d-880e-8bb3febb1693 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/99de6e18-1f86-4a01-b94e-6b85587d93ca" status: 202 len: 0 microversion: 2.1 time: 1.045520 Oct 06 13:02:17.232776 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1552/3073] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:16 2022] DELETE /compute/v2.1/os-security-groups/99de6e18-1f86-4a01-b94e-6b85587d93ca => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:17.238446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91c9311c-a047-4067-8113-64f788df1742 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d47771d30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.293730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:17.320836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:17.334559 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91c9311c-a047-4067-8113-64f788df1742 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.100398 Oct 06 13:02:17.340119 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1553/3074] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:17.355681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.356439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.364848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.365353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.365937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.367473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.368013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.368496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.434501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:17.444566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd42754c-dccf-4574-b812-d57957c2a4d2 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.592975 Oct 06 13:02:17.451988 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1522/3075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:16 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:17.459364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.459980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.480040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:17.482191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.482695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.483138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.483871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.484305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.484737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.509612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:17.519157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:17.522646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:17.529452 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0767709d-ed9e-405d-824a-974d273463b5 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.188247 Oct 06 13:02:17.530807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1554/3076] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:17.535829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.536452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 022843ae-fcf5-42b2-a16c-1bbdfa1377f8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.542828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.543331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.543776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.544501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.544965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.545397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.560774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] HTTP exception thrown: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Request method failure captured: Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 HTTP/1.1 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGHkntipJ5-nJcI463cSeMoXTBuPLbBtCITfSiMjfAOyB54Ygm_o7ZYbsnDXuSmxDq715ApCADQO4nRSjnSaknJnul6qmpwBReBOh4ZoiM4cFZDEdlKiorfTDU2TVWFgo9HCO-lvhedmSdx9VnP1WKz-Lf1CSOIVl3dXWhPRotoq5Q Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 21d4c3e3fd93446491476dbe36b3a9d0 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21d4c3e3fd93446491476dbe36b3a9d0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21d4c3e3fd93446491476dbe36b3a9d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21d4c3e3fd93446491476dbe36b3a9d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21d4c3e3fd93446491476dbe36b3a9d0"}]}] Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 21d4c3e3fd93446491476dbe36b3a9d0 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-MultipleCreateTestJSON-1026579160-project Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 3b1c3b6afd0141dc9864adb77f40553a Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-MultipleCreateTestJSON-1026579160-project Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '022843ae-fcf5-42b2-a16c-1bbdfa1377f8'} Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:17.562505 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Returning 404 to user: Instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3be6c9a6-14a3-493d-91b2-80cdc3acac61 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8" status: 404 len: 111 microversion: 2.1 time: 0.032002 Oct 06 13:02:17.567306 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1555/3077] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/022843ae-fcf5-42b2-a16c-1bbdfa1377f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:17.569823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8acb630f-bd0f-41ec-abd3-17b42ddc38aa tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d47732700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.742158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:17.757044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-882f1ca7-0cea-4c83-b7f0-62fcf9985f08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.304170 Oct 06 13:02:17.758349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1523/3078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:17.766501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.767121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] [instance: 371bde92-02d4-41c4-92d8-265fb5096838] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.782422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.782921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.783557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.784667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.785322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.785956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.805081 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] HTTP exception thrown: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Request method failure captured: Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 HTTP/1.1 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGHkntipJ5-nJcI463cSeMoXTBuPLbBtCITfSiMjfAOyB54Ygm_o7ZYbsnDXuSmxDq715ApCADQO4nRSjnSaknJnul6qmpwBReBOh4ZoiM4cFZDEdlKiorfTDU2TVWFgo9HCO-lvhedmSdx9VnP1WKz-Lf1CSOIVl3dXWhPRotoq5Q Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 21d4c3e3fd93446491476dbe36b3a9d0 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21d4c3e3fd93446491476dbe36b3a9d0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21d4c3e3fd93446491476dbe36b3a9d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21d4c3e3fd93446491476dbe36b3a9d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21d4c3e3fd93446491476dbe36b3a9d0"}]}] Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 21d4c3e3fd93446491476dbe36b3a9d0 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1026579160 Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MultipleCreateTestJSON-1026579160-project Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 3b1c3b6afd0141dc9864adb77f40553a Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MultipleCreateTestJSON-1026579160-project Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '371bde92-02d4-41c4-92d8-265fb5096838'} Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:17.807391 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. Oct 06 13:02:17.811851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:17.814341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] Returning 404 to user: Instance 371bde92-02d4-41c4-92d8-265fb5096838 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:17.815388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7428c71-ec4f-4fff-8d36-68ba453107e2 tempest-MultipleCreateTestJSON-1026579160 tempest-MultipleCreateTestJSON-1026579160-project] 10.222.0.26 "GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838" status: 404 len: 111 microversion: 2.1 time: 0.052777 Oct 06 13:02:17.819415 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1524/3079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/371bde92-02d4-41c4-92d8-265fb5096838 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:17.835654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064f249d-452f-4d91-9c2c-397ee9f49014", "name": "network-vif-plugged", "status": "completed", "tag": "1c4d9918-0996-45d1-8b51-357f7d0dd04f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:17.864531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.865126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.865572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.905106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] Creating event network-vif-plugged:1c4d9918-0996-45d1-8b51-357f7d0dd04f for instance 064f249d-452f-4d91-9c2c-397ee9f49014 on n-h2-860556-1 Oct 06 13:02:17.912602 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-414031e2-3c71-479d-ae8d-4cea5c194bbc req-29d4e830-860a-4f22-a797-29d78296f709 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095042 Oct 06 13:02:17.914550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1525/3080] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:17.923469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.924896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.927889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8acb630f-bd0f-41ec-abd3-17b42ddc38aa tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c7483692-bedd-415c-a287-b1750acfb33e" status: 202 len: 0 microversion: 2.1 time: 0.361395 Oct 06 13:02:17.933017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1556/3081] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:17 2022] DELETE /compute/v2.1/os-security-groups/c7483692-bedd-415c-a287-b1750acfb33e => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:17.939268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:17.940162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:17.985756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.986534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.987964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:17.988871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:17.990127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:17.990732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.002843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.003784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.004507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.005730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.006478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.007157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.300365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:18.313357 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4060713-5de4-488d-b788-5aeb13f8845a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.394040 Oct 06 13:02:18.327243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:18.334965 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1526/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:18.336563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1811334a-3082-465b-b9c7-eb15a8b5ea28 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.400449 Oct 06 13:02:18.350591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5555f12-2d64-4964-a928-1398cedd1a69 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e6dc790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:18.352887 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1557/3083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:17 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:18.357811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022843ae-fcf5-42b2-a16c-1bbdfa1377f8", "name": "network-vif-deleted", "tag": "602e3866-98fa-4dd3-8346-f2675d44e64d"}, {"server_uuid": "371bde92-02d4-41c4-92d8-265fb5096838", "name": "network-vif-deleted", "tag": "6e9441c5-43d0-4ffe-b165-2a0671cd9c1c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:18.370557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.372319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.374077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.394699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Creating event network-vif-deleted:602e3866-98fa-4dd3-8346-f2675d44e64d for instance 022843ae-fcf5-42b2-a16c-1bbdfa1377f8 on n-h1-860556-1 Oct 06 13:02:18.395401 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] Creating event network-vif-deleted:6e9441c5-43d0-4ffe-b165-2a0671cd9c1c for instance 371bde92-02d4-41c4-92d8-265fb5096838 on n-h2-860556-1 Oct 06 13:02:18.408910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ea1f4c0d-8598-42d2-accd-702b9d2fd2eb req-abf324bc-ed58-45bb-8ee2-9d4e15fbb4c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054188 Oct 06 13:02:18.409860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1558/3084] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:18.418056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:18.418951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:18.426050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f/action HTTP/1.1 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 15 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: {"unpause": {}} Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f', 'body': {'unpause': {}}} Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:18.427980 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:18.432858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:18.432858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:18.432858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. Oct 06 13:02:18.432858 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:18.436748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:18.438303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f65a6890-966b-42f1-a188-63ba76be13c9 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f/action" status: 404 len: 111 microversion: 2.1 time: 0.026711 Oct 06 13:02:18.439409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1559/3085] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:18 2022] POST /compute/v2.1/servers/68028bb6-16e6-4f0f-a33c-9c5e3bb6f19f/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:18.444254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52cd5eb4-15fe-4546-ae3b-d1fbc0868636 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f9fbdc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:18.499722 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52cd5eb4-15fe-4546-ae3b-d1fbc0868636 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.058727 Oct 06 13:02:18.500562 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1560/3086] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:18 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:18.515575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:18.516471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:18.524965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.526054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.527666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.528983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.529614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.530241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.759938 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5555f12-2d64-4964-a928-1398cedd1a69 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/45e7e3e7-1ca8-461e-b7a2-1d931ff561dd" status: 202 len: 0 microversion: 2.1 time: 0.422855 Oct 06 13:02:18.761165 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1527/3087] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:18 2022] DELETE /compute/v2.1/os-security-groups/45e7e3e7-1ca8-461e-b7a2-1d931ff561dd => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:18.766385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:18.767308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:18.795871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.796773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.797488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.798516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.799246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.799902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.846695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:18.855747 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bdf760b8-8de6-4c4a-b9fd-4d4fad0285aa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.353934 Oct 06 13:02:18.860023 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1561/3088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:18 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:18.866124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:18.867646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:18.874317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.875088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.875789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.876744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:18.878442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:18.879110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:18.999561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:19.009138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:19.015131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:19.029187 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c354778-f14b-4b08-82d4-088853383a5e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.167401 Oct 06 13:02:19.029843 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1562/3089] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:18 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:19.034705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb525b9c-162f-4b49-80ea-b8dbeabd116b tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d476f38b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:19.192542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:19.217191 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d923166-90d2-429f-8b24-a0eb43185f99 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1324 microversion: 2.1 time: 0.453418 Oct 06 13:02:19.225555 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1528/3090] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:18 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:19.240503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:19.241145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:19.261657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:19.262575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:19.264911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:19.267960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:19.268937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:19.269470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:19.846170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:19.871554 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-277dc46c-7ee9-47f7-b83f-27515aab8e97 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.632817 Oct 06 13:02:19.871554 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1529/3091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:19 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:19.871554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:19.871554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:19.890340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:19.892038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:19.892602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:19.893776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:19.894929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:19.895511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.095095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb525b9c-162f-4b49-80ea-b8dbeabd116b tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b91ece2a-047a-4f8c-9b46-a8583a56d4a1" status: 202 len: 0 microversion: 2.1 time: 1.063891 Oct 06 13:02:20.095699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1563/3092] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:19 2022] DELETE /compute/v2.1/os-security-groups/b91ece2a-047a-4f8c-9b46-a8583a56d4a1 => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:20.102826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dfd41e7f-cf54-4e64-8ef9-a6195b05bb8c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476c2e50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:20.192670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dfd41e7f-cf54-4e64-8ef9-a6195b05bb8c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.095669 Oct 06 13:02:20.197433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1564/3093] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:20 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:20.204111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:20.205608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:20.216805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.217607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.219948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.220934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.221560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.222189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.250924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:20.264014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e22cf45-8976-40b9-af42-7531512038bd tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.400753 Oct 06 13:02:20.264605 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1530/3094] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:19 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'unpause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 15 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: {"unpause": {}} Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'unpause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'unpause': {}}} Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state active. Cannot unpause while the instance is in this state. Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:20.278045 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'unpause' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ade3afa5-b4bb-4006-83e0-c827095a5c5f tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 145 microversion: 2.1 time: 0.080573 Oct 06 13:02:20.285638 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1565/3095] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:20 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 145 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:02:20.293508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:20.294218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:20.303093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8585e4b1-7cef-4308-a5e5-1005269a9b48 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] Calling method '.version_select at 0x7f7d3e6c48b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:20.309091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.310361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.310879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.311612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.312075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.316477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.452002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:20.475613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:20.479483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:20.488360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b1d224e-bf91-4262-8ef0-eedde0909b3a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.198934 Oct 06 13:02:20.522881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1566/3096] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:20 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:20.529213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:20.529489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:20.547282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.547774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.548218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.548928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.549383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.549841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.809700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:20.819703 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a770583-1479-4d3c-8737-f548b3000427 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 200 len: 1520 microversion: 2.1 time: 0.295623 Oct 06 13:02:20.835367 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1567/3097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:20 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:20.836173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8585e4b1-7cef-4308-a5e5-1005269a9b48 tempest-SecurityGroupRulesTestJSON-2087321211 tempest-SecurityGroupRulesTestJSON-2087321211-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3fdf5cb4-b65d-44d8-bdc7-7e08629f7cbf" status: 202 len: 0 microversion: 2.1 time: 0.547896 Oct 06 13:02:20.837153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1531/3098] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:02:20 2022] DELETE /compute/v2.1/os-security-groups/3fdf5cb4-b65d-44d8-bdc7-7e08629f7cbf => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:02:20.849340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.55"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:20.851534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:20.852231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:20.853168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:20.859321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.859828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.860274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:20.861030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:20.861484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:20.861948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.174756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:21.190839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e112f21-efb8-49c8-bec8-08c67fe85a22 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.343471 Oct 06 13:02:21.191777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1568/3099] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:20 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:21.214937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-155581a2-d850-49f2-a643-24aaa7f356b0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476c25e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:21.234483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.235312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.235989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.236925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.237598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.238313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.259926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:21.270839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:02:21.271580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquired lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:02:21.336634 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-155581a2-d850-49f2-a643-24aaa7f356b0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.128583 Oct 06 13:02:21.337239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1569/3100] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:21 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:21.341947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:21.342580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:21.384822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.385330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.385799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.386529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.402373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.403081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.852457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:21.861730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49661fbf-62cb-4935-bf71-d390de759c2e tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.523325 Oct 06 13:02:21.890538 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1570/3101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:21 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:21.907626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:21.908594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:21.917589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.918436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.919215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:21.919933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:21.920441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:21.920889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:22.242639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:22.279284 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a14c0c0-8313-4aff-9758-c3184e2a62b3 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.375926 Oct 06 13:02:22.293766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1571/3102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:21 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:22.305196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:22.305933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:22.315738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:22.316224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:22.316661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:22.317562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:22.326023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:22.326654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:22.331622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:22.982283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:22.997100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:23.004978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:23.017179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-474a25e6-926d-492b-9dc8-de5fa3cf6fd2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.735666 Oct 06 13:02:23.042186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1572/3103] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:22 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:23.053070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:23.053695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 8248b7be-5e3e-466a-9cb9-e692180fcb27] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:23.079586 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/8248b7be-5e3e-466a-9cb9-e692180fcb27/action HTTP/1.1 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 18 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: {"unshelve": null} Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8248b7be-5e3e-466a-9cb9-e692180fcb27', 'body': {'unshelve': None}} Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:23.081474 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. Oct 06 13:02:23.086654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:23.088386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 8248b7be-5e3e-466a-9cb9-e692180fcb27 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:23.098999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4083e340-7ae0-4563-b619-1d65ac914c00 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/8248b7be-5e3e-466a-9cb9-e692180fcb27/action" status: 404 len: 111 microversion: 2.1 time: 0.055269 Oct 06 13:02:23.117398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1573/3104] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:23 2022] POST /compute/v2.1/servers/8248b7be-5e3e-466a-9cb9-e692180fcb27/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:23.131118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cc6ce22-4d06-47be-a020-7c710318d4ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e720a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:23.217836 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cc6ce22-4d06-47be-a020-7c710318d4ec tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.098132 Oct 06 13:02:23.222092 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1574/3105] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:23 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:23.228757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5cfd34-f02b-4b72-8714-c90899e0db59", "name": "network-vif-plugged", "status": "completed", "tag": "9c83aee0-67a0-41ff-bb39-6965ac886955"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:23.240471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:23.241318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:23.242684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:23.257064 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] Creating event network-vif-plugged:9c83aee0-67a0-41ff-bb39-6965ac886955 for instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 on n-h1-860556-1 Oct 06 13:02:23.266820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bd62b21d-7e2c-4bac-ab8c-a61b584aa857 req-0e940a82-8a75-4154-8b52-1401e433629b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042202 Oct 06 13:02:23.271186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1575/3106] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:23.287441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:23.288500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:23.312474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:23.313304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:23.314198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:23.316590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:23.317308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:23.317966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:23.758947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:23.772138 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be372642-3899-4794-a9f9-27cf6a4a09fa tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.498849 Oct 06 13:02:23.788244 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1576/3107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:23 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:23.794626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:23.795188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:23.807662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:23.808166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:23.808602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:23.809326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:23.813772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:23.814151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:24.234043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:24.243617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4fa29e17-b870-477d-9c0c-95b2547689f7 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1318 microversion: 2.1 time: 0.466499 Oct 06 13:02:24.247544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Building network info cache for instance {{(pid=129614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:02:24.248307 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1577/3108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:23 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:24.260519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:24.262373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:24.269406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:24.274554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:24.277593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:24.280748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:24.283674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:24.284298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:24.996105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:25.005023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39324baf-9b40-4dd6-91a9-7684abd9cec8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.754192 Oct 06 13:02:25.011995 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1578/3109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:24 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:25.016994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:25.019558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:25.035623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.036478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.050171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.051420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.052143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.052810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.351209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:25.364999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:25.367731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:25.384834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24dd2d61-b0fe-4a11-b08f-6466f2b42d5a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.371160 Oct 06 13:02:25.395035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1579/3110] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:25 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:25.402388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93a8dc37-8454-4a2c-b1e6-aa9b0b3a7855 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d47732550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:25.500188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93a8dc37-8454-4a2c-b1e6-aa9b0b3a7855 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.103369 Oct 06 13:02:25.501218 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1580/3111] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:25 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:25.521634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:25.559155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.559664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.565888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.585170 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] Creating event network-changed:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:02:25.603313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-354eb713-fad9-4f5e-a797-6215eb8ce285 req-774727b0-3fa8-43aa-a756-4fab0deb718c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097276 Oct 06 13:02:25.605286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1581/3112] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:25.619308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:25.621217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:25.651691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.654102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.654778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.661169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.662037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.662662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.717029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Cannot 'unshelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action HTTP/1.1 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 18 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: {"unshelve": null} Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'unshelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'unshelve': None}} Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69deb394-39d0-4415-9693-ce716eb374b0 in vm_state active. Cannot unshelve while the instance is in this state. Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:02:25.718783 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active Oct 06 13:02:25.723611 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:25.734724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 409 to user: Cannot 'unshelve' instance 69deb394-39d0-4415-9693-ce716eb374b0 while it is in vm_state active {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:25.738653 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4881b70-2b70-4caa-837e-c3d66e04bba1 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action" status: 409 len: 146 microversion: 2.1 time: 0.129056 Oct 06 13:02:25.747009 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1582/3113] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:25 2022] POST /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:02:25.757816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:25.758484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:25.775753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.780205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.780872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:25.785039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:25.785793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:25.786495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:26.323973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Updating instance_info_cache with network_info: [{"id": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34", "address": "fa:16:3e:03:0d:12", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf15e258e-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:02:26.358504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Releasing lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:02:26.359689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-446c73fd-49df-4cae-bd78-acf0b9cc0c66 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action" status: 202 len: 0 microversion: 2.1 time: 5.513974 Oct 06 13:02:26.363572 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1532/3114] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:20 2022] POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action => generated 0 bytes in 5516 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 06 13:02:26.374981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:26.379682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:26.384683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3009aa1-5345-4bcc-bea4-e03085608936 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1509 microversion: 2.1 time: 0.636436 Oct 06 13:02:26.387701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:26.403416 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1583/3115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:25 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:26.409395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:26.410227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:26.410710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:26.413980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:26.414802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:26.416732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:26.419202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.55"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:26.428736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:26.440609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:26.454642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:26.455431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:26.456397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:26.457052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:26.457695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:26.514576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:02:26.515035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquired lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:02:27.020191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:27.032923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c9dd6b9-b18f-43ac-8758-a4293f913fdd tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.670149 Oct 06 13:02:27.053954 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1533/3116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:26 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:27.067395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:27.068530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:27.076242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.077482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.079151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:27.083160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.084927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.087867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:27.510340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:27.521590 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-adbfcc98-3650-40f9-97cf-e688ffe4369b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1509 microversion: 2.1 time: 0.464926 Oct 06 13:02:27.536739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1534/3117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:27 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:27.550018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:27.552458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:27.570075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.573694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.575063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:27.576554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.578291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.579364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:27.736851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:27.751856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:27.759038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:27.771641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b80c5e6-4e9c-4c5f-a952-63aa0ed0ae26 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.247277 Oct 06 13:02:27.773080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1535/3118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:27 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:27.778778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-072c489a-ad28-4f3e-b06e-4aae0abb75d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e941670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:27.842789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-072c489a-ad28-4f3e-b06e-4aae0abb75d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.063253 Oct 06 13:02:27.843400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1536/3119] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:27 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:27.848650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:27.849545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:27.867973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.868765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.869409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:27.870394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:27.871023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:27.871709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:28.277363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:28.289398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3dc52fd7-a4e7-4f56-8386-662bd6848a08 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.441278 Oct 06 13:02:28.309756 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1537/3120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:27 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:28.316044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:28.320436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:28.327261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:28.328093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:28.328839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:28.329812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:28.330589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:28.338660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:28.527883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5283a24-977e-4457-87db-255cca47371a tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "PUT /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1081 microversion: 2.1 time: 0.215559 Oct 06 13:02:28.546168 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1538/3121] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:02:28 2022] PUT /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1081 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:28.552597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1051119766_updated"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:28.557808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 271748cc-bf36-483e-941d-367e7bb6148c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:28.575107 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/servers/271748cc-bf36-483e-941d-367e7bb6148c HTTP/1.1 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 81 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1051119766_updated"}} Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '271748cc-bf36-483e-941d-367e7bb6148c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1051119766_updated'}}} Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 06 13:02:28.578709 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. Oct 06 13:02:28.582656 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:28.587507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 271748cc-bf36-483e-941d-367e7bb6148c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:28.588701 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1024bb1-9d06-44b6-8334-ea8316d3c6ba tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "PUT /compute/v2.1/servers/271748cc-bf36-483e-941d-367e7bb6148c" status: 404 len: 111 microversion: 2.1 time: 0.041070 Oct 06 13:02:28.589898 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1539/3122] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:02:28 2022] PUT /compute/v2.1/servers/271748cc-bf36-483e-941d-367e7bb6148c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:28.597687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:28.598979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:28.611726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:28.612680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:28.613450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:28.615121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:28.618604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:28.620450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.072935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:29.087420 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19698c5e-cd43-4d09-bf69-6bf52c364f31 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1507 microversion: 2.1 time: 0.495869 Oct 06 13:02:29.101774 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1540/3123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:28 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:29.113780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:29.113780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:29.116656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.117155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.117594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.118346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.118799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.119331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.470550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:29.478459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd440aea-350e-4284-83c6-9cc545f401ae tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.388523 Oct 06 13:02:29.479041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1541/3124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:29 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:29.498426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:29.499297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:29.508702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.509931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.510633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.511571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.512274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.512978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.709897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:29.723759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:29.731067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:29.746916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78b033da-be69-4856-bb84-84f9dc5c8f59 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.260805 Oct 06 13:02:29.749088 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1542/3125] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:29 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:29.766637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0efd8c1-fe61-46f8-9d77-40227fd979b0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e9b9f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:29.880149 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0efd8c1-fe61-46f8-9d77-40227fd979b0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.127862 Oct 06 13:02:29.883769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1543/3126] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:29 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:29.900340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:29.906156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:29.915002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.915991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.916658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:29.917645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:29.918434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:29.919274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:30.199544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:30.209342 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09224331-0233-45a7-bb3a-8786925e91a1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1507 microversion: 2.1 time: 0.324205 Oct 06 13:02:30.213716 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1544/3127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:29 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:30.227118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:30.228010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:30.240341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:30.241038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:30.242170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:30.242934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:30.246977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:30.247944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:31.344018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:31.368001 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e91ecbaf-b049-4501-8659-b3261b32c837 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 1.140491 Oct 06 13:02:31.373301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1545/3128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:30 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:31.386100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:31.399919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:31.407019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:31.407696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:31.408291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:31.417652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:31.418246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:31.418690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:31.528733 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.neutron [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] re-assign floating IP 172.25.9.55 from instance 7e89288b-1bff-437a-be5a-ab8c462c7708 Oct 06 13:02:31.541859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab92e147-1558-4ca4-b474-2b20bb90b3bc tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "PUT /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1083 microversion: 2.1 time: 0.160386 Oct 06 13:02:31.543173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1546/3129] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:02:31 2022] PUT /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1083 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:31.557661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:31.558399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:31.587263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:31.587577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:31.588215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:31.595637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:31.600691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:31.602093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:31.674788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:02:31.815644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:31.825080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:31.830296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:31.844978 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15ac4533-496e-4762-bda1-2e13c532314c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.300683 Oct 06 13:02:31.845994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1547/3130] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:31 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:31.851824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47c55b44-ae44-4239-a38c-c84be8c1dc7f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e71e310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:31.943780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47c55b44-ae44-4239-a38c-c84be8c1dc7f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1412 microversion: 2.1 time: 0.096694 Oct 06 13:02:31.954728 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1548/3131] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:31 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:31.959214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:31.988730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:31.989552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:31.989685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:32.019635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] Creating event network-changed:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:02:32.034655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b529a7b4-8053-4b4f-b57f-f7568a0e9c80 req-b66eb695-12f4-436e-be65-2d9472482e4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085693 Oct 06 13:02:32.036856 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1549/3132] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:32.050407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe322603-acc1-4fe2-9009-4246dd2e774b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe322603-acc1-4fe2-9009-4246dd2e774b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 HTTP/1.1 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 280 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.062636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:32.066379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe322603-acc1-4fe2-9009-4246dd2e774b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:32.072527 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe322603-acc1-4fe2-9009-4246dd2e774b tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 400 len: 619 microversion: 2.1 time: 0.027761 Oct 06 13:02:32.072527 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1550/3133] 10.222.0.26 () {60 vars in 1257 bytes} [Thu Oct 6 13:02:32 2022] PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:02:32.082503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:32.084834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:32.106298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:32.108409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:32.109028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:32.110174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:32.112744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:32.112744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:32.850276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:32.875602 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a7286b60-caaa-4b37-be3c-d97f4263603b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1509 microversion: 2.1 time: 0.804403 Oct 06 13:02:32.876374 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1551/3134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:32 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1509 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:32.888725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:32.890489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:32.909552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:32.910410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:32.911045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:32.911952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:32.914318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:32.914977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:33.825880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:33.832181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:33.834533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14b4d29d-8cc7-4423-a646-bd4910a8dae8 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.957016 Oct 06 13:02:33.856271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Updating instance_info_cache with network_info: [{"id": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34", "address": "fa:16:3e:03:0d:12", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf15e258e-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:02:33.859944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1552/3135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:32 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:33.868779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:33.870069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:33.873492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:02:33.887951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:33.889049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:33.889525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:33.890304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:33.893706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:33.894603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:34.041350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:34.055005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:34.059691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:34.073681 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a29f2777-f7ff-4584-930b-69a5df6cbe9e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.212351 Oct 06 13:02:34.091295 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1553/3136] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:34.111825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:34.113537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:34.138071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:34.141603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:34.142278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:34.145282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:34.146048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:34.146709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.105806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:35.117559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3246a337-4ae9-4488-bbaf-7abdf2ae46c6 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1509 microversion: 2.1 time: 1.024734 Oct 06 13:02:35.118189 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1554/3137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:34 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1509 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:35.123315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65ae4682-6e30-4c89-9724-b21df6f10d7d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea18280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.175273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65ae4682-6e30-4c89-9724-b21df6f10d7d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1421 microversion: 2.1 time: 0.055611 Oct 06 13:02:35.176066 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1555/3138] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:35 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:35.198203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.199080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:35.205649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.206197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.206644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.207359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.207824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.208257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.609042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:35.615052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Updating instance_info_cache with network_info: [{"id": "1c4d9918-0996-45d1-8b51-357f7d0dd04f", "address": "fa:16:3e:97:01:3e", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1c4d9918-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:02:35.619196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1191e07b-0b62-4f02-8476-12fb862a4688 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.431650 Oct 06 13:02:35.638060 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1556/3139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:35 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:35.643476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Releasing lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:02:35.645078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3fa175cf-98e0-4521-9d18-b12deb9ca582 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014/action" status: 202 len: 0 microversion: 2.1 time: 9.234161 Oct 06 13:02:35.646413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1584/3140] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:26 2022] POST /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014/action => generated 0 bytes in 9236 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:02:35.647433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064f249d-452f-4d91-9c2c-397ee9f49014", "tag": "1c4d9918-0996-45d1-8b51-357f7d0dd04f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:35.652771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.653454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:35.660287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.661107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.661829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.665846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.666685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.667367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.668919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.669550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.670172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.674863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] Creating event network-changed:1c4d9918-0996-45d1-8b51-357f7d0dd04f for instance 064f249d-452f-4d91-9c2c-397ee9f49014 on n-h2-860556-1 Oct 06 13:02:35.681901 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e75a4c3d-3898-4822-8ce0-b6e05e8b3ce7 req-317ca034-5dbc-41ef-bbba-8c5e5ba3aba7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041719 Oct 06 13:02:35.683477 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1557/3141] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:35.689371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.690644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:35.701369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.702385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.703213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.704002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.704861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.705964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.738946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:35.858766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:35.875225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92e332ed-fee9-4eb1-b84f-abb3a3af20f0 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 204 len: 0 microversion: 2.1 time: 0.188954 Oct 06 13:02:35.878177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:35.880069 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1558/3142] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:35 2022] DELETE /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:35.880495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:35.886859 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60ca8b71-34e4-4a1f-8f30-cdaf1651529f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.239324 Oct 06 13:02:35.892410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a98c0eca-d964-49f6-9587-f52556c7c3c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea18280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.912315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1585/3143] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:35 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:35.919727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66436f7c-fa6c-46e0-9d04-3ac8d922ee0c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66436f7c-fa6c-46e0-9d04-3ac8d922ee0c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 HTTP/1.1 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 24 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": ""}} Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0', 'body': {'server': {'name': ''}}} Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '' Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:02:35.923566 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66436f7c-fa6c-46e0-9d04-3ac8d922ee0c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-66436f7c-fa6c-46e0-9d04-3ac8d922ee0c tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 400 len: 108 microversion: 2.1 time: 0.011591 Oct 06 13:02:35.930233 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1586/3144] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:02:35 2022] PUT /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:02:35.934731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.55"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:35.973971 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a98c0eca-d964-49f6-9587-f52556c7c3c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 200 len: 1421 microversion: 2.1 time: 0.092191 Oct 06 13:02:35.976754 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1559/3145] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:02:35 2022] GET /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:35.981946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:35.982637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:35.993009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.993009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.993558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:35.994741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:35.995320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:35.995824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:36.024607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:36.078992 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Instance is already in deleting state, ignoring this request Oct 06 13:02:36.079922 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-527ff707-4d20-4143-ae3d-88f5614a0fee tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 204 len: 0 microversion: 2.1 time: 0.102025 Oct 06 13:02:36.080795 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1560/3146] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:35 2022] DELETE /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:36.092678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:36.094642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:36.107631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:36.108914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:36.109550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:36.110594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:36.111229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:36.112795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:36.354053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:36.359883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:36.361665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:36.362370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:36.363019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:36.364035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:36.364769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:36.365355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:36.906551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:36.917101 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ea499be-9b49-49a9-9a7f-43807a31fd1a tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1505 microversion: 2.1 time: 0.834913 Oct 06 13:02:36.929943 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1561/3147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:36 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:36.929943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1deef520-0c10-4b4c-ad54-0c35cfd1a721 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e6c4f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:37.265841 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] HTTP exception thrown: Floating IP 172.25.9.55 is not associated with instance 7e89288b-1bff-437a-be5a-ab8c462c7708. Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Request method failure captured: Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action HTTP/1.1 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 48 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGmAdhWi7A0TfKCn_n1psPxM9x8Ujv7Uk4v9_kc7zOLQMQrU5LecfEUJ5khDgG08bxFK5_EXx7pSA_htZjAxjsJS46iFO3Zkgi_gE8ZGfecs1G-GyZMiWsxc2Ptp0Xk2zxS4CquOAL4QK0kr0fgBtNQ4GARJ3JbeSH-ykhpqX77M9s Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7fa2ec3b9243b58610250907ea9c73", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}] Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f28f44f509374131894128efad3281e5 Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: {"removeFloatingIp": {"address": "172.25.9.55"}} Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: exception: Floating IP 172.25.9.55 is not associated with instance 7e89288b-1bff-437a-be5a-ab8c462c7708. Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7e89288b-1bff-437a-be5a-ab8c462c7708', 'body': {'removeFloatingIp': {'address': '172.25.9.55'}}} Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.55 is not associated with instance 7e89288b-1bff-437a-be5a-ab8c462c7708. Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.55 is not associated with instance 7e89288b-1bff-437a-be5a-ab8c462c7708. Oct 06 13:02:37.267209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:37.271998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Returning 409 to user: Floating IP 172.25.9.55 is not associated with instance 7e89288b-1bff-437a-be5a-ab8c462c7708. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:37.271998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e6080e0-9ab5-41f3-892b-b1ee0e236077 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action" status: 409 len: 145 microversion: 2.1 time: 1.337764 Oct 06 13:02:37.271998 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1587/3148] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:35 2022] POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action => generated 145 bytes in 1339 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:02:37.283544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:37.284262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:37.295589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:37.323293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:37.324140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:37.325239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:37.325895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:37.326469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:37.819768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1deef520-0c10-4b4c-ad54-0c35cfd1a721 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 204 len: 0 microversion: 2.1 time: 0.900762 Oct 06 13:02:37.824017 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1562/3149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:36 2022] DELETE /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:37.828279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:37.829061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:37.837631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:37.838211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:37.838667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:37.839387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:37.839902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:37.840391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:37.863306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72051080ff9c4e9d80df2ff14b828464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3af87ea03245b6bfc4d8185d256292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:37.884639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9f8c91a-cc8c-4c0e-a50f-33967fc6ee6b tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 200 len: 1515 microversion: 2.1 time: 0.609840 Oct 06 13:02:37.885560 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1588/3150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:37 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 1515 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:37.902876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.55"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:38.046288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:38.057268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:38.058792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:38.068987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c154707-49c8-429a-8e82-18e7f7ba02d1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.246308 Oct 06 13:02:38.070703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1563/3151] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:37 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:38.078449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:38.078973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:38.096438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:38.100383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:38.102368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:38.103464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:38.104035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:38.104562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:38.151607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:38.323950 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae94e15c-5a90-4f0d-a075-125618b3f339 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 204 len: 0 microversion: 2.1 time: 0.251750 Oct 06 13:02:38.329021 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1564/3152] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:38 2022] DELETE /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:38.554066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1999900931", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a3976e54-2526-447e-9882-cadece24aa4d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:38.652993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] validate_networks() for [('a3976e54-2526-447e-9882-cadece24aa4d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:02:38.826869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:38.834355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:38.835363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:38.836115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:38.838742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:38.839508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:38.840170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:39.745131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:02:39.745887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquired lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:02:41.136927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:02:41.138055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:02:41.138933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:02:41.139584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:02:41.140364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:02:41.155309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.156264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.157017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.158095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.158956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.159775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.181041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:02:41.188091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for user d9bc79cb12634352b8fc75ea5bd40a61 and project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:02:41.204366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:02:41.207680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:02:41.221234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:41.265902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-349e468a-5064-420f-915e-e5c34e7a29b3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.716056 Oct 06 13:02:41.267189 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1565/3153] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:02:41.273319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.274347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 8a5cfd34-f02b-4b72-8714-c90899e0db59] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:41.282991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.283753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.284553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.285558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.286294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.286897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.303998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] HTTP exception thrown: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Request method failure captured: Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 HTTP/1.1 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE6wIVVxS_CAL0croVo4rtmWOJUah3Xfi84tKt4jMS3GjyHMvnE7wMNkz3uQKQoblcCzxyMu2EyjfWQIuAej4bym2-_mK-T6mxqgZlr95QzO-Ia5Ad4PaTz35BRx9uC1QLIjf5SE1Teiq0DvhSGuOuHgtuGwRu9TeHtZse7YBJsZ2k Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e3af87ea03245b6bfc4d8185d256292", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}] Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 72051080ff9c4e9d80df2ff14b828464 Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '8a5cfd34-f02b-4b72-8714-c90899e0db59'} Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.306207 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. Oct 06 13:02:41.311192 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.312450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Returning 404 to user: Instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:41.313476 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67258796-ebbf-4460-91f9-fbc956187be1 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59" status: 404 len: 111 microversion: 2.1 time: 0.044648 Oct 06 13:02:41.317487 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1566/3154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:41 2022] GET /compute/v2.1/servers/8a5cfd34-f02b-4b72-8714-c90899e0db59 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:41.322995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.324028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:41.330562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.331279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.331906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.332917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.333583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.334218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.473489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:41.485746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:41.490455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:41.500538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b91f25b0-aca5-4fe5-b9ea-3e48dfa57649 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.181723 Oct 06 13:02:41.508378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1567/3155] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:41 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:41.513200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4c1490-aa60-469a-aa91-92cc9da47d35", "name": "network-vif-unplugged", "status": "completed", "tag": "5a67bd90-fd77-4d47-9dd1-6daa353e6020"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:41.537469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.538871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.542254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.559619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] Creating event network-vif-unplugged:5a67bd90-fd77-4d47-9dd1-6daa353e6020 for instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 on n-h1-860556-1 Oct 06 13:02:41.565132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f6d0c086-a764-402a-805e-475a56aa7c77 req-47a13f23-845d-40be-a99f-678e8bd8f7ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055372 Oct 06 13:02:41.571175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1568/3156] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:41.578540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5cfd34-f02b-4b72-8714-c90899e0db59", "name": "network-vif-deleted", "tag": "9c83aee0-67a0-41ff-bb39-6965ac886955"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:41.592045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.592755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.593351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.623881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] Creating event network-vif-deleted:9c83aee0-67a0-41ff-bb39-6965ac886955 for instance 8a5cfd34-f02b-4b72-8714-c90899e0db59 on n-h1-860556-1 Oct 06 13:02:41.634216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-458d1423-b5a7-4e8b-9bc0-e6da092d2c63 req-8f68d97e-30b4-4e5e-b5eb-7d20b21e8927 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061240 Oct 06 13:02:41.636116 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1569/3157] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:41.651368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce7feb1f-ab9b-4703-ba59-9bba8219d555 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.652469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ce7feb1f-ab9b-4703-ba59-9bba8219d555 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:41.888305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ce7feb1f-ab9b-4703-ba59-9bba8219d555 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:41.895822 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce7feb1f-ab9b-4703-ba59-9bba8219d555 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1208 microversion: 2.1 time: 0.258389 Oct 06 13:02:41.909992 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1570/3158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:41 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1208 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:41.909992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.909992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:41.918897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.919775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.919895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.920532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.921014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.921423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.935846 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] HTTP exception thrown: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Request method failure captured: Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 HTTP/1.1 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE6wIVVxS_CAL0croVo4rtmWOJUah3Xfi84tKt4jMS3GjyHMvnE7wMNkz3uQKQoblcCzxyMu2EyjfWQIuAej4bym2-_mK-T6mxqgZlr95QzO-Ia5Ad4PaTz35BRx9uC1QLIjf5SE1Teiq0DvhSGuOuHgtuGwRu9TeHtZse7YBJsZ2k Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e3af87ea03245b6bfc4d8185d256292", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}] Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 72051080ff9c4e9d80df2ff14b828464 Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '53273278-4088-4090-9af4-808ffe05bb30'} Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:41.937693 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Returning 404 to user: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98a1cd5c-b822-4d9d-93b5-5431cf26fce8 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 404 len: 111 microversion: 2.1 time: 0.041664 Oct 06 13:02:41.942508 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1571/3159] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:41 2022] DELETE /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:41.948749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.949501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 53273278-4088-4090-9af4-808ffe05bb30] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:41.956923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.957667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.958328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.959314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:41.959954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:41.960500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:41.977401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] HTTP exception thrown: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Request method failure captured: Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 HTTP/1.1 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE6wIVVxS_CAL0croVo4rtmWOJUah3Xfi84tKt4jMS3GjyHMvnE7wMNkz3uQKQoblcCzxyMu2EyjfWQIuAej4bym2-_mK-T6mxqgZlr95QzO-Ia5Ad4PaTz35BRx9uC1QLIjf5SE1Teiq0DvhSGuOuHgtuGwRu9TeHtZse7YBJsZ2k Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e3af87ea03245b6bfc4d8185d256292", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}] Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 72051080ff9c4e9d80df2ff14b828464 Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '53273278-4088-4090-9af4-808ffe05bb30'} Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:41.979466 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. Oct 06 13:02:41.983557 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:41.987836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Returning 404 to user: Instance 53273278-4088-4090-9af4-808ffe05bb30 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:41.988955 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73ff272e-4141-4e43-a04d-75cc690f1833 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30" status: 404 len: 111 microversion: 2.1 time: 0.044098 Oct 06 13:02:41.990072 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1572/3160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:41 2022] GET /compute/v2.1/servers/53273278-4088-4090-9af4-808ffe05bb30 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:41.998827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:41.999651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:42.006440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.008398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.009127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:42.010238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.010977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.011734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:42.030383 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] HTTP exception thrown: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Request method failure captured: Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 HTTP/1.1 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE6wIVVxS_CAL0croVo4rtmWOJUah3Xfi84tKt4jMS3GjyHMvnE7wMNkz3uQKQoblcCzxyMu2EyjfWQIuAej4bym2-_mK-T6mxqgZlr95QzO-Ia5Ad4PaTz35BRx9uC1QLIjf5SE1Teiq0DvhSGuOuHgtuGwRu9TeHtZse7YBJsZ2k Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e3af87ea03245b6bfc4d8185d256292", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}] Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 72051080ff9c4e9d80df2ff14b828464 Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '41113534-cc14-42a5-895b-49aff31cc262'} Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:42.032372 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.037126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.041054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Returning 404 to user: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:42.042232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03707cbb-1361-42ec-8362-cdae575f28e9 tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 404 len: 111 microversion: 2.1 time: 0.047678 Oct 06 13:02:42.043439 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1573/3161] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:41 2022] DELETE /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:42.054322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:42.055427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] [instance: 41113534-cc14-42a5-895b-49aff31cc262] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:42.063108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.063958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.064703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:42.065785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.066694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.067375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:42.087250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:42.089516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] HTTP exception thrown: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Request method failure captured: Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 HTTP/1.1 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtE6wIVVxS_CAL0croVo4rtmWOJUah3Xfi84tKt4jMS3GjyHMvnE7wMNkz3uQKQoblcCzxyMu2EyjfWQIuAej4bym2-_mK-T6mxqgZlr95QzO-Ia5Ad4PaTz35BRx9uC1QLIjf5SE1Teiq0DvhSGuOuHgtuGwRu9TeHtZse7YBJsZ2k Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e3af87ea03245b6bfc4d8185d256292", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e3af87ea03245b6bfc4d8185d256292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e3af87ea03245b6bfc4d8185d256292"}]}] Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5e3af87ea03245b6bfc4d8185d256292 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-325887937 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 72051080ff9c4e9d80df2ff14b828464 Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-325887937-project Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '41113534-cc14-42a5-895b-49aff31cc262'} Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:42.091079 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] Returning 404 to user: Instance 41113534-cc14-42a5-895b-49aff31cc262 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db66bec7-0e4f-4b22-97c1-1d283c26bd6c tempest-ServerDiskConfigTestJSON-325887937 tempest-ServerDiskConfigTestJSON-325887937-project] 10.222.0.26 "GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262" status: 404 len: 111 microversion: 2.1 time: 0.044298 Oct 06 13:02:42.100273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1574/3162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:42 2022] GET /compute/v2.1/servers/41113534-cc14-42a5-895b-49aff31cc262 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:42.538998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:42.540395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:42.550915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.552867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.558738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:42.560177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:42.560834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:42.561445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.366841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:43.388494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:43.390414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:43.396706 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e69de82-0b44-4f4a-8265-859d44f34229 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.863424 Oct 06 13:02:43.397425 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1575/3163] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:42 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:43.404060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:02:43.406775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:43.407391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:43.421092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.425440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.426167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.427074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.427702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.428133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.745224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:43.761390 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eaa31ccc-9432-4dd5-a971-6c08ce1f73c3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1266 microversion: 2.1 time: 0.362601 Oct 06 13:02:43.762077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1576/3164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:43 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:43.766777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4c1490-aa60-469a-aa91-92cc9da47d35", "name": "network-vif-deleted", "tag": "5a67bd90-fd77-4d47-9dd1-6daa353e6020"}, {"name": "network-changed", "server_uuid": "064f249d-452f-4d91-9c2c-397ee9f49014", "tag": "1c4d9918-0996-45d1-8b51-357f7d0dd04f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:43.788766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.789264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.793922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.824508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Creating event network-vif-deleted:5a67bd90-fd77-4d47-9dd1-6daa353e6020 for instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 on n-h1-860556-1 Oct 06 13:02:43.825030 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] Creating event network-changed:1c4d9918-0996-45d1-8b51-357f7d0dd04f for instance 064f249d-452f-4d91-9c2c-397ee9f49014 on n-h2-860556-1 Oct 06 13:02:43.851180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e0d5cf4b-fde9-4d18-b30c-051ea5e43584 req-8d93fe80-2883-4c15-bdd6-f8ab7324cff0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.086447 Oct 06 13:02:43.862126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1577/3165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:43.867766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:43.868360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:43.885813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.886327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.886777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.887490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.888139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.888736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.922322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 HTTP/1.1 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e5e28c2e-5721-485c-bafe-4201f690bb65'} Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:43.924303 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:43.929616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:43.937317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:43.938413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5de031ed-0980-4be5-a62b-493fa1ea95d4 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 404 len: 111 microversion: 2.1 time: 0.075043 Oct 06 13:02:43.939488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1578/3166] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:43 2022] DELETE /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:43.950385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:43.957100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: e5e28c2e-5721-485c-bafe-4201f690bb65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:43.968165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.969289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.970005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:43.975719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:43.976445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:43.977118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.008107 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 HTTP/1.1 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e5e28c2e-5721-485c-bafe-4201f690bb65'} Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:44.011387 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. Oct 06 13:02:44.016300 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:02:44.018645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance e5e28c2e-5721-485c-bafe-4201f690bb65 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:44.019747 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-570c756d-de4d-4973-88e7-78fa04999307 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65" status: 404 len: 111 microversion: 2.1 time: 0.076398 Oct 06 13:02:44.020819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1579/3167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:43 2022] GET /compute/v2.1/servers/e5e28c2e-5721-485c-bafe-4201f690bb65 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:02:44.029340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:44.032925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:44.042821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.043697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.044361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.045523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.050528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.051713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.091177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:44.358531 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdd41856-5a2a-4cec-bd68-433b11da39b2 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 204 len: 0 microversion: 2.1 time: 0.332778 Oct 06 13:02:44.362729 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1580/3168] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:44 2022] DELETE /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:02:44.384003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:44.390495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:44.414733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.415252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.417450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.418229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.423753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.424349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.862134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:44.880764 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62ba8bd0-93be-4456-bbd1-525500b8c769 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.512726 Oct 06 13:02:44.900648 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1581/3169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:44 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:44.909101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:44.910930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:44.932479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.934470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.935767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:44.938644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:44.939368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:44.942961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:45.080629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:45.095912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:45.097438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:45.121025 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79e569b3-f0a3-47d4-9a7e-8105d178392b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1556 microversion: 2.91 time: 0.218919 Oct 06 13:02:45.121678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1582/3170] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:44 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1556 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:45.387129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1372408339", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:45.482984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] validate_networks() for [('995bd02c-39c5-4080-b8ab-f8c31cbdb68d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:02:45.693184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Updating instance_info_cache with network_info: [{"id": "1c4d9918-0996-45d1-8b51-357f7d0dd04f", "address": "fa:16:3e:97:01:3e", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1c4d9918-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:02:45.715057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Releasing lock "refresh_cache-064f249d-452f-4d91-9c2c-397ee9f49014" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:02:45.715967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5fa7b349-ab7c-467e-87c9-dcc1703cfa64 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014/action" status: 202 len: 0 microversion: 2.1 time: 7.829162 Oct 06 13:02:45.717343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1589/3171] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:37 2022] POST /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014/action => generated 0 bytes in 7831 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:02:45.726373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:45.727037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:45.738937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:45.750355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:45.751164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:45.752157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:45.752816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:45.753418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.135695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:46.150444 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e5f77379-0b25-46a8-b31d-b477eabc75c1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1308 microversion: 2.1 time: 0.429704 Oct 06 13:02:46.151854 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1590/3172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:45 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:46.163272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:46.165269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:46.178020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.183550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.184298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.187070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.187815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.189829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.253098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:46.274736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:46.406512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:02:46.407572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:02:46.408358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:02:46.408934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:02:46.409515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:02:46.422281 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e879708e-8239-4f90-a82e-34e8ba683460 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 204 len: 0 microversion: 2.1 time: 0.266392 Oct 06 13:02:46.427457 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1591/3173] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:46 2022] DELETE /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:46.429581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.430305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.430949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.431952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.432601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.433243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.434661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:46.435752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:46.453954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.455056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Getting quotas for project 573f6c038ba94a49bcc15340135e2ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:02:46.455244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.457462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.462203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.462699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.463246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Getting quotas for user 8729143afadd41b3baf3dc96b313a922 and project 573f6c038ba94a49bcc15340135e2ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:02:46.467045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.483700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:02:46.486555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:02:46.580818 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f79637f-dc74-49d6-83bf-1e5a65bae994 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455584 Oct 06 13:02:46.582443 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1583/3174] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:02:46.592231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:46.599002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:46.611302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.611819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.612324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.613253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.620830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.621294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.890316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:46.907921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:46.914743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:46.930359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94d1dc48-491c-4791-a8d3-7e2bfbc76503 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.346484 Oct 06 13:02:46.931431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1584/3175] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:46 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:46.946701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.55"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:46.956158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:46.969533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.972817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.976503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:46.981186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:46.982016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:46.983148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:47.084509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:02:47.090841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquired lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:02:47.313073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:47.328661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87fd2863-20e6-449e-bd26-8464a2909903 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.903837 Oct 06 13:02:47.333530 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1592/3176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:46 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:47.386498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-702a8ae6-beb0-4e57-b43e-3d19f3c4803c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:47.387859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-702a8ae6-beb0-4e57-b43e-3d19f3c4803c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:47.939304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-702a8ae6-beb0-4e57-b43e-3d19f3c4803c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:47.946825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-702a8ae6-beb0-4e57-b43e-3d19f3c4803c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1224 microversion: 2.1 time: 0.611862 Oct 06 13:02:47.967885 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1593/3177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:47 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1224 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:47.973795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:47.998145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:48.005972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:48.006478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:48.007474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:48.008191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:48.021024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:48.021496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:49.528057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:49.546878 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d073e6d-60d7-4c3a-a45d-6d1e688b7672 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1308 microversion: 2.1 time: 1.577748 Oct 06 13:02:49.547479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1594/3178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:47 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1308 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:49.569764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:49.570374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:49.577906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:49.578403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:49.578844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:49.579557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:49.580029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:49.580456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:50.436584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:50.445549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:50.447143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:50.484139 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62e4cb2e-35b3-4941-9957-530f587501ca tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.919322 Oct 06 13:02:50.501088 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1595/3179] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:49 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:50.520338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:50.521251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:50.535112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:50.535759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:50.536060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:50.536807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:50.537276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:50.538527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:51.409159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ecfef9e7a450c93fdad2519facf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fe61d37f9a4066b32989b00440841a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:51.429028 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc9318fc-10af-402e-b5ed-dd45526408e7 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 200 len: 1511 microversion: 2.1 time: 0.920838 Oct 06 13:02:51.430555 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1596/3180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:50 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 1511 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:51.435773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:51.436683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:51.444189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:51.444941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:51.446355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:51.447378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:51.448017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:51.448672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:52.441512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:52.462793 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-022210ff-4d5d-4100-a20a-a7e90748177e tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 1.026178 Oct 06 13:02:52.465307 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1597/3181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:51 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:52.492297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f", "tag": "4e0937c0-6bef-4946-8c2b-a8689c8d95da"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:52.540280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:52.540774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:52.541226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:52.605518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] Creating event network-changed:4e0937c0-6bef-4946-8c2b-a8689c8d95da for instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f on n-h2-860556-1 Oct 06 13:02:52.614962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-02b3450d-8f96-43a2-9454-8ba2f16cadfb req-e6fb1e18-ca57-4e53-a902-9ab66f398287 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147892 Oct 06 13:02:52.616580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1598/3182] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:52.622772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:52.628878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:52.643731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:52.644341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:52.646028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:52.646915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:52.649785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:52.650698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:53.092074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:53.114197 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-095e9003-fee2-4af6-8919-b4de8da76069 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1308 microversion: 2.1 time: 0.493368 Oct 06 13:02:53.118645 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1599/3183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:52 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:53.130874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-unplugged", "status": "completed", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:53.151250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:53.152663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:53.153396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:53.201985 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] Creating event network-vif-unplugged:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h1-860556-1 Oct 06 13:02:53.215477 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e9eaa3d2-2e28-42a9-94c5-b6f70db685d4 req-552c52a1-8c6b-44ee-be86-94a6d6fbeea6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094146 Oct 06 13:02:53.226032 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1600/3184] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:53.244029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:53.247905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:53.262483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:53.264788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:53.266331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:53.269170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:53.269685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:53.273655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:53.358247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Building network info cache for instance {{(pid=129614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:02:53.456783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:53.471312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:53.478486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:53.491134 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a7ef92a6-0700-462b-86ab-aad8379f2098 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.259987 Oct 06 13:02:53.515541 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1601/3185] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:53 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:53.536352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69deb394-39d0-4415-9693-ce716eb374b0", "name": "network-vif-deleted", "tag": "4e896f4b-30cc-4f54-ace9-aa7519853e28"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:53.557104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:53.557626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:53.561219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:53.592236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] Creating event network-vif-deleted:4e896f4b-30cc-4f54-ace9-aa7519853e28 for instance 69deb394-39d0-4415-9693-ce716eb374b0 on n-h1-860556-1 Oct 06 13:02:53.608041 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-af504a1c-c6d9-4c55-bffd-408f34563afa req-3689d13e-bd82-402b-95bc-3d132c0faa3b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088411 Oct 06 13:02:53.612428 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1602/3186] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:53.755253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41df1bb9-7065-4b39-8958-3f60ad06db55 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d4771d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-240347131", "description": "tempest-description-1496085664"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:54.502319 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41df1bb9-7065-4b39-8958-3f60ad06db55 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.887694 Oct 06 13:02:54.503660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1603/3187] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:02:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:54.517778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:54.518971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] [instance: 69deb394-39d0-4415-9693-ce716eb374b0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:54.550357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:54.550860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:54.551295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:54.552006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:54.552465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:54.552892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:54.578290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] HTTP exception thrown: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Request method failure captured: Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 HTTP/1.1 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtDen-mUmvHgNGPzGVAq72wE_uPwemQXBPS3m_3LdxvaEOwiX2tv-n_L9VsqeGl8QzWNYnSmWRrZ_y1X6csMXeT4jfZ0G_4NLqEm3V6fzuIBO63Vi4Bo4DBixZDIKMce5KTgshn3DrjfjiVc6cXNSfqh1wi6h0pCd7uHIVqsNByZviM Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_01fe61d37f9a4066b32989b00440841a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/01fe61d37f9a4066b32989b00440841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/01fe61d37f9a4066b32989b00440841a"}]}] Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 01fe61d37f9a4066b32989b00440841a Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-465380891 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 342ecfef9e7a450c93fdad2519facf31 Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-465380891-project Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '69deb394-39d0-4415-9693-ce716eb374b0'} Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:54.589776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. Oct 06 13:02:54.595294 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:54.599207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] Returning 404 to user: Instance 69deb394-39d0-4415-9693-ce716eb374b0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:54.600930 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e1b16fe-26d6-4847-8508-6cea8c3b5e66 tempest-ServersNegativeTestJSON-465380891 tempest-ServersNegativeTestJSON-465380891-project] 10.222.0.26 "GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0" status: 404 len: 111 microversion: 2.1 time: 0.094526 Oct 06 13:02:54.610552 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1604/3188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:54 2022] GET /compute/v2.1/servers/69deb394-39d0-4415-9693-ce716eb374b0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:02:54.616072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:54.622785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:54.632657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:54.635251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:54.637558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:54.638713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:54.646542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:54.647655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:55.429862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:55.442078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-924200ca-bfb1-431a-81f2-41fae4471c22 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 0.827358 Oct 06 13:02:55.443663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1605/3189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:54 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:55.454007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:55.459320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:55.472051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:55.476510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:55.477266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:55.479834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:55.485044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:55.485885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:55.609952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:02:55.879918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-734789dd-2061-4413-8d94-339485a493f3 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 204 len: 0 microversion: 2.1 time: 0.433462 Oct 06 13:02:55.880539 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1606/3190] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:02:55 2022] DELETE /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:02:55.889030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:55.894093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:55.909226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:55.912220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:55.913721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:55.914739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:55.916284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:55.918645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:56.278003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:56.290651 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-74242419-9f36-4c94-871a-35a6d5ccfa4f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1308 microversion: 2.1 time: 0.408657 Oct 06 13:02:56.296514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1607/3191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:55 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:56.307384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-03d47c45-5771-470d-b084-ed64e80ee2fb tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3ecf6f70>, body: {"security_group_rule": {"parent_group_id": "3803a2cd-79f8-46c0-a805-aeef2ca80b77", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:56.442998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:56.478122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:56.605853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Updating instance_info_cache with network_info: [{"id": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34", "address": "fa:16:3e:03:0d:12", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf15e258e-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:02:56.642547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Releasing lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:02:56.644316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-404d0c58-84cc-47ee-9d9a-77dea39fd9c1 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action" status: 202 len: 0 microversion: 2.1 time: 9.711789 Oct 06 13:02:56.647386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1585/3192] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:02:46 2022] POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action => generated 0 bytes in 9714 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:02:56.653117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:56.655792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:56.666033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:56.666952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:56.667511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:56.668365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:56.668946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:56.669450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:56.846451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:56.880837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:56.882976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:56.907055 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97ec6c72-f28c-4cef-957e-7026d26c2dfb tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.258310 Oct 06 13:02:56.932967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1586/3193] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:56 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:56.943895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d3f72c-30da-43fe-901a-5ee80cd7ddee", "tag": "82b1f9fc-8af5-453d-8cb1-44dcb4b36709"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:56.958727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:56.971009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:56.971581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:56.992757 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] Creating event network-changed:82b1f9fc-8af5-453d-8cb1-44dcb4b36709 for instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee on n-h1-860556-1 Oct 06 13:02:57.018294 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f70bac37-7fe4-404d-9d48-38cfa2936272 req-57e9d5d4-cbb1-4253-912f-cdc8924e1e0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083635 Oct 06 13:02:57.020145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1587/3194] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:57.037376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:57.039141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:57.046166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-03d47c45-5771-470d-b084-ed64e80ee2fb tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.743077 Oct 06 13:02:57.046802 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1608/3195] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:57.055930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064f249d-452f-4d91-9c2c-397ee9f49014", "name": "network-vif-deleted", "tag": "1c4d9918-0996-45d1-8b51-357f7d0dd04f"}, {"name": "network-changed", "server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:57.058167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:57.061957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:57.062588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:57.063507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:57.065728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:57.066374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:57.074897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:57.076157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:57.076623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:57.097484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Creating event network-vif-deleted:1c4d9918-0996-45d1-8b51-357f7d0dd04f for instance 064f249d-452f-4d91-9c2c-397ee9f49014 on n-h2-860556-1 Oct 06 13:02:57.098053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] Creating event network-changed:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:02:57.116500 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-09c21d95-7adc-4dc1-8b4d-567885086c90 req-8663eb71-4266-4bec-a8c1-bfd240c851a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066211 Oct 06 13:02:57.123635 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1609/3196] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:57.159008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:57.159768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:57.185720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:57.186262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:57.186722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:57.187457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:57.187910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:57.195630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:57.737696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:57.752606 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-46288316-dc19-49d1-90c4-2d7c5eb04b65 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1664 microversion: 2.1 time: 0.727549 Oct 06 13:02:57.756229 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1588/3197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:57 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1664 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:57.773456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44bbc8c8-5c94-414e-a51b-84ef383f6deb tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '.version_select at 0x7f7d3ea52430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:57.802261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:57.816092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c41d0933-a209-47eb-bdb1-1888260e9c1c tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 0.677258 Oct 06 13:02:57.830142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1610/3198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:57 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:57.835158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c239cf3-8f3b-46ed-9e40-2273e72f597a tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3ecf6790>, body: {"security_group_rule": {"parent_group_id": "3803a2cd-79f8-46c0-a805-aeef2ca80b77", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:02:57.946757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:58.038258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6c239cf3-8f3b-46ed-9e40-2273e72f597a tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c239cf3-8f3b-46ed-9e40-2273e72f597a tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 138 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: {"security_group_rule": {"parent_group_id": "3803a2cd-79f8-46c0-a805-aeef2ca80b77", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: exception: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3803a2cd-79f8-46c0-a805-aeef2ca80b77', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:02:58.040502 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:02:58.044610 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:02:58.044610 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:02:58.044610 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 Oct 06 13:02:58.044610 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:02:58.047378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c239cf3-8f3b-46ed-9e40-2273e72f597a tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: This rule already exists in group 3803a2cd-79f8-46c0-a805-aeef2ca80b77 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:02:58.048991 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c239cf3-8f3b-46ed-9e40-2273e72f597a tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.217750 Oct 06 13:02:58.049858 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1611/3199] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:02:57 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:02:58.056314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:58.057469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:58.070553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:58.072819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:58.075644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:58.076943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:58.078474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:58.083093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:58.104208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:02:58.834297 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44bbc8c8-5c94-414e-a51b-84ef383f6deb tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/0a316adc-f4bb-4f0b-a719-6c333a17e30d" status: 200 len: 183 microversion: 2.1 time: 1.075870 Oct 06 13:02:58.836634 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1589/3200] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 13:02:57 2022] GET /compute/v2.1/os-floating-ips/0a316adc-f4bb-4f0b-a719-6c333a17e30d => generated 183 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:02:58.862991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:58.863961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:58.885551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:58.886935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:58.889211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:58.892149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:58.893381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:58.899505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:59.558442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:59.580784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:59.582630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:59.591175 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09a10dcb-3888-498b-aa82-695170090263 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.751790 Oct 06 13:02:59.592506 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1590/3201] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:02:58 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:02:59.598779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88b69826-3090-47a8-b685-37ce82874c72 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3ea5a5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:59.681891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:02:59.697671 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c6c87c3-c654-498d-bc9f-638f8b622ba7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1308 microversion: 2.1 time: 1.645797 Oct 06 13:02:59.709364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1612/3202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:58 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1308 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:02:59.727698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:02:59.727698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:02:59.739678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:59.740191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:59.740692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:02:59.742088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:02:59.742594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:02:59.743175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:00.489210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6007f23e7443d68385fd3b5f9c0d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2570fcfed5384a709d390737306e0d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:00.502642 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3fc793ec-71b0-43d3-8439-8ce8af44408e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 200 len: 1664 microversion: 2.1 time: 0.793350 Oct 06 13:03:00.531474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1613/3203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:02:59 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 1664 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:00.541452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:00.542594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:00.570616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:00.571425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:00.575033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:00.576856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:00.580641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:00.583071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:00.602428 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88b69826-3090-47a8-b685-37ce82874c72 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/df4d8ca9-e863-4833-bf3e-f41f2e5b80c7" status: 202 len: 0 microversion: 2.1 time: 1.008407 Oct 06 13:03:00.603488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1591/3204] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Oct 6 13:02:59 2022] DELETE /compute/v2.1/os-security-group-rules/df4d8ca9-e863-4833-bf3e-f41f2e5b80c7 => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:00.612896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.55"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:01.088706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:01.110133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab9c4ffd-61cb-4da8-87a7-05928474b7cb tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 0.581723 Oct 06 13:03:01.129091 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1614/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:00 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:01.140799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f", "name": "network-vif-plugged", "status": "completed", "tag": "4e0937c0-6bef-4946-8c2b-a8689c8d95da"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:01.168888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:01.170219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:01.171495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:01.217862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] Creating event network-vif-plugged:4e0937c0-6bef-4946-8c2b-a8689c8d95da for instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f on n-h2-860556-1 Oct 06 13:03:01.226977 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e4c2c1dd-0c84-48d2-9e87-ae65de02b0d3 req-7a4f991d-febb-49e3-b093-6ee16e49f84f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090600 Oct 06 13:03:01.228591 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1615/3206] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:01.319443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:01.334142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:01.337886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:01.342687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:01.343711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:01.345729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:01.346456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:01.571780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1550047824", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:01.725523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:03:01.731659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:03:01.733842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:03:01.736846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:03:01.737318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:03:01.805573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:01.808962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:01.813564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:01.815325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:01.820268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:01.820727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:01.909059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Getting quotas for project c7c4020f330546739e4005aae3ab102d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:03:01.920225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Getting quotas for user 66e8ea28d84e4ea9a91a4fe19e34534c and project c7c4020f330546739e4005aae3ab102d. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:03:01.972041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:03:01.989297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:03:02.117719 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62cbd3c8-4f04-4138-9eb4-7edca05d6d1e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.884073 Oct 06 13:03:02.121699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1616/3207] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:03:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:03:02.130511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-317bc3f4-d006-4efc-8d6b-f3102d840f9e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f9fbaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-129212097", "description": "tempest-description-22198406"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:02.195746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:03:02.196805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquired lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:03:03.452262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-317bc3f4-d006-4efc-8d6b-f3102d840f9e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.329171 Oct 06 13:03:03.453460 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1617/3208] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:03:02 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:03.458549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:03.459373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:03.475558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:03.476068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:03.476596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:03.477325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:03.477680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:03.478214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:03.966580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:03.979786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:03.981568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:03.994654 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95f4d12c-4f2d-4d58-bf27-1af3977788ed tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.539750 Oct 06 13:03:03.998318 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1618/3209] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:03 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:04.008531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:04.009380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:04.026671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.028146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.028912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.033916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.034753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.035399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.530284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Building network info cache for instance {{(pid=129614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:03:04.547057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:04.570638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc9a7f86-4255-4fc5-9eeb-076969a74b77 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1488 microversion: 2.1 time: 0.570998 Oct 06 13:03:04.578107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1619/3210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:03 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1488 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:04.586038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:04.594689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] [instance: 7bb8a2fc-537d-452d-895d-0e341f9082d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:04.606936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.619753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.620571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.621512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.622175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.622790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.672418 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] HTTP exception thrown: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Request method failure captured: Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 HTTP/1.1 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGnz99TTWb2QPR5ojcojOvU_HMHeizGSZWWDcsCsRyUbl3xTs4HMvmIWPaK36-90VUur4_jhnkXtVhlnIGbTqXFOQGCklyN2lBFn79JBBUJPTRkJR7VS4AJ81wSQxFbcTlkKdEeEcqqZKOIHo5wP9FaJ5RTau76Ik8ov9eIv4B5TRs Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2570fcfed5384a709d390737306e0d3c Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestFqdnHostnames-1936325790 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2570fcfed5384a709d390737306e0d3c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2570fcfed5384a709d390737306e0d3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2570fcfed5384a709d390737306e0d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2570fcfed5384a709d390737306e0d3c"}]}] Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestFqdnHostnames-1936325790 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2570fcfed5384a709d390737306e0d3c Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1936325790 Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestFqdnHostnames-1936325790-project Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8a6007f23e7443d68385fd3b5f9c0d4c Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestFqdnHostnames-1936325790-project Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7bb8a2fc-537d-452d-895d-0e341f9082d1'} Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:04.674195 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Returning 404 to user: Instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3aa59887-d652-43b5-82ba-e6ac67a1086e tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1" status: 404 len: 111 microversion: 2.1 time: 0.096169 Oct 06 13:03:04.680008 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1620/3211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:04 2022] GET /compute/v2.1/servers/7bb8a2fc-537d-452d-895d-0e341f9082d1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:04.699425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:04.700041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:04.721488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.722016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.722459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.723184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.723642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.724076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.854339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:04.865171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:04.872506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:04.880648 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0cc0e257-5a32-44fb-b1bb-3068a9cdd743 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1339 microversion: 2.47 time: 0.185234 Oct 06 13:03:04.884035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1621/3212] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:04 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:04.894139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:04.898509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:04.907513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.911250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.912501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:04.914912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:04.916334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:04.917434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.293103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:05.308120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b963c95-47ed-49e2-8491-aa9502bdea17 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 0.422786 Oct 06 13:03:05.312061 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1622/3213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:04 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:05.319293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb8a2fc-537d-452d-895d-0e341f9082d1", "name": "network-vif-deleted", "tag": "647989af-2207-4cb6-a08b-5f3d0fece9c3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:05.341191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.345386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.351156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.382343 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] Creating event network-vif-deleted:647989af-2207-4cb6-a08b-5f3d0fece9c3 for instance 7bb8a2fc-537d-452d-895d-0e341f9082d1 on n-h1-860556-1 Oct 06 13:03:05.392961 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0921afa0-3372-495b-863c-b6ea2de6c537 req-0a563254-433b-45e0-9694-cb2bf5e622ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079441 Oct 06 13:03:05.398463 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1623/3214] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:05.410672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dcddf92-ed31-4f88-8142-171d00d70c1e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f242ee0>, body: {"security_group_rule": {"parent_group_id": "b4d0aa23-6525-46ca-b956-ec87164f6f5e", "ip_protocol": "tcp", "from_port": 345016310, "to_port": 22}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:05.540397 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2dcddf92-ed31-4f88-8142-171d00d70c1e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Invalid port range 345016310:22. Former value cannot be greater than the later Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dcddf92-ed31-4f88-8142-171d00d70c1e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 145 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: {"security_group_rule": {"parent_group_id": "b4d0aa23-6525-46ca-b956-ec87164f6f5e", "ip_protocol": "tcp", "from_port": 345016310, "to_port": 22}} Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid port range 345016310:22. Former value cannot be greater than the later Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b4d0aa23-6525-46ca-b956-ec87164f6f5e', 'ip_protocol': 'tcp', 'from_port': 345016310, 'to_port': 22}}} Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 345016310:22. Former value cannot be greater than the later Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 345016310:22. Former value cannot be greater than the later Oct 06 13:03:05.542454 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 345016310:22. Former value cannot be greater than the later Oct 06 13:03:05.547691 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.549167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dcddf92-ed31-4f88-8142-171d00d70c1e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: Invalid port range 345016310:22. Former value cannot be greater than the later {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:05.550242 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2dcddf92-ed31-4f88-8142-171d00d70c1e tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.149785 Oct 06 13:03:05.550989 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1624/3215] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:05 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:05.560612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d3f72c-30da-43fe-901a-5ee80cd7ddee", "name": "network-vif-plugged", "status": "completed", "tag": "82b1f9fc-8af5-453d-8cb1-44dcb4b36709"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:05.579932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:05.593943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.594431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.594865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.639434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Updating instance_info_cache with network_info: [{"id": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34", "address": "fa:16:3e:03:0d:12", "network": {"id": "2afa6420-716f-474d-b2c7-a93ecf6eda53", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1598072024-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ab7fa2ec3b9243b58610250907ea9c73", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf15e258e-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:03:05.643115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] Creating event network-vif-plugged:82b1f9fc-8af5-453d-8cb1-44dcb4b36709 for instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee on n-h1-860556-1 Oct 06 13:03:05.650564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6467f265-b6a6-427c-b928-9e75c1d34791 req-d6224452-6a44-442f-a217-81d99f238a95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093228 Oct 06 13:03:05.651950 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1625/3216] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:05.660431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:05.667418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Releasing lock "refresh_cache-7e89288b-1bff-437a-be5a-ab8c462c7708" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:03:05.668453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.668796 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fdfb6d8e-8322-4861-82c4-bce549816323 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action" status: 202 len: 0 microversion: 2.1 time: 5.064061 Oct 06 13:03:05.669876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.670473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1592/3217] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:03:00 2022] POST /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708/action => generated 0 bytes in 5066 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:03:05.674115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.687086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37a0373a-cf87-4c4d-805b-ebd0b5ff16e5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] Calling method '.version_select at 0x7f7d3eae2a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:05.765493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37a0373a-cf87-4c4d-805b-ebd0b5ff16e5 tempest-ServersTestFqdnHostnames-1936325790 tempest-ServersTestFqdnHostnames-1936325790-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265486591" status: 202 len: 0 microversion: 2.1 time: 0.093685 Oct 06 13:03:05.766126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1593/3218] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265486591 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:05.771183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:05.771804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:05.790335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.790817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.793458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.794998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.795518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.795970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.815765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:03:05.837911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:05.919441 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-faccbadc-741a-4be5-8478-8131bab43631 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f/action" status: 202 len: 0 microversion: 2.1 time: 0.265365 Oct 06 13:03:05.920413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1626/3219] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:03:05 2022] POST /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:05.931996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d6825b8-be36-4628-ad27-9b3ce9932c38 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f1fc0d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330934484", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:05.936670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0d6825b8-be36-4628-ad27-9b3ce9932c38 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Security group id should be uuid Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d6825b8-be36-4628-ad27-9b3ce9932c38 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 131 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330934484", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group id should be uuid Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1330934484', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:05.938501 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:05.944545 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 06 13:03:05.944545 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:05.946093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d6825b8-be36-4628-ad27-9b3ce9932c38 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: Security group id should be uuid {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:05.950665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d6825b8-be36-4628-ad27-9b3ce9932c38 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028889 Oct 06 13:03:05.951628 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1627/3220] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:05 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:03:05.964602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:05.965509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:05.974669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.975205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.975648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.976540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:05.977002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:05.977433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:05.986594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.004277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.005729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.010834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] HTTP exception thrown: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Request method failure captured: Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 HTTP/1.1 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGmAdhWi7A0TfKCn_n1psPxM9x8Ujv7Uk4v9_kc7zOLQMQrU5LecfEUJ5khDgG08bxFK5_EXx7pSA_htZjAxjsJS46iFO3Zkgi_gE8ZGfecs1G-GyZMiWsxc2Ptp0Xk2zxS4CquOAL4QK0kr0fgBtNQ4GARJ3JbeSH-ykhpqX77M9s Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7fa2ec3b9243b58610250907ea9c73", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}] Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f28f44f509374131894128efad3281e5 Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '064f249d-452f-4d91-9c2c-397ee9f49014'} Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:06.012449 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.017137 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.018717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Returning 404 to user: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:06.019773 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1026c51c-f1f2-4839-ac5c-370d2459815f tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 404 len: 111 microversion: 2.1 time: 0.066974 Oct 06 13:03:06.020833 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1628/3221] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:03:05 2022] DELETE /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:06.025405 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ef7d937-77b2-404a-b95c-e499855cf09c tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.253701 Oct 06 13:03:06.029277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:06.030182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:06.036044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1594/3222] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:05 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:06.040276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.044590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.045265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.046087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.046309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:06.046679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.047183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.047615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:06.054098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.054883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.055531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.056628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.057281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.059261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.189332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.199747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.211162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.214094 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84148547-2f81-432c-a7ef-34108979aa07 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1339 microversion: 2.47 time: 0.191922 Oct 06 13:03:06.216008 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1629/3223] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:06 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:06.266482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-db8e432b-c8c1-4739-b76e-6505999477b3 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f126a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-904709063", "description": "tempest-description-1105007410"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:06.368098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:06.377337 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0543b27-85ad-4927-9119-d5b3c252ffd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.339906 Oct 06 13:03:06.388074 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1595/3224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:06 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:06.406261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:06.412294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 064f249d-452f-4d91-9c2c-397ee9f49014] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:06.427403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.428681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.430253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.433474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.434160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.434781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.505975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] HTTP exception thrown: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Request method failure captured: Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 HTTP/1.1 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGmAdhWi7A0TfKCn_n1psPxM9x8Ujv7Uk4v9_kc7zOLQMQrU5LecfEUJ5khDgG08bxFK5_EXx7pSA_htZjAxjsJS46iFO3Zkgi_gE8ZGfecs1G-GyZMiWsxc2Ptp0Xk2zxS4CquOAL4QK0kr0fgBtNQ4GARJ3JbeSH-ykhpqX77M9s Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7fa2ec3b9243b58610250907ea9c73", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}] Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f28f44f509374131894128efad3281e5 Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '064f249d-452f-4d91-9c2c-397ee9f49014'} Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.514943 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. Oct 06 13:03:06.519586 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:06.529004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Returning 404 to user: Instance 064f249d-452f-4d91-9c2c-397ee9f49014 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:06.532616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d0749df-4a1b-479b-b291-e9c0f546a06c tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014" status: 404 len: 111 microversion: 2.1 time: 0.141503 Oct 06 13:03:06.536137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1596/3225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:06 2022] GET /compute/v2.1/servers/064f249d-452f-4d91-9c2c-397ee9f49014 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:06.556381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:06.561253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:06.575386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:06.577506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.581012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.581659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.582545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:06.584136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:06.585895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:06.711312 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-db8e432b-c8c1-4739-b76e-6505999477b3 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.478847 Oct 06 13:03:06.720682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1630/3226] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:03:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:06.727325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddc7075d-a307-4083-9f68-7fe58ef58cd9 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '.version_select at 0x7f7d3f00fe50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:07.273662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:07.292921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-449534f4-e619-4d76-a823-48340a4798c0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1324 microversion: 2.1 time: 0.752423 Oct 06 13:03:07.295011 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1597/3227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:06 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:07.336825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df357d8e-0a94-4415-94fc-2f2132cd6e69 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3e736670>, body: {"security_group_rule": {"parent_group_id": "2b3ed668-509b-478d-a182-8950c2f7deef", "ip_protocol": "tempest-999-1504479532", "from_port": 22, "to_port": 22}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:07.477166 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-df357d8e-0a94-4415-94fc-2f2132cd6e69 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Invalid IP protocol tempest-999-1504479532. Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df357d8e-0a94-4415-94fc-2f2132cd6e69 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 157 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: {"security_group_rule": {"parent_group_id": "2b3ed668-509b-478d-a182-8950c2f7deef", "ip_protocol": "tempest-999-1504479532", "from_port": 22, "to_port": 22}} Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid IP protocol tempest-999-1504479532. Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b3ed668-509b-478d-a182-8950c2f7deef', 'ip_protocol': 'tempest-999-1504479532', 'from_port': 22, 'to_port': 22}}} Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1504479532. Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1504479532. Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:07.479897 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1504479532. Oct 06 13:03:07.483967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:07.488676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df357d8e-0a94-4415-94fc-2f2132cd6e69 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: Invalid IP protocol tempest-999-1504479532. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:07.490474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df357d8e-0a94-4415-94fc-2f2132cd6e69 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.193151 Oct 06 13:03:07.492044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1598/3228] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:07 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:03:07.501546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:07.503202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:07.511435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:07.512283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:07.514182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:07.515438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:07.516349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:07.517119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:07.708388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:07.757567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:07.766200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:07.784098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a25e1ccb-38d3-41df-97b0-1b08ab2d35f2 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.288782 Oct 06 13:03:07.803488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1599/3229] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:07 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:07.826915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:07.828865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:07.846972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:07.848920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:07.852740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:07.853879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:07.854497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:07.855133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:08.206290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:08.235643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:08.240172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:08.242667 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c80fb377-f0ac-4b8c-bb9d-a0b023dcc870 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1339 microversion: 2.47 time: 0.437851 Oct 06 13:03:08.248134 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1600/3230] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:07 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1339 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:08.257518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:08.262309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:08.283472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:08.285041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:08.285773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:08.287649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:08.289978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:08.290674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:08.386563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddc7075d-a307-4083-9f68-7fe58ef58cd9 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/0a316adc-f4bb-4f0b-a719-6c333a17e30d" status: 202 len: 0 microversion: 2.1 time: 1.664431 Oct 06 13:03:08.392199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1631/3231] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:03:06 2022] DELETE /compute/v2.1/os-floating-ips/0a316adc-f4bb-4f0b-a719-6c333a17e30d => generated 0 bytes in 1666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:08.393066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:08.448783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:08.451393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:08.452093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:08.484595 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] Creating event network-changed:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:03:08.495164 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ad015af8-12dc-49a4-9d7c-f7a6af956641 req-e6ac73dc-a609-4161-be12-cb0aadc39e5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105742 Oct 06 13:03:08.499104 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1632/3232] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:08.514957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d5aa4f9-0dbf-44b8-b56e-62e022329ba7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f00f940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1703215349", "description": "tempest-description-1901555513"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:08.763426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:08.783818 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-686392c7-4a8b-4567-ac78-132396f4aa1f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.527876 Oct 06 13:03:08.801260 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1601/3233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:08 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:08.810004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:08.810639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:08.833198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:08.833717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:08.834198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:08.840015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:08.840513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:08.840973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.311160 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d5aa4f9-0dbf-44b8-b56e-62e022329ba7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.808505 Oct 06 13:03:09.311777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1633/3234] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:03:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:09.326214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:09.330629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:09.341025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.341816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.342814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.346387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.347066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.347667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.396501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:03:09.543115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-782f4195-2e80-4e1a-8a80-d892c14fa752 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 204 len: 0 microversion: 2.1 time: 0.220083 Oct 06 13:03:09.544249 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1634/3235] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:03:09 2022] DELETE /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:03:09.550878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:09.551810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:09.559997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.560754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.561367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.562903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.563547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.564306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.704753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:09.721506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a61d0aa-c8f7-49c4-8ad8-9c91da1aeb19 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1520 microversion: 2.1 time: 0.934129 Oct 06 13:03:09.722180 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1602/3236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:08 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1520 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:09.733939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:09.738515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:09.746252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:09.766868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.767714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.768523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.769430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:09.770625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:09.771381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:09.782416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:09.788537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:09.811222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c29883ef-4738-45ef-9671-7c714a33c6d8 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.265388 Oct 06 13:03:09.851035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1635/3237] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:09 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:09.856863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4c638bf-e4d0-4021-8a62-41bda32622a7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f01d550>, body: {"security_group_rule": {"parent_group_id": "3dfa8c79-2303-4567-bac4-9404f6678871", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:09.993707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:10.018939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:10.024135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:10.027743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3298616-dadb-41f1-bcce-9fb24e9f55f0 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1360 microversion: 2.47 time: 0.300499 Oct 06 13:03:10.028349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1603/3238] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:09 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1360 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:10.034633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:10.035259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:10.043110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.044956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.045421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.046805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.047276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.047713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.098962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e4c638bf-e4d0-4021-8a62-41bda32622a7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4c638bf-e4d0-4021-8a62-41bda32622a7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 138 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: {"security_group_rule": {"parent_group_id": "3dfa8c79-2303-4567-bac4-9404f6678871", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3dfa8c79-2303-4567-bac4-9404f6678871', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 06 13:03:10.100692 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4c638bf-e4d0-4021-8a62-41bda32622a7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4c638bf-e4d0-4021-8a62-41bda32622a7 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.249748 Oct 06 13:03:10.104704 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1636/3239] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:09 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:10.112240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:10.112865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:10.131081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.132194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.132636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.133512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.134094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.134528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.465826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:10.476053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce09e76b-b086-4bc4-9541-7240082a7f05 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1526 microversion: 2.1 time: 0.445728 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1604/3240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:10 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1526 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c22c227c-4a38-45fb-b22a-7b91a3655a62 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1321441007", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c22c227c-4a38-45fb-b22a-7b91a3655a62 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 243 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1321441007", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1321441007', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '995bd02c-39c5-4080-b8ab-f8c31cbdb68d'}]}}} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 06 13:03:10.494454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c22c227c-4a38-45fb-b22a-7b91a3655a62 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c22c227c-4a38-45fb-b22a-7b91a3655a62 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.009393 Oct 06 13:03:10.504617 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1605/3241] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:03:10 2022] POST /compute/v2.1/servers => generated 175 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:10.516420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1890114829"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:10.523443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:10.544952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:10.545767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.546377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.546975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.547869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.548430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.549282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:10.551758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:10.560029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c055c5a-dfed-4542-902d-f22f6efa6761 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.451452 Oct 06 13:03:10.560959 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1637/3242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:10 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:10.570548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-437b6100-540e-4db6-aa03-2660b4f4d3cf tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f018310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-579912962", "description": "tempest-description-1376210239"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:10.948670 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8a6d032-a764-45c0-8cbe-7d302aca380e tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "POST /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715/action" status: 202 len: 52 microversion: 2.47 time: 0.454993 Oct 06 13:03:10.955584 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1606/3243] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:03:10 2022] POST /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715/action => generated 52 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 06 13:03:10.962816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:10.963710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 909c3d9b-1bc2-4d77-b71d-bfedca5572f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:10.971137 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] HTTP exception thrown: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/909c3d9b-1bc2-4d77-b71d-bfedca5572f3/metadata HTTP/1.1 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '909c3d9b-1bc2-4d77-b71d-bfedca5572f3'} Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:10.975572 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:10.979648 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:10.979648 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:10.979648 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. Oct 06 13:03:10.979648 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:10.981697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 404 to user: Instance 909c3d9b-1bc2-4d77-b71d-bfedca5572f3 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:10.982813 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64bd0945-5f91-419c-91ba-696a9086987d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/909c3d9b-1bc2-4d77-b71d-bfedca5572f3/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024467 Oct 06 13:03:10.983907 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1607/3244] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:03:10 2022] GET /compute/v2.1/servers/909c3d9b-1bc2-4d77-b71d-bfedca5572f3/metadata => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:10.988598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:10.989478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:10.998045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:10.998981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:10.999690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.000675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.001373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.002178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.101279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.114338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.116630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.123138 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c50e66e-2ac5-4d61-ac79-eb87a21f118f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1551 microversion: 2.91 time: 0.138036 Oct 06 13:03:11.138441 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1608/3245] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:10 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:11.151566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:11.152611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:11.160354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.161304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.161949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.163844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.164513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.165366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.213336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:03:11.425946 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed582682-b5dd-4fec-94cd-d88dab4c9e76 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 204 len: 0 microversion: 2.47 time: 0.278294 Oct 06 13:03:11.429212 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1609/3246] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:03:11 2022] DELETE /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:03:11.455348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b20508d1-87e7-4fb2-ab4a-5e2e7c0e3f66 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-563534569", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b20508d1-87e7-4fb2-ab4a-5e2e7c0e3f66 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 498 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-563534569", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-563534569', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '995bd02c-39c5-4080-b8ab-f8c31cbdb68d'}]}}} Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 13:03:11.460770 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b20508d1-87e7-4fb2-ab4a-5e2e7c0e3f66 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:11.464525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b20508d1-87e7-4fb2-ab4a-5e2e7c0e3f66 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017426 Oct 06 13:03:11.471870 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1610/3247] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:03:11 2022] POST /compute/v2.1/servers => generated 687 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:11.479797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:11.485491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:11.495722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.496477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.497142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.498179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.498841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.499441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.518718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-437b6100-540e-4db6-aa03-2660b4f4d3cf tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.956598 Oct 06 13:03:11.528700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1638/3248] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:03:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:11.528700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:11.528700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:11.549630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.550246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.550661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.556515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:11.560438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:11.570438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:11.762702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.776633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.787937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:11.793688 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-681360cc-1a0a-4020-b867-d86951242387 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1366 microversion: 2.47 time: 0.317250 Oct 06 13:03:11.804425 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1611/3249] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:11 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:11.819342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d757e40c-331c-4306-ae5e-b039634d86c1 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d475bc430>, body: {"security_group_rule": {"parent_group_id": "e638390e-c490-4ead-bfdf-dd8377677bb4", "ip_protocol": "tcp", "from_port": 22, "to_port": 550513922}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:11.875656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:11.954120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:12.499128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d757e40c-331c-4306-ae5e-b039634d86c1 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d757e40c-331c-4306-ae5e-b039634d86c1 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 145 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: {"security_group_rule": {"parent_group_id": "e638390e-c490-4ead-bfdf-dd8377677bb4", "ip_protocol": "tcp", "from_port": 22, "to_port": 550513922}} Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e638390e-c490-4ead-bfdf-dd8377677bb4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 550513922}}} Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 Oct 06 13:03:12.500691 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d757e40c-331c-4306-ae5e-b039634d86c1 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 400 to user: Invalid port range 22:550513922. Valid TCP ports should be between 1-65535 {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d757e40c-331c-4306-ae5e-b039634d86c1 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.696271 Oct 06 13:03:12.504936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1612/3250] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:11 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 697 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:12.507968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79a22f16-dc63-4421-8564-802c990357d0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1906144931", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:12.508795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79a22f16-dc63-4421-8564-802c990357d0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 500 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1906144931", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1906144931', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '995bd02c-39c5-4080-b8ab-f8c31cbdb68d'}]}}} Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 13:03:12.512084 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79a22f16-dc63-4421-8564-802c990357d0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:12.515274 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79a22f16-dc63-4421-8564-802c990357d0 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009880 Oct 06 13:03:12.526245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1613/3251] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:03:12 2022] POST /compute/v2.1/servers => generated 689 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:12.532574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:12.533101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:12.547438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f613a3f0-fcd9-41fb-b2ea-a90e29742494 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1526 microversion: 2.1 time: 1.023926 Oct 06 13:03:12.566587 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1639/3252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:11 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1526 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:12.567250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:12.567250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:12.567250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:12.567250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:12.567250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:12.574537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:12.575725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:12.577869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:12.613625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:12.614528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:12.614663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:12.615357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:12.616399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:12.616840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:12.795590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:12.832914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:12.836521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:12.847615 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0bdcb2f-d2b3-4f07-9e8f-90f765fc4db0 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.291412 Oct 06 13:03:12.859029 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1640/3253] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:12 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:12.877165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e89288b-1bff-437a-be5a-ab8c462c7708", "name": "network-vif-deleted", "tag": "f15e258e-8c70-48ef-b8a9-b2fd57a76b34"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:12.890656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:12.891341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:12.892001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:12.908430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] Creating event network-vif-deleted:f15e258e-8c70-48ef-b8a9-b2fd57a76b34 for instance 7e89288b-1bff-437a-be5a-ab8c462c7708 on n-h2-860556-1 Oct 06 13:03:12.916881 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ec4222f4-5f76-49bc-9c58-1b4706ed9f6f req-2688361c-acb7-47ff-8312-aa7bae2e2f6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056270 Oct 06 13:03:12.917789 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1641/3254] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:12.924579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Action: 'create', calling method: .version_select at 0x7f7d3f1fc160>, body: {"security_group_rule": {"parent_group_id": "47ee4fc0-0214-4285-ab5a-7102c638abce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:12.981905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:03:12.984650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.security_group_api [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Neutron security group 47ee4fc0-0214-4285-ab5a-7102c638abce not found {{(pid=129615) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:03:12.985564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.985564 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 138 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: {"security_group_rule": {"parent_group_id": "47ee4fc0-0214-4285-ab5a-7102c638abce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: exception: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'security_group_rule': {'parent_group_id': '47ee4fc0-0214-4285-ab5a-7102c638abce', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:03:12.988461 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] Oct 06 13:03:12.993576 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:12.997980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 404 to user: Security group 47ee4fc0-0214-4285-ab5a-7102c638abce does not exist Oct 06 13:03:12.997980 n-d-860556-1 devstack@n-api.service[129615]: Neutron server returns request_ids: ['req-60bb71a0-fcc1-49e6-ba4c-fd5b35701dd7'] {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:12.999205 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e3ab0022-c4a8-45a9-b59b-7ccbbfb07344 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.079902 Oct 06 13:03:12.999966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1642/3255] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Oct 6 13:03:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:13.007892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4004473c-92a9-4ad4-8202-dc7a5ba09c45 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1388170586", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4004473c-92a9-4ad4-8202-dc7a5ba09c45 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 754 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1388170586", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1388170586', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '995bd02c-39c5-4080-b8ab-f8c31cbdb68d'}]}}} Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:03:13.013516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:03:13.016591 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:03:13.019594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.019594 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.020876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4004473c-92a9-4ad4-8202-dc7a5ba09c45 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:13.022743 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4004473c-92a9-4ad4-8202-dc7a5ba09c45 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020817 Oct 06 13:03:13.023604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1643/3256] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:03:13 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 06 13:03:13.041069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.042449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:13.050668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.051495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.052177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.053198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.054338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.054774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.145446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:13.149708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:13.154723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3d73d9f-ab86-4eb5-a372-77a7ad2052fd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.625933 Oct 06 13:03:13.166537 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1614/3257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:12 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:13.171582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3ea1be50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.203543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:13.210829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:03:13.211701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Neutron security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 not found {{(pid=129614) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 06 13:03:13.212892 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] HTTP exception thrown: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.212892 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.215582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Request method failure captured: Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-group-rules/a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 HTTP/1.1 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH8tmZxSDthvx6GMpoUPhRToAvHCsdBpxRxL1-mr9dLGvWFAatjAoXLrGx7T7U87jHSmUg44TzNs3JcRQImiIE8gp2fA3cEOYnZRBA4NcUHm9z-oHX5_jnwNoUAsNac6yAoBVLDE2VUSmMVBpvQUxxvvAxUE19WVbn9Vr_6TQZy3E8 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15889a8a0ba64729bd5e30eb05543e03", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15889a8a0ba64729bd5e30eb05543e03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15889a8a0ba64729bd5e30eb05543e03"}]}] Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 15889a8a0ba64729bd5e30eb05543e03 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 69ffce08db7a4ba6a406a05b370a84cc Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a7f8b356-f5b0-450f-8df6-6c43a5fb90a7'} Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:03:13.216718 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] Oct 06 13:03:13.220591 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.227740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:13.227740 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de051d9b-b9a5-4ed3-ad36-70f7ddefd67b tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1366 microversion: 2.47 time: 0.191350 Oct 06 13:03:13.227740 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1644/3258] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:13 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:13.229659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Returning 404 to user: Security group rule a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 does not exist Oct 06 13:03:13.229659 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-84e89409-dca7-497b-b498-ba89b2442744'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:13.230932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e36846b-5148-406b-95c5-38a7443fda91 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/a7f8b356-f5b0-450f-8df6-6c43a5fb90a7" status: 404 len: 199 microversion: 2.1 time: 0.063210 Oct 06 13:03:13.231723 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1615/3259] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Oct 6 13:03:13 2022] DELETE /compute/v2.1/os-security-group-rules/a7f8b356-f5b0-450f-8df6-6c43a5fb90a7 => generated 199 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:13.243381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a844dc32-159d-4f23-8d5f-4f788f86da70 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3eaf73a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.249829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14f623a3-fb79-41d0-81e4-720baf944e94 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1138011949", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14f623a3-fb79-41d0-81e4-720baf944e94 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 1266 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1138011949", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "995bd02c-39c5-4080-b8ab-f8c31cbdb68d"}]}} Oct 06 13:03:13.260192 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1138011949', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '995bd02c-39c5-4080-b8ab-f8c31cbdb68d'}]}}} Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.262436 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:03:13.263530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:03:13.265262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 06 13:03:13.265262 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.265262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14f623a3-fb79-41d0-81e4-720baf944e94 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:13.265262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14f623a3-fb79-41d0-81e4-720baf944e94 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025491 Oct 06 13:03:13.269489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1645/3260] 10.222.0.26 () {60 vars in 1148 bytes} [Thu Oct 6 13:03:13 2022] POST /compute/v2.1/servers => generated 2221 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 06 13:03:13.275031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.275748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 6c00b56d-9776-4140-8cfe-e07a701e0cd6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:13.282799 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] HTTP exception thrown: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/6c00b56d-9776-4140-8cfe-e07a701e0cd6/metadata/test2 HTTP/1.1 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': '6c00b56d-9776-4140-8cfe-e07a701e0cd6', 'id': 'test2'} Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:13.284789 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:13.289604 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:13.289604 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:13.289604 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. Oct 06 13:03:13.289604 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:13.290644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 404 to user: Instance 6c00b56d-9776-4140-8cfe-e07a701e0cd6 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:13.291680 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-693272c8-ec0a-415d-8edc-15e98eb70b37 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/6c00b56d-9776-4140-8cfe-e07a701e0cd6/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.020993 Oct 06 13:03:13.300924 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1646/3261] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 13:03:13 2022] GET /compute/v2.1/servers/6c00b56d-9776-4140-8cfe-e07a701e0cd6/metadata/test2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:13.308108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.308816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:13.315981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.316488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.316969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.317895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.318366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.319341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.349925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:03:13.474744 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-35578de6-818b-4f94-be6b-851b3b9f9ed2 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 204 len: 0 microversion: 2.1 time: 0.170628 Oct 06 13:03:13.476561 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1647/3262] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:03:13 2022] DELETE /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:03:13.487020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.487973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:13.496166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.496823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.497366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.500413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.501316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.501918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.762661 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a844dc32-159d-4f23-8d5f-4f788f86da70 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e638390e-c490-4ead-bfdf-dd8377677bb4" status: 202 len: 0 microversion: 2.1 time: 0.524483 Oct 06 13:03:13.766779 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1616/3263] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:03:13 2022] DELETE /compute/v2.1/os-security-groups/e638390e-c490-4ead-bfdf-dd8377677bb4 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:13.772997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.774079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:13.782407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.783690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.799446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.803435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.823911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.827116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.863228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:13.882368 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b63c9e21-25ca-4156-874f-0faf0784b277 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1526 microversion: 2.1 time: 0.400723 Oct 06 13:03:13.885583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1648/3264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:13 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1526 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:13.902449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7de47300-9dcd-4589-93e1-62b0f0a04940 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3ef583a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:13.923840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:13.927238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:13.929095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:13.930142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lazy-loading 'fault' on Instance uuid 7e89288b-1bff-437a-be5a-ab8c462c7708 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:03:14.087845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28f44f509374131894128efad3281e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7fa2ec3b9243b58610250907ea9c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:14.117680 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32bc62ef-2adc-4d9b-b8a6-5bd9b1087997 tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 200 len: 1314 microversion: 2.1 time: 0.349666 Oct 06 13:03:14.134784 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1617/3265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:13 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:14.148818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:14.159926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:14.179128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.184219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.186000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.187011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.190763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.191591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.359207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:14.369305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:14.373889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:14.391459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31f4aa80-713b-44aa-bd6b-ad4d4edf6f23 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1533 microversion: 2.91 time: 0.255196 Oct 06 13:03:14.406283 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1618/3266] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:14 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1533 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:14.418598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:14.419471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:14.426516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.427202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.427640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.429002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.429363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.429864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.775030 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7de47300-9dcd-4589-93e1-62b0f0a04940 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3dfa8c79-2303-4567-bac4-9404f6678871" status: 202 len: 0 microversion: 2.1 time: 0.886679 Oct 06 13:03:14.775897 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1649/3267] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:03:13 2022] DELETE /compute/v2.1/os-security-groups/3dfa8c79-2303-4567-bac4-9404f6678871 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:14.781675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:14.782324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:14.790165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.790926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.791534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.792430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:14.793105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:14.796167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:14.810296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:14.822648 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.415123 Oct 06 13:03:14.843422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1619/3268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:14 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:14.845903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:14.847650 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd997d1d-4c61-4e67-ba48-f9f3ef77f65b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001696 Oct 06 13:03:14.852778 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1620/3269] 10.222.0.26 () {56 vars in 886 bytes} [Thu Oct 6 13:03:14 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 06 13:03:14.862315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cacdb136-22b7-4efe-bd98-1c672f7284d8 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3f76fca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:14.985057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.000854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.003012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e8ea28d84e4ea9a91a4fe19e34534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c4020f330546739e4005aae3ab102d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.004510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42897127-8cc9-42b2-ad0c-f24b9b4878fe tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 200 len: 1366 microversion: 2.47 time: 0.227315 Oct 06 13:03:15.006000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1650/3270] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:14 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:15.011857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:15.012874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:15.020190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.021118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.021915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.022900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.023603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.024330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.491792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.500979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a134c2bb-0d3d-4e7e-8acd-040f86876b5a tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1526 microversion: 2.1 time: 0.493071 Oct 06 13:03:15.512538 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1651/3271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:15 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1526 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:15.531161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:15.531854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] [instance: 7e89288b-1bff-437a-be5a-ab8c462c7708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:15.538912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.539489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.540096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.540810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.541352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.542097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.557348 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] HTTP exception thrown: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Request method failure captured: Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 HTTP/1.1 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGmAdhWi7A0TfKCn_n1psPxM9x8Ujv7Uk4v9_kc7zOLQMQrU5LecfEUJ5khDgG08bxFK5_EXx7pSA_htZjAxjsJS46iFO3Zkgi_gE8ZGfecs1G-GyZMiWsxc2Ptp0Xk2zxS4CquOAL4QK0kr0fgBtNQ4GARJ3JbeSH-ykhpqX77M9s Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7fa2ec3b9243b58610250907ea9c73", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7fa2ec3b9243b58610250907ea9c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7fa2ec3b9243b58610250907ea9c73"}]}] Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: ab7fa2ec3b9243b58610250907ea9c73 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1360246158 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f28f44f509374131894128efad3281e5 Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1360246158-project Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7e89288b-1bff-437a-be5a-ab8c462c7708'} Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:15.561837 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] Returning 404 to user: Instance 7e89288b-1bff-437a-be5a-ab8c462c7708 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:15.566212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c1784d8-7f08-45c2-8ce9-0762a7a0952b tempest-FloatingIPsAssociationTestJSON-1360246158 tempest-FloatingIPsAssociationTestJSON-1360246158-project] 10.222.0.26 "GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708" status: 404 len: 111 microversion: 2.1 time: 0.042743 Oct 06 13:03:15.567410 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1652/3272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:15 2022] GET /compute/v2.1/servers/7e89288b-1bff-437a-be5a-ab8c462c7708 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:15.573388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:15.574039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:15.581376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.581661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.582085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.582804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.583431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.583879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.722323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.733918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.738704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:15.749637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5a46faf-fb6d-4ddc-acac-5862402cf2cc tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1536 microversion: 2.91 time: 0.181109 Oct 06 13:03:15.761762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1653/3273] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:15 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1536 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:15.778803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:15.781425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:15.792171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.792787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.793478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.794409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:15.794974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:15.795502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:15.853407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860556-1". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 13:03:16.007314 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b763d94-2b9a-4f3a-a12b-d9524bd22bd6 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action" status: 202 len: 0 microversion: 2.91 time: 0.231744 Oct 06 13:03:16.009100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1654/3274] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:03:15 2022] POST /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:03:16.018385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:16.023522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:16.032258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:16.032781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:16.034231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:16.034980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:16.035445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:16.035880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:16.608424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cacdb136-22b7-4efe-bd98-1c672f7284d8 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2b3ed668-509b-478d-a182-8950c2f7deef" status: 202 len: 0 microversion: 2.1 time: 1.754296 Oct 06 13:03:16.609908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1621/3275] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:03:14 2022] DELETE /compute/v2.1/os-security-groups/2b3ed668-509b-478d-a182-8950c2f7deef => generated 0 bytes in 1756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:16.622806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:16.623665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:16.659730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:16.660259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:16.660686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:16.661415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:16.661895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:16.662383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:17.013777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:17.031442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:17.034350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:17.041710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee3582ae-7290-42f5-905e-ce6b0d31f8f3 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1484 microversion: 2.91 time: 0.430601 Oct 06 13:03:17.042997 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1622/3276] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:16 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1484 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:17.065474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:17.070973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] [instance: 4bc54a99-e58b-4b73-b631-fe4f47178715] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:17.091335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:17.091833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:17.093793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:17.096787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:17.097320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:17.098244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:17.126828 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] HTTP exception thrown: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Request method failure captured: Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 HTTP/1.1 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtIDKcnROETV7ESYws86deTqzVImn7Kt2doXREdR8kqX_B5EfQmrXWgxnIS9KpQ6Ycxn3XALl--ssh-BugJ8DaYoSsTfufhIaCgcx976EuMrczIsE2OHwXlEO1aIetpPOjBXLTVFRV2KPKBJEMLZmk4weplPTABVbn8GPO2LEEDcfbQ Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.47 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c7c4020f330546739e4005aae3ab102d Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAaction247Test-1295202850 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c7c4020f330546739e4005aae3ab102d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7c4020f330546739e4005aae3ab102d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c7c4020f330546739e4005aae3ab102d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7c4020f330546739e4005aae3ab102d"}]}] Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAaction247Test-1295202850 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c7c4020f330546739e4005aae3ab102d Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAaction247Test-1295202850 Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAaction247Test-1295202850-project Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 66e8ea28d84e4ea9a91a4fe19e34534c Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAaction247Test-1295202850-project Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4bc54a99-e58b-4b73-b631-fe4f47178715'} Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:17.130005 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. Oct 06 13:03:17.138369 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:17.149553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:17.159177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] Returning 404 to user: Instance 4bc54a99-e58b-4b73-b631-fe4f47178715 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:17.161540 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b2fa814-f561-4161-914f-52745a1eb795 tempest-ServersAaction247Test-1295202850 tempest-ServersAaction247Test-1295202850-project] 10.222.0.26 "GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715" status: 404 len: 111 microversion: 2.47 time: 0.116001 Oct 06 13:03:17.163301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99bd26ff-b5a9-49a4-9195-6cb8f826b767 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 1.151556 Oct 06 13:03:17.166563 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1623/3277] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:17 2022] GET /compute/v2.1/servers/4bc54a99-e58b-4b73-b631-fe4f47178715 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:17.173579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:17.175735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:17.184221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:17.184938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:17.185396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1655/3278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:16 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:17.186009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:17.187199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:17.187815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:17.188432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:17.213371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a03d3ae-dc70-4d0a-aaf1-492ba8743948 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d3f693820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:17.679098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:17.701366 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c28096c-c779-4f85-ac5a-a51f5fbfdb7d tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1526 microversion: 2.1 time: 0.532613 Oct 06 13:03:17.703767 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1624/3279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:17 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1526 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:18.077829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:18.079325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:18.091771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:18.092629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:18.094005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:18.094956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:18.096092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:18.097378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:18.473402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:18.486236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:18.488513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:18.495626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9183da2f-fe13-4ff4-a43b-1853f3b6ad54 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.423630 Oct 06 13:03:18.510462 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1625/3280] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:18 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:18.525772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:18.526867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:18.536362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:18.538412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:18.539117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:18.540255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:18.541049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:18.541726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:19.001149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a03d3ae-dc70-4d0a-aaf1-492ba8743948 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b4d0aa23-6525-46ca-b956-ec87164f6f5e" status: 202 len: 0 microversion: 2.1 time: 1.811449 Oct 06 13:03:19.005175 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1656/3281] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:03:17 2022] DELETE /compute/v2.1/os-security-groups/b4d0aa23-6525-46ca-b956-ec87164f6f5e => generated 0 bytes in 1817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:19.013015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:19.013649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:19.024030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:19.024540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:19.025702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:19.026551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:19.027010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:19.027862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:19.324649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8729143afadd41b3baf3dc96b313a922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f6c038ba94a49bcc15340135e2ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:19.358264 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-805a4103-eb4f-4ae2-a8fc-d2fb9caf5526 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 200 len: 1484 microversion: 2.1 time: 0.350515 Oct 06 13:03:19.370068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1657/3282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:19 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 1484 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:19.375408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-197da4b6-6794-48a3-8a8f-c2bf0cb501d2 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] Calling method '.version_select at 0x7f7d475bf550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:19.604006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:19.616580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f29168d6-c05f-428d-949f-a2658371a7eb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 1.100517 Oct 06 13:03:19.617896 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1626/3283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:18 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:19.626294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:19.639223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:19.655266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:19.655772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:19.656826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:19.663486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:19.664068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:19.665760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:20.282703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:20.295746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:20.305659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:20.326482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14161b91-09cf-4624-b4aa-b59abbae759b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.705900 Oct 06 13:03:20.327117 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1627/3284] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:19 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:20.570897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-235673110", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:20.743066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:03:20.743760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:03:20.744497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:03:20.745431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:03:20.747632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:03:20.760865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:20.762155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:20.763109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:20.764304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:20.765409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:20.766227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:20.794069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Getting quotas for project 9d08289d34c44c789486b4a860e493d8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:03:20.801967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Getting quotas for user 8abd80b390864bf0b525929d804def4d and project 9d08289d34c44c789486b4a860e493d8. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:03:20.824072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:03:20.827436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:03:20.894729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8db7eedb-8177-4e1a-ae7f-d83153cd0786 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.565187 Oct 06 13:03:20.904770 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1628/3285] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:03:20.910837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d3f72c-30da-43fe-901a-5ee80cd7ddee", "name": "network-vif-deleted", "tag": "82b1f9fc-8af5-453d-8cb1-44dcb4b36709"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:20.926821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:20.927904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:20.929253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:20.948631 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] Creating event network-vif-deleted:82b1f9fc-8af5-453d-8cb1-44dcb4b36709 for instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee on n-h1-860556-1 Oct 06 13:03:20.954375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3e5143fa-fdd0-4f9f-bf2b-99aff19d3d50 req-c1bfd788-2116-46d2-8736-f4da72fcfb2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047513 Oct 06 13:03:20.955301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1629/3286] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:20.964150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:20.965480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] [instance: 75d3f72c-30da-43fe-901a-5ee80cd7ddee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:20.977879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:20.978954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:20.979706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:20.981664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:20.982389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:20.983102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:21.008375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] HTTP exception thrown: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Request method failure captured: Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee HTTP/1.1 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtH0XYDRxXFum8mmDhrKqaAn6GVrTM8o-kIKpiDTKWdzudE9hsdeEsWEisdjrALc6scv-lmWJcNv6RrDnYSsb71QazQvgiYUYiCiHlAoCkiSqXyqQL50zbfKyyiDc30gY8-tDMtaeGK9cIzWjICrk_ArSbKqs6dL_-Stdu-glTtNFp0 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_573f6c038ba94a49bcc15340135e2ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/573f6c038ba94a49bcc15340135e2ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/573f6c038ba94a49bcc15340135e2ad4"}]}] Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 573f6c038ba94a49bcc15340135e2ad4 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2097535047 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8729143afadd41b3baf3dc96b313a922 Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2097535047-project Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '75d3f72c-30da-43fe-901a-5ee80cd7ddee'} Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:21.010841 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. Oct 06 13:03:21.022427 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:21.034310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] Returning 404 to user: Instance 75d3f72c-30da-43fe-901a-5ee80cd7ddee could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:21.035557 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-586fe9f9-d266-4512-88a5-8d7bb76f0977 tempest-ServerMetadataNegativeTestJSON-2097535047 tempest-ServerMetadataNegativeTestJSON-2097535047-project] 10.222.0.26 "GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee" status: 404 len: 111 microversion: 2.1 time: 0.077664 Oct 06 13:03:21.040138 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1630/3287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:20 2022] GET /compute/v2.1/servers/75d3f72c-30da-43fe-901a-5ee80cd7ddee => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:21.056462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:21.057681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:21.070479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:21.071392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:21.072383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:21.073356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:21.074037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:21.074931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:21.950790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:21.961528 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79f9f398-6f70-4eae-9c02-bf77d52985d2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.924294 Oct 06 13:03:21.982054 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1631/3288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:21 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:21.993681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:21.994635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:22.003420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-197da4b6-6794-48a3-8a8f-c2bf0cb501d2 tempest-SecurityGroupRulesNegativeTestJSON-1220340203 tempest-SecurityGroupRulesNegativeTestJSON-1220340203-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3803a2cd-79f8-46c0-a805-aeef2ca80b77" status: 202 len: 0 microversion: 2.1 time: 2.639172 Oct 06 13:03:22.004663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1658/3289] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:03:19 2022] DELETE /compute/v2.1/os-security-groups/3803a2cd-79f8-46c0-a805-aeef2ca80b77 => generated 0 bytes in 2643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:03:22.013880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:22.016519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:22.053902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:22.057948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:22.059829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:22.062429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:22.063295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:22.064076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:22.117367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.140603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.148160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.159880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db441ad2-7dc9-4f2f-bce3-6965918cdfba tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1277 microversion: 2.54 time: 0.176470 Oct 06 13:03:22.181147 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1632/3290] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:21 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:22.233755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.243587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.250630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:22.262127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f4c601e-7055-425b-90fd-abb97dcf73bd tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.256011 Oct 06 13:03:22.267125 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1659/3291] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:22 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:22.994315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:22.995603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:23.016955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:23.018245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:23.020272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:23.022860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:23.027592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:23.028985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:23.199544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:23.210405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:23.227795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:23.228905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:23.229664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:23.230907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:23.231785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:23.232488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:24.092800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.098780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:24.132194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.135986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.149140 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1abf384d-a1a2-4673-b43f-a2133c6dbdf6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1337 microversion: 2.54 time: 0.953463 Oct 06 13:03:24.156703 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1660/3292] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:23 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1337 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:24.176120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:24.184925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:24.212862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:24.213506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:24.213814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:24.214852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:24.215589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:24.217830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:24.243272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.258530 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41abc5b1-df27-4cf9-a7cc-4b40c8ab7a42 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 1.272927 Oct 06 13:03:24.285974 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1633/3293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:22 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:24.582444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.632337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.640060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:24.663868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd884cb9-65a2-412b-917f-39e53dd7539a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.505480 Oct 06 13:03:24.664485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1661/3294] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:24 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:25.186139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:25.187544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:25.205575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.209561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.211162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:25.217039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.217678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.222537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:25.284848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:25.285731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:25.301624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.302614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.303359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:25.306646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.309989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.310803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:25.567070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:25.587052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:25.588615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:25.590560 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdca48a1-bba2-4ffa-abc7-3a9a4631a77a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1335 microversion: 2.54 time: 0.408588 Oct 06 13:03:25.591549 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1634/3295] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:25 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1335 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:25.708845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:25.709803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:25.735387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.744448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.745208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:25.746182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:25.749476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:25.750191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:26.191974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:26.216313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea4be370-7e91-4344-994a-ab5ecd013bf2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.936300 Oct 06 13:03:26.220280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1662/3296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:25 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:26.277712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:26.292803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:26.294368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:26.304007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba9a7fc5-d742-4ee1-8195-5058b5c8793e tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.603752 Oct 06 13:03:26.306206 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1635/3297] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:25 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:26.628195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:26.629053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:26.641879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:26.643183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:26.643826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:26.644910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:26.645689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:26.646326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:26.988355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:27.002796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:27.009146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:27.011795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-875f1281-c104-4fab-9797-23005907c013 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1356 microversion: 2.54 time: 0.389650 Oct 06 13:03:27.018598 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1663/3298] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:26 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1356 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:27.072313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4289986d-67b5-416d-b7d5-f8da914b8c24 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Action: 'create', calling method: .version_select at 0x7f7d3eae2550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-354487664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBtpgrWyhAF84kljQ5klXp/3oqsdwZO7ic2xTr4Ofo/3VnPX5KSwa/Ugf5GLo9cRptwLTmzIX8ArxwN8gYu5vrgGgCMm95ogefvKstxgAt6N5/Ix/g5TZUwtDLxtcSmbA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:27.111091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:27.135126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4289986d-67b5-416d-b7d5-f8da914b8c24 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Getting quotas for project 9d08289d34c44c789486b4a860e493d8. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:03:27.156672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4289986d-67b5-416d-b7d5-f8da914b8c24 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Getting quotas for user 8abd80b390864bf0b525929d804def4d and project 9d08289d34c44c789486b4a860e493d8. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:03:27.247584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:27.249857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:27.259231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4289986d-67b5-416d-b7d5-f8da914b8c24 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.192054 Oct 06 13:03:27.260498 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1636/3299] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 13:03:27 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 13:03:27.265865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.266714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.267368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.268293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.269071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.269682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.289528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-354487664", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:27.299134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:27.308731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.309580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.310357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.311773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.312500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.313261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.468540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:03:27.473325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:03:27.476437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:03:27.477214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:03:27.478461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:03:27.703746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:27.726002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.727387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.729035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.731586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.732172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.739885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.772801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:27.812516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6f2b280-c049-4dc8-9eb3-7ed26480dd2f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "POST /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00/action" status: 202 len: 1138 microversion: 2.54 time: 0.533732 Oct 06 13:03:27.813281 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1637/3300] 10.222.0.26 () {62 vars in 1320 bytes} [Thu Oct 6 13:03:27 2022] POST /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00/action => generated 1138 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 06 13:03:27.830531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:27.831190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:27.840633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.841155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.841588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:27.842682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:27.843153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:27.843589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:29.069603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.081329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.088597 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-29328200-126a-436d-af78-649bf6895a51 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 1.846718 Oct 06 13:03:29.107571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1664/3301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:27 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:29.113020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.117439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.129380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:29.131486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:29.140806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c247245e-ed9e-4e18-8478-b09395c52c27 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 1.318741 Oct 06 13:03:29.141445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1638/3302] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:27 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:29.154535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:29.157252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:29.158898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:29.169501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:29.170266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:29.171485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:29.498544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.531451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.539844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:29.544819 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae9055ff-860a-4efe-b38e-6d727b4c646f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.435266 Oct 06 13:03:29.549538 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1665/3303] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:29 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:30.118920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:30.119930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:30.137544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.151041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.152817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.156145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.157458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.162962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.172991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:30.173612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:30.190819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.193989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.196638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.197491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.199564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.200024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.613320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.648109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.653876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.667621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0fbb539b-95d5-40b9-9e31-ada999de584b tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.498947 Oct 06 13:03:30.673909 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1666/3304] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:30 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:30.697900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:30.699217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:30.727210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.727849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.728437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.729231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:30.729708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:30.730407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:30.784411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:30.939161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.955599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.964253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:30.972630 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d565f53-e7ec-4fc3-9b4e-891d121a86b4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.293413 Oct 06 13:03:30.973285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1667/3305] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:30 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:31.006871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:31.020514 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b1c2376-8697-4bb6-9e19-210bd3bc6c81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.902569 Oct 06 13:03:31.024348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1639/3306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:30 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:31.703842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:31.708038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:31.731148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:31.732827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:31.733346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:31.736648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:31.739607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:31.741950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:32.004522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:32.005194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:32.018165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:32.020668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:32.022938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:32.027621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:32.028448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:32.030975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:32.033349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.053686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.063411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.078387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f1fb12b-8a4d-4f6d-b140-09f8a5677862 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.380521 Oct 06 13:03:32.087411 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1668/3307] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:31 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:32.103363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:32.104157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:32.119430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:32.121536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:32.126168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:32.128082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:32.128590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:32.129042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:32.303443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.314032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.317562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.319865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45efeb51-1263-4657-bd3f-3f9f55efc262 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.319191 Oct 06 13:03:32.345776 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1640/3308] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:31 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:32.614382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:32.629765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2327b2a-1257-43db-97ff-6972179b361a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1498 microversion: 2.1 time: 0.539673 Oct 06 13:03:32.649068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1669/3309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:32 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1498 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:33.114302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:33.115065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:33.152792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.153305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.153847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.154541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.155015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.155455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.353524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:33.354173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:33.392883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.393421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.397217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.398324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.400824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.401489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.516150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.527858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.530522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.543502 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-189e6229-a8f4-4eaa-a3ed-1fb744d3a019 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.433666 Oct 06 13:03:33.544698 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1641/3310] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:33 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:33.616421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.640367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.642162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:33.648970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f46d646c-f176-4e41-a34c-15303967d208 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.297182 Oct 06 13:03:33.659704 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1670/3311] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:33 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:33.678210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:33.679095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:33.696970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.698114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.698764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.699862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:33.700501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:33.702523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:33.830064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51fe5866-4125-4ae9-9cf3-ee1d9261ddf8 tempest-ExtensionsTest-239001561 tempest-ExtensionsTest-239001561-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:33.832078 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51fe5866-4125-4ae9-9cf3-ee1d9261ddf8 tempest-ExtensionsTest-239001561 tempest-ExtensionsTest-239001561-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.286279 Oct 06 13:03:33.833878 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1642/3312] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 13:03:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:33.843395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89b136d3-7be3-4f37-8878-b660db6409a2 tempest-ExtensionsTest-239001561 tempest-ExtensionsTest-239001561-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:33.857516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89b136d3-7be3-4f37-8878-b660db6409a2 tempest-ExtensionsTest-239001561 tempest-ExtensionsTest-239001561-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018593 Oct 06 13:03:33.863360 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1643/3313] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Oct 6 13:03:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:03:34.482136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:34.489925 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1671be8b-b910-497a-a20e-682eefb34c63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 200 len: 1475 microversion: 2.1 time: 0.818007 Oct 06 13:03:34.506473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1671/3314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:33 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 1475 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:34.528424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1535078105"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:34.535561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:34.548303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.550021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.551666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:34.554779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.555686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.556304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:34.580669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:34.582856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:34.591568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:34.616848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.617592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.618294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:34.619480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.621372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.623267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:34.845933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:34.873290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:34.883506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:34.909860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5013f65-27d7-4fbf-892a-905c6352440f tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.338912 Oct 06 13:03:34.910741 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1672/3315] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:34 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:34.917753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:34.918530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:34.943852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.947309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.948848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:34.950704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:34.952876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:34.956941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:35.077677 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea647080-8d3e-4248-ae90-6cb160ad44e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f/action" status: 202 len: 0 microversion: 2.1 time: 0.565700 Oct 06 13:03:35.085926 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1644/3316] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:03:34 2022] POST /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 13:03:35.093458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43e9a5ac-e6d0-4091-a40a-7f325af62a9d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea173a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:35.127140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:35.148714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:35.153181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:35.163782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-950c5103-17a1-4555-bc01-234c89d45bea tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.251173 Oct 06 13:03:35.176700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1673/3317] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:34 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:35.196715 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43e9a5ac-e6d0-4091-a40a-7f325af62a9d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.109375 Oct 06 13:03:35.203906 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1645/3318] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:35 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:35.938063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:35.938682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:35.951054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:35.952408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:35.954058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:35.957312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:35.958082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:35.958795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:36.196986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:36.198327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:36.213838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:36.216586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:36.218570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:36.219559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:36.230547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:36.231367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:36.338990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.347375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.348849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.364379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca37d66c-fb6a-4b30-9c9c-137830ff222a tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.430189 Oct 06 13:03:36.365527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1674/3319] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:35 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:36.378551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71d8552b-c93e-4755-b84d-80446e300c72 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ef67280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:36.404608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.417354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.423921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:36.425242 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-de5c4d83-a777-4065-9b35-33f2f00ce0d2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.234958 Oct 06 13:03:36.425986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1646/3320] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:36 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:36.460330 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71d8552b-c93e-4755-b84d-80446e300c72 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.085493 Oct 06 13:03:36.461008 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1675/3321] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:36 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:37.393329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:37.394044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:37.409482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:37.411393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:37.412422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:37.412884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:37.413607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:37.426391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:37.426901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:37.453562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:37.454108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:37.467867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:37.467867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:37.467867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:37.467867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:37.468253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:37.489797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:37.699026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.699568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.715178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.719343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.722590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.722798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fce66d0c-4081-4b84-bbe4-ab48811f4c0e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.273981 Oct 06 13:03:37.728043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:37.738610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1676/3322] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:37 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:37.752545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79393c2f-bbf2-404b-9f4c-af477183aa95 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ed7a040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:37.786653 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3eeb20c3-f67a-4cfa-9491-bea6a2f55810 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.396998 Oct 06 13:03:37.798217 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1647/3323] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:37 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:37.871480 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79393c2f-bbf2-404b-9f4c-af477183aa95 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.131450 Oct 06 13:03:37.872005 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1677/3324] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:37 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:38.760744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:38.761640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:38.785221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:38.788416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:38.789304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:38.792671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:38.795125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:38.798503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:38.817720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:38.819051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:38.855314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:38.856467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:38.858650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:38.859982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:38.860454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:38.860885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:39.202467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.215416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.220472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.228520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.232685 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48e97e53-e4c3-417d-82f0-d6183d25fbd1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.419782 Oct 06 13:03:39.234487 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1678/3325] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:38 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:39.245506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.253167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de471ed5-500d-48a7-9606-38a59a7aba12 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d47732af0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:39.254541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:39.268319 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a66f740-26f0-45e8-ae3e-602e0a1fcef2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.507942 Oct 06 13:03:39.284224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1648/3326] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:38 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:39.355209 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de471ed5-500d-48a7-9606-38a59a7aba12 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.118037 Oct 06 13:03:39.357112 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1679/3327] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:39 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:40.266953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:40.268216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:40.280346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:40.283702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:40.285359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:40.291220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:40.292400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:40.293090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:40.298205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:40.298942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:40.314502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:40.315202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:40.316446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:40.317329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:40.319686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:40.320416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:40.360411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:40.847071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.866374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.871363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.885875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-262e09b3-20a9-4f6a-b5d9-a2a7272e38c1 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.623434 Oct 06 13:03:40.890548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1649/3328] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:40 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:40.895448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-790242d0-ca0b-4746-adc7-7207e8ac17f2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1e9670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:40.929453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.954937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.960576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:40.963498 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc37af98-f9d8-4b85-9bd6-3f10f7761b49 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.669217 Oct 06 13:03:40.964104 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1680/3329] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:40 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:41.020805 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-790242d0-ca0b-4746-adc7-7207e8ac17f2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.129106 Oct 06 13:03:41.025095 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1650/3330] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:40 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:41.250727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6cf9b46e-4115-44c9-b1eb-f1ff2c1e3c73 tempest-ComputeTenantNetworksTest-286960480 tempest-ComputeTenantNetworksTest-286960480-project] Calling method '.version_select at 0x7f7d3f2ae1f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:41.928361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:41.934561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:41.960779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:41.961945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:41.962522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:41.963668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:41.964410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:41.964987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:42.165124 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6cf9b46e-4115-44c9-b1eb-f1ff2c1e3c73 tempest-ComputeTenantNetworksTest-286960480 tempest-ComputeTenantNetworksTest-286960480-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.198159 Oct 06 13:03:42.172696 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1681/3331] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 13:03:40 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:42.179279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:42.180154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:42.199562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:42.200758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:42.202505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:42.206259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:42.207468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:42.208500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:42.303270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.314482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.316686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.324479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a349d6b6-eec2-4615-a26c-427219d855ab tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1542 microversion: 2.91 time: 0.410067 Oct 06 13:03:42.325724 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1651/3332] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:41 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1542 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:42.331279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4a178bd-5c92-44f4-b2df-65a3ee48b49f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1e94c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:42.375960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.386301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.393633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:42.394922 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-508c586b-eadc-4058-9bec-35faddef6dcf tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.220884 Oct 06 13:03:42.405266 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1682/3333] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:42 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:42.405608 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4a178bd-5c92-44f4-b2df-65a3ee48b49f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.077147 Oct 06 13:03:42.405608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1652/3334] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:42 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:42.411807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d825b98c-0e71-448d-8107-934f04c58cc6 tempest-ComputeTenantNetworksTest-286960480 tempest-ComputeTenantNetworksTest-286960480-project] Calling method '.version_select at 0x7f7d3f86d9d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:42.499182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1221895054", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "2a527ac1-be52-4484-a0c2-d42680a20cf4"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:42.586490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] validate_networks() for [('2a527ac1-be52-4484-a0c2-d42680a20cf4', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:03:42.726170 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d825b98c-0e71-448d-8107-934f04c58cc6 tempest-ComputeTenantNetworksTest-286960480 tempest-ComputeTenantNetworksTest-286960480-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/21746f58-2c61-40c7-ab3c-bcac2f11b7c8" status: 200 len: 139 microversion: 2.1 time: 0.322673 Oct 06 13:03:42.727089 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1683/3335] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:03:42 2022] GET /compute/v2.1/os-tenant-networks/21746f58-2c61-40c7-ab3c-bcac2f11b7c8 => generated 139 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:43.361022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:43.361659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:43.375759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.377402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.380161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.381797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.382288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.382734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.573950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:03:43.575186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:03:43.575850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:03:43.576537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:03:43.577162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:03:43.607120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.610112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.614660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.619311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.622936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.623753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.713415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:43.719250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Getting quotas for project 4d7db924891d4a4b9963dffe3c907a00. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:03:43.728768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:43.730558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:43.743631 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dae7c75-0959-4ce2-9b14-fd8be6342a02 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1529 microversion: 2.91 time: 0.389619 Oct 06 13:03:43.762291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Getting quotas for user 3a19df443251444dbd5f575994affff7 and project 4d7db924891d4a4b9963dffe3c907a00. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:03:43.762386 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1684/3336] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:43 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1529 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:43.762386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecec995b-4cee-4e29-be05-63774f0b99c0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f2aec10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:43.831837 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ecec995b-4cee-4e29-be05-63774f0b99c0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.082747 Oct 06 13:03:43.840294 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1685/3337] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:43 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:43.840294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:43.840294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:43.843193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:03:43.859572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:03:43.860297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.863870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.864400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.865301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:43.871556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:43.872101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:43.980361 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-506aef59-f1cb-4472-94d2-7b752862be03 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569240 Oct 06 13:03:43.988790 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1653/3338] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:03:43.994398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:43.995329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:44.003111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.003869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.004543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.006218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.012543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.016456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.109531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:44.127444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:44.129568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:44.133848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eaa3ad3f-23d8-4526-b0b3-4b8490e1ae67 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.300025 Oct 06 13:03:44.135880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1686/3339] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:43 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:44.141255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb0ed316-0ac8-4e95-8403-e03c0cdb5123 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:44.141905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb0ed316-0ac8-4e95-8403-e03c0cdb5123 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:44.284098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fb0ed316-0ac8-4e95-8403-e03c0cdb5123 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:44.295430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb0ed316-0ac8-4e95-8403-e03c0cdb5123 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1217 microversion: 2.1 time: 0.157753 Oct 06 13:03:44.296460 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1687/3340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:44 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:44.317682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] Lazy-loading 'services' on Instance uuid a17820e8-f5c9-474b-a35e-167d51a87d50 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:03:44.381885 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5fe3cc9-ee71-41b6-9f7d-7e7cfb3a1be9 tempest-UnshelveToHostMultiNodesTest-1287030608 tempest-UnshelveToHostMultiNodesTest-1287030608-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1934 microversion: 2.91 time: 0.391155 Oct 06 13:03:44.382642 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1654/3341] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:43 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1934 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:44.459776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:44.464367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:44.479391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.480200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.480883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.481866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.483761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.484819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.544092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:03:44.761523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0ac5bdc-3998-4d17-836d-b97b552c4764 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 204 len: 0 microversion: 2.91 time: 0.311776 Oct 06 13:03:44.766789 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1688/3342] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:03:44 2022] DELETE /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:03:44.771971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:44.773419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:44.794806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.799682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.800162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.807377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:44.808023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:44.808479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:44.849357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-239d317f-4505-4927-bc7d-7f69df780ad7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1fc160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:44.950312 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-239d317f-4505-4927-bc7d-7f69df780ad7 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.106550 Oct 06 13:03:44.953374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1689/3343] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:44 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:45.166355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:45.167712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:45.178037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:45.179733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:45.181998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:45.184614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:45.190724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:45.195278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:45.441786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.467521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.471928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.487338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a21e70f1-6874-4647-96e0-174ff0293a52 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.720244 Oct 06 13:03:45.498285 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1655/3344] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:44 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:45.512121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:45.514111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:45.528784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:45.530108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:45.532362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:45.536132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:45.538093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:45.539124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:45.747493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.770330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.775996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.779422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f6a9047-6dc4-47eb-9988-4183fd045460 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.620175 Oct 06 13:03:45.782919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:45.789944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1690/3345] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:45 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:45.797589 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d69580a0-f46c-496b-b445-2c5c7149a403 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1221 microversion: 2.1 time: 0.295358 Oct 06 13:03:45.812268 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1656/3346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:45 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:45.970933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ce7b94b-36b4-48e5-a959-685c980e4831 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ecca820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:46.068876 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ce7b94b-36b4-48e5-a959-685c980e4831 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.098117 Oct 06 13:03:46.073720 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1691/3347] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:45 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:46.524678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:46.525831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:46.549203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.550428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.551024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:46.552030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.561645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.576372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:46.820146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:46.820875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:46.822050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:46.841286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:46.843670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.844194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.847235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:46.848068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:46.853924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.855298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.858247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:46.876120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b41dc7f-9ffc-4992-a489-4901cfc60285 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.357011 Oct 06 13:03:46.888630 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1657/3348] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:46 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:46.939316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:46.940205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:46.963284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.967069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.967725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:46.968634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:46.970041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:46.971979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:47.056790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:48.152902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:48.164685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:48.169607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:48.172148 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3f8e3e5a-2463-4538-a0e8-584e19dd863e tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 1.358329 Oct 06 13:03:48.174708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:48.175358 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1692/3349] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:46 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:48.186061 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d12edce6-d23c-4257-947e-bb71958b9ba8 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1277 microversion: 2.1 time: 1.261265 Oct 06 13:03:48.213967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1658/3350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:46 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1277 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:48.226664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1442638e-4ff2-4eeb-ad53-aee5820a90ed tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e6c45e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:48.375116 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1442638e-4ff2-4eeb-ad53-aee5820a90ed tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.158191 Oct 06 13:03:48.380175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1659/3351] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:48 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:48.392805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f", "name": "network-vif-plugged", "status": "completed", "tag": "4e0937c0-6bef-4946-8c2b-a8689c8d95da"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:48.447406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:48.449635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:48.452913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:48.492577 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] Creating event network-vif-plugged:4e0937c0-6bef-4946-8c2b-a8689c8d95da for instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f on n-h2-860556-1 Oct 06 13:03:48.503652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-79f43840-a58a-48fc-be78-f7eb1398b4e2 req-6e8a8a4d-1d69-448e-ba6e-20fd22c203bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121519 Oct 06 13:03:48.507027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1660/3352] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:48.527874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:48.529847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:48.558095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:48.559164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:48.559648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:48.560417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:48.560892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:48.561338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:48.663637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8224add-ef89-40f5-b51b-53dca9567267 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Calling method '.version_select at 0x7f7d3e6d01f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:49.023214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.043780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.049066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '932d510ec1ac4cda9d88e94a2cf996bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257019a6c0b04603a673e520f6e44b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.075175 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e993d526-da52-4765-8c53-e1c44e07b7cf tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 200 len: 1535 microversion: 2.91 time: 0.562705 Oct 06 13:03:49.082304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1661/3353] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:48 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 1535 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:49.188383 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8224add-ef89-40f5-b51b-53dca9567267 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.011549 Oct 06 13:03:49.189616 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1693/3354] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 13:03:48 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:03:49.210982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-577c4442-4dd7-4921-bca0-6326ac92f063 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Action: 'create', calling method: .version_select at 0x7f7d3f1e08b0>, body: {"pool": "non_exist_pool"} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:49.218346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:49.219426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:49.244261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:49.246324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:49.248473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:49.251504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:49.252644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:49.254247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:49.499815 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-577c4442-4dd7-4921-bca0-6326ac92f063 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] HTTP exception thrown: Floating IP pool not found. Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-577c4442-4dd7-4921-bca0-6326ac92f063 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Request method failure captured: Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 26 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtIycpVJY4rSoe0t-ZosNhu--v_-f93umvA262WkiPDT1p2_vW4p4iyPGXKw6aoE5M1T6jXURZ0s8jIVJcvz2v5us9dJVTpap3WPHxSTzeK-20pSXfpYePPGkCVMiFojWMO_e5_lFyPE3zETdhyoNR38yWBULsLqvw1KT6hF5q0FKkI Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0adf923ed5724d48aa4f3e006b919e22 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0adf923ed5724d48aa4f3e006b919e22", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0adf923ed5724d48aa4f3e006b919e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0adf923ed5724d48aa4f3e006b919e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0adf923ed5724d48aa4f3e006b919e22"}]}] Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0adf923ed5724d48aa4f3e006b919e22 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-FloatingIPsNegativeTestJSON-1915961244-project Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: dbd0aefd3411483b98581d043c86ef84 Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1915961244-project Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: {"pool": "non_exist_pool"} Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: exception: Floating IP pool not found. Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:49.502423 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:49.507602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 06 13:03:49.507602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.510534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-577c4442-4dd7-4921-bca0-6326ac92f063 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Returning 404 to user: Floating IP pool not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:49.512948 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-577c4442-4dd7-4921-bca0-6326ac92f063 tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.312334 Oct 06 13:03:49.514475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1662/3355] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 13:03:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:03:49.522186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.542545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.543909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:49.544538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:49.544958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:49.546447 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ab1d1c3-a280-4066-ad93-af0acc2c38a3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.341867 Oct 06 13:03:49.562607 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1694/3356] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:49 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:49.580651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:49.581491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dd0d5ab-86c7-4beb-aab9-7ca95266445b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3edd2040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:49.582269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:49.583651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:49.585857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:49.589068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:49.590264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:49.650734 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dd0d5ab-86c7-4beb-aab9-7ca95266445b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.086583 Oct 06 13:03:49.652863 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1695/3357] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:49 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:49.666358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Calling method '.version_select at 0x7f7d3f693820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:49.935680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0170266b-d254-4e06-b561-4200a231b5c7 could not be found", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:03:49.936637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] HTTP exception thrown: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Request method failure captured: Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-floating-ips/0170266b-d254-4e06-b561-4200a231b5c7 HTTP/1.1 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtIycpVJY4rSoe0t-ZosNhu--v_-f93umvA262WkiPDT1p2_vW4p4iyPGXKw6aoE5M1T6jXURZ0s8jIVJcvz2v5us9dJVTpap3WPHxSTzeK-20pSXfpYePPGkCVMiFojWMO_e5_lFyPE3zETdhyoNR38yWBULsLqvw1KT6hF5q0FKkI Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0adf923ed5724d48aa4f3e006b919e22 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0adf923ed5724d48aa4f3e006b919e22", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0adf923ed5724d48aa4f3e006b919e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0adf923ed5724d48aa4f3e006b919e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0adf923ed5724d48aa4f3e006b919e22"}]}] Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0adf923ed5724d48aa4f3e006b919e22 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1915961244 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPsNegativeTestJSON-1915961244-project Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: dbd0aefd3411483b98581d043c86ef84 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1915961244-project Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: exception: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0170266b-d254-4e06-b561-4200a231b5c7'} Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0170266b-d254-4e06-b561-4200a231b5c7 could not be found Oct 06 13:03:49.945682 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eae79da-a6c9-4db5-96e9-ebb044c51187'] Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7. Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7 Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7 Oct 06 13:03:49.950422 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:49.962020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] Returning 404 to user: Floating IP not found for ID 0170266b-d254-4e06-b561-4200a231b5c7 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:49.963245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b02974c5-bd65-4c45-8af1-36f2a38706dc tempest-FloatingIPsNegativeTestJSON-1915961244 tempest-FloatingIPsNegativeTestJSON-1915961244-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/0170266b-d254-4e06-b561-4200a231b5c7" status: 404 len: 111 microversion: 2.1 time: 0.305214 Oct 06 13:03:49.965873 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1696/3358] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:03:49 2022] DELETE /compute/v2.1/os-floating-ips/0170266b-d254-4e06-b561-4200a231b5c7 => generated 111 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:03:50.113889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:50.114516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] [instance: a17820e8-f5c9-474b-a35e-167d51a87d50] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:50.128905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:50.129487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:50.132309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:50.134443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:50.135010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:50.137305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:50.199550 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] HTTP exception thrown: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Request method failure captured: Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 HTTP/1.1 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtFqiZk__53tCX9vYj9JYBOO_kWWqpn4X-pu0cdiTlp1AgnieK1Q97jnb5vAHY7Mh6UoSz6rQpeNWdiOrHYGV5pj0siq3lZD_hPW8d7kyVbB-TCxsziYaehTPRDiWMmDJWHdLHYAr1vHtsTbGUhoWL7U-VgNwhi9ClSrZlYvf-5fPlc Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.91 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 257019a6c0b04603a673e520f6e44b99 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-193346385 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_257019a6c0b04603a673e520f6e44b99", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/257019a6c0b04603a673e520f6e44b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/257019a6c0b04603a673e520f6e44b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/257019a6c0b04603a673e520f6e44b99"}]}] Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-193346385 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 257019a6c0b04603a673e520f6e44b99 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-193346385 Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-UnshelveToHostMultiNodesTest-193346385-project Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 932d510ec1ac4cda9d88e94a2cf996bb Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-193346385-project Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a17820e8-f5c9-474b-a35e-167d51a87d50'} Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:50.215685 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. Oct 06 13:03:50.221161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:03:50.222776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] Returning 404 to user: Instance a17820e8-f5c9-474b-a35e-167d51a87d50 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:03:50.230453 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f7616f8-980d-47ca-be01-d48705ce1200 tempest-UnshelveToHostMultiNodesTest-193346385 tempest-UnshelveToHostMultiNodesTest-193346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50" status: 404 len: 111 microversion: 2.91 time: 0.122184 Oct 06 13:03:50.237054 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1697/3359] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:50 2022] GET /compute/v2.1/servers/a17820e8-f5c9-474b-a35e-167d51a87d50 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:03:50.260678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:50.272838 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8d17b44-c605-4445-9082-e698ce92b46f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 0.742854 Oct 06 13:03:50.273455 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1663/3360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:49 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:50.583809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:50.584440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:50.599684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:50.600190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:50.605318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:50.611533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:50.612043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:50.612489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:50.668212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8570e8c6-58f9-4ecb-a97f-376935d4182b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f18f4c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:50.788193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8570e8c6-58f9-4ecb-a97f-376935d4182b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.123683 Oct 06 13:03:50.788739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1664/3361] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:50 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:51.303964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:51.304617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:51.316584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:51.317406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:51.321176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:51.322231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:51.325908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:51.326698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:51.433322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:51.448595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:51.454407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:51.469594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac7c5e8f-903b-4b89-834f-2a0f297db6c6 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.891803 Oct 06 13:03:51.472682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1698/3362] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:50 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:51.804669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec27e6f1-ce79-4d81-b8d6-aa4dc91f3a56 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ef67280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:51.893488 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec27e6f1-ce79-4d81-b8d6-aa4dc91f3a56 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.093328 Oct 06 13:03:51.894734 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1699/3363] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:51 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:52.135066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:52.148300 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-29ceee7c-ca5d-4d92-a1b3-83a5663dc24f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 0.848725 Oct 06 13:03:52.150551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1665/3364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:51 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:03:52.497472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:52.498804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:52.516013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:52.522698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:52.523726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:52.525164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:52.530868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:52.531883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:52.711849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:52.723565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:52.727310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:52.728898 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-840dc620-7610-46a0-b2dc-a1529b1bde60 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.235354 Oct 06 13:03:52.729778 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1700/3365] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:52 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:52.910680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03887642-0d03-4bac-8110-43cc386a5371 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f228790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:53.059391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03887642-0d03-4bac-8110-43cc386a5371 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.149112 Oct 06 13:03:53.078543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1666/3366] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:52 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:53.178247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:53.178958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:53.188277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:53.196084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:53.198904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:53.201315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:53.203030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:53.209334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:53.762790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:53.765639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:53.771794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:53.798613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:53.803251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:53.805441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:53.807852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:53.808694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:53.809188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:53.814132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:54.170761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:54.182771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:54.185935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:54.189210 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f97fc026-e00d-41f3-bddd-76e0f7212c7a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1407 microversion: 2.54 time: 0.437331 Oct 06 13:03:54.191827 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1667/3367] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:53 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:54.211470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5b57fb7-89b0-451c-bb8e-10bc812eb003 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1e9700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:54.292921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:54.361281 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5b57fb7-89b0-451c-bb8e-10bc812eb003 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.168068 Oct 06 13:03:54.375634 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1668/3368] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:54 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:54.400245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f298bf9-f917-413c-96a7-d58ba80f3c16", "tag": "096c27bb-9a7a-476f-a797-fc1cebbffe95"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:03:54.430011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:54.430911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:54.431597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:54.473502 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] Creating event network-changed:096c27bb-9a7a-476f-a797-fc1cebbffe95 for instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 on n-h2-860556-1 Oct 06 13:03:54.501983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2969940c-1adc-495f-852a-917b09b8efe8 req-d206e0a5-1c4a-437d-9cba-5755697ebd94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123356 Oct 06 13:03:54.515383 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1669/3369] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:03:55.222513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:55.223997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:55.234729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:55.235154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:55.235601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:55.236328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:55.236911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:55.237510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:55.653665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:55.675040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:55.683968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:55.690317 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-913f0dea-8902-4db7-aaef-42c7c70e17f2 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1413 microversion: 2.54 time: 0.474012 Oct 06 13:03:55.694530 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1670/3370] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:55 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1413 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:55.717104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bcb3761-3f9c-4e20-9fdf-1be8aa35b52c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f2288b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:55.868238 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bcb3761-3f9c-4e20-9fdf-1be8aa35b52c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.169043 Oct 06 13:03:55.870802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1671/3371] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:55 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:56.106248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:56.126817 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c975de85-1949-4323-b9d3-c0d2c648d9a1 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 2.954047 Oct 06 13:03:56.131100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1701/3372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:53 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 2959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:56.723397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:56.725448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:56.743458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:56.744224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:56.745386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:56.749807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:56.754289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:56.755864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:56.884859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c3a2779-7c2e-49b3-a210-4e7475cd3c8d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f6c35e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:56.979774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c3a2779-7c2e-49b3-a210-4e7475cd3c8d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.098178 Oct 06 13:03:56.983736 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1702/3373] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:56 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:57.154841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:57.155500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:57.171732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:57.172236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:57.179065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:57.182900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:57.187821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:57.191430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:57.339089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:57.358510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:57.363551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:57.365065 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fa433f5-8732-453c-9eb3-556bc6ba3fc4 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1413 microversion: 2.54 time: 0.647166 Oct 06 13:03:57.383298 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1672/3374] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:56 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1413 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:03:58.003188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33daf825-86da-4740-9692-34c1f12e0462 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f228e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:58.154973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33daf825-86da-4740-9692-34c1f12e0462 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.162251 Oct 06 13:03:58.155588 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1673/3375] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:57 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:58.399310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:58.399992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:58.402152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:03:58.422707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:58.423038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:58.423476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:58.424214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:58.428998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:58.429479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:58.860835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:58.868916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:58.889992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65c0f705-3407-46b2-98d3-3dbc78dbef55 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.727320 Oct 06 13:03:58.890708 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1703/3376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:03:57 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:58.892713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:58.913574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:03:58.915550 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03f203a9-852a-487d-bdf0-7554e32be7e3 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1398 microversion: 2.54 time: 0.520651 Oct 06 13:03:58.927788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1674/3377] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:58 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1398 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:03:58.945912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ddd2aa4-e69b-40af-a1e0-deb9b249f1cb tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '.version_select at 0x7f7d3f228430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:59.043144 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ddd2aa4-e69b-40af-a1e0-deb9b249f1cb tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-354487664" status: 204 len: 0 microversion: 2.54 time: 0.102072 Oct 06 13:03:59.044478 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1675/3378] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 13:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-354487664 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:03:59.074876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:59.076790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:59.145701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:59.153953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:59.154981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:59.159355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:59.162682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:59.164942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:59.240794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:03:59.548771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e2cf787e-aaf7-48bc-a208-d75e38a1463a tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "DELETE /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 204 len: 0 microversion: 2.54 time: 0.497386 Oct 06 13:03:59.583084 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1676/3379] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:03:59 2022] DELETE /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:03:59.612048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4bd158f7-57cd-4482-b234-36b07873696f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1d1d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:59.787409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4bd158f7-57cd-4482-b234-36b07873696f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.204787 Oct 06 13:03:59.788052 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1677/3380] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:03:59 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:03:59.845572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:03:59.858746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:03:59.925553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:59.931302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:59.937915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:03:59.938778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:03:59.940022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:03:59.944935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:00.198459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0660a66f-ccda-41f7-82d0-14497900e8b1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Action: 'create', calling method: .version_select at 0x7f7d3f00f4c0>, body: {"keypair": {"name": "tempest-keypair-662139321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2D6jGTkP84XmobmQKzgx2XW6GEstRMQAkcvUGeY6kYMV32ILVDas4/i1ymgT9AGLSF7UvYBRp5utqWRCIOnvRu0M8PBakjnC8XhmUlLNCkve3iinYLPEiXUxHhtZtw9w=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:00.249945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0660a66f-ccda-41f7-82d0-14497900e8b1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for project 174e3c56e3314cb5b80f05ad67b81926. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:00.264442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0660a66f-ccda-41f7-82d0-14497900e8b1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for user ecb911264e82477bb5fb733db5655391 and project 174e3c56e3314cb5b80f05ad67b81926. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:00.326471 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0660a66f-ccda-41f7-82d0-14497900e8b1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.433012 Oct 06 13:04:00.332038 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1704/3381] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:03:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:00.345108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:00.352839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:00.375960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:00.377932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:00.381854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:00.387265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:00.388377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:00.390025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:00.589440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:00.608516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:00.610636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:00.612739 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9e7df2ab-f2e9-4fcf-ad4e-b79c095ae05c tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1404 microversion: 2.54 time: 0.790907 Oct 06 13:04:00.613468 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1678/3382] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:03:59 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1404 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:00.813261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f152e14-3f30-4f30-be3d-3fc955b7af97 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475bcee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:00.899808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f152e14-3f30-4f30-be3d-3fc955b7af97 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.098852 Oct 06 13:04:00.901984 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1679/3383] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:00 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:01.386942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:01.396378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d02eb89-d393-4505-b3f4-4f3aab08e0a4 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.059065 Oct 06 13:04:01.403275 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1705/3384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:00 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:01.648919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:01.649497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:01.723895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:01.731332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:01.734845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:01.745177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:01.757574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:01.758804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:01.916134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83083c65-9b84-4340-93bd-87f4e405418b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ee6fc10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:02.016006 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83083c65-9b84-4340-93bd-87f4e405418b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.103863 Oct 06 13:04:02.022847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1706/3385] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:01 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:02.290331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-694680064", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "7166850e-6ee7-41b2-9282-b1f0cf2bd67f"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:02.311708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:02.322713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:02.329267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8abd80b390864bf0b525929d804def4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08289d34c44c789486b4a860e493d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:02.335306 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3da3809c-400d-4ae5-ba15-5757af88aec7 tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 200 len: 1404 microversion: 2.54 time: 0.695249 Oct 06 13:04:02.350903 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1680/3386] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:01 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 1404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:02.424275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:02.425192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:02.428986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] validate_networks() for [('7166850e-6ee7-41b2-9282-b1f0cf2bd67f', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:02.441985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:02.443261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:02.443906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:02.444822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:02.445455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:02.446103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:03.429253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:03.438768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dbd6bfed-bc73-41aa-ab85-e893a2e70a0f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.018358 Oct 06 13:04:03.442443 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1681/3387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:02 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:03.454620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b988ea2-54ae-4a73-af15-1b7dc7528f63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea4e700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:03.563593 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b988ea2-54ae-4a73-af15-1b7dc7528f63 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.118529 Oct 06 13:04:03.565804 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1682/3388] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:03 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:03.575771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:03.587875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] [instance: 745e8863-cb02-4b57-b0b8-064cf3d13d00] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:03.601663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:03.602501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:03.603809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:03.604709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:03.605340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:03.606171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:03.624910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] HTTP exception thrown: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Request method failure captured: Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 HTTP/1.1 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtIXL26MqgQnXMyLZgO4XJ6tXvPsMOQ0c9zPaxA_8cbm-0-xJsijfuYTuRCYjNCbRS51H6wLD_ziScW2-rDzmdXqIVOtTbSTT0vdTKIeaOHMow2vG-_l-0-m1duieJH5EcWU45TKTW9MxVQHHdAE_lj6Zjn_A4PRLhfckCQSay7RHAI Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.54 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 9d08289d34c44c789486b4a860e493d8 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerShowV254Test-892228243 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d08289d34c44c789486b4a860e493d8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d08289d34c44c789486b4a860e493d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d08289d34c44c789486b4a860e493d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d08289d34c44c789486b4a860e493d8"}]}] Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerShowV254Test-892228243 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 9d08289d34c44c789486b4a860e493d8 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerShowV254Test-892228243 Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerShowV254Test-892228243-project Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8abd80b390864bf0b525929d804def4d Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerShowV254Test-892228243-project Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '745e8863-cb02-4b57-b0b8-064cf3d13d00'} Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:03.626950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. Oct 06 13:04:03.633480 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:03.636902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] Returning 404 to user: Instance 745e8863-cb02-4b57-b0b8-064cf3d13d00 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:03.638024 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39943bb8-01d5-4c15-9f96-09f49eaa3d1f tempest-ServerShowV254Test-892228243 tempest-ServerShowV254Test-892228243-project] 10.222.0.26 "GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00" status: 404 len: 111 microversion: 2.54 time: 0.070781 Oct 06 13:04:03.638799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1683/3389] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:03 2022] GET /compute/v2.1/servers/745e8863-cb02-4b57-b0b8-064cf3d13d00 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:04.466251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:04.466959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:04.481635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:04.487213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:04.489213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:04.491430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:04.491910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:04.492350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:04.540520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:04.541401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:04.541714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:04.542202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:04.542672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:04.563904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:04.564599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:04.565239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:04.566253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:04.568289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:04.571511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:04.629971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Getting quotas for project c379343e9fdb4210ba1f500cccadc8df. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:04.656037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:04.657690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Getting quotas for user 6b2fdc08156b49f59ecaa01f19dd4285 and project c379343e9fdb4210ba1f500cccadc8df. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:04.688114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:04.691037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:04.813885 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a389d0f3-6205-4672-8d2a-a292918531de tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.790383 Oct 06 13:04:04.820868 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1707/3390] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:04:04.828635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43120ae1-86cd-45f9-8abf-d9a2e1e6993b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476f3700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:04.908229 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43120ae1-86cd-45f9-8abf-d9a2e1e6993b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.086257 Oct 06 13:04:04.909391 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1708/3391] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:04 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:04.920692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:04.934951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:05.175197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:05.186029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:05.195427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:05.201129 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5cebb525-5889-4dce-bcfa-094f70b2129f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1261 microversion: 2.26 time: 0.286564 Oct 06 13:04:05.202030 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1709/3392] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:04 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1261 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:05.519177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:05.537106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0132eb9-75ee-45f5-9a89-2a57a72533d7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.075097 Oct 06 13:04:05.553836 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1684/3393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:04 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:05.928202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b37e3818-30ec-458a-8fc6-d2e78a911e13 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f01d550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:05.990626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b37e3818-30ec-458a-8fc6-d2e78a911e13 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.068481 Oct 06 13:04:05.992851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1710/3394] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:05 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:06.230557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:06.231214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:06.243564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:06.246955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:06.248770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:06.251612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:06.252502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:06.254647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:06.564891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:06.565606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:06.575060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:06.589597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:06.600442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:06.601565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:06.602318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:06.603364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:06.607847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:06.608971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:06.611438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:06.621473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0f6545f-fd19-45ea-b1c7-e51ce31307ea tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1265 microversion: 2.26 time: 0.397626 Oct 06 13:04:06.638124 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1685/3395] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:06 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:07.007662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f2ad2025-4c25-4f87-9181-01a59dd81518 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475bcc10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:07.176510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f2ad2025-4c25-4f87-9181-01a59dd81518 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.173242 Oct 06 13:04:07.191211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1686/3396] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:07 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:07.665825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:07.666477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:07.680817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:07.681323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:07.692240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:07.694527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:07.695044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:07.695500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:07.700370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:08.091206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:08.106904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:08.111696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:08.128367 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c1fc57f-4512-451d-9e49-69a156525913 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1331 microversion: 2.26 time: 0.463794 Oct 06 13:04:08.134953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1687/3397] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:07 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1331 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:04:08.191824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ebfb979b-461f-4a81-9ee0-2eb840f7f38d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3eb15a60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:08.275561 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ebfb979b-461f-4a81-9ee0-2eb840f7f38d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.087451 Oct 06 13:04:08.276216 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1688/3398] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:08 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:08.674793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:08.685374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02f1a7f0-717d-425f-8dce-731ab5720f7a tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 2.125114 Oct 06 13:04:08.692834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1711/3399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:06 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:08.731823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa0ab749-a07c-4ad8-b33b-d4a04bbc5bac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: .version_select at 0x7f7d3ea1b5e0>, body: {"keypair": {"name": "tempest-keypair-180489035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCkevvrNacUGULBRi2ZJBJb5u/mM7cAP3FcrtObE39AenOC42or8zHY2QyktmDsbkq4RQXp/lsy5PIKCU7JkzjMV7Y0B6ipZRrYBrAHCPX4aS/FqY5iZAYlj3lfpce1MA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:08.756971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-aa0ab749-a07c-4ad8-b33b-d4a04bbc5bac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for project 844e3815b5a545ab8fc1821d284f9504. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:08.763306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-aa0ab749-a07c-4ad8-b33b-d4a04bbc5bac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for user 1adca22b5c8a44fcbe1e6ef0f39ba69b and project 844e3815b5a545ab8fc1821d284f9504. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:08.796385 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa0ab749-a07c-4ad8-b33b-d4a04bbc5bac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.366524 Oct 06 13:04:08.803841 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1689/3400] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 13:04:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 373 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 06 13:04:09.162205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:09.163483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:09.181994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:09.184109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:09.184723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:09.186103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:09.188674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:09.204850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:09.293395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f210d0c0-54cd-4687-81df-56ae1c93fcf6 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f4588b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:09.376791 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f210d0c0-54cd-4687-81df-56ae1c93fcf6 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.087232 Oct 06 13:04:09.378667 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1690/3401] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:09 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:09.718082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:09.719057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:09.738104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:09.740878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:09.741580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:09.748088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:09.748956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:09.749574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:10.116388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:10.123920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:10.131792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:10.136545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:10.140983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92bbbefb-80fd-4be7-bb91-4da949775fce tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1319 microversion: 2.26 time: 0.982213 Oct 06 13:04:10.143042 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1712/3402] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:09 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:10.395205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a5cb9614-e5ac-4a64-a11f-672951a15025 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3eda2ca0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:10.540562 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a5cb9614-e5ac-4a64-a11f-672951a15025 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.150096 Oct 06 13:04:10.542425 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1713/3403] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:10 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:10.731858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:10.745646 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3027313-1e43-41ba-9ca9-21d8e226933f tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.030139 Oct 06 13:04:10.760782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1691/3404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:09 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:11.175940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:11.177555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:11.204100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:11.206008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:11.207823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:11.213115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:11.213820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:11.214529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:11.557913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38c777d8-186d-47e0-824e-30ba44656923 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea1b940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:11.595916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:11.613453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:11.618536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:11.621662 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dca3f710-1309-4945-ab9a-cde0d6634dab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1319 microversion: 2.26 time: 0.449955 Oct 06 13:04:11.624705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1714/3405] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:11 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:11.661314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38c777d8-186d-47e0-824e-30ba44656923 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1412 microversion: 2.1 time: 0.106502 Oct 06 13:04:11.661959 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1692/3406] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:11 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:11.771336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:11.772310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:11.786809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:11.788201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:11.793946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:11.797123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:11.806794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:11.810582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:12.655304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:12.657040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:12.679175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:12.680093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:12.682170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:12.683119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:12.686378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:12.687021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:12.907349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:12.920458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:12.925916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:12.928122 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-231e4b84-b23e-4850-a5be-f7086638b729 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1319 microversion: 2.26 time: 0.279254 Oct 06 13:04:12.934010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1693/3407] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:12 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:04:12.940637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-563a57f8-1757-4602-8930-bc7242ab1b69 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475bc430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:13.062740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:13.073341 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18ada755-330b-4665-856c-d8a7e7e9eef7 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.307467 Oct 06 13:04:13.080901 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1715/3408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:11 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:13.569271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f305721c-5a0f-42b2-8d39-987063ec0b9b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.310228 Oct 06 13:04:13.570692 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1716/3409] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Oct 6 13:04:13 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 13:04:13.592683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6b29e1c-bc3d-44d8-aad4-1a2890b43e8e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Calling method '.version_select at 0x7f7d3edce160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:14.596651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:15.180955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:18.775562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:18.960810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d6b29e1c-bc3d-44d8-aad4-1a2890b43e8e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] HTTP exception thrown: Image not found. Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6b29e1c-bc3d-44d8-aad4-1a2890b43e8e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Request method failure captured: Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJNBwquW8za9ifWTDLtFdqTgJDioLkn6onVkhmz2RBF3KFzdiBqZ5e6jbo93ECzOyu7ujyrN5lgVasF2Xf6HFt1iZqog1JBkHZib0w07XjjtwzSlFfQjTtSmi-2Ct56MtUNIXkhZOk7jVLEQyQXK8-SvR99wWvHJkzcENVWUHUwPA4 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc3d3e68d7cf433697efdfb3f661e6cd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}] Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cf64e1f8f6344f01992deed3acde5e6b Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '-1'} Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.977530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:04:18.983368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:18.988333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6b29e1c-bc3d-44d8-aad4-1a2890b43e8e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:18.991055 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6b29e1c-bc3d-44d8-aad4-1a2890b43e8e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 5.411867 Oct 06 13:04:18.999464 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1717/3410] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Oct 6 13:04:13 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 5421 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:04:19.010786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:19.012260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:19.034658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:19.035238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:19.035696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:19.040982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:19.041582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:19.042070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:19.076019 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-563a57f8-1757-4602-8930-bc7242ab1b69 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1421 microversion: 2.1 time: 6.140528 Oct 06 13:04:19.091151 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1694/3411] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:12 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1421 bytes in 6156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:19.129220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:19.140416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:19.183390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:19.184342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:19.185023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:19.189071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:19.190907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:19.212656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:19.956360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:19.971181 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd8ecf0d-c6ef-477b-b44c-883044716588 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 0.878456 Oct 06 13:04:19.971780 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1695/3412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:19 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:20.058737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:20.101334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:20.115524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:20.118866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14f72401-a50f-445b-8663-32e9a961c7c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 1.118327 Oct 06 13:04:20.122412 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1718/3413] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:18 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:20.151362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1374592819", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18f3fe7e-30f7-47b4-afdf-deb0bca1ef46"}], "security_groups": [{"name": "tempest-securitygroup--1364129230"}], "key_name": "tempest-keypair-180489035", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:20.187774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f298bf9-f917-413c-96a7-d58ba80f3c16", "name": "network-vif-plugged", "status": "completed", "tag": "096c27bb-9a7a-476f-a797-fc1cebbffe95"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:20.200626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:20.201349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:20.202742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:20.236627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] Creating event network-vif-plugged:096c27bb-9a7a-476f-a797-fc1cebbffe95 for instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 on n-h2-860556-1 Oct 06 13:04:20.259567 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-befaeccd-8117-4761-b670-80d3c63c78ca req-2c30d8c7-9794-4416-8c76-95a7d71e6cd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271647 Oct 06 13:04:20.265837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1696/3414] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:20.507825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] validate_networks() for [('18f3fe7e-30f7-47b4-afdf-deb0bca1ef46', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:20.523373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab", "tag": "65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:20.558190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:20.558907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:20.559830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:20.601925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] Creating event network-changed:65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de for instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab on n-h1-860556-1 Oct 06 13:04:20.615985 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-33b50c51-3715-4e90-a481-d516785c8bd5 req-d79156e4-b468-4407-8a8a-769b4c366c82 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346043 Oct 06 13:04:20.618118 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1697/3415] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:20.629718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70421387-bc39-4472-bd96-71edd7e562d7 tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Calling method '.version_select at 0x7f7d3eaa1dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:20.660559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-70421387-bc39-4472-bd96-71edd7e562d7 tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] HTTP exception thrown: Image not found. Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70421387-bc39-4472-bd96-71edd7e562d7 tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Request method failure captured: Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/images/c28faea3-6f7c-4ae5-957e-2b75b91c33dj HTTP/1.1 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJNBwquW8za9ifWTDLtFdqTgJDioLkn6onVkhmz2RBF3KFzdiBqZ5e6jbo93ECzOyu7ujyrN5lgVasF2Xf6HFt1iZqog1JBkHZib0w07XjjtwzSlFfQjTtSmi-2Ct56MtUNIXkhZOk7jVLEQyQXK8-SvR99wWvHJkzcENVWUHUwPA4 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc3d3e68d7cf433697efdfb3f661e6cd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}] Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: cf64e1f8f6344f01992deed3acde5e6b Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c28faea3-6f7c-4ae5-957e-2b75b91c33dj'} Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c28faea3-6f7c-4ae5-957e-2b75b91c33dj to delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c28faea3-6f7c-4ae5-957e-2b75b91c33dj could not be found. Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.663241 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:04:20.668273 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.671703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70421387-bc39-4472-bd96-71edd7e562d7 tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:20.672775 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70421387-bc39-4472-bd96-71edd7e562d7 tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/c28faea3-6f7c-4ae5-957e-2b75b91c33dj" status: 404 len: 62 microversion: 2.1 time: 0.053267 Oct 06 13:04:20.673877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1698/3416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:20 2022] DELETE /compute/v2.1/images/c28faea3-6f7c-4ae5-957e-2b75b91c33dj => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:04:20.683901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c48ce561-b544-4f54-9219-f8178b04068b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3eaf7e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:20.766789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c48ce561-b544-4f54-9219-f8178b04068b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 200 len: 1421 microversion: 2.1 time: 0.091641 Oct 06 13:04:20.776514 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1699/3417] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:20 2022] GET /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:20.781319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8caecfee-07c6-4266-aa69-da311aa68dfd tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Calling method '.version_select at 0x7f7d3f1e0670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:20.815907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-8caecfee-07c6-4266-aa69-da311aa68dfd tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] HTTP exception thrown: Image not found. Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8caecfee-07c6-4266-aa69-da311aa68dfd tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Request method failure captured: Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/images/06f8061f-5f2c-432d-9f03-839c34f94af01 HTTP/1.1 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJNBwquW8za9ifWTDLtFdqTgJDioLkn6onVkhmz2RBF3KFzdiBqZ5e6jbo93ECzOyu7ujyrN5lgVasF2Xf6HFt1iZqog1JBkHZib0w07XjjtwzSlFfQjTtSmi-2Ct56MtUNIXkhZOk7jVLEQyQXK8-SvR99wWvHJkzcENVWUHUwPA4 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc3d3e68d7cf433697efdfb3f661e6cd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}] Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: cf64e1f8f6344f01992deed3acde5e6b Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '06f8061f-5f2c-432d-9f03-839c34f94af01'} Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06f8061f-5f2c-432d-9f03-839c34f94af01 to delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06f8061f-5f2c-432d-9f03-839c34f94af01 could not be found. Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.818054 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8caecfee-07c6-4266-aa69-da311aa68dfd tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:20.823315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8caecfee-07c6-4266-aa69-da311aa68dfd tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/06f8061f-5f2c-432d-9f03-839c34f94af01" status: 404 len: 62 microversion: 2.1 time: 0.050606 Oct 06 13:04:20.825579 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1700/3418] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:04:20 2022] DELETE /compute/v2.1/images/06f8061f-5f2c-432d-9f03-839c34f94af01 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:04:20.829771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb5f0292-75bc-425c-b4c2-a82081cecd66 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f3064c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:22.007066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:22.007793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:22.021156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:22.024033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:22.024678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:22.068187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.068691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.069136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:22.069953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.070371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.070795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:22.129698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for project 844e3815b5a545ab8fc1821d284f9504. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:22.148201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for user 1adca22b5c8a44fcbe1e6ef0f39ba69b and project 844e3815b5a545ab8fc1821d284f9504. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:22.191510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:22.194844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:22.316799 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c0463a3-8096-4a46-9cca-47e5dbde1e22 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.189765 Oct 06 13:04:22.330881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1719/3419] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:04:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:04:22.348277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb5f0292-75bc-425c-b4c2-a82081cecd66 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 204 len: 0 microversion: 2.1 time: 1.522380 Oct 06 13:04:22.348889 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1701/3420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:20 2022] DELETE /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:22.356983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:22.357763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:22.361015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a76487cf-27bd-468c-99bc-5f32c4f30f4b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Calling method '.version_select at 0x7f7d3edaa8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:22.387693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.389429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.390082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:22.390983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.391614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.392729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:22.410758 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a76487cf-27bd-468c-99bc-5f32c4f30f4b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] HTTP exception thrown: Image not found. Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a76487cf-27bd-468c-99bc-5f32c4f30f4b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Request method failure captured: Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/tempest-invalid-1447300056 HTTP/1.1 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJNBwquW8za9ifWTDLtFdqTgJDioLkn6onVkhmz2RBF3KFzdiBqZ5e6jbo93ECzOyu7ujyrN5lgVasF2Xf6HFt1iZqog1JBkHZib0w07XjjtwzSlFfQjTtSmi-2Ct56MtUNIXkhZOk7jVLEQyQXK8-SvR99wWvHJkzcENVWUHUwPA4 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc3d3e68d7cf433697efdfb3f661e6cd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}] Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cf64e1f8f6344f01992deed3acde5e6b Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'tempest-invalid-1447300056'} Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1447300056 to delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1447300056 could not be found. Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.413344 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a76487cf-27bd-468c-99bc-5f32c4f30f4b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a76487cf-27bd-468c-99bc-5f32c4f30f4b tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-1447300056" status: 404 len: 62 microversion: 2.1 time: 0.082662 Oct 06 13:04:22.418447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1720/3421] 10.222.0.26 () {58 vars in 1206 bytes} [Thu Oct 6 13:04:22 2022] DELETE /compute/v2.1/images/tempest-invalid-1447300056 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:04:22.425416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:22.436264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:22.460161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.460871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.461490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:22.462612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:22.464469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:22.465129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:23.178671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.190549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.196487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.201702 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37760949-5944-46f3-8451-5956e8cfe1b9 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 0.781128 Oct 06 13:04:23.202320 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1721/3422] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:22 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:23.219074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:23.219693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:23.500702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.514871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d154c1ed-6e77-43e0-899f-9cafd7591964 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1317 microversion: 2.1 time: 1.164540 Oct 06 13:04:23.517588 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1702/3423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:22 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1317 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:23.524920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:23.531318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:23.563758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:23.570308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:23.577700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:23.581642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:23.584450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:23.585937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:23.674735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.693447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.696326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:23.704669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af58bd85-56ce-4f29-b221-9f16778d1258 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1281 microversion: 2.20 time: 0.496686 Oct 06 13:04:23.706693 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1722/3424] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:23 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1281 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:23.720460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:04:23.727254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b98bc050-d563-414d-a5f1-8b19aedee34e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Calling method '.version_select at 0x7f7d3edaa940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:23.794716 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b98bc050-d563-414d-a5f1-8b19aedee34e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] HTTP exception thrown: Image not found. Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b98bc050-d563-414d-a5f1-8b19aedee34e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Request method failure captured: Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/4354e2c8-8fcb-465b-a0e5-c11fefb40375 HTTP/1.1 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJNBwquW8za9ifWTDLtFdqTgJDioLkn6onVkhmz2RBF3KFzdiBqZ5e6jbo93ECzOyu7ujyrN5lgVasF2Xf6HFt1iZqog1JBkHZib0w07XjjtwzSlFfQjTtSmi-2Ct56MtUNIXkhZOk7jVLEQyQXK8-SvR99wWvHJkzcENVWUHUwPA4 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc3d3e68d7cf433697efdfb3f661e6cd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc3d3e68d7cf433697efdfb3f661e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc3d3e68d7cf433697efdfb3f661e6cd"}]}] Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: bc3d3e68d7cf433697efdfb3f661e6cd Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-928696055 Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: cf64e1f8f6344f01992deed3acde5e6b Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-928696055-project Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4354e2c8-8fcb-465b-a0e5-c11fefb40375'} Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4354e2c8-8fcb-465b-a0e5-c11fefb40375 to delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4354e2c8-8fcb-465b-a0e5-c11fefb40375 could not be found. Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:23.798092 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:04:23.804355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:23.814742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b98bc050-d563-414d-a5f1-8b19aedee34e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:23.815637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b98bc050-d563-414d-a5f1-8b19aedee34e tempest-ImagesDeleteNegativeTestJSON-928696055 tempest-ImagesDeleteNegativeTestJSON-928696055-project] 10.222.0.26 "DELETE /compute/v2.1/images/4354e2c8-8fcb-465b-a0e5-c11fefb40375" status: 404 len: 62 microversion: 2.1 time: 0.105089 Oct 06 13:04:23.831595 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1723/3425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:23 2022] DELETE /compute/v2.1/images/4354e2c8-8fcb-465b-a0e5-c11fefb40375 => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:04:23.918498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99eecdf7-fbd7-413c-a6ac-5b0bd6cb8785 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 204 len: 0 microversion: 2.1 time: 0.397006 Oct 06 13:04:23.927125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1703/3426] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:04:23 2022] DELETE /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:24.234088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:24.234931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:24.252331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:24.253090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:24.254451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:24.256003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:24.258538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:24.259198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:24.320360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] Calling method '.version_select at 0x7f7d3edce040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:24.679568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG neutronclient.v2_0.client [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab could not be found", "detail": ""}} {{(pid=129615) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:04:24.680607 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] HTTP exception thrown: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] Request method failure captured: Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-floating-ips/f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab HTTP/1.1 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJXDZwFRiM7BqN0fHLrgCM5lDZTeqX1umyA-9_suuKa2xqROzkaAsJTBfRA8TKACTjrQeVbE7ZP5QUuCsER6iNtAdtM1_HItG8xVabo4WFx_FYNyqOQrWSiTrgvVTbo1njsLlzwus85oJYlEw7nMY0cnbRRRT78GgXM5Weo7skSoTM Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74d2824da63244dcbef4db93621646f4 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1348765709 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74d2824da63244dcbef4db93621646f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74d2824da63244dcbef4db93621646f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74d2824da63244dcbef4db93621646f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74d2824da63244dcbef4db93621646f4"}]}] Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1348765709 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74d2824da63244dcbef4db93621646f4 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1348765709 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 36c13a8918be4f899b1f013a137636f2 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: exception: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab'} Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:04:24.683348 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab could not be found Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-338430cd-9660-492b-9d5e-3f151fe28f45'] Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab. Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab Oct 06 13:04:24.688000 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:24.694027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] Returning 404 to user: Floating IP not found for ID f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:24.695166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-815bcbd4-3e60-4a1d-9583-59bd0f6d7892 tempest-FloatingIPDetailsNegativeTestJSON-1348765709 tempest-FloatingIPDetailsNegativeTestJSON-1348765709-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab" status: 404 len: 111 microversion: 2.1 time: 0.855655 Oct 06 13:04:24.696314 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1724/3427] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 13:04:23 2022] GET /compute/v2.1/os-floating-ips/f0710e4e-3e2b-4d1a-aa62-f5244bdaa5ab => generated 111 bytes in 862 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:04:24.710202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f", "name": "network-vif-unplugged", "status": "completed", "tag": "4e0937c0-6bef-4946-8c2b-a8689c8d95da"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:24.757594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:24.761465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:24.762837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:24.815775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] Creating event network-vif-unplugged:4e0937c0-6bef-4946-8c2b-a8689c8d95da for instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f on n-h2-860556-1 Oct 06 13:04:24.835694 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-86bf75d1-1042-47db-be7e-cd0e1280728d req-0ed3f5c1-c983-4b01-a2fc-78d3c257318b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135098 Oct 06 13:04:24.840045 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1725/3428] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:24.870619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-502590082", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a3976e54-2526-447e-9882-cadece24aa4d"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:24.968334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:24.980575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:24.987269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:24.991722 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d605f693-daee-4e88-8217-329bc48eaa88 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 0.764715 Oct 06 13:04:24.999505 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1704/3429] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:24 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:04:25.017001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:25.018425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:25.040119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] validate_networks() for [('a3976e54-2526-447e-9882-cadece24aa4d', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:25.049992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:25.050776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:25.075737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:25.079237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:25.080092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:25.084397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.056357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:26.088800 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-023151e1-f8e8-4c2f-84fc-726440589f91 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1505 microversion: 2.1 time: 1.082425 Oct 06 13:04:26.093158 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1705/3430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:24 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1505 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:26.116755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:26.117388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:26.132243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.138437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.138909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.139668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.140136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.140574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.362358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:26.376580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:26.378171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:26.382523 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c3a37b26-5d6d-4f03-b312-e8321e04d486 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1339 microversion: 2.20 time: 0.287869 Oct 06 13:04:26.386140 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1706/3431] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:26 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:26.391014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:26.398851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:26.410793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.416246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.416941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.417928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.418587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.421352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.874615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:26.875444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:26.875950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:26.876372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:26.876797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:26.901020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.904376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.906007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.906997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:26.909958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:26.910749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:26.997478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:27.004151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for user d9bc79cb12634352b8fc75ea5bd40a61 and project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:27.029189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:27.034098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:27.191670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.210871 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b5bcf8b-4522-420e-a67e-48f8e3dce5fb tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369447 Oct 06 13:04:27.216510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.224298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.234083 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1726/3432] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:04:27.238473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62dbe87d-88ad-4169-a1d3-44ce942f22c3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 0.850996 Oct 06 13:04:27.244108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1707/3433] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:26 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:27.268846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:27.275585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:27.288705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c98fd5f9-d205-4877-ba9d-150ec9f3cbe1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:27.291168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c98fd5f9-d205-4877-ba9d-150ec9f3cbe1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:27.299310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.304922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.308037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:27.309161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.313527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.314100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:27.412938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.414300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63fc718a-f172-4eed-bdf5-544ff4deb62e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/os-instance-actions/req-506aef59-f1cb-4472-94d2-7b752862be03" status: 200 len: 313 microversion: 2.1 time: 0.174536 Oct 06 13:04:27.426993 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1727/3434] 10.222.0.26 () {58 vars in 1419 bytes} [Thu Oct 6 13:04:27 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/os-instance-actions/req-506aef59-f1cb-4472-94d2-7b752862be03 => generated 313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:27.438318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:27.439775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:27.475237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.477046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.477750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:27.479410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.480092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.480951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:27.643938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c98fd5f9-d205-4877-ba9d-150ec9f3cbe1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.662931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.672269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c98fd5f9-d205-4877-ba9d-150ec9f3cbe1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1207 microversion: 2.1 time: 0.419297 Oct 06 13:04:27.701431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1708/3435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:27 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1207 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:27.716001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.718722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:27.721229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:27.724357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:27.725668 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc1f3176-a34f-471c-b2e7-979ff02924eb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1339 microversion: 2.20 time: 0.294023 Oct 06 13:04:27.726282 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1728/3436] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:27 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1339 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:27.776393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.777152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.777452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:27.784020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:27.784615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:27.785072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:28.096652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87b66945-3508-41bb-9262-3b5d6f927525 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "POST /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/action" status: 202 len: 0 microversion: 2.1 time: 0.390194 Oct 06 13:04:28.101584 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1709/3437] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:04:27 2022] POST /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:04:28.107257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:28.107879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:28.147527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:28.160468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:28.161398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:28.165000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:28.186611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:28.191774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:28.272980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:28.273708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:28.312982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:28.315741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:28.316884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:28.332388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:28.333133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:28.333602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:28.956204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:28.969660 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0a02d82-cbcb-4dcc-be6e-df12e3ce14e6 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1507 microversion: 2.1 time: 0.865902 Oct 06 13:04:28.974659 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1729/3438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:28 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1507 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:29.090088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:29.107223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:29.109664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:29.113551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9265c3f-ad5a-40c0-a6cc-82d2702db90d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 0.846797 Oct 06 13:04:29.116450 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1710/3439] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:28 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:04:29.127837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:29.130280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:29.140038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:29.146739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:29.148457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:29.150475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:29.152798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:29.155073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:29.156670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:29.378559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f", "name": "network-vif-deleted", "tag": "4e0937c0-6bef-4946-8c2b-a8689c8d95da"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:29.413233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:29.413768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:29.427915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:29.480068 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] Creating event network-vif-deleted:4e0937c0-6bef-4946-8c2b-a8689c8d95da for instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f on n-h2-860556-1 Oct 06 13:04:29.495028 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2a756959-8d84-470b-bb58-5ff1a5f06253 req-416abddd-9fe1-4d0e-9776-f42d26f79941 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.519028 Oct 06 13:04:29.503962 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1730/3440] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:29.520735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:29.523519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:29.545754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:29.559406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:29.560890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:29.561911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:29.562573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:29.564010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:30.118477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:30.129221 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7fff6e9-fdfa-400f-a28e-d2bcdad4dcdf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1211 microversion: 2.1 time: 1.011246 Oct 06 13:04:30.133436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1711/3441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:29 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1211 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:30.494374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:30.503828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:30.506268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:30.514251 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-daba4c61-133f-44a7-b34d-5ea5374a44b6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 1.008616 Oct 06 13:04:30.515690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1731/3442] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:29 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:30.520711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:30.527265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:30.539202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6873ef75-1796-4925-9893-3fa3ffe9d1c2 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-48791207", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:30.543666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:30.544367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:30.547026 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6873ef75-1796-4925-9893-3fa3ffe9d1c2 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] HTTP exception thrown: min_count must be <= max_count Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6873ef75-1796-4925-9893-3fa3ffe9d1c2 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Request method failure captured: Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 182 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJd_x6LMkb-afS7SZy2UhJfY4v72pxZRHo4o8flyBJHDklfe58LoLYAvodZAGSg6AP08ZAjgRP1MFNNxe7Sm6M0-nzmrGwZfTAEzKXxIlwYxZxz4rV9sFN6xlzG8CUi1R4dpxOeFQn_L5FdqTDdZA80i7ZlGJQ1UoTFzXHWN_PHioo Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_217660d512cf4ef99d502d3d1b9b1fde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}] Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8abc2cf96ae4420ab33c18fd9c9b2881 Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-48791207", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: exception: min_count must be <= max_count Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-48791207', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 06 13:04:30.549016 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:30.556129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:30.556129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:30.558491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:30.558966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:30.560985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6873ef75-1796-4925-9893-3fa3ffe9d1c2 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Returning 400 to user: min_count must be <= max_count {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:30.562833 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6873ef75-1796-4925-9893-3fa3ffe9d1c2 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.427111 Oct 06 13:04:30.569079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1712/3443] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:30 2022] POST /compute/v2.1/servers => generated 74 bytes in 435 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 06 13:04:30.574556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:30.575454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:30.585594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:30.586475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:30.587148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:30.588096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:30.592893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:30.593711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:30.656229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:31.611142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:31.620710 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-54c2ac10-9d8a-4cee-9b67-c5b56d56a41e tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1507 microversion: 2.1 time: 1.103715 Oct 06 13:04:31.623548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1732/3444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:30 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1507 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:31.634495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab", "name": "network-vif-plugged", "status": "completed", "tag": "65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:31.658457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:31.664929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:31.665877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:31.687127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] Creating event network-vif-plugged:65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de for instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab on n-h1-860556-1 Oct 06 13:04:31.696850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:31.719497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:31.720181 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-59bd9c6a-f80e-4228-833e-056f38319e80 req-40e9c2a2-7e17-4cdc-9202-c88e3a507f3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087848 Oct 06 13:04:31.730613 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1733/3445] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:31.731550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:31.738402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d98e9c91-6637-48b0-9b5c-19b0540496ad tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 1.164617 Oct 06 13:04:31.739208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1713/3446] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:30 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:31.749360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c010fe08-9e57-4907-8f9e-466a7b046743 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2064752846", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "max_count": 0}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:31.756002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:31.760165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c010fe08-9e57-4907-8f9e-466a7b046743 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Request method failure captured: Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 168 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJd_x6LMkb-afS7SZy2UhJfY4v72pxZRHo4o8flyBJHDklfe58LoLYAvodZAGSg6AP08ZAjgRP1MFNNxe7Sm6M0-nzmrGwZfTAEzKXxIlwYxZxz4rV9sFN6xlzG8CUi1R4dpxOeFQn_L5FdqTDdZA80i7ZlGJQ1UoTFzXHWN_PHioo Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_217660d512cf4ef99d502d3d1b9b1fde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}] Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8abc2cf96ae4420ab33c18fd9c9b2881 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2064752846", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "max_count": 0}} Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2064752846', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'max_count': 0}}} Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi 0 Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:04:31.767776 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c010fe08-9e57-4907-8f9e-466a7b046743 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:31.773557 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c010fe08-9e57-4907-8f9e-466a7b046743 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039994 Oct 06 13:04:31.778971 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1734/3447] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:31.784945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:31.787941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:31.789210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:31.790730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:31.791612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:31.792751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:31.793879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:31.794658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:31.827254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:31.830568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:31.832565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:31.839703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:31.840602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:31.842940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:32.261781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:32.278406 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28d0fc58-7d49-4e31-b04b-a5ea9c70c3f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1265 microversion: 2.1 time: 0.535765 Oct 06 13:04:32.279348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1714/3448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:31 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1265 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:32.284225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56aff0f3-399f-40bd-b2c8-1fdcc950e405 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-796659896", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "max_count": 2.5}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56aff0f3-399f-40bd-b2c8-1fdcc950e405 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Request method failure captured: Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 169 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJd_x6LMkb-afS7SZy2UhJfY4v72pxZRHo4o8flyBJHDklfe58LoLYAvodZAGSg6AP08ZAjgRP1MFNNxe7Sm6M0-nzmrGwZfTAEzKXxIlwYxZxz4rV9sFN6xlzG8CUi1R4dpxOeFQn_L5FdqTDdZA80i7ZlGJQ1UoTFzXHWN_PHioo Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_217660d512cf4ef99d502d3d1b9b1fde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}] Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8abc2cf96ae4420ab33c18fd9c9b2881 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-796659896", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "max_count": 2.5}} Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-796659896', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'max_count': 2.5}}} Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 2.5 Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:04:32.303199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.315625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56aff0f3-399f-40bd-b2c8-1fdcc950e405 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:32.320802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56aff0f3-399f-40bd-b2c8-1fdcc950e405 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040151 Oct 06 13:04:32.323426 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1715/3449] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:32.434875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f149798-a16b-4088-902c-3512006979c0 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1372577908", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 0}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f149798-a16b-4088-902c-3512006979c0 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Request method failure captured: Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 168 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJd_x6LMkb-afS7SZy2UhJfY4v72pxZRHo4o8flyBJHDklfe58LoLYAvodZAGSg6AP08ZAjgRP1MFNNxe7Sm6M0-nzmrGwZfTAEzKXxIlwYxZxz4rV9sFN6xlzG8CUi1R4dpxOeFQn_L5FdqTDdZA80i7ZlGJQ1UoTFzXHWN_PHioo Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_217660d512cf4ef99d502d3d1b9b1fde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}] Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8abc2cf96ae4420ab33c18fd9c9b2881 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1372577908", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 0}} Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1372577908', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'min_count': 0}}} Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 0 Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:04:32.439441 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f149798-a16b-4088-902c-3512006979c0 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:32.444405 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f149798-a16b-4088-902c-3512006979c0 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010141 Oct 06 13:04:32.448481 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1716/3450] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:32.450652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:32.478124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:32.483810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:32.487457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bcdab324-ffc9-4637-bd55-388d203de52e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 0.706735 Oct 06 13:04:32.497137 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1735/3451] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:31 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:32.550557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a544f3b4-19de-4e6a-9d9f-08e6c5717360 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-568497572", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 2.5}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a544f3b4-19de-4e6a-9d9f-08e6c5717360 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Request method failure captured: Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 169 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJd_x6LMkb-afS7SZy2UhJfY4v72pxZRHo4o8flyBJHDklfe58LoLYAvodZAGSg6AP08ZAjgRP1MFNNxe7Sm6M0-nzmrGwZfTAEzKXxIlwYxZxz4rV9sFN6xlzG8CUi1R4dpxOeFQn_L5FdqTDdZA80i7ZlGJQ1UoTFzXHWN_PHioo Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_217660d512cf4ef99d502d3d1b9b1fde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/217660d512cf4ef99d502d3d1b9b1fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/217660d512cf4ef99d502d3d1b9b1fde"}]}] Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 217660d512cf4ef99d502d3d1b9b1fde Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558073969 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8abc2cf96ae4420ab33c18fd9c9b2881 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558073969-project Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-568497572", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 2.5}} Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-568497572', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'min_count': 2.5}}} Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 2.5 Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:04:32.564679 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a544f3b4-19de-4e6a-9d9f-08e6c5717360 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:32.569584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a544f3b4-19de-4e6a-9d9f-08e6c5717360 tempest-MultipleCreateNegativeTestJSON-558073969 tempest-MultipleCreateNegativeTestJSON-558073969-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024463 Oct 06 13:04:32.572777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1717/3452] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:32.655035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:32.656359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:32.672381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:32.674525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:32.678780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:32.680067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:32.682699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:32.684636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:32.768891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:32.770584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:32.804758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:32.816616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:32.817391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:32.818395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:32.820010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:32.821770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.176395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:33.185524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f06c721a-44f4-4574-a797-f01a58b2605c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1505 microversion: 2.1 time: 0.537979 Oct 06 13:04:33.202129 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1736/3453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:32 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:33.217035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '.version_select at 0x7f7d3ee6fdc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:33.219858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:33.247684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.250586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.251220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.252979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.257823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.260997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.330952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5381c25-0aba-482a-a12f-3b6bf038817c tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.118087 Oct 06 13:04:33.340275 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1737/3454] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Oct 6 13:04:33 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16/os-instance-actions => generated 611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:33.352981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:33.379192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.385352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.386384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.406988 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] Creating event network-changed:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:04:33.414663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c9531eca-680a-4373-a374-ce608efb63d5 req-3eed1afc-a748-4656-985a-297ab96e39dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072504 Oct 06 13:04:33.421817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1738/3455] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:33.427635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:33.434857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:33.448517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.453799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.454474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.455509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.457296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.459850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.481018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:33.521083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:33.542831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:33.548142 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad6d211b-131b-4955-9e62-097667213633 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1361 microversion: 2.26 time: 0.782691 Oct 06 13:04:33.550768 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1718/3456] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:32 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:33.557444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:33.558413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:33.566262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.567702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.568541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.573547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.574224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.574688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.647327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:04:33.843251 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6e900d4e-8b52-4744-877b-81f031c5ab87 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 204 len: 0 microversion: 2.1 time: 0.289436 Oct 06 13:04:33.850928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1719/3457] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:04:33 2022] DELETE /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:33.866269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:33.867683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:33.894565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:33.920599 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75eddd1a-21bc-41ba-85dc-6e3a9b1aa8fc tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1265 microversion: 2.1 time: 0.496556 Oct 06 13:04:33.925167 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1739/3458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:33 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1265 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:33.926190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.928532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.930184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.931255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.934220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.935229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.939847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:33.942930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:33.972849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.977427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.979233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:33.981562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:33.982325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:33.984033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:34.890226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:34.900564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:34.909007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa9a73c6-c9bc-4892-b42d-13afb47f83fb tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1511 microversion: 2.1 time: 0.978910 Oct 06 13:04:34.914701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1740/3459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:33 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1511 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:34.917144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:34.920745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:34.920902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:34.921375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:34.922015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5118f6a7-272a-4569-84e6-e713af1f8bd3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 1.068691 Oct 06 13:04:34.923422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:34.950304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1720/3460] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:33 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:34.958373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:34.959314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:34.961634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:34.962320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:34.963148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:34.964003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:34.964474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:34.966029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:34.983522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:34.984377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:34.985055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:34.987026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:34.990318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:34.991068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.024581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:35.190423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:35.204268 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ffefc220-679a-4b86-a539-cd90304ff69f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1265 microversion: 2.1 time: 0.252343 Oct 06 13:04:35.204881 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1721/3461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:34 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:35.403616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:35.430833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:35.432267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:35.433623 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ccdedf62-1a1c-470c-9156-5dd1d25141d0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1545 microversion: 2.26 time: 0.517963 Oct 06 13:04:35.434243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1741/3462] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:34 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1545 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:35.482531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d475bcaf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:35.542807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.545589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.548831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.549622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:35.559003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.559944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.561502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.562657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.563357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.564012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.632818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.634385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.635670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.686424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.688581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.692822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.755989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:35.788332 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38861bd9-a0a2-48a7-bf73-160d9dbc69c0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-994899503" status: 201 len: 0 microversion: 2.26 time: 0.313960 Oct 06 13:04:35.793407 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1722/3463] 10.222.0.26 () {62 vars in 1377 bytes} [Thu Oct 6 13:04:35 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-994899503 => generated 0 bytes in 320 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 06 13:04:35.800105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e231388-6dd4-4355-816c-21b179de4b1a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3eccae50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:35.817591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e231388-6dd4-4355-816c-21b179de4b1a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.819305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e231388-6dd4-4355-816c-21b179de4b1a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.824164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e231388-6dd4-4355-816c-21b179de4b1a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.862610 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e231388-6dd4-4355-816c-21b179de4b1a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-994899503" status: 204 len: 0 microversion: 2.26 time: 0.066437 Oct 06 13:04:35.864439 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1742/3464] 10.222.0.26 () {60 vars in 1358 bytes} [Thu Oct 6 13:04:35 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-994899503 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:35.875601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f2b4820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:35.895921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.896709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.897332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.898028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:35.913372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.914627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.915253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.916151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.916776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.917375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.932544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:35.934132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:35.944941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.950062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.950768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.952231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.952866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.953492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:35.985949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:35.987138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:35.987753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:36.028641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:36.056249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da476a9d-c009-4f0d-a37d-3fe0ac39464b tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.186804 Oct 06 13:04:36.058119 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1723/3465] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Oct 6 13:04:35 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:36.069439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:36.070545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:36.094832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:36.096687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:36.098893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:36.099939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:36.101131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:36.103046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:36.975620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:37.001036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:37.011518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9028e3b9-32cc-46b8-8bdd-2d8ac65b8666 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1511 microversion: 2.1 time: 1.082177 Oct 06 13:04:37.028516 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1743/3466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:35 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1511 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:37.036529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cb2047e-aa5e-4d3b-a910-535e059c506c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f006550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.043253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:37.048815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cb2047e-aa5e-4d3b-a910-535e059c506c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.049663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cb2047e-aa5e-4d3b-a910-535e059c506c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.050393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cb2047e-aa5e-4d3b-a910-535e059c506c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.064740 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cb2047e-aa5e-4d3b-a910-535e059c506c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.034865 Oct 06 13:04:37.066073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1744/3467] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 13:04:37 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:37.072332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.073307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.093398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.097546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.103002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.104083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.104686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.106250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.192738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:37.206276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:37.210230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:37.212888 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc2feef7-e002-4567-81b3-846e2851bfb8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 1.153589 Oct 06 13:04:37.215650 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1724/3468] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:36 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:37.230064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f2b43a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.253943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.254524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.255496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.255993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.274429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.278404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.278972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.279737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.280209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.280644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.342731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.343242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.345079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.369483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.371263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.371738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.418649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:37.455831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2fe20c5-f9bd-446f-b8f4-d5c4f86e53e1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1636038260" status: 201 len: 0 microversion: 2.26 time: 0.238897 Oct 06 13:04:37.462154 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1725/3469] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Oct 6 13:04:37 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1636038260 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 06 13:04:37.476370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe3d40cf-9c63-4f6b-9ff3-8c6ccdefbeba tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f2b4430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.492375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe3d40cf-9c63-4f6b-9ff3-8c6ccdefbeba tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.492789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe3d40cf-9c63-4f6b-9ff3-8c6ccdefbeba tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.493295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe3d40cf-9c63-4f6b-9ff3-8c6ccdefbeba tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.504041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe3d40cf-9c63-4f6b-9ff3-8c6ccdefbeba tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 36 microversion: 2.26 time: 0.039513 Oct 06 13:04:37.510359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1726/3470] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 13:04:37 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 36 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:37.517250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f1e00d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.532442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.533478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.534885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.535772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.552135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.552874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.554203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.555121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.555760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.556365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.591713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.593514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.594002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.597563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:37.643230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:37.650497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:37.668465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63cd166a-c7f3-48db-9477-d998ffa6b1d1 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1636038260" status: 204 len: 0 microversion: 2.26 time: 0.155770 Oct 06 13:04:37.670060 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1727/3471] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Oct 6 13:04:37 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1636038260 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:37.688992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea2c267b-8fdd-45df-8b04-547bee2006a3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f1e0af0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.701079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2c267b-8fdd-45df-8b04-547bee2006a3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.701943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2c267b-8fdd-45df-8b04-547bee2006a3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.702551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2c267b-8fdd-45df-8b04-547bee2006a3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.715411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea2c267b-8fdd-45df-8b04-547bee2006a3 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.040496 Oct 06 13:04:37.717634 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1728/3472] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 13:04:37 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 12 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:37.731274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3ea5a700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.740930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.741809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.742354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.743047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.750545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.751152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.751722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.752633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.753217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.753781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.785104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.786509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.787235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.800560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:37.821153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20e525dc-7870-4f40-89ba-259c1db6346f tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.097603 Oct 06 13:04:37.828720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1729/3473] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Oct 6 13:04:37 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:37.836609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3eaa1280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.849192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.849934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.850438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.851133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.860033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.860543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.861204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.862203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.862681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.863177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.900906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.901643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.902129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.914321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.914815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.915263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.946526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:37.964151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a9c28e2-d309-4a0b-adcc-0c6b4afbcf60 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-339631876" status: 201 len: 0 microversion: 2.26 time: 0.134035 Oct 06 13:04:37.970830 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1730/3474] 10.222.0.26 () {62 vars in 1377 bytes} [Thu Oct 6 13:04:37 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-339631876 => generated 0 bytes in 141 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 06 13:04:37.977680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f3ae9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:37.988718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.989931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.990393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.991253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:37.997954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:37.998390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:37.998841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:37.999556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.000021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.000460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.075735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.076242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.076696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.103191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.103695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.104145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.163629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:38.196588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87fa18b0-7a3a-4357-ae57-e36ff3300703 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-863975963" status: 201 len: 0 microversion: 2.26 time: 0.224351 Oct 06 13:04:38.197279 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1731/3475] 10.222.0.26 () {62 vars in 1377 bytes} [Thu Oct 6 13:04:37 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-863975963 => generated 0 bytes in 226 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 06 13:04:38.206227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:38.207038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:38.214275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.214784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.215420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.217089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.217576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.218051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.530111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:38.544534 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-270bbeae-3eb4-41a6-ab5e-83806fbe0990 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1469 microversion: 2.1 time: 0.345898 Oct 06 13:04:38.545927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1732/3476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:38 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:38.562164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f1baca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:38.577065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.577978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.582734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.583455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:38.595231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.596417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.598438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.602216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.602922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.603624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.647627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:38.660553 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0e81b61-e459-4df0-9bf2-48d7c5639f59 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 1.592743 Oct 06 13:04:38.660989 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1745/3477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:37 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:38.672648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.673153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.673599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.682456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:38.683093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:38.710948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.711446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.711894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.722766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.725709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.727923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.735946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:38.813604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9bb898b-5e50-4837-8247-b2575c7fa98d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.266291 Oct 06 13:04:38.820287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1733/3478] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Oct 6 13:04:38 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:38.836275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da184d7d-ef68-4cff-bf1c-5908508c023d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f747f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:38.865432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da184d7d-ef68-4cff-bf1c-5908508c023d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.865967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da184d7d-ef68-4cff-bf1c-5908508c023d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.866413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da184d7d-ef68-4cff-bf1c-5908508c023d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.890365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da184d7d-ef68-4cff-bf1c-5908508c023d tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.059633 Oct 06 13:04:38.890999 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1734/3479] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 13:04:38 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:38.901726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f74c280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:38.920655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.921156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.921599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.922109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:38.937927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.938429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.938875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.939596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.940059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.940490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:38.988667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:38.989761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:38.993686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.022790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:39.083959 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cec7d03a-190d-43bb-a5d1-f08cf28514f6 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.186126 Oct 06 13:04:39.084672 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1735/3480] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Oct 6 13:04:38 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:04:39.089127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f298bf9-f917-413c-96a7-d58ba80f3c16", "name": "network-vif-deleted", "tag": "096c27bb-9a7a-476f-a797-fc1cebbffe95"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:39.128617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.129231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.129862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.147953 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] Creating event network-vif-deleted:096c27bb-9a7a-476f-a797-fc1cebbffe95 for instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 on n-h2-860556-1 Oct 06 13:04:39.168029 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7c74d64b-ec03-49b9-9d92-aa476f7f356f req-0465b7ec-1fc1-4180-a3c1-3cd59c51adc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080228 Oct 06 13:04:39.169899 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1736/3481] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:39.179191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3eb01550>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:39.224987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.225672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.225964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.226585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:39.245127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.246164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.246649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.249655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.250258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.250655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.352842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.354726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.357412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.375549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.376313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.377257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.459771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:39.469665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:39.490985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:39.492868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:39.494289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2498fe45-d960-4d8c-9c2b-da3d2d78e38a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 0.823383 Oct 06 13:04:39.495381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1746/3482] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:38 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:39.497412 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ed4aeb8-7238-4a84-9dab-ddf39ae80906 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1164528026" status: 201 len: 0 microversion: 2.26 time: 0.324942 Oct 06 13:04:39.498526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1737/3483] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Oct 6 13:04:39 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1164528026 => generated 0 bytes in 328 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 06 13:04:39.512773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3eccac10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:39.527417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.529565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.534475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.535258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:39.546677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.558547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.559737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.560703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.561364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.562040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.587830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:39.591669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:39.626691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.627909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.632106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.643955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.644445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.644974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.645643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.647477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.647929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.675100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.675608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.676019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.713817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:39.744107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:39.754134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.755394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.755842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.759275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lazy-loading 'fault' on Instance uuid 7f298bf9-f917-413c-96a7-d58ba80f3c16 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:39.881619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21c5792a-3be9-42c6-abac-4e4e92fed6b7 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1111416387" status: 201 len: 0 microversion: 2.26 time: 0.372602 Oct 06 13:04:39.883287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1747/3484] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Oct 6 13:04:39 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags/tempest-tag-1111416387 => generated 0 bytes in 375 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 06 13:04:39.889221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:39.890253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:39.907581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a19df443251444dbd5f575994affff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7db924891d4a4b9963dffe3c907a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:39.920888 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e2167b0-7f9b-4f3b-8efd-9b5a22ba0908 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 200 len: 1307 microversion: 2.1 time: 0.350669 Oct 06 13:04:39.921211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.921821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.923250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.923993 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1738/3485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:39 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:39.926210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.927685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.928380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.953695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Action: 'update_all', calling method: .version_select at 0x7f7d3f74c040>, body: {"tags": ["tempest-tag-1970172878", "tempest-tag-1193554435"]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:39.983400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.984074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.984662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.985300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:39.994224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.994886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.995546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:39.996417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:39.997282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:39.999134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.030783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.031610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.032008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.063402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:40.110793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ff3a997-368e-4dc3-9e54-c42a94eb49a0 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 62 microversion: 2.26 time: 0.162906 Oct 06 13:04:40.112539 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1739/3486] 10.222.0.26 () {62 vars in 1312 bytes} [Thu Oct 6 13:04:39 2022] PUT /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 62 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:40.127259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a935f31-13a0-4439-a828-292a2742a4aa tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d3f1ba5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:40.137103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a935f31-13a0-4439-a828-292a2742a4aa tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.137601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a935f31-13a0-4439-a828-292a2742a4aa tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.138085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a935f31-13a0-4439-a828-292a2742a4aa tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.176479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a935f31-13a0-4439-a828-292a2742a4aa tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 200 len: 62 microversion: 2.26 time: 0.056229 Oct 06 13:04:40.178994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1740/3487] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Oct 6 13:04:40 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 62 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:40.193643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '.version_select at 0x7f7d475bc550>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:40.209077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.209581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.210078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.210574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:40.235622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.236276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.236604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.238306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.238835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.239280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.252074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:40.269268 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69c03715-9d4f-4b4d-af32-f6559d402191 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 0.383193 Oct 06 13:04:40.269987 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1748/3488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:39 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:40.322768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.323278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.323730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.367038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'flavor' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:40.389126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5eef87e-b957-4b80-902c-e4c8679db9ab tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.202983 Oct 06 13:04:40.390696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288eff98-ad91-480a-bf5c-2756bdf40bb2", "tag": "ec31873b-7c34-4d36-b17b-0325f7d7dca5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:40.392148 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1741/3489] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Oct 6 13:04:40 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab/tags => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:04:40.411607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:40.414471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:40.430502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.431014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.433956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.434924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.435418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.435867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.440645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.441153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.441598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.495849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] Creating event network-changed:ec31873b-7c34-4d36-b17b-0325f7d7dca5 for instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 on n-h2-860556-1 Oct 06 13:04:40.514238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-12fdf389-7b73-49d6-846c-7176b68d7abb req-50471fee-a23c-49e8-b868-fc706eeb0590 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133041 Oct 06 13:04:40.515615 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1749/3490] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:04:40.537055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:40.538266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:40.541559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:04:40.558099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.559703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.560797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.564497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.565218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.568128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.776451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc6e1d8d-b7f9-4fb7-aa14-395dad1d3bec tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 204 len: 0 microversion: 2.26 time: 0.370387 Oct 06 13:04:40.790077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1742/3491] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:04:40 2022] DELETE /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:04:40.792917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:40.793632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:40.801118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.802721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.802996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:40.803710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:40.804165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:40.810879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.118748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:41.132912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:41.134404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:41.135548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b6edee3b-d20c-4a9b-a082-37144dad799c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 0.616400 Oct 06 13:04:41.136118 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1750/3492] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:40 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:41.155898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:41.156854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] [instance: 7f298bf9-f917-413c-96a7-d58ba80f3c16] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:41.170396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:41.170894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:41.171336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.172065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:41.172524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:41.172949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.204315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] HTTP exception thrown: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Request method failure captured: Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 HTTP/1.1 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtIuVROTph8kew1Qj-TKVOGbZ7BI35gdDZMk1oLajm4PsvKCUNQNfdgK36aPFon1YoctlRG6hU-JZ-HFHij6odjSR0yvKrFmLhx_5vBxZC36nfbOMNwbikIxdnIjSfkO6S-1S0x49IQxEkl1HBCzj9nEF81WKnTRv3VbtsWygxQa7_4 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 4d7db924891d4a4b9963dffe3c907a00 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-InstanceActionsTestJSON-2040725271 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d7db924891d4a4b9963dffe3c907a00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d7db924891d4a4b9963dffe3c907a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d7db924891d4a4b9963dffe3c907a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d7db924891d4a4b9963dffe3c907a00"}]}] Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-InstanceActionsTestJSON-2040725271 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 4d7db924891d4a4b9963dffe3c907a00 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2040725271 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-InstanceActionsTestJSON-2040725271-project Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 3a19df443251444dbd5f575994affff7 Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-InstanceActionsTestJSON-2040725271-project Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7f298bf9-f917-413c-96a7-d58ba80f3c16'} Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:41.216521 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. Oct 06 13:04:41.221219 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:04:41.222611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] Returning 404 to user: Instance 7f298bf9-f917-413c-96a7-d58ba80f3c16 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:41.224051 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b93ef206-93b5-43d8-87df-d1d5aaecd680 tempest-InstanceActionsTestJSON-2040725271 tempest-InstanceActionsTestJSON-2040725271-project] 10.222.0.26 "GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16" status: 404 len: 111 microversion: 2.1 time: 0.078393 Oct 06 13:04:41.224895 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1751/3493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:41 2022] GET /compute/v2.1/servers/7f298bf9-f917-413c-96a7-d58ba80f3c16 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:04:41.233626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-plugged", "status": "completed", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:41.245706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:41.247165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:41.247875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.269204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] Creating event network-vif-plugged:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:04:41.276507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a907b473-72f1-4960-a1dd-2e16e5b919b1 req-2ec185b6-19b2-425d-9963-f45f5da14d39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050453 Oct 06 13:04:41.278734 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1752/3494] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:41.304724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:41.310567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:41.329687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:41.330850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:41.333429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.336109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:41.336612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:41.337064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:41.988175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:42.009327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:42.015292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:42.017349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc24cd8b-8d37-4e93-b385-cd9df2f9377c tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1551 microversion: 2.26 time: 1.229092 Oct 06 13:04:42.024731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1743/3495] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:40 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1551 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:42.164693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:42.165467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:42.180016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:42.184018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:42.185084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:42.189408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:42.190238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:42.190990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:42.510255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:42.521672 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88e2fe4e-f25f-46d2-8e08-40e9879e0060 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 1.226157 Oct 06 13:04:42.543055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1753/3496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:41 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:42.815722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef29e9e2-3947-4ef7-8a81-8db30814ef3e tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] Calling method '.version_select at 0x7f7d3ed7a3a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:42.890083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef29e9e2-3947-4ef7-8a81-8db30814ef3e tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] 10.222.0.26 "GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2" status: 200 len: 784 microversion: 2.1 time: 0.342392 Oct 06 13:04:42.892017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1754/3497] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:04:42 2022] GET /compute/v2.1/images/9c012702-c0af-44bb-9be6-c3831386ffe2 => generated 784 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:42.912363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff1f81c3-40a3-45d7-9e9d-83550a3c4977 tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] Calling method '.version_select at 0x7f7d3ef4c5e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:42.991681 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff1f81c3-40a3-45d7-9e9d-83550a3c4977 tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.085923 Oct 06 13:04:42.994853 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1755/3498] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Oct 6 13:04:42 2022] GET /compute/v2.1/images => generated 445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:04:43.007212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7e3a01c-27ab-4652-8544-2e6227357231 tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] Calling method '.version_select at 0x7f7d3e6d0c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:43.139374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7e3a01c-27ab-4652-8544-2e6227357231 tempest-ListImagesTestJSON-1525607834 tempest-ListImagesTestJSON-1525607834-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.136943 Oct 06 13:04:43.140769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1756/3499] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 13:04:43 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:43.156347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:43.159896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:43.190813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:43.191328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:43.191832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:43.193077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:43.193542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:43.200547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:43.315234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.330873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.334390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.338269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be12d4a1-c27b-4f9d-b39d-fabf73aa78c2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1407 microversion: 2.20 time: 1.178672 Oct 06 13:04:43.344221 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1744/3500] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:42 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1407 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:43.556328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:43.556946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:43.578140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:43.578812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:43.579277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:43.581648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:43.582200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:43.583207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:43.750502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.767549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.771485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:43.775444 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7f1bacb-2524-45a0-85fa-6730712e1547 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1551 microversion: 2.26 time: 0.633739 Oct 06 13:04:43.776496 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1757/3501] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:43 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1551 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:44.011146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:44.026364 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e8ce39fe-bef7-4804-bdcf-07088b0e9fd2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 0.474507 Oct 06 13:04:44.052152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1745/3502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:43 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:44.377539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:44.378485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:44.417051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.417555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.421601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.423893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.424877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.425534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.579992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab", "name": "network-vif-deleted", "tag": "65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:44.604260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:44.614977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.615503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.615980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.703770 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] Creating event network-vif-deleted:65e115d0-8b08-4ef8-a2b9-a5a1d5ddc7de for instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab on n-h1-860556-1 Oct 06 13:04:44.737388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ba9a5de6-c2c9-40b0-99eb-cba164c407ac req-4fa8cb41-42bb-4ded-b477-5ec7747d433a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154073 Oct 06 13:04:44.740442 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1746/3503] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:04:44.812026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:44.813567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:44.836814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.850687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.851270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.851985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.852456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.852894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.978193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:44.980744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:44.985542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:44.986495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lazy-loading 'fault' on Instance uuid 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:45.248500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.256966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.261960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b2fdc08156b49f59ecaa01f19dd4285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c379343e9fdb4210ba1f500cccadc8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.265397 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b77b5601-86b5-449f-ab3e-4f72a0a8b91a tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 200 len: 1351 microversion: 2.26 time: 0.465604 Oct 06 13:04:45.278471 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1747/3504] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:44 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 1351 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:45.296593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.309205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.311181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:45.316721 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82ee8330-fe8e-4f66-b0f2-7b4982429713 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1600 microversion: 2.20 time: 0.943889 Oct 06 13:04:45.318330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:45.319541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:45.322384 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1758/3505] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:44 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1600 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:04:45.335377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:45.336538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:45.338079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:45.343153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:45.347989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:45.349575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:45.359266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:45.359779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:45.366254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:45.366759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:45.367204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:45.367919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:45.368381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:45.368812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:46.275262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f38696a-b666-4d1f-9503-9c0935220e05 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.919822 Oct 06 13:04:46.293451 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1759/3506] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 13:04:45 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-interface => generated 285 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:04:46.632626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:46.643274 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7acfa043-7e7a-4036-a76a-b65792b66562 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 1.363286 Oct 06 13:04:46.649089 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1748/3507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:45 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:46.658997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:46.663580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] [instance: 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:46.674036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:46.679625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:46.680306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:46.681148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:46.681728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:46.682292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:46.716739 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] HTTP exception thrown: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Request method failure captured: Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab HTTP/1.1 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJB6Zx7goKmrnj_-QMWbVp9KWTGObUeFkusGvcl_6JoTZsa6pqr-ijQw8C83QSi9qE-7iph42drtNbszKqkuc1aSI4CMAQnv6Wpu7UWLklYwc7g6T71qYBHJYkBGBB3VYn3hPk0waX-_HNMY_y9Fvay_3hOM7Ql4DN_2z3jp_cwKtU Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.26 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c379343e9fdb4210ba1f500cccadc8df Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerTagsTestJSON-1131695231 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c379343e9fdb4210ba1f500cccadc8df", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c379343e9fdb4210ba1f500cccadc8df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c379343e9fdb4210ba1f500cccadc8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c379343e9fdb4210ba1f500cccadc8df"}]}] Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerTagsTestJSON-1131695231 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c379343e9fdb4210ba1f500cccadc8df Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerTagsTestJSON-1131695231 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerTagsTestJSON-1131695231-project Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6b2fdc08156b49f59ecaa01f19dd4285 Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerTagsTestJSON-1131695231-project Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab'} Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:04:46.718616 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] Returning 404 to user: Instance 1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:04:46.725626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c26b304-99aa-4094-8096-7eef15fe5839 tempest-ServerTagsTestJSON-1131695231 tempest-ServerTagsTestJSON-1131695231-project] 10.222.0.26 "GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab" status: 404 len: 111 microversion: 2.26 time: 0.072333 Oct 06 13:04:46.731706 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1749/3508] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:04:46 2022] GET /compute/v2.1/servers/1cabc84b-8fc2-4573-aeb8-94b3ad6fd5ab => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:04:46.735732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1319017395", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a6b5fc47-3c94-4679-a037-812e2a29f7af"}], "security_groups": [{"name": "tempest-securitygroup--1974723529"}], "key_name": "tempest-keypair-662139321", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "479dfa81-416a-419b-8c6a-72da870cfd64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:46.872662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1099765527", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "cb18dde0-5f57-4490-905b-b703bca4067b"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:46.947351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] validate_networks() for [('cb18dde0-5f57-4490-905b-b703bca4067b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:47.236064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] validate_networks() for [('a6b5fc47-3c94-4679-a037-812e2a29f7af', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:48.937405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:48.938608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:48.939572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:48.940506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:48.941141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:48.953348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:48.954255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:48.955574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:48.956553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:48.957764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:48.958436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:48.994268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Getting quotas for project 5b900a549a3e492cb10a9c202b04792e. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:49.000782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Getting quotas for user 73a8fe6f5f914ca5a44d5c455e8fdb4c and project 5b900a549a3e492cb10a9c202b04792e. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:49.023400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:49.031280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:49.098690 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9733a1f-5d6c-4a7a-9e5c-7e112711a32e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.801264 Oct 06 13:04:49.100112 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1760/3509] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:04:49.351141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de691de6-9f00-4bf3-b8f1-d63a50841522 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3ee99ca0>, body: {"keypair": {"name": "tempest-keypair-585048456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbgVjXn92B3lr3BbbgPEu/jrGz40n1pyXb+Ob2+/JGu7abmdqzZp+EhNOf/DEztBnLhrUp4Z7pMuvBvVZGwsnaRfl4Tp9nsZa3ZiVabLWG7zMI71dM3E+LZDU4R6130g=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:49.404319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-de691de6-9f00-4bf3-b8f1-d63a50841522 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:49.419490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for project 174e3c56e3314cb5b80f05ad67b81926. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:49.428207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-de691de6-9f00-4bf3-b8f1-d63a50841522 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:49.442674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for user ecb911264e82477bb5fb733db5655391 and project 174e3c56e3314cb5b80f05ad67b81926. Resources: dict_keys(['metadata_items']) {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:49.474350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:49.475955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:49.477833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:49.479068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:49.480526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:49.489565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de691de6-9f00-4bf3-b8f1-d63a50841522 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.386545 Oct 06 13:04:49.492518 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1761/3510] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:49.502458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:49.503652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:49.550262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:49.550763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:49.551243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:49.551978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:49.552435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:49.552871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:49.556013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:49.556497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:49.557099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:49.557842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:49.558305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:49.558737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:49.604593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for project 174e3c56e3314cb5b80f05ad67b81926. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:49.623914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Getting quotas for user ecb911264e82477bb5fb733db5655391 and project 174e3c56e3314cb5b80f05ad67b81926. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:49.795649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:49.799100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='479dfa81-416a-419b-8c6a-72da870cfd64',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:50.159922 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a297f5fa-16ba-482f-b500-4f8ab3eb92e5 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.430107 Oct 06 13:04:50.168933 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1750/3511] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 3438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:04:50.178443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:50.202429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:50.202837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:50.203271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:50.250718 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] Creating event network-changed:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:04:50.266625 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cbd0004b-417e-4de7-a513-54fa7c0f571f req-8d961f50-843e-4be5-ab7f-8ee89da0a2cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096300 Oct 06 13:04:50.269055 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1751/3512] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:50.277682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288eff98-ad91-480a-bf5c-2756bdf40bb2", "name": "network-vif-plugged", "status": "completed", "tag": "ec31873b-7c34-4d36-b17b-0325f7d7dca5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:50.307609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:50.311671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:50.312378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:50.342919 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] Creating event network-vif-plugged:ec31873b-7c34-4d36-b17b-0325f7d7dca5 for instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 on n-h2-860556-1 Oct 06 13:04:50.376693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e8991272-d2e5-4b01-b430-52bfee28789f req-29d3d36a-de93-401b-a262-5ba0e00b3b89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105922 Oct 06 13:04:50.377317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1752/3513] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:50.400922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:50.408873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:50.421379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:50.424593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:50.426943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:50.430244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:50.431571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:50.432879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:50.690974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:50.705988 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6b91f8d-9238-4548-9834-a1188141b1df tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 1.208422 Oct 06 13:04:50.707351 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1762/3514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:49 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:50.723853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:50.732761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ffce4ca5-14d4-4e89-bb8a-5a34509961c5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1232 microversion: 2.1 time: 0.342659 Oct 06 13:04:50.733516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acd344eb-9104-457b-a023-653b6ffcb210 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3ed69a60>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:50.750535 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1753/3515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:50 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1232 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:50.774427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb9e0ac9-9110-4c54-80ca-67656a035e7c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:50.775743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb9e0ac9-9110-4c54-80ca-67656a035e7c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:50.782613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acd344eb-9104-457b-a023-653b6ffcb210 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-585048456" status: 200 len: 512 microversion: 2.2 time: 0.070940 Oct 06 13:04:50.784187 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1763/3516] 10.222.0.26 () {60 vars in 1255 bytes} [Thu Oct 6 13:04:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-585048456 => generated 512 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:50.797798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b274146-bd6d-4346-8729-2c39a962cabf tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3ed7c1f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:50.875659 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b274146-bd6d-4346-8729-2c39a962cabf tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585048456" status: 204 len: 0 microversion: 2.2 time: 0.081526 Oct 06 13:04:50.876438 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1764/3517] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Oct 6 13:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585048456 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:04:50.891384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9af7cbff-edf6-4b98-8c3f-6ddffad7fab0 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3e7148b0>, body: {"keypair": {"name": "tempest-keypair-1594418405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq/mkKD50R9J7MsCrOK0ftQawyX4xpmRgBomTBhCTI3H7JQKrnPQSRq1qz/eioaGsJymHaZ2AFDLMSCHmH+MtoIkuXrNpcPifxRYaJirabRrIy4M37qwhNDKbhrT3NpnA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:50.937357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9af7cbff-edf6-4b98-8c3f-6ddffad7fab0 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:50.945906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb9e0ac9-9110-4c54-80ca-67656a035e7c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:50.962280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb9e0ac9-9110-4c54-80ca-67656a035e7c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1121 microversion: 2.1 time: 0.197789 Oct 06 13:04:50.963928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9af7cbff-edf6-4b98-8c3f-6ddffad7fab0 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:50.967581 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1754/3518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:50 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1121 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:51.009249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9af7cbff-edf6-4b98-8c3f-6ddffad7fab0 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.123943 Oct 06 13:04:51.015453 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1765/3519] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:51.022026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37b0868d-74c5-4f56-8a64-7bed102b123c tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f7da8b0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.087629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37b0868d-74c5-4f56-8a64-7bed102b123c tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594418405" status: 204 len: 0 microversion: 2.2 time: 0.069921 Oct 06 13:04:51.088481 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1755/3520] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Oct 6 13:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594418405 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:51.102628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77ebc6e7-480b-479f-b800-7cb1a70f6798 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3e714f70>, body: {"keypair": {"name": "tempest-keypair-283464669", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:51.152516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-77ebc6e7-480b-479f-b800-7cb1a70f6798 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:51.168325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-77ebc6e7-480b-479f-b800-7cb1a70f6798 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:51.233967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77ebc6e7-480b-479f-b800-7cb1a70f6798 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.139505 Oct 06 13:04:51.235179 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1766/3521] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:51 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:51.246085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0395c83b-21f5-4cbc-aa5a-15373fad7aaf tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f462dc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.269468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0395c83b-21f5-4cbc-aa5a-15373fad7aaf tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283464669" status: 204 len: 0 microversion: 2.2 time: 0.027620 Oct 06 13:04:51.271793 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1756/3522] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Oct 6 13:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283464669 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:51.285289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7b8f63a-d65b-4000-bee2-a4adc68bb14e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3ed7c4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1585840526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpFKZUa64C3fSBvl1KS4ZYNDli/1FoiRaUqRQ1V0+r/5K2GaZF1GS+z9wGJzevpQhONHWvGU425pC5eMeoZj5nRBs8eHRR+ZTxg1zbunZPEq1apXHcK8I43H/ajO2lpRQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:51.302725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b7b8f63a-d65b-4000-bee2-a4adc68bb14e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:51.309547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b7b8f63a-d65b-4000-bee2-a4adc68bb14e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:51.312502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:51.341856 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7b8f63a-d65b-4000-bee2-a4adc68bb14e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060914 Oct 06 13:04:51.354698 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1767/3523] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:51.359284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10014bfa-e51e-41b1-b7d8-8a7ccbfaadba tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3fe2b280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-225745530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETnVps6Mv53eDyu3pjr+GFIeuH1GQlxzc/9poejjadAw3K0t5nFufqmEH2BFJ5FaA5pQyEgS/MZLFuODELK1tx8JHhjnvLEQSyPxN0z9YJErr4aGddJqzMQMetuQi1mQA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:51.391992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-10014bfa-e51e-41b1-b7d8-8a7ccbfaadba tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:51.407740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-10014bfa-e51e-41b1-b7d8-8a7ccbfaadba tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:51.468787 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10014bfa-e51e-41b1-b7d8-8a7ccbfaadba tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.113559 Oct 06 13:04:51.469772 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1757/3524] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:51.489012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a045756-16fc-4c64-bc01-faddd946e276 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3ed69c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-140473644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpppx+0YfPz7LoImdI9nBj7YpdTqYx35Qs1E/lmO7zHIqC+Y9j0itaGzx5b/TAUyTPof1hHbMVF/pmZijYvRWy7wuA+egltbm+/fxiLr+cUmmLdwIXMfo+fwKlwFfrs6g=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:51.537604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4a045756-16fc-4c64-bc01-faddd946e276 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:51.543834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4a045756-16fc-4c64-bc01-faddd946e276 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:51.606810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a045756-16fc-4c64-bc01-faddd946e276 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.127012 Oct 06 13:04:51.607446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1768/3525] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:51.624975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c311621f-da0a-43ed-ae85-8021c9f4c224 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3fb2d040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.635588 n-d-860556-1 devstack@n-api.service[129614]: WARNING oslo_db.sqlalchemy.utils [None req-c311621f-da0a-43ed-ae85-8021c9f4c224 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 13:04:51.644097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c311621f-da0a-43ed-ae85-8021c9f4c224 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.028750 Oct 06 13:04:51.657265 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1758/3526] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Oct 6 13:04:51 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:51.668172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c732ae8-867b-4bd5-bf9f-876f21d6fae6 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3e714430>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.704496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c732ae8-867b-4bd5-bf9f-876f21d6fae6 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-140473644" status: 204 len: 0 microversion: 2.2 time: 0.033699 Oct 06 13:04:51.710961 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1769/3527] 10.222.0.26 () {60 vars in 1318 bytes} [Thu Oct 6 13:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-140473644 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:51.721669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a16ee6ee-6368-48ca-a9fe-26d281ad367c tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f7da040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.749771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.751387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:51.786600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:51.787490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:51.789068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:51.795243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:51.796370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a16ee6ee-6368-48ca-a9fe-26d281ad367c tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-225745530" status: 204 len: 0 microversion: 2.2 time: 0.080640 Oct 06 13:04:51.796526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:51.797690 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1759/3528] 10.222.0.26 () {60 vars in 1318 bytes} [Thu Oct 6 13:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-225745530 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:51.798424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:51.820910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:51.822183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:51.832073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:51.833423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:51.834277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:51.835222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:51.835922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:51.836889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:52.115001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:52.118492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:52.129462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8756e5c-7e72-4013-863e-9f5b991a8ccf tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1288 microversion: 2.1 time: 0.329837 Oct 06 13:04:52.130608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1760/3529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:51 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1288 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:52.137517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d58df0c-d7c5-4c99-a91b-630f39e26bb4 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f33c430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:52.177629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d58df0c-d7c5-4c99-a91b-630f39e26bb4 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1585840526" status: 204 len: 0 microversion: 2.2 time: 0.045065 Oct 06 13:04:52.179075 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1761/3530] 10.222.0.26 () {60 vars in 1321 bytes} [Thu Oct 6 13:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1585840526 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:52.193929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:52.198799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:52.228179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:52.228921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:52.229388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:52.230186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:52.230665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:52.231196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:52.403781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:52.413878 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1cda2016-c2da-4ab3-abaf-959763932e2c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1163 microversion: 2.1 time: 0.233765 Oct 06 13:04:52.422863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1762/3531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:52 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1163 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:52.428748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad2cbfbb-e5ee-43ba-8d0a-eb129eb5d052 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3fb2d700>, body: {"keypair": {"name": "tempest-keypair-2047843004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLcgcF7E2DkQlqQSKa7K9N5QzJlmHBAbTKm89nNAOOyREgmicABDMLYTIEtlF5+zXbFKR5pkH5UzwXWNeAlWvgyt/Mv3195gDd9e0YEf2Ne3ENUlh1Iji9PXnTs+ZSWzQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:52.484214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ad2cbfbb-e5ee-43ba-8d0a-eb129eb5d052 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:52.500490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ad2cbfbb-e5ee-43ba-8d0a-eb129eb5d052 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:52.507024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:52.527921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ba608c5-74fe-417a-a630-63171c192a9e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1307 microversion: 2.1 time: 0.795938 Oct 06 13:04:52.530069 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1770/3532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:51 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1307 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:52.581802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad2cbfbb-e5ee-43ba-8d0a-eb129eb5d052 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.157347 Oct 06 13:04:52.582964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1763/3533] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Oct 6 13:04:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 06 13:04:52.595458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd075b98-7b23-4ef7-9e92-52daca519ca7 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f7abee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:52.605997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd075b98-7b23-4ef7-9e92-52daca519ca7 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-2047843004" status: 200 len: 513 microversion: 2.2 time: 0.015201 Oct 06 13:04:52.614718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1764/3534] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Oct 6 13:04:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2047843004 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:52.620467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f799359b-47b9-4a9d-98b0-1ac9c911dcd3 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f1ba670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:52.625391 n-d-860556-1 devstack@n-api.service[129614]: WARNING oslo_db.sqlalchemy.utils [None req-f799359b-47b9-4a9d-98b0-1ac9c911dcd3 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 13:04:52.632340 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f799359b-47b9-4a9d-98b0-1ac9c911dcd3 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016163 Oct 06 13:04:52.639931 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1765/3535] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Oct 6 13:04:52 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:52.648608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-486b68c3-a212-4e89-a132-ed41edfe9dc7 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f78d040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:52.679743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-486b68c3-a212-4e89-a132-ed41edfe9dc7 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047843004" status: 204 len: 0 microversion: 2.2 time: 0.038176 Oct 06 13:04:52.680806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1766/3536] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Oct 6 13:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047843004 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:52.692317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Action: 'create', calling method: .version_select at 0x7f7d3f3fda60>, body: {"keypair": {"name": "tempest-keypair-1388365765", "type": "x509"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:52.700366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:52.707782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-320613236", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "1419e5b5-e386-44f6-820e-6286b286e95b"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:52.724114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:52.764354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:52.803833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.processutils [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpe_sk09d6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpe_sk09d6/temp.key -subj /CN=0089465312e34e128b9f9a62166f56df -extensions v3_req_client {{(pid=129614) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 06 13:04:52.812799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] validate_networks() for [('1419e5b5-e386-44f6-820e-6286b286e95b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:04:52.933522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.processutils [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpe_sk09d6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpe_sk09d6/temp.key -subj /CN=0089465312e34e128b9f9a62166f56df -extensions v3_req_client" returned: 0 in 0.129s {{(pid=129614) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 06 13:04:52.935193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.processutils [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpe_sk09d6/temp.key -password pass: {{(pid=129614) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 06 13:04:52.973665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.processutils [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpe_sk09d6/temp.key -password pass:" returned: 0 in 0.037s {{(pid=129614) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 06 13:04:53.059492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:53.076884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Getting quotas for user 0089465312e34e128b9f9a62166f56df and project 8aa2583b8e764263beaacf8926df873e. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:53.112816 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5277f1be-1a69-495a-b712-e108ab38f60f tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.425561 Oct 06 13:04:53.125594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1767/3537] 10.222.0.26 () {62 vars in 1198 bytes} [Thu Oct 6 13:04:52 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:53.137450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-039c28b7-d351-4e9a-a87f-df881643a824 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3fd8f4c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:53.163979 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-039c28b7-d351-4e9a-a87f-df881643a824 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1388365765" status: 200 len: 1534 microversion: 2.2 time: 0.036934 Oct 06 13:04:53.164908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1768/3538] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Oct 6 13:04:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1388365765 => generated 1534 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:53.177066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:53.178466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:53.186578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:53.188243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:53.188898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:53.189945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:53.190591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:53.192682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:53.855171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:53.869633 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be7b302d-7532-47e2-b1f0-5407faaa9944 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.702421 Oct 06 13:04:53.870403 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1769/3539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:53 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:53.884850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31ca44c1-8380-426d-9489-e595a8bc2a6e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3f7abee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:53.889081 n-d-860556-1 devstack@n-api.service[129614]: WARNING oslo_db.sqlalchemy.utils [None req-31ca44c1-8380-426d-9489-e595a8bc2a6e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 13:04:53.906431 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31ca44c1-8380-426d-9489-e595a8bc2a6e tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.034610 Oct 06 13:04:53.907145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1770/3540] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Oct 6 13:04:53 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:53.917622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:53.918430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:53.935097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:53.935763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:53.936354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:53.937191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:53.942436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:53.943145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:54.131906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:54.165126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b88c5f60-55ae-498d-ad20-71fd83676fd0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1237 microversion: 2.1 time: 0.256779 Oct 06 13:04:54.174619 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1771/3541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:53 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1237 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:54.213518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:54.215588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:54.240308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:54.241769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:54.252975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:54.254127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:54.256145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:54.256790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.050685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:55.076624 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-853412ce-8add-4346-be7e-bbd3f5d69875 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1487 microversion: 2.1 time: 0.899378 Oct 06 13:04:55.077246 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1772/3542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:54 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1487 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:55.090126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e544f76-674c-41a8-a699-83428485d1d2 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] Calling method '.version_select at 0x7f7d3fe2b280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:55.149898 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e544f76-674c-41a8-a699-83428485d1d2 tempest-KeyPairsV22TestJSON-623002635 tempest-KeyPairsV22TestJSON-623002635-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388365765" status: 204 len: 0 microversion: 2.2 time: 0.071499 Oct 06 13:04:55.150514 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1773/3543] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Oct 6 13:04:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388365765 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:04:55.155552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:55.156194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:55.176039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.176552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.177003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.177764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.182470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.182938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.447359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:04:55.448570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:04:55.449248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:04:55.449853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:04:55.450499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:04:55.466104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.469113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.472624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.473716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.474427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.475024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.522719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Getting quotas for project e31072d8e4ef41589b2bc0ca7c86829e. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:04:55.539327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Getting quotas for user f6639a16e2ea462eb6fffb8647446e7f and project e31072d8e4ef41589b2bc0ca7c86829e. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:04:55.570076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:04:55.575150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:04:55.659862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24797b3e-014f-44c1-87ac-ec432ece1740 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.079283 Oct 06 13:04:55.667918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1771/3544] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:04:55.680046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1591e2b2-6c69-408c-bb9e-e8cf00946d02", "tag": "e51f639b-60bc-4cc0-b3a4-4e07f886d1c7"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:55.696183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.730292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.731227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.780102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:55.787998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] Creating event network-changed:e51f639b-60bc-4cc0-b3a4-4e07f886d1c7 for instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 on n-h2-860556-1 Oct 06 13:04:55.820186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:55.820469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a367a785-7e19-4189-b777-7314b6a6092c req-6cc17203-5a6b-4d6b-a3ac-75a905350729 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135045 Oct 06 13:04:55.822921 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1772/3545] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:04:55.833042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0b3fbc6-8a56-47e9-962c-1901a1fb3ca5 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.680855 Oct 06 13:04:55.838389 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1774/3546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:55 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:55.843337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:55.850704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:55.853475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:55.854896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:55.863644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.864148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.864602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.865306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.874579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.874806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.875329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.875528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.876412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.877296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:55.878054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:55.878783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:55.919521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lazy-loading 'flavor' on Instance uuid 288eff98-ad91-480a-bf5c-2756bdf40bb2 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:04:56.101025 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c900e3cf-1c1c-4af5-ba40-67b55b5aadb8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2/action" status: 202 len: 0 microversion: 2.1 time: 0.270962 Oct 06 13:04:56.105352 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1773/3547] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:04:55 2022] POST /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:04:56.129479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e20ca62e-7b50-4488-abca-39b424b6da93 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:56.132860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e20ca62e-7b50-4488-abca-39b424b6da93 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:56.226533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:56.249787 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e780cbe-a380-4b28-9380-e676f9eeec7b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1237 microversion: 2.1 time: 0.410021 Oct 06 13:04:56.250400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1775/3548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:55 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1237 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:56.264667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:56.269200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:56.293117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:56.294487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:56.295219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:56.299586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:56.300607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:56.301473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:56.385987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e20ca62e-7b50-4488-abca-39b424b6da93 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:56.393972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e20ca62e-7b50-4488-abca-39b424b6da93 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1215 microversion: 2.1 time: 0.284823 Oct 06 13:04:56.402469 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1774/3549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:56 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:56.784804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:56.800083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c79d9ab0-8182-4d18-a5fb-c7578eec4010 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1495 microversion: 2.1 time: 0.539252 Oct 06 13:04:56.811387 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1776/3550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:56 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1495 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:56.860135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:56.861461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:56.882984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:56.885059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:56.886718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:56.887730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:56.891119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:56.898435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.277048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:57.277659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:57.296331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.297017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.297796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.298715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.299341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.301701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.469874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:57.483375 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45fd467b-b66f-4663-a0bc-dda3ee4356e2 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.627029 Oct 06 13:04:57.486861 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1775/3551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:56 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:57.508086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:57.510455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:57.532065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:57.554656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.555357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.558637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2779714c-313b-4c42-8689-de464664c4ad tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1237 microversion: 2.1 time: 0.280834 Oct 06 13:04:57.559534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.562452 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1777/3552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:57 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1237 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:57.563629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.564285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.566183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.827335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:57.828122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:57.838516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.840101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.842998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:57.844151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:57.844755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:57.845702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:58.381201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:58.390592 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18987084-2f37-4bf5-99a7-f819a7543ed9 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1267 microversion: 2.1 time: 0.902469 Oct 06 13:04:58.402182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1776/3553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:57 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1267 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:58.509722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:58.510745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:58.523727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:58.524624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:58.525313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:58.526322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:58.528116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:58.532872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:58.834749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:58.849947 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3266e40f-061f-4c4a-ba4f-145389d4e27f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 200 len: 1478 microversion: 2.1 time: 1.029075 Oct 06 13:04:58.865769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1778/3554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:57 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 1478 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:04:58.869901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:58.872064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:58.888752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:58.892006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:58.892650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:58.896580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:58.897279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:58.898139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:58.949146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:04:58.971966 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b7f8317-d744-422b-a1fa-75c6d5c15361 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.466529 Oct 06 13:04:58.974126 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1777/3555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:58 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:04:58.988967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2089540764"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:04:58.994064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:59.002758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:59.003590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:59.004814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:59.005820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:59.006578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:59.007264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:59.503303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7192ea77-9434-4d5e-8796-2e426bce1b7e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2/action" status: 202 len: 0 microversion: 2.1 time: 0.526424 Oct 06 13:04:59.508182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1778/3556] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:04:58 2022] POST /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 13:04:59.518142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:04:59.518847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:04:59.539289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:59.539788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:59.540229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:59.540944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:04:59.541399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:04:59.541849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:04:59.581143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:04:59.998344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:00.014273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c17f2c3b-c94a-41a8-84ac-3384a83dc33d tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1305 microversion: 2.1 time: 1.159801 Oct 06 13:05:00.026707 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1779/3557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:58 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1305 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:00.045261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45b95e92-2915-4ec5-bbad-8950c320fa6e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f96fa60>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:00.139578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45b95e92-2915-4ec5-bbad-8950c320fa6e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.099619 Oct 06 13:05:00.148902 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1780/3558] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:00 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:00.159463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:00.160096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:00.174672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:00.182066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:00.182498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:00.183284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:00.183763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:00.184202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:00.630417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:00.643789 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5dd2a4d9-1a50-45e9-9356-b15e2232ff95 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 1.131925 Oct 06 13:05:00.645234 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1779/3559] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:04:59 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:00.686126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:00.703761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f74c0bf-072f-4e2c-b9e0-2dcb3f3332f8 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.558969 Oct 06 13:05:00.717765 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1781/3560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:00 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:01.054457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:01.056566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:01.086893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:01.089239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:01.089931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:01.093942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:01.094596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:01.095569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:01.157023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-75a49b8c-17ea-4daa-9feb-5f6eb24a2eff tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f352160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:01.246434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-75a49b8c-17ea-4daa-9feb-5f6eb24a2eff tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.093881 Oct 06 13:05:01.260177 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1782/3561] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:01 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:01.398406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a247d2-be46-495d-96cd-912dd6a8d455", "tag": "deced7f2-ceaf-478a-9418-0b9d3f5da297"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:01.448343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:01.448843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:01.449291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:01.488239 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] Creating event network-changed:deced7f2-ceaf-478a-9418-0b9d3f5da297 for instance f0a247d2-be46-495d-96cd-912dd6a8d455 on n-h2-860556-1 Oct 06 13:05:01.508114 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-dd37dcf3-f5f7-4555-b92e-19ca56342053 req-7c1e1af2-ee87-4f4d-952a-178ae0147a35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115573 Oct 06 13:05:01.509088 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1783/3562] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:01.878101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:01.908215 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c374a55e-0a7b-49a8-b98d-1eb5258d573e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1305 microversion: 2.1 time: 0.858257 Oct 06 13:05:01.908833 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1780/3563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:01 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1305 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:01.932056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:01.936618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:01.968228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:01.969314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:01.973287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:01.985941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:01.986726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:01.987353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.400921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Calling method '.version_select at 0x7f7d3f3524c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:02.442125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:02.445260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:02.446191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.450285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:02.450855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:02.454069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.553294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:02.562759 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dda928d2-12d0-41bb-b2d9-c4ac4d3ea12c tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.017242 Oct 06 13:05:02.567963 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1784/3564] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Oct 6 13:05:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:02.574556 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fecaea24-0b23-4608-840b-cb95080f1403 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 0.661433 Oct 06 13:05:02.576177 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1781/3565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:01 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:02.579984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:02.594311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:02.599710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a94b1d7d-25af-483f-8005-aa298ee59e2e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3edce430>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:02.607016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:02.610584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:02.612398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.616659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:02.618269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:02.619089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.682386 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a94b1d7d-25af-483f-8005-aa298ee59e2e tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.088611 Oct 06 13:05:02.683390 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1782/3566] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:02 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:02.711490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3119f6-2bd5-451d-ad00-50ad002a66e6", "tag": "cdeb7ce7-6370-434a-9737-50f377dc8e51"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:02.757868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:02.765853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:02.766897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:02.785995 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] Creating event network-changed:cdeb7ce7-6370-434a-9737-50f377dc8e51 for instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 on n-h1-860556-1 Oct 06 13:05:02.816890 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7a56757e-08f3-4956-921a-9a56ba399c93 req-efe14d4f-d89b-4bfa-9dd1-1f00dadfd11e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127968 Oct 06 13:05:02.839226 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1783/3567] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:02.904185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1631515911", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:03.032704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:05:03.070289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:03.079127 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-981062e6-807f-4acd-939d-8e22791c8cfb tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.509554 Oct 06 13:05:03.084639 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1785/3568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:02 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:03.092535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:03.093162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:03.119570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:03.120079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:03.120526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:03.121250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:03.130422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:03.131861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:03.856378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:03.872748 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cfbc532c-0084-4130-a76f-8225d4c3436f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1305 microversion: 2.1 time: 0.785607 Oct 06 13:05:03.874016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1786/3569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:03 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1305 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:03.895712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Getting quotas for project 0a8523af15694c95a5eb8dd321949fe7. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:05:03.899614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:03.900452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:03.903589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Getting quotas for user b697f79b0cab43c695c465057de7e19f and project 0a8523af15694c95a5eb8dd321949fe7. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:05:03.910464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:03.911462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:03.912081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:03.913518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:03.914276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:03.915165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:03.937811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Request method failure captured: Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 1752 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJ9ufUze-Rkqqzox0fkFEBxCFSIIAm2N3gzfndKGoaiFR7wYeEd1bLVmbPUZvsK85gnEIjj426BHhEXyvt4nnH_bllW4U8BfYks4a6IdANCug3kP3Wey-5TNqHifLG5Z0rtBtFZxgzTA3PyCbM_l3jkUz9-nfikBsKNxbfNwU4bA8Q Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0a8523af15694c95a5eb8dd321949fe7 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1448918326 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0a8523af15694c95a5eb8dd321949fe7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a8523af15694c95a5eb8dd321949fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0a8523af15694c95a5eb8dd321949fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a8523af15694c95a5eb8dd321949fe7"}]}] Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1448918326 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0a8523af15694c95a5eb8dd321949fe7 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1448918326 Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b697f79b0cab43c695c465057de7e19f Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1631515911", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:05:03.940786 n-d-860556-1 devstack@n-api.service[129615]: exception: Maximum number of metadata items exceeds 128 Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1631515911', 'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:03.949803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f432c22-9366-468a-b1d0-bbd541fca108 tempest-AbsoluteLimitsNegativeTestJSON-1448918326 tempest-AbsoluteLimitsNegativeTestJSON-1448918326-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.045507 Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1784/3570] 10.222.0.26 () {60 vars in 1148 bytes} [Thu Oct 6 13:05:02 2022] POST /compute/v2.1/servers => generated 87 bytes in 1051 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 06 13:05:03.953570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-952f22ba-e3fa-49d3-a7ea-303e76ab33c2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ed69160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:04.047257 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-952f22ba-e3fa-49d3-a7ea-303e76ab33c2 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.095013 Oct 06 13:05:04.049598 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1785/3571] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:03 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:04.110312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:04.111274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:04.125955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:04.129017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:04.134264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:04.135289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:04.135942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:04.136549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:04.296069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:04.306647 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ba03e09-e994-43db-bfb7-e028d0b8fed8 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 0.417762 Oct 06 13:05:04.310516 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1787/3572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:03 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:04.355962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:04.366019 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-607aa3cc-0e11-4af8-954d-f4574ebf0b78 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.260844 Oct 06 13:05:04.367525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1786/3573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:04 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:04.409078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1591e2b2-6c69-408c-bb9e-e8cf00946d02", "name": "network-vif-plugged", "status": "completed", "tag": "e51f639b-60bc-4cc0-b3a4-4e07f886d1c7"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:04.427255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:04.427757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:04.428452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:04.447424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] Creating event network-vif-plugged:e51f639b-60bc-4cc0-b3a4-4e07f886d1c7 for instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 on n-h2-860556-1 Oct 06 13:05:04.455713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0dd4c79e-b48d-4290-9445-d1661201fa16 req-207198fe-13fb-463e-bf05-b767646fb505 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049539 Oct 06 13:05:04.456638 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1788/3574] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:04.901726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:04.902391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:04.913712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:04.919435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:04.920222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:04.921269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:04.922411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:04.923094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:05.073439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da50b13e-78cb-4f1a-a35b-e40619e988b5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d477cad30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:05.124748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:05.141303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aaf6a2f8-b1dd-41f4-a902-897d014759c6 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.243649 Oct 06 13:05:05.161558 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1787/3575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:04 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:05.162396 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da50b13e-78cb-4f1a-a35b-e40619e988b5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.093489 Oct 06 13:05:05.163022 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1789/3576] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:05 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:05.335252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:05.336238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:05.350634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:05.351444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:05.352670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:05.354929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:05.356949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:05.358390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:05.392509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:05.393183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:05.403898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:05.404404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:05.404856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:05.409915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:05.410569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:05.411039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:05.499389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:06.087616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:06.100390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c7d70551-89c2-4d9a-ad55-fcf5ec6f04e3 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 0.770156 Oct 06 13:05:06.102411 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1788/3577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:05 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:06.169664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:06.171758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:06.188161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:06.189030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:06.190907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:06.195669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:06.197410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:06.198809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:06.208047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:06.229472 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-045b462f-d3e7-43f7-9d3c-40aa492d5949 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1328 microversion: 2.1 time: 0.839561 Oct 06 13:05:06.230974 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1790/3578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:05 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1328 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:06.245578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c051d5a0-4b8c-47ad-904b-2e11df8f6041 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ea5a5e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:06.339847 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c051d5a0-4b8c-47ad-904b-2e11df8f6041 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.107491 Oct 06 13:05:06.340449 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1791/3579] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:06 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:06.883319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:06.915198 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da86a392-63d9-4fdc-8256-5bd0e659144c tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.749907 Oct 06 13:05:06.916299 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1789/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:06 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:07.126880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:07.127712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:07.138619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.139981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.141302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.143200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.145043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.146225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.558171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:07.560780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.562933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.565580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.570493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.572038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.572502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.650676 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f98baafd-56bc-4d32-980e-99e25ce9d94a tempest-AZV2TestJSON-127529979 tempest-AZV2TestJSON-127529979-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.614335 Oct 06 13:05:07.673685 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1792/3581] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Oct 6 13:05:07 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:05:07.696252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:07.697890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:07.715608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.715907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.720520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.721861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:07.725486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:07.728050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:07.796285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:08.743156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:08.757873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c4cda13-165f-4b40-89bd-0c91acf06e91 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 1.635287 Oct 06 13:05:08.759216 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1790/3582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:07 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:08.764465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8607c06c-6e0c-4d35-b130-18c67c99990d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e6d01f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:08.864116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8607c06c-6e0c-4d35-b130-18c67c99990d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.103604 Oct 06 13:05:08.877345 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1791/3583] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:08 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:08.889542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288eff98-ad91-480a-bf5c-2756bdf40bb2", "name": "network-vif-plugged", "status": "completed", "tag": "ec31873b-7c34-4d36-b17b-0325f7d7dca5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:08.914536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:08.916623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:08.917147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:08.927747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:08.953828 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] Creating event network-vif-plugged:ec31873b-7c34-4d36-b17b-0325f7d7dca5 for instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 on n-h2-860556-1 Oct 06 13:05:08.967269 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b6ef7ba7-fb73-4687-8454-193d895918da req-ac5d8586-5499-4734-a20f-c4d208ef2aee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087974 Oct 06 13:05:08.969493 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1792/3584] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:08.987120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:08.991826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:09.002151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.003515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.007856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:09.010084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.010903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.011947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:09.042612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:09.051409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b917687-5e93-4ab8-9518-6b9346e13287 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1528 microversion: 2.1 time: 1.370517 Oct 06 13:05:09.057894 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1793/3585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:07 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1528 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:09.089030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:09.089660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:09.098266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.098757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.099402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:09.100176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.103715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.104412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:09.472112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:09.487357 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d96de72b-3c7b-4fd2-897e-c7a63df1a71a tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.516078 Oct 06 13:05:09.503404 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1793/3586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:08 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:09.615839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:09.632640 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73eb86d1-df8c-448b-b1e0-d7a98520fa3c tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1528 microversion: 2.1 time: 0.547843 Oct 06 13:05:09.651411 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1794/3587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:09 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:09.781766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:09.782543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:09.804301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.806675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.807893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:09.809591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:09.812223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:09.816719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.250039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:10.263773 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-54824b58-ef04-41d7-81ee-c9407e831fad tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 0.486741 Oct 06 13:05:10.265007 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1795/3588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:09 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:10.273016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-06ab3368-ea7d-497a-b5d2-a4e8fe5151d1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f352d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:10.362032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-06ab3368-ea7d-497a-b5d2-a4e8fe5151d1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.095157 Oct 06 13:05:10.362908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1796/3589] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:10 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:10.372870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:10.373578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:10.401296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.404367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.405109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.408298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.408800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.409286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.486268 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] HTTP exception thrown: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Request method failure captured: Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 HTTP/1.1 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJthHYgPUe7B9FokfuZHEz0v5BWS5rtTy6-Uegz6gEQuTcS-pHIltIu_EjnT78uJBmCtkJ3UITubm72SjBPHo8frO6eR2E6oXaAEWNfnY-N6BE4CI08iATwjR3iYgLQrGNdkX4wSOpHfKGQSuqrPtbcvRtLErHzgBZEmroP0eOKbR0 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 07803b3070df486897668f7c42b05cb7 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07803b3070df486897668f7c42b05cb7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07803b3070df486897668f7c42b05cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07803b3070df486897668f7c42b05cb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07803b3070df486897668f7c42b05cb7"}]}] Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 07803b3070df486897668f7c42b05cb7 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1233021475-project Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1b772a7c86724d1f83fe6d9524d7217c Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475-project Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1591e2b2-6c69-408c-bb9e-e8cf00946d02'} Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:05:10.493894 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:10.500957 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:10.506156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Returning 404 to user: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:05:10.507340 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61d45c0e-7b37-4af0-91ba-7d1e2d88ed5a tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 404 len: 111 microversion: 2.1 time: 0.849840 Oct 06 13:05:10.510759 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1794/3590] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:05:09 2022] DELETE /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 111 bytes in 854 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:05:10.521113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:10.522147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:10.535561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.542235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:10.542617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:10.544569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.545029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.545888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.546280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.546718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.592229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.592935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.593401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:10.598327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:10.599109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:10.608618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.049424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:11.060483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5098bda9-85fc-4e0f-b227-bd211a3a07f1 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.547819 Oct 06 13:05:11.066126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1797/3591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:10 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:11.079499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:11.085263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3119f6-2bd5-451d-ad00-50ad002a66e6", "name": "network-vif-plugged", "status": "completed", "tag": "cdeb7ce7-6370-434a-9737-50f377dc8e51"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:11.096784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92ce1df9-fff0-4885-b15f-2379deeb3ea0 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1528 microversion: 2.1 time: 0.581283 Oct 06 13:05:11.098305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1795/3592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:10 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1528 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:11.118841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.126160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Action: 'update', calling method: >, body: {"server": {"name": "1591e2b2-6c69-408c-bb9e-e8cf00946d02_new"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:11.129245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.130005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:11.130453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.159090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.161477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.163526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.164462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.165669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.166870 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] Creating event network-vif-plugged:cdeb7ce7-6370-434a-9737-50f377dc8e51 for instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 on n-h1-860556-1 Oct 06 13:05:11.167307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.180170 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8c92bd58-fa22-4a35-85d6-5751623d2bba req-178fbc14-7d2a-4749-b389-74476a67a92a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110722 Oct 06 13:05:11.187929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1798/3593] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:11.198568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] HTTP exception thrown: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Request method failure captured: Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: request: PUT /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 HTTP/1.1 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 64 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJthHYgPUe7B9FokfuZHEz0v5BWS5rtTy6-Uegz6gEQuTcS-pHIltIu_EjnT78uJBmCtkJ3UITubm72SjBPHo8frO6eR2E6oXaAEWNfnY-N6BE4CI08iATwjR3iYgLQrGNdkX4wSOpHfKGQSuqrPtbcvRtLErHzgBZEmroP0eOKbR0 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 07803b3070df486897668f7c42b05cb7 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07803b3070df486897668f7c42b05cb7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07803b3070df486897668f7c42b05cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07803b3070df486897668f7c42b05cb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07803b3070df486897668f7c42b05cb7"}]}] Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 07803b3070df486897668f7c42b05cb7 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475 Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1233021475-project Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1b772a7c86724d1f83fe6d9524d7217c Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1233021475-project Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: {"server": {"name": "1591e2b2-6c69-408c-bb9e-e8cf00946d02_new"}} Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1591e2b2-6c69-408c-bb9e-e8cf00946d02', 'body': {'server': {'name': '1591e2b2-6c69-408c-bb9e-e8cf00946d02_new'}}} Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:05:11.200537 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:11.205644 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:11.211290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] Returning 404 to user: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:05:11.212446 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d688a476-a1ca-4fc5-8d24-a632ea232aaa tempest-ServersNegativeTestMultiTenantJSON-1233021475 tempest-ServersNegativeTestMultiTenantJSON-1233021475-project] 10.222.0.26 "PUT /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 404 len: 111 microversion: 2.1 time: 0.090597 Oct 06 13:05:11.215678 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1796/3594] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:05:11 2022] PUT /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:05:11.226951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:11.227898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:11.255076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.258216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.259747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.262799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.264026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.265694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.287260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:11.291462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:11.301790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:05:11.323517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.323936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.324386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.325116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.338149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.338696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.425308 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60e58031-6d14-405b-addd-bcb0fac0139d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 204 len: 0 microversion: 2.1 time: 0.203724 Oct 06 13:05:11.427968 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1799/3595] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:05:11 2022] DELETE /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:11.436067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-726ab91c-dd5d-4a61-8139-297d006bc6a3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f5a2790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:11.507328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-726ab91c-dd5d-4a61-8139-297d006bc6a3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.075962 Oct 06 13:05:11.522080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1800/3596] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:11 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:11.532616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:11.533681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:11.544472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.545501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.546268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.547256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:11.547954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:11.548624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:11.740964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:11.754178 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34e5398a-cf16-4f0b-9892-fc628019a9bb tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 0.466704 Oct 06 13:05:11.758187 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1797/3597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:11 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:11.899339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:11.937494 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8eddb927-35c3-48f4-9d35-cbe981926928 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1534 microversion: 2.1 time: 0.408853 Oct 06 13:05:11.950616 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1801/3598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:11 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1534 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:12.089413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:12.094853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:12.109089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.110573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.111649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:12.113298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.115296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.116461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:12.530852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a28bf91e-879a-469b-a791-db84b9ab6f95 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f7abee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:12.554538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=30 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:12.588677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:12.611290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7246607-b65c-454f-b49c-209154c81cbe tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.525680 Oct 06 13:05:12.625821 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1798/3599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:12 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:12.671316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a28bf91e-879a-469b-a791-db84b9ab6f95 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.147297 Oct 06 13:05:12.672461 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1802/3600] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:12 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:12.780983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:12.782423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:12.794044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.799379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.800221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:12.801458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.803749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.805368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:12.964119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:12.965331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:12.985248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.986143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.986839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:12.987825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:12.989167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:12.989885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:13.886433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:13.899422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6ce283b-054f-4aaa-b67c-081a30ef143f tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1315 microversion: 2.1 time: 1.121881 Oct 06 13:05:13.902844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1799/3601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:12 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:13.912272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:13.914803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:13.926449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:13.928749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=38 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:13.937005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:13.938789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:13.939618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:13.943378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:13.944421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:13.946066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:14.620985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:14.637287 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc2eb11c-d1f0-4405-881b-28918f71f95e tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1534 microversion: 2.1 time: 1.677538 Oct 06 13:05:14.656169 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1803/3602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:12 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1534 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:14.663580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03127e45-461a-41a0-86d7-165227eb43c4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f7daaf0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:14.728675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03127e45-461a-41a0-86d7-165227eb43c4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.068322 Oct 06 13:05:14.731653 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1804/3603] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:14 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:14.929970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:14.932645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:14.955446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:14.956976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:14.960167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:14.961346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:14.962619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:14.966951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.202165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:15.227336 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c362047-203a-41b2-bb21-b113e919c5ed tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 1.322275 Oct 06 13:05:15.228329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1800/3604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:13 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:15.250977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a247d2-be46-495d-96cd-912dd6a8d455", "name": "network-vif-plugged", "status": "completed", "tag": "deced7f2-ceaf-478a-9418-0b9d3f5da297"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:15.286811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.287296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.287729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.358873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] Creating event network-vif-plugged:deced7f2-ceaf-478a-9418-0b9d3f5da297 for instance f0a247d2-be46-495d-96cd-912dd6a8d455 on n-h2-860556-1 Oct 06 13:05:15.378100 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ac63e4fa-ed4c-4efe-ad90-38d05ccdf6bc req-53a19ce8-db95-4152-8e28-c47a8c566980 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147839 Oct 06 13:05:15.379254 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1801/3605] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:15.498183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:15.514022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a9399b31-bf6a-42da-b691-9a76000f54c1 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1503 microversion: 2.1 time: 0.588634 Oct 06 13:05:15.516222 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1805/3606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:14 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1503 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:15.548943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:15.549619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:15.567119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.568010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.572463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.576062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.577003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.577622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.669434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:15.670433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:15.701056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.702082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.702993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.706051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.707419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.708096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.778759 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cba053dc-1ceb-4d57-8152-97c0d6e9b1e4 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.231081 Oct 06 13:05:15.780383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1802/3607] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Oct 6 13:05:15 2022] DELETE /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6/os-server-password => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:15.787103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-943b845b-52d2-4833-ac50-c20c703207dd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476c2280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:15.918574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-943b845b-52d2-4833-ac50-c20c703207dd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.131697 Oct 06 13:05:15.919649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1803/3608] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:15 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:15.933005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:15.933698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:15.956786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.957335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.958943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:15.960708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:15.962340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:15.978305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.072893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28295320-02c8-4be9-815e-a6dbae68ff6b tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.151936 Oct 06 13:05:16.085862 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1804/3609] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Oct 6 13:05:15 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6/os-server-password => generated 16 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:05:16.100929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1591e2b2-6c69-408c-bb9e-e8cf00946d02", "name": "network-vif-deleted", "tag": "e51f639b-60bc-4cc0-b3a4-4e07f886d1c7"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:16.129611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.130641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.134579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.171003 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] Creating event network-vif-deleted:e51f639b-60bc-4cc0-b3a4-4e07f886d1c7 for instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 on n-h2-860556-1 Oct 06 13:05:16.184893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-681ef634-3c14-44c4-b28a-e7fd6267463f req-a1bd8aff-6c98-4f30-ba08-87dabe64250d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095499 Oct 06 13:05:16.188876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1805/3610] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:16.205355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:16.207748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:16.242746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:16.243034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.243599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.249554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.250764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.251553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.252192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.259122 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55701bf3-6c66-4e32-906d-3e3c67b03f9d tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1492 microversion: 2.1 time: 0.593287 Oct 06 13:05:16.261138 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1806/3611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:15 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1492 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:16.296812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:16.303875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:16.340842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.343478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.344902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.348714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.350541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.352464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.354260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:05:16.571775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8bc74c3-2f54-4578-8137-d2c9c04adbac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 204 len: 0 microversion: 2.1 time: 0.378668 Oct 06 13:05:16.572931 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1806/3612] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:05:16 2022] DELETE /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:16.593609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:16.594741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:16.609195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.609767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.610415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:16.611251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:16.611675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:16.613692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:17.026238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:17.038643 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24e0569c-7769-40ab-9950-8d7ca175fc86 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1509 microversion: 2.1 time: 0.449839 Oct 06 13:05:17.039869 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1807/3613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:16 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:17.073787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-809f2b7f-b795-434e-9838-67f88aa77093 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3edaa160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:17.090581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:17.102900 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a0bf4f50-0c9d-4446-94fc-f90b23ba68ee tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1293 microversion: 2.1 time: 0.819769 Oct 06 13:05:17.139174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1807/3614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:16 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1293 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:17.215800 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-809f2b7f-b795-434e-9838-67f88aa77093 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.154369 Oct 06 13:05:17.216401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1808/3615] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:17 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:17.288817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:17.289869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:17.292465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:17.305339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:17.307543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:17.310120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:17.312389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:17.313089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:17.314188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:17.462141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:17.467479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:17.468132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:17.468489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lazy-loading 'fault' on Instance uuid 1591e2b2-6c69-408c-bb9e-e8cf00946d02 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:05:17.603519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:18.070466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:18.071369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:18.111085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:18.111591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:18.117711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:18.125077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:18.126738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:18.130652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:18.582314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a8fe6f5f914ca5a44d5c455e8fdb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b900a549a3e492cb10a9c202b04792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:18.596690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c197d30-c2c0-4130-955d-b7abe7f0399b tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 200 len: 1318 microversion: 2.1 time: 1.313296 Oct 06 13:05:18.618247 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1808/3616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:17 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 1318 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:18.626283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:18.627845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:18.635314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:18.636112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:18.636835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:18.638102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:18.638777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:18.639388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:18.878694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:18.889290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1ac493a-0839-45b5-b20f-3d5d91436e4a tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1509 microversion: 2.1 time: 0.826299 Oct 06 13:05:18.906465 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1809/3617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:18 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1509 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:18.911587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59d823df-9ee3-4902-af33-16e5c00d4155 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475c7f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:18.994550 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59d823df-9ee3-4902-af33-16e5c00d4155 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.098473 Oct 06 13:05:18.995156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1810/3618] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:18 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:19.132308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:19.142991 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11330148-b50b-4fcb-b577-42d54b6b3299 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1485 microversion: 2.1 time: 0.522955 Oct 06 13:05:19.146171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1809/3619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:18 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1485 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:19.173639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:19.174207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:19.192289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.193123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.193223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:19.194066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.194540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.199822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:19.340220 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c113e9f9-8437-4d1d-8320-b29b97b16705 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171804 Oct 06 13:05:19.341141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1811/3620] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:05:19 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:19.623231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:19.623866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] [instance: 1591e2b2-6c69-408c-bb9e-e8cf00946d02] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:19.633669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.634288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.634742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:19.636150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.636637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.637084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:19.673461 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] HTTP exception thrown: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Request method failure captured: Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 HTTP/1.1 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJX0a7pHCfE-7lHh_0sC4U9Mv8oLsJ2VAhEXr8xjSY1wUwgWto5YZKyf0q-XBU4hpXNmCfXnl_fx-P_UJX_yykb8jN8I6ExfbwNzDXIk8Ho4-7VyoW64OvAhc2JXEALQ6Xwm8PqxFn7hsGqkyNHzkDRPP6QlmgFO5hC1UTnoFS_Zak Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5b900a549a3e492cb10a9c202b04792e Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-849928337 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b900a549a3e492cb10a9c202b04792e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b900a549a3e492cb10a9c202b04792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b900a549a3e492cb10a9c202b04792e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b900a549a3e492cb10a9c202b04792e"}]}] Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-849928337 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5b900a549a3e492cb10a9c202b04792e Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-849928337 Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestMultiTenantJSON-849928337-project Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 73a8fe6f5f914ca5a44d5c455e8fdb4c Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-849928337-project Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1591e2b2-6c69-408c-bb9e-e8cf00946d02'} Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:19.675350 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] Returning 404 to user: Instance 1591e2b2-6c69-408c-bb9e-e8cf00946d02 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:05:19.680876 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22daa098-6f07-46b0-b7c5-87afe4508094 tempest-ServersNegativeTestMultiTenantJSON-849928337 tempest-ServersNegativeTestMultiTenantJSON-849928337-project] 10.222.0.26 "GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02" status: 404 len: 111 microversion: 2.1 time: 0.061766 Oct 06 13:05:19.686083 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1810/3621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:19 2022] GET /compute/v2.1/servers/1591e2b2-6c69-408c-bb9e-e8cf00946d02 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:05:19.916787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:19.917443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:19.936785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.937629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.938282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:19.939259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:19.939893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:19.940501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:20.011655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0c3b242-31f9-4eae-baef-9c3d63139e46 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f3524c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:20.076848 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0c3b242-31f9-4eae-baef-9c3d63139e46 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.069063 Oct 06 13:05:20.077952 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1811/3622] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:20 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:20.998521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:21.002207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:21.035054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fef89a9-a267-4006-90d4-ef8701944dac tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1509 microversion: 2.1 time: 1.109238 Oct 06 13:05:21.036866 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1812/3623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:19 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1509 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:21.093896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0f7670a-1e4c-451c-81b6-569f1dc26d92 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1d1d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:21.203217 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0f7670a-1e4c-451c-81b6-569f1dc26d92 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.113399 Oct 06 13:05:21.204019 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1812/3624] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:21 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:21.219599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3119f6-2bd5-451d-ad00-50ad002a66e6", "name": "network-vif-deleted", "tag": "cdeb7ce7-6370-434a-9737-50f377dc8e51"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:21.246718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:21.249586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:21.253228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:21.294572 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] Creating event network-vif-deleted:cdeb7ce7-6370-434a-9737-50f377dc8e51 for instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 on n-h1-860556-1 Oct 06 13:05:21.305564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c210612d-b3c3-49e4-980d-bf55a5b94be3 req-41d77936-e8fe-4484-ba0d-196b9d7ec0b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092922 Oct 06 13:05:21.309877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1813/3625] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:21.682135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:21.682846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:21.694976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:21.702938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:21.703588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:21.704371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:21.725254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:21.730851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:21.850948 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e3c1d0e-f843-4aa9-891a-dd0061a21b91 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/ips" status: 200 len: 153 microversion: 2.20 time: 0.168032 Oct 06 13:05:21.852301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1813/3626] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Oct 6 13:05:21 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/ips => generated 153 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:05:22.099104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:22.100871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:22.162675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:22.163182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:22.163681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:22.164398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:22.168267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:22.168790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:22.222105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:22.223566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:22.224412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:22.225078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lazy-loading 'fault' on Instance uuid eb3119f6-2bd5-451d-ad00-50ad002a66e6 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:05:22.225614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55b58b66-1774-4eae-9f30-7225a6d092e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f04ce50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:22.374384 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55b58b66-1774-4eae-9f30-7225a6d092e8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.157453 Oct 06 13:05:22.375473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1814/3627] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:22 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:22.461410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6639a16e2ea462eb6fffb8647446e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31072d8e4ef41589b2bc0ca7c86829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:22.475626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-668d7512-9268-480d-8534-279c100a8040 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 200 len: 1305 microversion: 2.1 time: 0.418535 Oct 06 13:05:22.482003 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1814/3628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:22 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 1305 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:23.328508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1055235062", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9ab076eb-5d20-4831-a99d-d9d85e1fc567"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:23.395988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d879ce2-9420-40f2-8375-92f6b513473d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476a84c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:23.643307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] validate_networks() for [('9ab076eb-5d20-4831-a99d-d9d85e1fc567', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:05:23.667600 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d879ce2-9420-40f2-8375-92f6b513473d tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.280031 Oct 06 13:05:23.676612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1815/3629] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:23 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:23.680171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:23.681044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] [instance: eb3119f6-2bd5-451d-ad00-50ad002a66e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:23.730497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:23.732154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:23.734690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:23.737143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:23.741710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:23.744249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:23.794442 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] HTTP exception thrown: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Request method failure captured: Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 HTTP/1.1 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJ0J5ye0ExQHRO58hU0FcbFV3-YSZlcDiGEJ2rEEcsAflL_FY_7dIAyIbnSocv9YvV5-wb7Uk3txXamzhZYxxmAt_HKswL_S11H0GBN--ferXgw0jZmco3Ml53D1FPg_7EOe0K-ewNBvB1tEM3ebJ_vqj36MkbOwHzAjuuRovjBKuk Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: e31072d8e4ef41589b2bc0ca7c86829e Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerPasswordTestJSON-1921238077 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e31072d8e4ef41589b2bc0ca7c86829e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e31072d8e4ef41589b2bc0ca7c86829e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e31072d8e4ef41589b2bc0ca7c86829e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e31072d8e4ef41589b2bc0ca7c86829e"}]}] Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerPasswordTestJSON-1921238077 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: e31072d8e4ef41589b2bc0ca7c86829e Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1921238077 Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerPasswordTestJSON-1921238077-project Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f6639a16e2ea462eb6fffb8647446e7f Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerPasswordTestJSON-1921238077-project Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'eb3119f6-2bd5-451d-ad00-50ad002a66e6'} Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:05:23.834763 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:05:23.840307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] Returning 404 to user: Instance eb3119f6-2bd5-451d-ad00-50ad002a66e6 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:05:23.840993 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a73621d8-bd1f-4208-877c-f1e3be0e1ad7 tempest-ServerPasswordTestJSON-1921238077 tempest-ServerPasswordTestJSON-1921238077-project] 10.222.0.26 "GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6" status: 404 len: 111 microversion: 2.1 time: 0.171612 Oct 06 13:05:23.848786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1816/3630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:23 2022] GET /compute/v2.1/servers/eb3119f6-2bd5-451d-ad00-50ad002a66e6 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:05:24.274657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:24.275299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:24.295081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:24.296119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:24.296735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:24.297479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:24.297976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:24.298415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:24.714197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:24.734156 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5ae728c-0229-4364-963f-0143656e9d55 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1485 microversion: 2.1 time: 0.465583 Oct 06 13:05:24.741092 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1817/3631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:24 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1485 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:24.789487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a247d2-be46-495d-96cd-912dd6a8d455", "tag": "deced7f2-ceaf-478a-9418-0b9d3f5da297"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:24.847732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:24.848236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:24.848676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:24.905673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] Creating event network-changed:deced7f2-ceaf-478a-9418-0b9d3f5da297 for instance f0a247d2-be46-495d-96cd-912dd6a8d455 on n-h2-860556-1 Oct 06 13:05:24.951709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-90922d4a-0d10-4e5f-9ea1-82994beeb45a req-440f0552-0cf8-4980-8fb0-c06fc98f76e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201101 Oct 06 13:05:24.952382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1818/3632] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:24.998835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cb62ee1-39e4-40b3-86e3-8bdfefa4be86 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e66a280>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:25.117806 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cb62ee1-39e4-40b3-86e3-8bdfefa4be86 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.160443 Oct 06 13:05:25.131356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1819/3633] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:24 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:26.016510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:05:26.017060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:05:26.020059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:05:26.020618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:05:26.021146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:05:26.040625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.043015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.045538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.048854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.049683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.060196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.118182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Getting quotas for project de1e3b7e1ec74f35b100c1f3ee4dbc20. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:05:26.135658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-472b3250-b598-48e6-8785-927957fd2ee8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475c7550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:26.140085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Getting quotas for user 98489c1ae29f4a05ba2416814f0e4423 and project de1e3b7e1ec74f35b100c1f3ee4dbc20. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:05:26.167178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Going to run 3 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:05:26.188593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:05:26.241306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-472b3250-b598-48e6-8785-927957fd2ee8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.110460 Oct 06 13:05:26.260397 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1820/3634] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:26 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:26.306616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=2a166b82-9b52-4339-8ed7-ffbda1cbaf7c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:05:26.392943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=a873b2cf-d75b-454b-91e5-52a9bc39b4ba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:05:26.531106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cfa97806-9a85-4cbe-a198-119cb2e70931 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.885008 Oct 06 13:05:26.532266 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1815/3635] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:05:26.552137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:26.570654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:26.572210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:05:26.704167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.713056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.713930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.715589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.717501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.718198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.767092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-712c5a26-6388-4152-ba89-47ddcdd7e51b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.224308 Oct 06 13:05:26.773487 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1821/3636] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:05:26 2022] GET /compute/v2.1/servers => generated 1018 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:26.783737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec2a1b9e-eb33-4087-b5e7-5efe693c8766 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:26.784479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec2a1b9e-eb33-4087-b5e7-5efe693c8766 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:26.877001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:26.877680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:26.892196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.892698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.893489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.894587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:26.895583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:26.896627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:26.912357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec2a1b9e-eb33-4087-b5e7-5efe693c8766 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:26.923438 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec2a1b9e-eb33-4087-b5e7-5efe693c8766 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1223 microversion: 2.1 time: 0.144535 Oct 06 13:05:26.927938 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1816/3637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:26 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:26.951482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lazy-loading 'flavor' on Instance uuid f947c19c-0ca6-46d8-a257-45e62a15a37c {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:05:27.273009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a11dc64-8cd4-4c17-ab90-2bf006998e17 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f33d700>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:27.490429 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c442666-6320-456a-bd29-c886a16c3bef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/action" status: 202 len: 0 microversion: 2.20 time: 0.617022 Oct 06 13:05:27.493722 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1822/3638] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:05:26 2022] POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:27.515466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:27.564386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:27.627693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a11dc64-8cd4-4c17-ab90-2bf006998e17 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.364514 Oct 06 13:05:27.644250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:27.645922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:27.646704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:27.647947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:27.648579 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1817/3639] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:27 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:27.649607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:27.650609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:27.954928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-12134643-956a-4bb7-897f-dcc1f1588339 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:27.955701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-12134643-956a-4bb7-897f-dcc1f1588339 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:28.114070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:28.129443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:28.139907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:28.141587 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-524725b7-3f16-4ecd-812c-ed1f128f2545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 0.643322 Oct 06 13:05:28.142784 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1823/3640] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:27 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:28.229309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-12134643-956a-4bb7-897f-dcc1f1588339 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:28.241792 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-12134643-956a-4bb7-897f-dcc1f1588339 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1223 microversion: 2.1 time: 0.290830 Oct 06 13:05:28.243517 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1818/3641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:27 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:28.652725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f90c639-bd15-4d6c-8da3-632b503e985b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d475c7c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:28.728386 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f90c639-bd15-4d6c-8da3-632b503e985b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.079552 Oct 06 13:05:28.733677 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1824/3642] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:28 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:29.172521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:29.173219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:29.192234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:29.192902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:29.196632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:29.213831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:29.214940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:29.215710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:29.272425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:29.276811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:29.306349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:29.307882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:29.308577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:29.312687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:29.324545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:29.325927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:29.698170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:29.711043 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ede6e11a-fbb0-4d07-9431-3acd3f5b3650 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1219 microversion: 2.1 time: 0.442883 Oct 06 13:05:29.716323 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1825/3643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:29 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1219 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:29.750479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8586318e-eacd-4747-aac4-2ec0069b0725 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3edce0d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:29.857064 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8586318e-eacd-4747-aac4-2ec0069b0725 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.111610 Oct 06 13:05:29.876114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:29.876758 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1826/3644] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:29 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:29.892009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:29.893717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:29.900803 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67d5aaeb-2dde-4ad5-9b59-3e484277922b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 0.730126 Oct 06 13:05:29.903931 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1819/3645] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:29 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:05:30.748575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:30.750699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:30.785822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:30.786646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:30.792169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:30.797599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:30.800314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:30.801962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:30.892701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0408535-4f42-4ec1-8f54-e22310c7a438 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d47773d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:31.007361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:31.010535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0408535-4f42-4ec1-8f54-e22310c7a438 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.121950 Oct 06 13:05:31.013269 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1820/3646] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:30 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:31.027901 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-29e29ae2-4363-4694-be26-e85db24eb239 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1275 microversion: 2.1 time: 0.288971 Oct 06 13:05:31.030910 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1827/3647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:30 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:31.037572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:31.042766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:31.075621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:31.080147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:31.080672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:31.082279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:31.084835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:31.089167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:31.115162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:32.029346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11fcbd75-6eee-4011-a1bd-2205393d72d5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e679670>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:32.115809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11fcbd75-6eee-4011-a1bd-2205393d72d5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.091302 Oct 06 13:05:32.116957 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1828/3648] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:32 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:32.130495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:32.132237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:32.168845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:32.169584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:32.170259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:32.171185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:32.171870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:32.172522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:32.587297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:32.603848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:32.618118 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8542157-7bc3-4f41-8b3e-41fbbef40641 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1281 microversion: 2.1 time: 0.499628 Oct 06 13:05:32.618728 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1829/3649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:32 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1281 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:32.635251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:32.637761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:32.647314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35614d81-d0d8-4e3e-8343-ea791b388c11 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 1.627789 Oct 06 13:05:32.647936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1821/3650] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:31 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:33.132293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46b43ab6-8c55-4f84-a5dd-7eec54cc4948 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3ee6fdc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:33.221104 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46b43ab6-8c55-4f84-a5dd-7eec54cc4948 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1438 microversion: 2.1 time: 0.092232 Oct 06 13:05:33.222614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1830/3651] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:33 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:33.648695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:33.649624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:33.662427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:33.680549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:33.681281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:33.692358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:33.694296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:33.695360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:33.697119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:33.701414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:33.711643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:33.711643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:33.711643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:33.728558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:33.729897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:33.734388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:35.241375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:35.258349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-987b169d-e042-4fea-9c9d-d23dec193f75 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 1.613801 Oct 06 13:05:35.260304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1822/3652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:33 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:35.266685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd3d993e-5c9d-427e-bc67-c32506ad040c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f1e24c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:35.331112 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd3d993e-5c9d-427e-bc67-c32506ad040c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1447 microversion: 2.1 time: 0.068901 Oct 06 13:05:35.336532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:35.342467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1823/3653] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:35 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1447 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:35.350655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42730743-93e8-49b3-ace6-3e555466a73c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f2b43a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:35.350916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:35.363085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:35.368803 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b9d1bd4-9232-4a28-a7d2-646e13ad3fc5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 1.692875 Oct 06 13:05:35.389156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1831/3654] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:33 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:35.428879 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42730743-93e8-49b3-ace6-3e555466a73c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 200 len: 1447 microversion: 2.1 time: 0.084828 Oct 06 13:05:35.440650 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1824/3655] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:05:35 2022] GET /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:35.458243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07ec79d1-4175-486d-ac18-78158d430fda tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e6798b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:36.285536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:36.295336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:36.301718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:36.366596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:36.367637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:36.370838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:36.371742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:36.376718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:36.377207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:36.746466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:36.906720 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07ec79d1-4175-486d-ac18-78158d430fda tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 204 len: 0 microversion: 2.1 time: 1.462660 Oct 06 13:05:36.907666 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1832/3656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:35 2022] DELETE /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 0 bytes in 1467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:36.918380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:36.919130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:36.939439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:36.940331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:36.941813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:36.946973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:36.948726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:36.950618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:37.779597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:37.802531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:37.814694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:37.816431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc4ba8d0-151b-4845-9ed9-85f6420aaa77 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 0.907442 Oct 06 13:05:37.817575 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1833/3657] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:36 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:37.832646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:37.837668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:37.838650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:37.843322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e13f7eaf-5cb5-4484-823e-e8cfe542f8e1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 1.559907 Oct 06 13:05:37.846022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:37.848822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:37.849531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:37.850508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:37.852937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:37.853526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:37.865437 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1825/3658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:36 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:37.908254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:05:38.076852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b29d2cc0-cdf2-4471-af8e-ab3811aa2894 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 204 len: 0 microversion: 2.1 time: 0.257720 Oct 06 13:05:38.080392 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1834/3659] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:05:37 2022] DELETE /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:05:38.334471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-214324610", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a3976e54-2526-447e-9882-cadece24aa4d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:38.344838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:38.411521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] validate_networks() for [('a3976e54-2526-447e-9882-cadece24aa4d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:05:38.492594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288eff98-ad91-480a-bf5c-2756bdf40bb2", "name": "network-vif-unplugged", "status": "completed", "tag": "ec31873b-7c34-4d36-b17b-0325f7d7dca5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:38.548949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:38.551788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:38.554271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:38.627376 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] Creating event network-vif-unplugged:ec31873b-7c34-4d36-b17b-0325f7d7dca5 for instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 on n-h2-860556-1 Oct 06 13:05:38.640700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7e0ee864-1fea-4762-8c11-8499acb4b28d req-320ca1f9-3719-434b-96c6-73cdd3cd13dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151622 Oct 06 13:05:38.641678 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1835/3660] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:38.849479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:38.851017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:38.874388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:38.874963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:38.875412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:38.879096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:38.880059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:38.881109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:39.399201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:39.401547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:39.420167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:39.422519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:39.424456 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f313bfa1-fee0-4329-b646-9a7b74c1cedd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1746 microversion: 2.20 time: 0.580492 Oct 06 13:05:39.439110 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1836/3661] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:38 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1746 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:05:39.451496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:39.452340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:39.460259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:39.460936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:39.461579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:39.462718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:39.463537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:39.464144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.043685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:40.057015 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0ca2d74-febe-45f3-938c-9e9c0bcd715a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 0.615178 Oct 06 13:05:40.058220 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1837/3662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:39 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:40.076461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b7e72d-9b1c-4fec-a295-f808b684846f", "tag": "dc1ee91f-5560-494b-b172-808725cd62f1"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:40.102193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.103201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.104142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.124523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] Creating event network-changed:dc1ee91f-5560-494b-b172-808725cd62f1 for instance 12b7e72d-9b1c-4fec-a295-f808b684846f on n-h1-860556-1 Oct 06 13:05:40.131865 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-adcded5e-fced-4d60-8389-2bdfc397485c req-2620f756-4f68-4ea6-8359-889105b09861 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069489 Oct 06 13:05:40.133106 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1838/3663] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:40.426459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a166b82-9b52-4339-8ed7-ffbda1cbaf7c", "tag": "5d3f6f1c-c810-4172-87fe-bd14f8cfac58"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:40.464369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.466410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.468346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.508873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] Creating event network-changed:5d3f6f1c-c810-4172-87fe-bd14f8cfac58 for instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c on n-h1-860556-1 Oct 06 13:05:40.521360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d774eae4-4409-477c-bd98-5668e84e4028 req-7602fd67-d7a1-48ba-8e3f-a7255bb5bb0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100208 Oct 06 13:05:40.525115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1839/3664] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:40.558706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:40.571568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:40.599223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.610847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:05:40.611594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:05:40.612025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:05:40.614294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:05:40.615158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:05:40.633246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.633929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.634715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.635202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.646920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.661879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.666237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.667431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.670972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:40.671734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:40.675987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:40.752503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:05:40.768359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Getting quotas for user d9bc79cb12634352b8fc75ea5bd40a61 and project 306464531f9e479cbfe9a7055b460595. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:05:40.800397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:05:40.807501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:05:40.922595 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c25bb81-1dfb-47b9-8885-f8f43f04d55f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.594230 Oct 06 13:05:40.923664 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1826/3665] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:05:40.937831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efb4b3b8-17fd-4136-9a42-075dac98664a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:40.941529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-efb4b3b8-17fd-4136-9a42-075dac98664a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:41.819087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-efb4b3b8-17fd-4136-9a42-075dac98664a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:41.835517 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efb4b3b8-17fd-4136-9a42-075dac98664a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1207 microversion: 2.1 time: 0.903823 Oct 06 13:05:41.838080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1827/3666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:40 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1207 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:41.849228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:41.850704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:41.893303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:41.895304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:41.897476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:41.902633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:41.904318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:41.906564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:43.386212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:43.400161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:43.407794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:43.409962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b1c4ff6-d20c-403f-bc00-278d2291e85a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 2.881093 Oct 06 13:05:43.412701 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1840/3667] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:40 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:43.420261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a873b2cf-d75b-454b-91e5-52a9bc39b4ba", "tag": "1d951849-31b1-4edb-8259-5d14ee4d9afd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:43.444003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:43.446025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:43.449297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:43.467647 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] Creating event network-changed:1d951849-31b1-4edb-8259-5d14ee4d9afd for instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba on n-h2-860556-1 Oct 06 13:05:43.474813 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-127494cc-506b-4392-b110-3f9ca0075163 req-a1f070c5-84e6-4ef7-8f23-ab4edc8af36c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060449 Oct 06 13:05:43.476109 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1841/3668] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:43.481953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:43.482960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:43.491647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:43.492638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:43.493414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:43.494399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:43.495284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:43.495968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:43.834964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:43.845131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-571fd911-76eb-4ff9-aad8-3fbe1abdb0ca tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1259 microversion: 2.1 time: 0.367406 Oct 06 13:05:43.847707 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1842/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:43 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1259 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:43.988423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:44.052464 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed3102ec-8a65-4470-95c5-c20ea26d23de tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 2.210108 Oct 06 13:05:44.054308 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1828/3670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:41 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:44.446059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:44.448323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:44.475185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:44.482101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:44.483328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:44.484498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:44.488865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:44.490978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:44.491615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:44.701546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-712829721", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "faec4f78-e826-4fb5-8191-bb5d7263f0c4"}, {"uuid": "cad5da30-dc48-44e4-b559-b40d6cf43185"}, {"uuid": "faec4f78-e826-4fb5-8191-bb5d7263f0c4"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:44.872718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] validate_networks() for [('faec4f78-e826-4fb5-8191-bb5d7263f0c4', None, None, None, None, None), ('cad5da30-dc48-44e4-b559-b40d6cf43185', None, None, None, None, None), ('faec4f78-e826-4fb5-8191-bb5d7263f0c4', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:05:45.506734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:45.515871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:45.517332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:45.518684 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1b7e716-eed6-45bb-96b5-7ddcd6cee1c5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 1.082114 Oct 06 13:05:45.535191 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1843/3671] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:44 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:45.546100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:45.554547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:45.573312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:45.575617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:45.578042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:45.579590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:45.581969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:45.584415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:45.910382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:45.920861 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c61715d-e8e0-4fa3-9395-b8e704258936 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1277 microversion: 2.1 time: 0.384156 Oct 06 13:05:45.921474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1844/3672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:45 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:45.947203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:45.947828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:45.982802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:45.983683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:45.984316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:45.985257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:45.986041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:45.986772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:47.905240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:47.916140 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-976526f7-730f-4689-b995-5b58783a6a26 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 1.972999 Oct 06 13:05:47.916751 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1845/3673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:45 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:47.943624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-plugged", "status": "completed", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:48.006007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:48.007541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:48.008492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:48.076079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] Creating event network-vif-plugged:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:05:48.102120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a95e2f11-679d-46e3-866c-1ba8713f813a req-95773ce0-581c-4ed6-ac87-f6fb4cf62753 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178684 Oct 06 13:05:48.108374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1846/3674] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:48.132053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288eff98-ad91-480a-bf5c-2756bdf40bb2", "name": "network-vif-deleted", "tag": "ec31873b-7c34-4d36-b17b-0325f7d7dca5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:48.171938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:48.180411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:48.183833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:48.223687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] Creating event network-vif-deleted:ec31873b-7c34-4d36-b17b-0325f7d7dca5 for instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 on n-h2-860556-1 Oct 06 13:05:48.238358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-19a97057-53ec-465b-8f19-34ef012d7275 req-b4493250-2401-4c87-bc01-4ee7abc4f67f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124973 Oct 06 13:05:48.247333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1847/3675] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:48.268298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:48.273526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:48.324947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:48.325466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:48.330153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:48.331094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:48.334127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:48.335012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:49.913901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:49.935484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:49.951201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:49.958118 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f14a5e94-cc3d-4dd4-9986-005a6183ffd6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 1.706207 Oct 06 13:05:49.975303 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1848/3676] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:48 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:49.986653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:49.987841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:50.008731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:50.009447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:50.011993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:50.012956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:50.013604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:50.014941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:50.596814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:05:50.598008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:05:50.598525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:05:50.599309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:05:50.600064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:05:50.602362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:50.658020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:50.663406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:50.667817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:50.669518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:50.674024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:50.680988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:50.776225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Getting quotas for project 292eb01305864b36bf5564aca04deeec. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:05:50.814052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Getting quotas for user 0df15d438aab4b3da00d48111df5e866 and project 292eb01305864b36bf5564aca04deeec. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:05:50.881777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:05:50.895955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:05:50.941031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:51.004243 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2498330d-a28e-495a-8c2b-adbabc36f16f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 1.026529 Oct 06 13:05:51.012633 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1849/3677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:49 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:51.049301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:51.051272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:51.061159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:51.071294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:51.073206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:51.075358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:51.075961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:51.078285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:51.110088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6162bd88-3138-48c6-8f7f-88d2d44a8417 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.413978 Oct 06 13:05:51.112365 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1829/3678] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:05:51.126177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a166b82-9b52-4339-8ed7-ffbda1cbaf7c", "name": "network-vif-plugged", "status": "completed", "tag": "5d3f6f1c-c810-4172-87fe-bd14f8cfac58"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:51.184503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:51.185002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:51.185451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:51.283270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] Creating event network-vif-plugged:5d3f6f1c-c810-4172-87fe-bd14f8cfac58 for instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c on n-h1-860556-1 Oct 06 13:05:51.296807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fef171b0-d1cb-4455-a3f0-349866897ab9 req-db9ef132-2df3-4b5e-b88d-a5775c0bb8e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179878 Oct 06 13:05:51.307994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1830/3679] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:51.350800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:51.366081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:51.381185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:51.382088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:51.383031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:51.384221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:51.384967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:51.386084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:51.927116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:51.937622 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e936106c-e855-408d-9945-004490c9a5ea tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 0.919815 Oct 06 13:05:51.938543 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1850/3680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:51 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:51.944739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0cd018af-60c3-4711-af4e-cfa53f6fd485 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:51.946174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0cd018af-60c3-4711-af4e-cfa53f6fd485 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:52.197493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:52.211220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:52.212795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:52.214051 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c050c972-d134-49dd-8378-98cd5aca11af tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.901106 Oct 06 13:05:52.222323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0cd018af-60c3-4711-af4e-cfa53f6fd485 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:52.225023 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1831/3681] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:51 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:52.232720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:52.242091 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0cd018af-60c3-4711-af4e-cfa53f6fd485 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1212 microversion: 2.1 time: 0.300214 Oct 06 13:05:52.243572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:52.245512 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1851/3682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:51 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1212 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:52.274527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:52.280566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:52.284272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:52.285753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:52.290639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:52.291345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:52.556457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:52.569624 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33379f7b-0db8-4279-ace2-15e1cb87dadf tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.342513 Oct 06 13:05:52.575030 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1832/3683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:52 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:52.965221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:52.965883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:53.018058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.018650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.032403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.036065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.036577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.037035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.268992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:53.268992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:53.288205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.289209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.292385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.293556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.297513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.298260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.794707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:53.810114 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e158b597-0ad3-47ab-a194-252cf2d749fd tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 0.843777 Oct 06 13:05:53.811165 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1852/3684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:52 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:53.827702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:53.829891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:53.851434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.855306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.857127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.859367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:53.861730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:53.865660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:53.875157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:53.890558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:53.911126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:53.915658 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ab22c5c-d707-4c7c-9ce2-1adc2505ba09 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.661980 Oct 06 13:05:53.932855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1833/3685] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:53 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:53.961910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a873b2cf-d75b-454b-91e5-52a9bc39b4ba", "name": "network-vif-plugged", "status": "completed", "tag": "1d951849-31b1-4edb-8259-5d14ee4d9afd"}, {"server_uuid": "12b7e72d-9b1c-4fec-a295-f808b684846f", "name": "network-vif-plugged", "status": "completed", "tag": "dc1ee91f-5560-494b-b172-808725cd62f1"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:54.010085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.014248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.015914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:54.084932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Creating event network-vif-plugged:1d951849-31b1-4edb-8259-5d14ee4d9afd for instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba on n-h2-860556-1 Oct 06 13:05:54.087363 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] Creating event network-vif-plugged:dc1ee91f-5560-494b-b172-808725cd62f1 for instance 12b7e72d-9b1c-4fec-a295-f808b684846f on n-h1-860556-1 Oct 06 13:05:54.136619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-32587baf-c938-442b-8959-c1dcd6e0a0b9 req-c043ce02-0b84-4ba9-b101-11bcaa6e49cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.190631 Oct 06 13:05:54.142721 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1834/3686] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:54.179470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:54.181341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:54.200637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.201161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.203693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:54.207730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.208346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.208694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:54.379829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:54.402908 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42e50a8e-8db7-4a87-acfe-1d5188c86f34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1272 microversion: 2.1 time: 0.587439 Oct 06 13:05:54.403522 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1853/3687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:53 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1272 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:54.424829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c627b87d-29b4-4c59-8446-cf882d247e99", "tag": "488ad0e7-708d-422c-8b4a-fec9a053e69e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:05:54.466612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.467100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.478459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:54.553871 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] Creating event network-changed:488ad0e7-708d-422c-8b4a-fec9a053e69e for instance c627b87d-29b4-4c59-8446-cf882d247e99 on n-h2-860556-1 Oct 06 13:05:54.578683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-117bb882-65f8-4d37-a324-d5ccf7782540 req-16d9bef8-8242-4fb1-99d5-a3fac3805c8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163177 Oct 06 13:05:54.583783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1854/3688] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:05:54.841430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:54.843339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:54.867766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.869465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.869955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:54.874006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:54.876167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:54.879550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:55.768339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:55.777588 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7fdfff86-b63a-4cff-87eb-cf515ab66a3e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 0.943832 Oct 06 13:05:55.782391 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1855/3689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:54 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:55.797405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:55.801896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:55.823718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:55.824666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:55.827375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:55.830191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:55.830927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:55.833505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:55.982899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:56.016435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37e2db9d-2eca-4815-ac80-969aca797611 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 1.842742 Oct 06 13:05:56.017449 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1835/3690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:54 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:56.033394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:56.034914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:56.055742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:56.058166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:56.058971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:56.063480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:56.064473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:56.067714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:56.297177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:56.311747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:56.314193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:56.315445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33b1f9cb-3260-402b-8392-952c46ecb77e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.531192 Oct 06 13:05:56.322752 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1856/3691] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:55 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:56.348853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:56.374785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b08848c-c5b9-430e-b768-61c149a0a5f8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1270 microversion: 2.1 time: 0.355247 Oct 06 13:05:56.389777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1836/3692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:56 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1270 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:56.814838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:56.816284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:56.834468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:56.839301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:56.840973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:56.844277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:56.849121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:56.857504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.043522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:57.044756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:57.060313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.060889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.061914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.064228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.066827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.068657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.486683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:57.505134 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d006ca6-b4fc-491e-9c45-5bd4dc7db332 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1323 microversion: 2.1 time: 0.700007 Oct 06 13:05:57.510262 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1857/3693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:56 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:57.527148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:57.528361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:57.535509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:57.544958 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b7c1856-cb91-4899-87be-b219cc91f89f tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.505262 Oct 06 13:05:57.548396 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1837/3694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:57 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:57.558740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:57.560047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:57.562479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.563360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.566261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.567989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.569061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.570620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.577430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.578073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.579772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.580533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:57.584873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:57.585464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:57.609515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:05:57.773812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:57.782498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ccf3b68-374e-4865-a875-343720282c8a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1270 microversion: 2.1 time: 0.232789 Oct 06 13:05:57.798547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1838/3695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:57 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:58.075753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:58.092107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:58.098484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:58.101004 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2d5f7a8-46c5-4b1f-a047-744cd6991c5e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.585950 Oct 06 13:05:58.103424 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1858/3696] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:57 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:05:58.533086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:58.533686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:58.552203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:58.552780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:58.553431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:58.554422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:58.555055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:58.555747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:58.568556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:58.571074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:58.580359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:58.580863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:58.581335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:58.582078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:58.582541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:58.582985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:59.599533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:59.610921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-047a4818-8b97-4410-aee5-33490fbd033c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 1.046541 Oct 06 13:05:59.614034 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1859/3697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:58 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:05:59.617201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:05:59.626198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:59.627497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:59.630999 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff7273c0-c133-4653-a053-014d80a21009 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 200 len: 1516 microversion: 2.1 time: 1.101495 Oct 06 13:05:59.637153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1839/3698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:58 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 1516 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:05:59.645569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:05:59.645990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:59.646671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:05:59.649589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:59.650349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:59.651279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:59.655982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:59.656879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:59.660941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:59.667188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:59.667849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:05:59.668793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:05:59.669366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:05:59.670076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:00.602807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:00.641367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:00.644994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:00.646473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-baec9588-f865-45ed-987b-8a3e42fa3620 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 1.008127 Oct 06 13:06:00.648837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1840/3699] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:05:59 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:00.659674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:00.663390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:00.685693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:00.686326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:00.686696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:00.687437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:00.687896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:00.695639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:00.730979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:00.816924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:00.826618 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4e524ac-ae99-4d45-ad1e-6c6f4c0f7fcd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1312 microversion: 2.1 time: 1.211123 Oct 06 13:06:00.832614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1860/3700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:05:59 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1312 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:00.840780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:00.851603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:00.857840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:00.878735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:00.879757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:00.881244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:00.884174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:00.886863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:00.889457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:01.176576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:01.199336 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7dce28b1-38aa-4440-b2eb-a47d471de662 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1516 microversion: 2.1 time: 0.549172 Oct 06 13:06:01.200048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1841/3701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:00 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1516 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:01.254896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:01.255712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:01.277795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:01.278316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:01.278774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:01.281668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:01.283931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:01.287509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:01.300424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:01.552035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:01.573103 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f68f1c6b-efc6-4800-8ff6-27db9e8ab85c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.733641 Oct 06 13:06:01.574573 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1861/3702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:00 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:01.679432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:01.680480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:01.693205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:01.697354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:01.702556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:01.705612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:01.706627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:01.707385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.168296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:02.187409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:02.199493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2451e6bb-b6c0-4263-b8f1-43d65400fd52 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 200 len: 1516 microversion: 2.1 time: 0.975281 Oct 06 13:06:02.214015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:02.216333 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1842/3703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:01 2022] GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 1516 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:02.226378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:02.228126 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a1808258-e965-49a2-a4fc-dc4e0fc1a3bf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.545214 Oct 06 13:06:02.245762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1862/3704] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:01 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:06:02.254610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:02.254843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:02.258147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:02.264888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:02.273526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:02.278399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.279809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.281916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.284774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.285409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.286203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.297322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.298130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.298566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.306807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.309354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.309856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.377858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:02.631685 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37afdab9-477a-4159-831c-26f51293839e tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 204 len: 0 microversion: 2.1 time: 0.396753 Oct 06 13:06:02.635233 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1863/3705] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:02 2022] DELETE /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:02.654394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:02.655767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:02.676948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.677522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.677938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:02.686561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:02.688461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:02.689095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:03.070570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:03.081056 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36d5d4ae-6d68-479f-8c3b-30a7ba3d637a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1333 microversion: 2.1 time: 0.863283 Oct 06 13:06:03.081614 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1843/3706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:02 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1333 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:03.189079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:03.203044 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c2b32db-7cdb-4ae4-ab67-c673cb7a37a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.568940 Oct 06 13:06:03.205295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1864/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:02 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:03.213124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:03.213124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:03.246980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:03.247500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:03.247959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:03.248699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:03.252863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:03.253466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:03.621159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:03.636223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f38fdd5-a4c6-4f45-a920-bb2e56061dd3 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 200 len: 1522 microversion: 2.1 time: 0.428435 Oct 06 13:06:03.639445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1865/3708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:03 2022] GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:03.663989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:03.664837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:03.671245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:03.671758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:03.672194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:03.673363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:03.674232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:03.674983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:03.771198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2083524437", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:03.912892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:06:04.795385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:04.813982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:04.815475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:04.816673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2fcbd720-b28c-421d-b872-6910c026d8b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 1.165661 Oct 06 13:06:04.836675 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1866/3709] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:03 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:04.852581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:04.853522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:04.863770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:04.864516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:04.868255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:04.873006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:04.873714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:04.874371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:05.997962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:06.012630 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52f10508-091a-492a-b404-456666ac53c6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 1.173538 Oct 06 13:06:06.031043 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1867/3710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:04 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:06.045299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:06.054588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:06.078272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:06.082703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:06.083603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:06.084616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:06.087892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:06.091151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:06.848117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:06.864196 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f82d191-36b3-4572-96b2-27f509e382f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.831256 Oct 06 13:06:06.865007 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1868/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:06 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:06.881423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:06.882101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:06.906204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:06.906711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:06.907160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:06.907879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:06.913459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:06.914216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:06.981031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:06:06.981690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:06:06.982405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:06:06.982997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:06:06.983589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:06:07.014888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:07.015912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:07.019612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:07.021783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:07.029894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:07.030681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:07.105704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:06:07.112373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:06:07.131391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:06:07.135176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:06:07.207424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-756e8b3c-a356-49c6-b629-7c35cc9c65f5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.124300 Oct 06 13:06:07.207829 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1844/3712] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:06:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:06:07.219752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c627b87d-29b4-4c59-8446-cf882d247e99", "name": "network-vif-plugged", "status": "completed", "tag": "488ad0e7-708d-422c-8b4a-fec9a053e69e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:07.272648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:07.273145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:07.273593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:07.295766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] Creating event network-vif-plugged:488ad0e7-708d-422c-8b4a-fec9a053e69e for instance c627b87d-29b4-4c59-8446-cf882d247e99 on n-h2-860556-1 Oct 06 13:06:07.307021 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-438cc8d4-543b-428f-ac8f-e663c76c31de req-af56e46c-fbb3-42a6-b728-e9f915c051a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097043 Oct 06 13:06:07.308286 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1845/3713] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:07.663479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:07.690811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e925a08-d93c-470e-8277-281361dcccbb tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 200 len: 1480 microversion: 2.1 time: 0.818981 Oct 06 13:06:07.691671 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1869/3714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:06 2022] GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 1480 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:07.716324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:07.739051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:07.751647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Searching by: {'deleted': False, 'project_id': '174e3c56e3314cb5b80f05ad67b81926'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:07.776059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:07.777489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:07.778164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:07.779381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:07.780019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:07.780906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:07.867090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:07.945262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7470e51-9dd5-4fd5-b9cc-77296333dc4b tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.232841 Oct 06 13:06:07.949809 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1870/3715] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:06:07 2022] GET /compute/v2.1/servers => generated 344 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:07.984338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:07.985160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:08.014351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.014681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.015121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.027438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.030254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.035540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.113154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20006657-bdf3-43ba-80da-d4cc87775d4a tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] Calling method '.version_select at 0x7f7d3f76b790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:08.213918 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20006657-bdf3-43ba-80da-d4cc87775d4a tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.904041 Oct 06 13:06:08.215326 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1846/3716] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:06:07 2022] GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18/defaults => generated 371 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:08.220575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:08.222776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:08.231916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.232745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.233455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.234643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.235311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.235961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.773313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:08.783575 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61d886f9-a987-4c4d-81c8-20d16db090b5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.566839 Oct 06 13:06:08.824788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1847/3717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:08 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:08.829635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:08.841611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:08.856083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.858359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.860517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.863183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.863857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.864475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.894588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:08.905259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:08.910087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:08.914235 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c8bfe2db-6b94-4172-b610-5769bf11d590 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1741 microversion: 2.20 time: 0.962007 Oct 06 13:06:08.919221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1871/3718] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:07 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1741 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:08.929905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a166b82-9b52-4339-8ed7-ffbda1cbaf7c", "name": "network-vif-deleted", "tag": "5d3f6f1c-c810-4172-87fe-bd14f8cfac58"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:08.955703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:08.957368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:08.963865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:08.986883 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] Creating event network-vif-deleted:5d3f6f1c-c810-4172-87fe-bd14f8cfac58 for instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c on n-h1-860556-1 Oct 06 13:06:08.997340 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3a3cffd2-ba2c-4de5-8373-94bcb3cbfdac req-dc78134e-1d18-415f-93b7-d4849a910e13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076584 Oct 06 13:06:09.004101 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1872/3719] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:09.010450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:09.011091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:09.030488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.030987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.031426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.032147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.032750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.033207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.319964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:09.331969 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45eb7e07-4240-45ea-b83b-4d2ed8d52420 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1189 microversion: 2.1 time: 0.503346 Oct 06 13:06:09.333070 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1848/3720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:08 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1189 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:09.356326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:09.371807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:09.375191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Searching by: {'deleted': False, 'project_id': '174e3c56e3314cb5b80f05ad67b81926'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:09.388153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.390096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.390557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.391318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.391788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.392216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.454600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:09.482867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:09.489464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:09.493860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b05653b0-094d-4d34-a990-08b5f123f199 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1307 microversion: 2.1 time: 0.488121 Oct 06 13:06:09.494480 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1873/3721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:09 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:09.499265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4bdbccad-5ccb-4952-b666-097280d57294 tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] Calling method '.version_select at 0x7f7d3e6791f0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:09.561673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:09.580671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.583218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.583741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.907109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4bdbccad-5ccb-4952-b666-097280d57294 tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18" status: 200 len: 371 microversion: 2.1 time: 0.411275 Oct 06 13:06:09.909766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1874/3722] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 13:06:09 2022] GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18 => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:09.922763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:09.923721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:09.935414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.937647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.939663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.941711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.943481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.944109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.963319 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] HTTP exception thrown: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c HTTP/1.1 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2a166b82-9b52-4339-8ed7-ffbda1cbaf7c'} Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:09.965638 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:09.971603 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:09.973362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 404 to user: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:09.974709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc042ea4-a4b9-4713-b5a8-33e2e8c43eb9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 404 len: 111 microversion: 2.1 time: 0.063595 Oct 06 13:06:09.981464 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1875/3723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:09 2022] GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:09.988088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:09.989147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:09.996391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.997182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:09.997830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:09.998744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:09.999562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.000170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.340495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:10.357019 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9479bdc-3f4f-4253-a987-b01d2eed97eb tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.374152 Oct 06 13:06:10.359906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1876/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:09 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:10.368174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d112b9fe-0749-4a80-97fd-b9e4ac4b389e tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] Calling method '.version_select at 0x7f7d3e63aee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:10.482630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28947ff3-4a57-4f23-a4b7-88095b2c1cf0 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.148018 Oct 06 13:06:10.484501 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1849/3725] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:06:09 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:10.502653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:10.503743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:10.512817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.514369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.516030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.518414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.519001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.521016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.714838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d112b9fe-0749-4a80-97fd-b9e4ac4b389e tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.353503 Oct 06 13:06:10.716183 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1877/3726] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18/defaults => generated 371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:10.723596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:10.734118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:10.735873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:10.756794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.757303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.757845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.759056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.759906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.760500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.885778 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46f1927a-994f-483b-a19c-75bda7fba7d8 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.167715 Oct 06 13:06:10.887348 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1878/3727] 10.222.0.26 () {58 vars in 1230 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:06:10.892439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:10.893907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:10.901537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.902343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.907079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.908254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:10.910195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:10.910756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:10.948023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:10.959555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:10.962111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:10.962278 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eba8ad9d-2b6b-4f96-8017-0c253f9ed335 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1723 microversion: 2.20 time: 0.476589 Oct 06 13:06:10.963125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1850/3728] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:10.973153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64ad15cd-49b6-47cd-856f-97360386c211 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:10.994054 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64ad15cd-49b6-47cd-856f-97360386c211 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029790 Oct 06 13:06:10.994646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1851/3729] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:11.004884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.005632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:11.012311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.012815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.013411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.014195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.014908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.015352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.038624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:11.050416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3eac11b-16e2-49f4-af6f-455c36ba0371 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1251 microversion: 2.1 time: 0.160496 Oct 06 13:06:11.052108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1879/3730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1251 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:11.066404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f584095-ce01-42a0-9036-3312075a7e14 tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] Calling method '.version_select at 0x7f7d3ee99ca0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.358928 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f584095-ce01-42a0-9036-3312075a7e14 tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18" status: 200 len: 371 microversion: 2.1 time: 0.305402 Oct 06 13:06:11.367700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1880/3731] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 13:06:11 2022] GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18 => generated 371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:11.373077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2a1f173-428a-4832-9e9e-7c9583904e14 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2a1f173-428a-4832-9e9e-7c9583904e14 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: action_args: {} Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 06 13:06:11.377198 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2a1f173-428a-4832-9e9e-7c9583904e14 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2a1f173-428a-4832-9e9e-7c9583904e14 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010423 Oct 06 13:06:11.388802 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1881/3732] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Oct 6 13:06:11 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:06:11.392176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "tag": "c343dba6-304c-4b89-962c-947f463af8cc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:11.407232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.407717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.408162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.419713 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] Creating event network-changed:c343dba6-304c-4b89-962c-947f463af8cc for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:11.425354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-550dc218-9123-4320-a246-8455d799358c req-c139ac5d-d002-46f4-9ccf-e472daf333c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037581 Oct 06 13:06:11.427904 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1882/3733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:11.433508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.434348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:11.442565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.443278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.443879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.444772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.445393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.446005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.477685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:11.478856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:11.486769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe409306-f97a-46c5-956f-186d19d79e3a tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1487 microversion: 2.1 time: 0.490839 Oct 06 13:06:11.502149 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1852/3734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:10 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1487 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:11.511052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c4e0e67a-7864-4519-a9e7-b6f6b408b13d tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] Calling method '.version_select at 0x7f7d47757820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.618687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c4e0e67a-7864-4519-a9e7-b6f6b408b13d tempest-QuotasTestJSON-1306519639 tempest-QuotasTestJSON-1306519639-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18?user_id=e33f5b3e848b4cfb858d29cdfa8c545f" status: 200 len: 371 microversion: 2.1 time: 0.114570 Oct 06 13:06:11.620066 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1853/3735] 10.222.0.26 () {58 vars in 1323 bytes} [Thu Oct 6 13:06:11 2022] GET /compute/v2.1/os-quota-sets/9b903a453557446bbb2d9310c709dd18?user_id=e33f5b3e848b4cfb858d29cdfa8c545f => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:11.625901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.626858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:11.636660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.637161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.638090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.639047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.639730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.640398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.644460 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7cb1a7b0-999c-4e63-8a13-1ca187e0151e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 204 len: 0 microversion: 2.1 time: 0.213531 Oct 06 13:06:11.650201 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1883/3736] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:11 2022] DELETE /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:11.662217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:11.673768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:11.677327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:11.689852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.692505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.693229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.694537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.695188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.697728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.732138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:11.772632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2c6ebf5-84b6-4be6-a93a-d1c8df7dc68d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.119726 Oct 06 13:06:11.774154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1884/3737] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:06:11 2022] GET /compute/v2.1/servers => generated 683 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:11.782413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-328879662"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:11.794563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:11.798577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:11.811303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.812234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.812864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:11.813659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:11.814308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:11.814770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.102377 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b20644b-09cb-46dd-a7c0-0f825f7ed1f5 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "POST /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99/action" status: 202 len: 0 microversion: 2.1 time: 0.326862 Oct 06 13:06:12.103338 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1885/3738] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:06:11 2022] POST /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 13:06:12.108562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:12.109385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:12.116711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.117546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.118109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.119129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.119806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.120468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.380497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:12.389700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c6c641b-a815-4d95-b5ea-25aca5d3a141 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.768272 Oct 06 13:06:12.395376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1854/3739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:11 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:12.406155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:12.422160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:12.422936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.servers [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Removing options 'limit' from query {{(pid=129614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 06 13:06:12.423612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:12.438150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.438716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.441395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.442305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.442763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.445542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.490030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:12.526603 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-914d3653-5670-4e8d-a27a-e4ad2df7a1f7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.129848 Oct 06 13:06:12.528307 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1855/3740] 10.222.0.26 () {58 vars in 1144 bytes} [Thu Oct 6 13:06:12 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:12.535671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:12.537072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:12.543807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.544642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.545803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.546862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.547503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.548313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.753226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:12.771407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32b489f2-306d-4c45-ae9d-4412918c9687 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1610 microversion: 2.1 time: 0.666625 Oct 06 13:06:12.772296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1886/3741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:12 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1610 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:12.799487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:12.800963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:12.818925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.819464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.819932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:12.820639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:12.821097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:12.821519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:13.134545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:13.159756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:13.161881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:13.163269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91a1498f-e8d3-480b-bf47-5c5bcb844310 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1723 microversion: 2.20 time: 0.633929 Oct 06 13:06:13.181529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1856/3742] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:12 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1723 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:13.199141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ae9ef77-9d91-46ff-94df-f83b6fa58d81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d476c0ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.284822 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ae9ef77-9d91-46ff-94df-f83b6fa58d81 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1" status: 200 len: 1411 microversion: 2.1 time: 0.101765 Oct 06 13:06:13.285417 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1857/3743] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:13.304990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa53aaf6-9822-4b77-abca-9a208d937040 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa53aaf6-9822-4b77-abca-9a208d937040 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi '-1' Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 06 13:06:13.316420 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 06 13:06:13.322495 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.327275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa53aaf6-9822-4b77-abca-9a208d937040 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:13.331434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa53aaf6-9822-4b77-abca-9a208d937040 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.043174 Oct 06 13:06:13.333362 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1858/3744] 10.222.0.26 () {58 vars in 1142 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:06:13.343584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-unplugged", "status": "completed", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:13.370601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:13.372332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:13.375332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:13.401997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] Creating event network-vif-unplugged:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:06:13.411261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fca6075a-67cc-465e-8413-a0f383f7c26e req-2b170de5-1a0b-402f-85c9-da991f182b73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074377 Oct 06 13:06:13.412400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1859/3745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:13.418129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d61eef8b-6ced-432e-881d-8660f5c19c53 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f04c430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.481283 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d61eef8b-6ced-432e-881d-8660f5c19c53 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1" status: 200 len: 1411 microversion: 2.1 time: 0.067178 Oct 06 13:06:13.482359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1860/3746] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 => generated 1411 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:13.489448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0be449c-0e7a-40a5-b79a-0ca66e6fc1c2 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0be449c-0e7a-40a5-b79a-0ca66e6fc1c2 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: action_args: {} Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi 'testing' Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 06 13:06:13.500952 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 06 13:06:13.507126 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:13.514076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0be449c-0e7a-40a5-b79a-0ca66e6fc1c2 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:13.516370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0be449c-0e7a-40a5-b79a-0ca66e6fc1c2 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.032792 Oct 06 13:06:13.518214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1861/3747] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:06:13.530582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.533643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:13.552943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:13.554410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:13.555683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:13.556452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:13.556930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:13.557376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:13.735621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:13.746419 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1e0dea5-9add-4c2d-b207-270c337d087b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.959046 Oct 06 13:06:13.762331 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1887/3748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:12 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:13.766198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eb67dbcf-e7a6-4132-82ca-5b6255ac8f84 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e63a940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.944556 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eb67dbcf-e7a6-4132-82ca-5b6255ac8f84 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1" status: 204 len: 0 microversion: 2.1 time: 0.190284 Oct 06 13:06:13.945434 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1888/3749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:13 2022] DELETE /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:13.950583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0d7b327-6fc2-40ae-8f94-36855057e817 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:13.956383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0d7b327-6fc2-40ae-8f94-36855057e817 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:13.957474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0d7b327-6fc2-40ae-8f94-36855057e817 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:13.963938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.servers [None req-a0d7b327-6fc2-40ae-8f94-36855057e817 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Flavor 'non_existing_flavor' could not be found {{(pid=129615) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 06 13:06:13.965321 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0d7b327-6fc2-40ae-8f94-36855057e817 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018453 Oct 06 13:06:13.966063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1889/3750] 10.222.0.26 () {58 vars in 1178 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:06:13.970980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "tag": "cb82a658-1f41-4072-b041-52bc688aef5a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:13.982370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:13.982942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:13.984906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:13.997638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] Creating event network-changed:cb82a658-1f41-4072-b041-52bc688aef5a for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:14.004789 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e939512a-d275-40ed-afc6-92146ea9a3a5 req-13cf9b5e-3a9e-47c3-bbb5-04c4b448f738 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Oct 06 13:06:14.005679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1890/3751] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:14.011434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:14.012437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:14.020574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.021596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.022422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.023387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.024478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.037099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.135571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:14.144809 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec8f6369-db86-43a7-bca7-bb08fa238863 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.622389 Oct 06 13:06:14.158203 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1862/3752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:13 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:14.166911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f248167-df6a-4e94-b8c6-174bf6a4e1a1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f33d9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:14.195970 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3f248167-df6a-4e94-b8c6-174bf6a4e1a1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Image not found. Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f248167-df6a-4e94-b8c6-174bf6a4e1a1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 HTTP/1.1 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c2601f4b-104f-471c-a584-851fde8e4de1'} Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c2601f4b-104f-471c-a584-851fde8e4de1 Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:06:14.199475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2601f4b-104f-471c-a584-851fde8e4de1 could not be found. Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f248167-df6a-4e94-b8c6-174bf6a4e1a1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:14.206580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f248167-df6a-4e94-b8c6-174bf6a4e1a1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1" status: 404 len: 62 microversion: 2.1 time: 0.044749 Oct 06 13:06:14.219463 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1863/3753] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:06:14 2022] GET /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:06:14.230094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:14.240258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:14.246029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:14.259809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.260317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.260771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.265439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.266033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.266456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.367864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7894e716-b3e9-448b-8738-4f242356fc2f tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.158577 Oct 06 13:06:14.368861 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1864/3754] 10.222.0.26 () {58 vars in 1174 bytes} [Thu Oct 6 13:06:14 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:06:14.476820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:14.486559 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e33d1dd-1150-465e-87ad-56db5a369e9e tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1610 microversion: 2.1 time: 0.479211 Oct 06 13:06:14.502134 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1891/3755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:14 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1610 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:14.502134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:14.503480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:14.517632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.519804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.520460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.522647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:14.523127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:14.523556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:14.738844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d2867c0-d38c-4488-bffc-bbae98f08592 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Action: 'create', calling method: .version_select at 0x7f7d476c01f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1634823427", "metadata": {"Type": "work"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:15.042543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:15.055022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:15.056487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:15.057704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2440de0e-f491-4493-b796-a74eadaff641 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1666 microversion: 2.20 time: 0.569061 Oct 06 13:06:15.058368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1892/3756] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:14 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1666 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:15.079239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:15.080437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:15.092136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.092997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.094150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.094891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.095362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.095799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.262084 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d2867c0-d38c-4488-bffc-bbae98f08592 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.891632 Oct 06 13:06:15.262733 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1865/3757] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Oct 6 13:06:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 893 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 13:06:15.267980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:15.281914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:15.284565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:15.305681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.306800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.307538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.308621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.309314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.310046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.438074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:15.452303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4de83a3-0b8f-491e-bbd6-709344672b5c tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1499 microversion: 2.1 time: 0.392848 Oct 06 13:06:15.453300 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1893/3758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:15 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1499 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:15.458017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-788a1756-a748-43b2-8aa2-28513b3e14ba tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.194191 Oct 06 13:06:15.458481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:15.459090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:15.459878 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1866/3759] 10.222.0.26 () {58 vars in 1184 bytes} [Thu Oct 6 13:06:15 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:06:15.465618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df77c013-59e7-4d51-bdfa-ccdf0539f73c"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:15.470038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:15.483654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.484214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.484608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.485512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.487878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.488822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.489548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.494227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.494879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:15.495818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:15.496569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:15.497059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.069913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:16.115130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cca5719f-2297-4d8b-b5ef-5e2b7c6a967f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.653217 Oct 06 13:06:16.116684 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1867/3760] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Oct 6 13:06:15 2022] POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 188 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:06:16.149296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:16.150924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:16.177442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.179420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.182062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.185751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.186716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.188842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.318842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:16.329690 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-186d013a-ee6e-4cf2-b397-67fc79130517 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.875309 Oct 06 13:06:16.334199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1894/3761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:15 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:16.364893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eef7ca31-db99-4f1b-af51-70d3ca9bdd56 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d3e666e50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:16.476098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eef7ca31-db99-4f1b-af51-70d3ca9bdd56 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 200 len: 353 microversion: 2.1 time: 0.140532 Oct 06 13:06:16.476676 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1895/3762] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:06:16 2022] GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:16.483489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a247d2-be46-495d-96cd-912dd6a8d455", "name": "network-vif-deleted", "tag": "deced7f2-ceaf-478a-9418-0b9d3f5da297"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:16.512104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.517024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.517503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.539323 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] Creating event network-vif-deleted:deced7f2-ceaf-478a-9418-0b9d3f5da297 for instance f0a247d2-be46-495d-96cd-912dd6a8d455 on n-h2-860556-1 Oct 06 13:06:16.553562 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1ce49721-ba2c-40eb-aa36-7d6fb060eb0c req-d93d0f24-2bfb-4ec6-822f-5b72d3148af5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067608 Oct 06 13:06:16.568863 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1896/3763] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:16.580859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:16.590573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:16.596987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:16.608413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.609149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.609953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.610920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.613312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.614379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:16.664178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:16.689868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:16.760880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:16.802535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:16.803261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:16.803894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.291917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:17.306890 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08747598-309b-43a5-908a-64f6aaed55dd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 1.186635 Oct 06 13:06:17.320445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1868/3764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:16 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:17.332604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:17.333535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:17.336153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:17.342132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.343137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.343879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.344869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.345505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.347244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.504941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-66e75a40-f46e-44d2-9855-714f60b52f77 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.934454 Oct 06 13:06:17.505862 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1897/3765] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:06:16 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:17.510750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "tag": "74a994a2-b14c-4b0a-867c-a0f80f287047"}, {"name": "network-changed", "server_uuid": "154dffdc-e1fe-439f-9061-c89b7be5d49c", "tag": "208ed6b6-a098-4f99-8907-1e44f8a52186"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:17.539365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.540188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.553250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.584602 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Creating event network-changed:74a994a2-b14c-4b0a-867c-a0f80f287047 for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:17.589974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] Creating event network-changed:208ed6b6-a098-4f99-8907-1e44f8a52186 for instance 154dffdc-e1fe-439f-9061-c89b7be5d49c on n-h1-860556-1 Oct 06 13:06:17.605933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:17.613934 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e315df48-4196-4672-ab7d-1b51a5f4ff73 req-96f3bd98-ce6f-49dd-a726-b1b5ffb42644 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.106786 Oct 06 13:06:17.617604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1898/3766] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:17.620434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78a226ab-4260-495f-acd5-f2099ff4a704 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1252 microversion: 2.1 time: 0.295037 Oct 06 13:06:17.623513 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1869/3767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:17 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1252 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:17.641011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:17.641945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:17.644665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:17.645116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:17.660050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.662111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.664667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.665221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.665779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.666328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.667144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.667941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.669559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.670124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.671251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.671737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.703374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 13:06:17.822620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b06a4c10-6d09-406f-9771-04b2d597af5d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/action" status: 202 len: 0 microversion: 2.20 time: 0.203529 Oct 06 13:06:17.825251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1899/3768] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:06:17 2022] POST /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:17.835397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:17.847944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:17.865119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.865780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.866342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:17.867161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:17.867908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:17.870043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.211637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.229132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3f61a69-9543-44c4-9f1f-c21a40292a87 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1505 microversion: 2.1 time: 0.597990 Oct 06 13:06:18.229905 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1870/3769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:17 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:18.245340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45ef60ba-fb90-4c97-bc52-86a68c6b20ec tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d3f727b80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.358433 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45ef60ba-fb90-4c97-bc52-86a68c6b20ec tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 200 len: 354 microversion: 2.1 time: 0.127256 Oct 06 13:06:18.359548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1871/3770] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:18.365882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d67a7ea3-f9e8-4d1c-9a96-846f5de65dd1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.374113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d67a7ea3-f9e8-4d1c-9a96-846f5de65dd1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.379657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.383100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d67a7ea3-f9e8-4d1c-9a96-846f5de65dd1 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022205 Oct 06 13:06:18.383683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1872/3771] 10.222.0.26 () {58 vars in 1178 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:06:18.388098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-337b7637-5616-41a1-a22e-318bde70099e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.557456 Oct 06 13:06:18.391240 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1900/3772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:17 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:18.401452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.410657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:18.417364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.421726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.421726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.421726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.421726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.421726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.425690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.429710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:18.472167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.477581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.478084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.480981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.481443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.481917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.868509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.886243 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99783cc1-9199-4501-95e0-81e6bc5930e2 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.490025 Oct 06 13:06:18.891649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1901/3773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:18.906654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5cace351-6359-421d-85d9-2887781683c0 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d3e60e550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.912242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.926040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.927914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.933925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-82ff4094-9c95-48fb-b8cb-6eca123985d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1752 microversion: 2.20 time: 0.524542 Oct 06 13:06:18.934788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1873/3774] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1752 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:18.939484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:18.948422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:18.954697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Searching by: {'deleted': False, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:06:18.969261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.969674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.970153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:18.970876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:18.973333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:18.973835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.003361 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5cace351-6359-421d-85d9-2887781683c0 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 200 len: 354 microversion: 2.1 time: 0.109215 Oct 06 13:06:19.004440 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1902/3775] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:19.010144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.012863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.028077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:06:19.036966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.040227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.040901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.042887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.048853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.050147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.081917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3e9d89b-7249-4449-92fe-cd411a229f3b tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.141930 Oct 06 13:06:19.082922 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1874/3776] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:06:18 2022] GET /compute/v2.1/servers => generated 683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:19.091738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c627b87d-29b4-4c59-8446-cf882d247e99", "name": "network-vif-plugged", "status": "completed", "tag": "488ad0e7-708d-422c-8b4a-fec9a053e69e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:19.125884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.126651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.127216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.152604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] Creating event network-vif-plugged:488ad0e7-708d-422c-8b4a-fec9a053e69e for instance c627b87d-29b4-4c59-8446-cf882d247e99 on n-h2-860556-1 Oct 06 13:06:19.169508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ab481e67-3886-45d0-a99f-0ba9be9c3347 req-2cedec90-a95b-4c9c-908b-e3babee5c911 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084947 Oct 06 13:06:19.175726 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1875/3777] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:19.195400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7daf0d50-0492-41b7-b2da-d1cb5fc500e1 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d476c01f0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.261693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:19.274963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c1ee2d1-ad88-4379-bbe6-f421256fd479 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1252 microversion: 2.1 time: 0.266115 Oct 06 13:06:19.277839 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1903/3778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:19 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1252 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:19.287790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.290504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.306832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.309300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.312203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.313679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.317350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.318064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.350975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] HTTP exception thrown: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:19.354704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7daf0d50-0492-41b7-b2da-d1cb5fc500e1 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 202 len: 0 microversion: 2.1 time: 0.174555 Oct 06 13:06:19.355289 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1876/3779] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:06:19 2022] DELETE /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:06:19.360343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.361090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c HTTP/1.1 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2a166b82-9b52-4339-8ed7-ffbda1cbaf7c'} Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:19.374355 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 404 to user: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:19.382387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b88bb4b-b89b-4331-ad4d-3fa36282078d tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 404 len: 111 microversion: 2.1 time: 0.096908 Oct 06 13:06:19.385466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.385466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.385466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.385466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.385466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.386370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.386801 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1904/3780] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:19 2022] DELETE /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:19.391591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ff00e33-cec1-42d3-b961-c4a4b684cf41 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d3ed7c550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.685832 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ff00e33-cec1-42d3-b961-c4a4b684cf41 tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 200 len: 353 microversion: 2.1 time: 0.297878 Oct 06 13:06:19.686663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1905/3781] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:06:19 2022] GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 353 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:19.697088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.698240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.710136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.711288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.713330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.714376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.715723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.716779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.756651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:19.764503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:19.773531 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-def3cbf1-173a-4b8e-b48f-fd455fc60a3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1500 microversion: 2.1 time: 0.416571 Oct 06 13:06:19.797655 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1877/3782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:19 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1500 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:19.809102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.810210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.828130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.828757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.829287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.832379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.832984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.833504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.949643 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6fb2feee-f3d8-4f02-9b6f-65bc5429ca19 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 204 len: 0 microversion: 2.1 time: 0.261432 Oct 06 13:06:19.950769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1906/3783] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:19 2022] DELETE /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:19.960298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:19.964033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:19.973946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.974450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.974891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:19.979290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:19.980170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:19.981547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.289077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.326105 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c0fba6f-a2d0-4655-9a57-f7b7e3bca5fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.525702 Oct 06 13:06:20.352290 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1878/3784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:19 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:20.363779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.364456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:20.382579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.383080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.383522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.384232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.384886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.385485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.417790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.426512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-013a5240-ba2f-42a4-95a6-bdfa37942f1e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.474502 Oct 06 13:06:20.429650 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1907/3785] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:19 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:20.453394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.457640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:20.470201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:20.475791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.476335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.476768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.486497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.487667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.488127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.656735 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dcf13592-8727-4173-9afd-901ccb6350e4 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "DELETE /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 204 len: 0 microversion: 2.1 time: 0.302158 Oct 06 13:06:20.659270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1879/3786] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:20 2022] DELETE /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:20.669482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.672203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:20.687774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.689662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.690622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.691677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.692344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.693254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.794971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.823905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.831816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.838484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a459daee-a428-421b-a3f7-bd143430e942 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.404176 Oct 06 13:06:20.845545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1908/3787] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:20 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:20.861039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.865763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:20.888507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:20.899749 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9e0ce06-90e2-4859-9b12-333ad2cdeb40 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1252 microversion: 2.1 time: 0.238872 Oct 06 13:06:20.899961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.901210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1880/3788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:20 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1252 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:20.903746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.904466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.905197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:20.905651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:20.906102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:20.910191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35434700-f0f8-41e1-a432-47bd899a866e tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Calling method '.version_select at 0x7f7d4766f040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.944372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] HTTP exception thrown: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c HTTP/1.1 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2a166b82-9b52-4339-8ed7-ffbda1cbaf7c'} Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:20.946381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. Oct 06 13:06:20.952168 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:20.966587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 404 to user: Instance 2a166b82-9b52-4339-8ed7-ffbda1cbaf7c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:20.969942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0921b9e6-2cca-4929-a461-214650056305 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c" status: 404 len: 111 microversion: 2.1 time: 0.122114 Oct 06 13:06:20.983851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1909/3789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:20 2022] GET /compute/v2.1/servers/2a166b82-9b52-4339-8ed7-ffbda1cbaf7c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:20.998842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:20.999483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:21.013356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.013910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.014484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.015336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.015820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.016313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.221209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:21.230245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e616373d-068b-45dc-a479-8a67caeead3b tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1487 microversion: 2.1 time: 0.244864 Oct 06 13:06:21.230851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1910/3790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:20 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1487 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:21.235889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:21.236686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:21.248747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.249262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.251354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.252085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.253568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.254020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.425055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:21.441777 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5fd40524-b001-4dd8-b460-61e35f500d06 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1522 microversion: 2.1 time: 0.209589 Oct 06 13:06:21.457645 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1911/3791] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:21 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:21.463516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:21.464325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:21.470960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.472074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.473042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.473228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.473674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.474202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.506061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:21.598217 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4522ff3d-483e-47c2-b685-ae9eb3af7724 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 204 len: 0 microversion: 2.1 time: 0.138527 Oct 06 13:06:21.599443 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1912/3792] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:21 2022] DELETE /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:21.608494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:21.608494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:21.609569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:21.615268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.615727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.616408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.617318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.617820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.618422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.622865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:21.805196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:21.814798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d0e3e1d-7aab-4e21-add9-09be483f83da tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.214190 Oct 06 13:06:21.816402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1913/3793] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:21 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:21.834747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:21.835692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:21.844732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.845917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.847279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:21.848230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:21.848904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:21.849539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.038093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:22.046799 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-809ca17f-d8d8-4200-b139-bce42a306584 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.221346 Oct 06 13:06:22.047933 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1914/3794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:21 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:22.055020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6d26f05-140d-4cc0-93d6-07d83d6d71da tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e666dc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:22.087769 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f6d26f05-140d-4cc0-93d6-07d83d6d71da tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Image not found. Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6d26f05-140d-4cc0-93d6-07d83d6d71da tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 HTTP/1.1 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c2601f4b-104f-471c-a584-851fde8e4de1'} Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c2601f4b-104f-471c-a584-851fde8e4de1 to delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2601f4b-104f-471c-a584-851fde8e4de1 could not be found. Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.089708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6d26f05-140d-4cc0-93d6-07d83d6d71da tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6d26f05-140d-4cc0-93d6-07d83d6d71da tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1" status: 404 len: 62 microversion: 2.1 time: 0.043928 Oct 06 13:06:22.097116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1915/3795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:22 2022] DELETE /compute/v2.1/images/c2601f4b-104f-471c-a584-851fde8e4de1 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:06:22.103674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:22.104368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:22.130639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.131138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.131580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.132294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.132763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.133193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.492440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:22.508929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:22.513505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:22.517965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a97550a-a794-4d44-a2f3-ff94033f32ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.421705 Oct 06 13:06:22.522128 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1916/3796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:22 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:22.540665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:22.541663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:22.552329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.554407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.555358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.557889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.560740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.561337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.719295 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-35434700-f0f8-41e1-a432-47bd899a866e tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] HTTP exception thrown: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35434700-f0f8-41e1-a432-47bd899a866e tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Request method failure captured: Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b HTTP/1.1 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtLFvRSP38bFYKUr6DNEj4AmEWdfYkqwIRRp4Sc1DeOtANO2OEtFRXVNQGsS6VASfdzmQecKINYzMyc99GZNpMiGVQ2q7a-Ygk3tfCdUiGVV1HClk4mvqGKsjhlqEZcpz1uBrZFnQSUlAZ-5jvibGXCffHdn6gDz0ouHw71KWIiqbbU Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3eefad81020e4a839fc8ae957391ec99 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesGetTestJSON-479550413 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3eefad81020e4a839fc8ae957391ec99", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eefad81020e4a839fc8ae957391ec99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3eefad81020e4a839fc8ae957391ec99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eefad81020e4a839fc8ae957391ec99"}]}] Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesGetTestJSON-479550413 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3eefad81020e4a839fc8ae957391ec99 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesGetTestJSON-479550413 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesGetTestJSON-479550413-project Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f45353f0e24d44bc95975e673a74bff2 Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesGetTestJSON-479550413-project Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: exception: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '774e64c1-c616-48d8-966f-3b6fe1f4862b'} Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. (HTTP 404) (Request-ID: req-936ad2cf-9f53-4a26-a85c-75cda9b75375) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:06:22.722661 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. Oct 06 13:06:22.728200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:22.736578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35434700-f0f8-41e1-a432-47bd899a866e tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] Returning 404 to user: Volume 774e64c1-c616-48d8-966f-3b6fe1f4862b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:22.736578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35434700-f0f8-41e1-a432-47bd899a866e tempest-VolumesGetTestJSON-479550413 tempest-VolumesGetTestJSON-479550413-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b" status: 404 len: 109 microversion: 2.1 time: 1.831291 Oct 06 13:06:22.736578 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1881/3797] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:06:20 2022] GET /compute/v2.1/os-volumes/774e64c1-c616-48d8-966f-3b6fe1f4862b => generated 109 bytes in 1832 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:22.817213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:22.829595 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ee37ef9-5e1b-4d2d-b21a-7f22965bb4dd tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1252 microversion: 2.1 time: 0.304384 Oct 06 13:06:22.830638 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1917/3798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:22 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1252 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:22.853589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:22.860113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:22.884055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.891431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.893171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:22.894054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:22.897073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:22.897782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.199044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:23.199619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:23.221026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.235656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.237637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.238664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.242326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.246062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.329819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:23.460126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:23.475920 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b0f673b-1c47-4a00-9b30-267235a1f7a0 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1522 microversion: 2.1 time: 0.642502 Oct 06 13:06:23.477118 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1918/3799] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:22 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:23.491823 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Instance is already in deleting state, ignoring this request Oct 06 13:06:23.494589 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b470e76-2b61-4963-a779-2545643a91f1 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 204 len: 0 microversion: 2.1 time: 0.759079 Oct 06 13:06:23.495354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:23.496697 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1882/3800] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:22 2022] DELETE /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:23.498820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:23.505281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:23.505808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:23.523015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.524902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.525377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.526157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.526639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.527072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.529670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.530738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.531786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:23.533083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:23.534265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:23.535250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.054211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.068749 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b4198ac-c8de-42fd-9e2e-ebd827e75ec4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.569981 Oct 06 13:06:24.076444 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1883/3801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:23 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:24.093761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c627b87d-29b4-4c59-8446-cf882d247e99", "name": "network-vif-unplugged", "status": "completed", "tag": "488ad0e7-708d-422c-8b4a-fec9a053e69e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:24.126882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.127603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.128310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.157854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.167892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43cbd5d1-fde0-4265-96f3-50a3d3631aff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.688096 Oct 06 13:06:24.178713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] Creating event network-vif-unplugged:488ad0e7-708d-422c-8b4a-fec9a053e69e for instance c627b87d-29b4-4c59-8446-cf882d247e99 on n-h2-860556-1 Oct 06 13:06:24.187937 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1919/3802] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:23 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:24.197642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7e72d-9b1c-4fec-a295-f808b684846f", "name": "network-vif-deleted", "tag": "dc1ee91f-5560-494b-b172-808725cd62f1"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:24.203581 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-40b8fdff-8bfc-4b06-b821-2c1d0d688057 req-8c6b84fd-d538-4dbf-b249-b54dc1df2b75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125215 Oct 06 13:06:24.206085 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1884/3803] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:24.215320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.216014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.217766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.231939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:24.236919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:24.237512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] Creating event network-vif-deleted:dc1ee91f-5560-494b-b172-808725cd62f1 for instance 12b7e72d-9b1c-4fec-a295-f808b684846f on n-h1-860556-1 Oct 06 13:06:24.253337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.255171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.255848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-55e2d687-c054-4353-bd6a-8bc0ab6576e4 req-d4cec848-649f-469c-9313-6b6ea23907c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065517 Oct 06 13:06:24.256172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.257796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.258632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.258881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1920/3804] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:24.259629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.267001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:24.268971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:24.277962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.278722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.279715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.281922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.282625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.284339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.553171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.563530 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-393a3bf9-d9e4-46ff-8938-3c3ff3fc3618 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1493 microversion: 2.1 time: 0.348448 Oct 06 13:06:24.567528 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1885/3805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:24 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:24.592496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:24.594864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:24.619943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.620874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.622948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.624616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.626868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.628623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.635156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:24.679484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.699029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.703821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.709574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5a41eb6e-dd01-47f2-9c18-3da10a92811a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.444835 Oct 06 13:06:24.710769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1921/3806] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:24 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:24.733024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:24.737328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:24.744492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.745184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.746686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.748628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:24.749823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:24.750439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:24.764444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb911264e82477bb5fb733db5655391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '174e3c56e3314cb5b80f05ad67b81926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.773915 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a1855fb-8226-49b2-83bd-dd93237a9690 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 200 len: 1252 microversion: 2.1 time: 0.204180 Oct 06 13:06:24.774515 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1886/3807] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:24 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 1252 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:24.983257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:24.993536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83efcc99-a9b6-4a41-9a97-f75ba51ec0f9 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1522 microversion: 2.1 time: 0.281595 Oct 06 13:06:24.994162 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1922/3808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:24 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:25.106074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:25.108264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:25.125017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:25.125800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:25.126406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:25.127548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:25.128363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:25.128959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:25.193116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:25.193858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:25.211133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:25.214412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:25.214915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:25.215662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:25.216215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:25.216651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.080467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:26.087250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:26.090331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d86226aa-e0eb-40ae-a844-c1e436ff1729 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.901311 Oct 06 13:06:26.101987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84d07f3c-dbb0-4a1e-be67-95460e01c3ff tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 1.000589 Oct 06 13:06:26.101987 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1887/3809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:25 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:26.108132 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1923/3810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:25 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:26.119259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:26.123446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:26.125406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:26.132709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:26.147169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.150203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.152117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.153068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.153453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.154493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.156556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.157630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.159046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.160928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.163204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.166885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.559585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc79cb12634352b8fc75ea5bd40a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306464531f9e479cbfe9a7055b460595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:26.568510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-400ca9e5-c2f3-41d9-a652-ad57870e93d0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 200 len: 1451 microversion: 2.1 time: 0.457670 Oct 06 13:06:26.569096 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1888/3811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:26 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 1451 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:26.615575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:26.626896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] [instance: f0a247d2-be46-495d-96cd-912dd6a8d455] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:26.630844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:26.644383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.644883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.645431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.654954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.655456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.655911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.725940 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] HTTP exception thrown: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Request method failure captured: Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 HTTP/1.1 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtI-th9FFjaznZg1tTzWoXHmZbpv_7SDmRX95bC_xowmKEVW_I6zCLHkvTEvYfzxxkzCz2DzEnb-gaZofrxgpMgPbQvzkb2uSmoGmRYNq-_3DvdyxspBbEkJ1xCaOImAU4rvpGnddA5EFsO2GNSqtJoDNtYF-tfMXrutpxls_d79jrI Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 174e3c56e3314cb5b80f05ad67b81926 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestBootFromVolume-483462150 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_174e3c56e3314cb5b80f05ad67b81926", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/174e3c56e3314cb5b80f05ad67b81926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/174e3c56e3314cb5b80f05ad67b81926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/174e3c56e3314cb5b80f05ad67b81926"}]}] Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestBootFromVolume-483462150 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 174e3c56e3314cb5b80f05ad67b81926 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestBootFromVolume-483462150 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestBootFromVolume-483462150-project Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ecb911264e82477bb5fb733db5655391 Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestBootFromVolume-483462150-project Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f0a247d2-be46-495d-96cd-912dd6a8d455'} Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:26.731051 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:26.736111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Returning 404 to user: Instance f0a247d2-be46-495d-96cd-912dd6a8d455 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:26.737714 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6db148cd-5083-441a-9de3-6d6c7b2c176f tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455" status: 404 len: 111 microversion: 2.1 time: 0.156171 Oct 06 13:06:26.738585 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1889/3812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:26 2022] GET /compute/v2.1/servers/f0a247d2-be46-495d-96cd-912dd6a8d455 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:26.749005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:26.751347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:26.759577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:26.769918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.773198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.774189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:26.776675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:26.778421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:26.780735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.027486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:27.078179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:27.085033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:27.090796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81f75183-60cd-4744-9ada-0e1838784265 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.981314 Oct 06 13:06:27.099612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1924/3813] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:26 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:27.117244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154dffdc-e1fe-439f-9061-c89b7be5d49c", "name": "network-vif-plugged", "status": "completed", "tag": "208ed6b6-a098-4f99-8907-1e44f8a52186"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:27.130934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.131814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.133175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.150897 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] Creating event network-vif-plugged:208ed6b6-a098-4f99-8907-1e44f8a52186 for instance 154dffdc-e1fe-439f-9061-c89b7be5d49c on n-h1-860556-1 Oct 06 13:06:27.159585 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8a7c2400-5e3a-41f4-99c5-89d9c85780c4 req-1b7f588e-19a2-4d71-86f6-9671da9728df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058285 Oct 06 13:06:27.161092 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1925/3814] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:27.167977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c627b87d-29b4-4c59-8446-cf882d247e99", "name": "network-vif-deleted", "tag": "488ad0e7-708d-422c-8b4a-fec9a053e69e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:27.179762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.180665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.181338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.202756 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] Creating event network-vif-deleted:488ad0e7-708d-422c-8b4a-fec9a053e69e for instance c627b87d-29b4-4c59-8446-cf882d247e99 on n-h2-860556-1 Oct 06 13:06:27.216780 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-71c34f8f-60f4-44d3-aed1-9b3decbf126d req-c442b8bc-e3a6-4d9f-849b-4f5d6ae8a379 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053793 Oct 06 13:06:27.219333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1926/3815] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:27.232932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-533ce4ce-bd67-4cab-8bcb-9ec72f487258 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] Calling method '.version_select at 0x7f7d3e510040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:27.243211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:27.254794 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3bd45b7-b813-4449-9955-02200db8ffd7 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1522 microversion: 2.1 time: 0.514929 Oct 06 13:06:27.258024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-533ce4ce-bd67-4cab-8bcb-9ec72f487258 tempest-ServersTestBootFromVolume-483462150 tempest-ServersTestBootFromVolume-483462150-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662139321" status: 202 len: 0 microversion: 2.1 time: 0.030743 Oct 06 13:06:27.262492 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1927/3816] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662139321 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:06:27.269376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:27.270351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:27.278076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.278742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.279536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.279704 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1890/3817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:26 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:27.280869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.281564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.282563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.298339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:27.298982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:27.322502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.323008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.323446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:27.324174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:27.324653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:27.325090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.110708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.123209 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f2aa87c-1b58-49c2-aef8-a7b71cebb8c5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.859413 Oct 06 13:06:28.129512 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1928/3818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:27 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:28.134818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.140654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: c627b87d-29b4-4c59-8446-cf882d247e99] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.150789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:28.155091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.156711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.157815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.159380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.164020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.183315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.187887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.192628 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6f8555cf-2c35-4cf7-93d8-5a00c656e73e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.911747 Oct 06 13:06:28.193670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1891/3819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:27 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:28.200775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.213343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.228544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.234454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. Oct 06 13:06:28.234950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.235730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.237274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.238041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.238716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 HTTP/1.1 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c627b87d-29b4-4c59-8446-cf882d247e99'} Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.243066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance c627b87d-29b4-4c59-8446-cf882d247e99 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.247909 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5af7c14d-88db-4d60-a790-8ce10e942eb9 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99" status: 404 len: 111 microversion: 2.1 time: 0.115428 Oct 06 13:06:28.254468 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1929/3820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] GET /compute/v2.1/servers/c627b87d-29b4-4c59-8446-cf882d247e99 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:28.271077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc8e694c-6dab-4507-b34c-aeff5065b5a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3e5aadc0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.310298 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-dc8e694c-6dab-4507-b34c-aeff5065b5a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Image not found. Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc8e694c-6dab-4507-b34c-aeff5065b5a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e HTTP/1.1 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b6579fc8-063c-4f65-bd4d-a82d94c7dd1e'} Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6579fc8-063c-4f65-bd4d-a82d94c7dd1e to delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6579fc8-063c-4f65-bd4d-a82d94c7dd1e could not be found. Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.312399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc8e694c-6dab-4507-b34c-aeff5065b5a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc8e694c-6dab-4507-b34c-aeff5065b5a0 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e" status: 404 len: 62 microversion: 2.1 time: 0.057394 Oct 06 13:06:28.319795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1930/3821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] DELETE /compute/v2.1/images/b6579fc8-063c-4f65-bd4d-a82d94c7dd1e => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:06:28.334415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.335476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.360528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.361111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.362335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.363285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.365471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.366029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.606642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.620841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.622457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.623656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-601cac9f-ce85-48d4-9277-c2cf861da6b1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.428775 Oct 06 13:06:28.624234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1892/3822] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:28 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:28.637265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.638082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.652711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.653495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.654174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.655575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.655829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.657769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.689800 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 HTTP/1.1 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '288eff98-ad91-480a-bf5c-2756bdf40bb2'} Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:28.696696 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.701538 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.702321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98489c1ae29f4a05ba2416814f0e4423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1e3b7e1ec74f35b100c1f3ee4dbc20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:28.702432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.703854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-105624af-3715-454c-bb94-553f8fa9afb4 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 404 len: 111 microversion: 2.1 time: 0.076823 Oct 06 13:06:28.704703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1893/3823] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:28 2022] DELETE /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:28.710136 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7337ad55-83e5-4fce-aa2c-64a867b0edb5 tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 200 len: 1522 microversion: 2.1 time: 0.387740 Oct 06 13:06:28.723121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1931/3824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:28.723121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.723121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 288eff98-ad91-480a-bf5c-2756bdf40bb2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.727844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.728604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.729215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.730264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.741792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.745852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.809994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 HTTP/1.1 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '288eff98-ad91-480a-bf5c-2756bdf40bb2'} Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.817143 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. Oct 06 13:06:28.822915 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.824958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 288eff98-ad91-480a-bf5c-2756bdf40bb2 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.826068 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2e3a673-3295-4bf7-b2e8-f0b23fb2bfd3 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2" status: 404 len: 111 microversion: 2.1 time: 0.114503 Oct 06 13:06:28.832781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1932/3825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] GET /compute/v2.1/servers/288eff98-ad91-480a-bf5c-2756bdf40bb2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:28.838751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420133b7-7a4d-484c-b7f0-5c0c3376a7a8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f09e160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.873988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a873b2cf-d75b-454b-91e5-52a9bc39b4ba", "name": "network-vif-deleted", "tag": "1d951849-31b1-4edb-8259-5d14ee4d9afd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:28.892126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.894321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.896180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.920956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] Creating event network-vif-deleted:1d951849-31b1-4edb-8259-5d14ee4d9afd for instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba on n-h2-860556-1 Oct 06 13:06:28.922641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-420133b7-7a4d-484c-b7f0-5c0c3376a7a8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Image not found. Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420133b7-7a4d-484c-b7f0-5c0c3376a7a8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 HTTP/1.1 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '190eeaa7-dc0c-41ee-a76b-ee907b1ff135'} Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 190eeaa7-dc0c-41ee-a76b-ee907b1ff135 to delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 190eeaa7-dc0c-41ee-a76b-ee907b1ff135 could not be found. Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.925475 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-420133b7-7a4d-484c-b7f0-5c0c3376a7a8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-420133b7-7a4d-484c-b7f0-5c0c3376a7a8 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135" status: 404 len: 62 microversion: 2.1 time: 0.095094 Oct 06 13:06:28.930346 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1894/3826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] DELETE /compute/v2.1/images/190eeaa7-dc0c-41ee-a76b-ee907b1ff135 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:06:28.939567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:28.941234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:28.943468 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d41efe41-de30-4ba7-b833-3a3a0695c413 req-8f854d1e-a774-44f1-9d44-b4ae7f70b8f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074079 Oct 06 13:06:28.945521 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1933/3827] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:06:28.953123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.953709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.954297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.955079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:28.956239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:28.956740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:28.973361 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f HTTP/1.1 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f'} Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:28.977882 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:28.983195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:28.985610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:28.987635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b602cef2-fe2b-4914-b53d-882354371286 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 404 len: 111 microversion: 2.1 time: 0.051941 Oct 06 13:06:28.989057 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1895/3828] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:28 2022] DELETE /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:28.998488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.000504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.018488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.018941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.019387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.020093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.021643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.022111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.037539 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f HTTP/1.1 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f'} Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.055577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4eb16c2-2ea8-4795-a560-f49d807a6142 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f" status: 404 len: 111 microversion: 2.1 time: 0.063808 Oct 06 13:06:29.061427 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1934/3829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:28 2022] GET /compute/v2.1/servers/2d4d22a2-1d1c-48d4-9318-5bfda9c57b4f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:29.067899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d447299-997e-439d-ba17-44d8446f34cd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '.version_select at 0x7f7d3f9013a0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.075632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:29.100963 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2d447299-997e-439d-ba17-44d8446f34cd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Image not found. Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d447299-997e-439d-ba17-44d8446f34cd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 HTTP/1.1 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: exception: Image not found. Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '2167491b-7046-458d-b45e-ff0cc59024c2'} Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2167491b-7046-458d-b45e-ff0cc59024c2 to delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2167491b-7046-458d-b45e-ff0cc59024c2 could not be found. Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.102858 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.108801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d447299-997e-439d-ba17-44d8446f34cd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Image not found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:29.111580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d447299-997e-439d-ba17-44d8446f34cd tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2" status: 404 len: 62 microversion: 2.1 time: 0.045923 Oct 06 13:06:29.112849 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1896/3830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:29 2022] DELETE /compute/v2.1/images/2167491b-7046-458d-b45e-ff0cc59024c2 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:06:29.121456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.122180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.139430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.143001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.146636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.154624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.155552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.162450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.163061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.164754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.172318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.179023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.179587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.180788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.185881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.186463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.215152 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 HTTP/1.1 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2d4c1490-aa60-469a-aa91-92cc9da47d35'} Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:29.221819 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.227581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:29.231690 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de506fd6-4b15-4b71-b335-6d1dcbfd3cae tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 404 len: 111 microversion: 2.1 time: 0.115567 Oct 06 13:06:29.233937 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1935/3831] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:29 2022] DELETE /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:29.250448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.252912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.279688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.290381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.290884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.291705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.292269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.292767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.765803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:29.782009 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a9d7009f-e10a-440e-ae06-075b011feb28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1293 microversion: 2.1 time: 0.632951 Oct 06 13:06:29.798035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1897/3832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:29 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1293 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:29.826819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.837836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] [instance: 2d4c1490-aa60-469a-aa91-92cc9da47d35] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.875564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.878271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.879983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.881127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.882109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:29.882297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.883786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.894116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-055a3832-23c1-4ed7-9452-707c5637c5ed tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.656576 Oct 06 13:06:29.908161 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1936/3833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:29 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:29.924575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.926316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:29.931674 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] HTTP exception thrown: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Request method failure captured: Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 HTTP/1.1 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtGfVtj1IL0pp7UISAcorpaZKIm9GzHpb4yUryGm_SDo4shgCvJgLNjKfKYL38hdAqvh35cEdiDIbEo-z5CF0FUs1iA0ITVvX6GNQKamXmJeu_sOSaWz6Xw4uVbcOzD78top28IhxzGNPLVuWVXIysrR_FDStXteTgBB620Kslg8OMs Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_306464531f9e479cbfe9a7055b460595", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/306464531f9e479cbfe9a7055b460595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/306464531f9e479cbfe9a7055b460595"}]}] Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 306464531f9e479cbfe9a7055b460595 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ImagesTestJSON-554977098 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d9bc79cb12634352b8fc75ea5bd40a61 Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ImagesTestJSON-554977098-project Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '2d4c1490-aa60-469a-aa91-92cc9da47d35'} Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.939500 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:29.945880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] Returning 404 to user: Instance 2d4c1490-aa60-469a-aa91-92cc9da47d35 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:29.948023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.952442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.954267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.956606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:29.957653 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5881cbb7-a4dd-4aed-ac8b-31a76bf1fc24 tempest-ImagesTestJSON-554977098 tempest-ImagesTestJSON-554977098-project] 10.222.0.26 "GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35" status: 404 len: 111 microversion: 2.1 time: 0.149012 Oct 06 13:06:29.958517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:29.960022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:29.965108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1898/3834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:29 2022] GET /compute/v2.1/servers/2d4c1490-aa60-469a-aa91-92cc9da47d35 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:29.981402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:29.982835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: a873b2cf-d75b-454b-91e5-52a9bc39b4ba] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:30.005326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.009244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.009513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.010681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.011331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.012381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.066663 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] HTTP exception thrown: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba HTTP/1.1 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a873b2cf-d75b-454b-91e5-52a9bc39b4ba'} Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.072474 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. Oct 06 13:06:30.079778 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.084953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 404 to user: Instance a873b2cf-d75b-454b-91e5-52a9bc39b4ba could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:30.086313 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67690764-671b-4f4f-a64f-6e38b1d6cf3a tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba" status: 404 len: 111 microversion: 2.1 time: 0.118941 Oct 06 13:06:30.092453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1899/3835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:29 2022] GET /compute/v2.1/servers/a873b2cf-d75b-454b-91e5-52a9bc39b4ba => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:30.104788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-plugged", "status": "completed", "tag": "cb82a658-1f41-4072-b041-52bc688aef5a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:30.125566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.126357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.126946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.147942 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] Creating event network-vif-plugged:cb82a658-1f41-4072-b041-52bc688aef5a for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:30.156864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6224eb83-1386-49c9-86fa-63979db79d1a req-157f4306-7f27-4970-9b37-3fb0153f8428 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061732 Oct 06 13:06:30.159571 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1900/3836] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:30.174924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:30.178141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] [instance: 12b7e72d-9b1c-4fec-a295-f808b684846f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:30.188147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.189116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.190180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.192060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.192889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.194579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.222595 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] HTTP exception thrown: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Request method failure captured: Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f HTTP/1.1 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKRxNX8hGt3XchJ8d3MF2MBLxHRXruXlqClZDwO078p0nTHYcCgWC-2w2qqUYxBbeP1LQIt8XRy2zV3y8A_BsM6eMhogPbW0W2EJQ4WBPe8YgrSVBj1ZAPFIb1ktUlL9gpUqsBkGirTMO8STdbNXPaBk2coNbkjytu-rA3UR2nfXyU Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de1e3b7e1ec74f35b100c1f3ee4dbc20", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de1e3b7e1ec74f35b100c1f3ee4dbc20"}]}] Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: de1e3b7e1ec74f35b100c1f3ee4dbc20 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1634008976 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 98489c1ae29f4a05ba2416814f0e4423 Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServersNegativeTestJSON-1634008976-project Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '12b7e72d-9b1c-4fec-a295-f808b684846f'} Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.225625 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] Returning 404 to user: Instance 12b7e72d-9b1c-4fec-a295-f808b684846f could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:30.236021 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c72dd0fe-138c-4a88-adc8-a2bb17775e8c tempest-ListServersNegativeTestJSON-1634008976 tempest-ListServersNegativeTestJSON-1634008976-project] 10.222.0.26 "GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f" status: 404 len: 111 microversion: 2.1 time: 0.068981 Oct 06 13:06:30.240510 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1901/3837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:30 2022] GET /compute/v2.1/servers/12b7e72d-9b1c-4fec-a295-f808b684846f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:30.709945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:30.722089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:30.728645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:30.734457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa3dca16-23ac-405a-8781-62748365d8d4 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.818450 Oct 06 13:06:30.737193 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1937/3838] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:29 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:30.821980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:30.822692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:30.831673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.847568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.848109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.849030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.853868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.854397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.920643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:30.921534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:30.932138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.932910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.934268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.935567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:30.945680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:30.946702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:30.952248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:31.724235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:31.739306 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b145aa2-5667-4fe4-b943-d575a36d4e81 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1473 microversion: 2.1 time: 0.918456 Oct 06 13:06:31.753777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1902/3839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:30 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1473 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:31.776272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:31.776901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:31.800630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:31.802261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:31.802731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:31.803487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:31.803957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:31.807782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:31.948688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:31.967764 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad7b57d0-fc1f-4919-90ba-65008f65bc28 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 1.050773 Oct 06 13:06:31.973876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1938/3840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:30 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:32.010531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1822987422", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:32.129021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:06:32.258229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:32.275524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:32.276985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:32.278229 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-609a0bb4-5d5b-41ff-baa1-a78d01dbbee6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1754 microversion: 2.20 time: 0.511143 Oct 06 13:06:32.287342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1903/3841] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:31 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1754 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:32.287342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-plugged", "status": "completed", "tag": "74a994a2-b14c-4b0a-867c-a0f80f287047"}, {"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-plugged", "status": "completed", "tag": "c343dba6-304c-4b89-962c-947f463af8cc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:32.301066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:32.301896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:32.302759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:32.323354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Creating event network-vif-plugged:74a994a2-b14c-4b0a-867c-a0f80f287047 for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:32.323907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] Creating event network-vif-plugged:c343dba6-304c-4b89-962c-947f463af8cc for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:32.337007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0152e112-a5d0-4df3-994d-e030e21cc875 req-bff31465-dcae-4694-98bf-1aac31bfe00c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056382 Oct 06 13:06:32.338343 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1904/3842] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:32.993922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:32.994846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:33.014790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:33.017625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:33.018884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:33.020459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:33.021119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:33.022138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:33.897500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:33.907232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35bebfc6-31d9-46f8-abc6-62db47b9f855 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1354 microversion: 2.1 time: 0.918390 Oct 06 13:06:33.918465 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1905/3843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:32 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1354 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:33.933782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:33.935324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:33.951734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:33.952691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:33.953361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:33.954317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:33.954989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:33.955665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:34.302556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:06:34.303058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:06:34.303438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:06:34.303843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:06:34.304245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:06:34.368486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:34.369436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:34.370830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:34.380054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:34.380519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:34.380959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:34.451205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:06:34.467558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:06:34.508509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:06:34.511087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:06:34.570072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:34.590566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:34.595115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:34.599821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8cf09828-c222-445a-84dc-1bd1239325cc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.679823 Oct 06 13:06:34.601969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1906/3844] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:33 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:34.637601 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-219811a9-826d-4d66-8e78-d617728e1af9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.628890 Oct 06 13:06:34.646630 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1939/3845] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:06:34.658627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:34.659569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:34.698575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:34.946932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:34.948816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:34.958554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:34.959048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:34.977660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:34.979209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:34.982268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:34.983212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:35.526504 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.scheduler.client.report [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Deleted allocations for instance 5e037f4b-32f0-441b-b03a-b08633c1c99e Oct 06 13:06:35.541024 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Instance Mapping does not exist while attempting local delete cleanup. Oct 06 13:06:35.543695 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b445927d-dd7d-4265-9762-ab13534b5f56 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e" status: 204 len: 0 microversion: 2.1 time: 0.893242 Oct 06 13:06:35.546971 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1907/3846] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:34 2022] DELETE /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:35.573823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:35.575702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:35.585865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e HTTP/1.1 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5e037f4b-32f0-441b-b03a-b08633c1c99e'} Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:35.589166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:35.595294 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:35.595294 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:35.595294 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:35.595294 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:06:35.595294 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:35.597609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:35.598821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4af9f6e8-7c3d-4942-88a2-ddf0f5504a1b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e" status: 404 len: 111 microversion: 2.1 time: 0.044636 Oct 06 13:06:35.600385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1908/3847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:35 2022] GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:35.647802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:35.648671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:35.672441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:35.675197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:35.676571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:35.682361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:35.684479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:35.686306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:35.801850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:35.810914 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-573a6e28-1510-4d82-adfb-3d95b1c16f54 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1804 microversion: 2.1 time: 0.869987 Oct 06 13:06:35.817316 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1940/3848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:34 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1804 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:35.842126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:35.843886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:35.852923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:35.856121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:35.859848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:35.862268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:35.863745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:35.865831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:35.923628 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-060876b8-d2e3-4bcf-b068-f451013c3b2c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965/ips" status: 200 len: 218 microversion: 2.1 time: 0.086850 Oct 06 13:06:35.925489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1941/3849] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:06:35 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965/ips => generated 218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:35.937714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-148988026", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:36.017331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:06:36.316058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:36.348237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:36.355173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:36.359447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-289458c3-31fb-4201-8bce-be72af0cfe0b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.732230 Oct 06 13:06:36.374795 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1909/3850] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:35 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:36.384518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:36.385593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:36.422467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:36.424416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:36.426084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:36.433049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:36.433641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:36.434134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:36.556180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:06:36.688485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:36.744175 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f848826-48ce-462a-8bf0-7eb1115f7a5e tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 204 len: 0 microversion: 2.1 time: 0.367008 Oct 06 13:06:36.745475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1910/3851] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:06:36 2022] DELETE /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:06:36.756949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:36.778548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:36.789817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:36.791497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:36.792753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:36.794232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:36.797414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:36.799534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:37.021427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:06:37.022126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:06:37.022515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:06:37.022757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:06:37.023168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:06:37.046439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:37.046927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:37.047368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:37.048090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:37.048545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:37.049533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:37.104318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:06:37.112194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:06:37.150290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:06:37.157592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:06:37.285068 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-577196d1-cfe0-4e5e-84db-23134331ee4c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358243 Oct 06 13:06:37.295301 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1942/3852] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:06:37.300683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83dd3114-c744-480e-bde9-0003c11640e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:37.301303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83dd3114-c744-480e-bde9-0003c11640e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:37.659353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83dd3114-c744-480e-bde9-0003c11640e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:37.667878 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83dd3114-c744-480e-bde9-0003c11640e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1220 microversion: 2.1 time: 0.371207 Oct 06 13:06:37.668468 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1943/3853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:37 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1220 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:37.688178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:37.688960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:37.739434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:37.743020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:37.744118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:37.754669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:37.755222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:37.755758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:38.406819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:38.417690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bca6d384-9185-41c8-a18c-cc147a9438e4 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1810 microversion: 2.1 time: 1.665647 Oct 06 13:06:38.427854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1911/3854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:36 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1810 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:38.693414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:38.694184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:38.705050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:38.721136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:38.721773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:38.727419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:38.727916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:38.728370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:39.161544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:39.166511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:39.176817 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e72f5c99-0f29-40d9-9151-26d1862c66c4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1224 microversion: 2.1 time: 0.488029 Oct 06 13:06:39.190448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1912/3855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:38 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1224 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:39.196952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:39.209126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:39.223391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a2301cc-53ba-4b6b-9ccb-1895fa6529e3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.533899 Oct 06 13:06:39.226765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1944/3856] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:37 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:39.445447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:39.446555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:39.460294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:39.460800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:39.461242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:39.473963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:39.474478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:39.474929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:40.210996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:40.212736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:40.228543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:40.230625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:40.232083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:40.237857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:40.240029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:40.241596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:42.213765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:42.238937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-021c09f4-40dd-4316-a6bc-ac424d56d4e8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1272 microversion: 2.1 time: 2.029086 Oct 06 13:06:42.243717 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1945/3857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:40 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1272 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:42.265591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:42.272575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:42.301529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:42.302836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:42.304062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:42.307210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:42.308665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:42.309763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:42.918041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:42.937035 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a3ecf87-27e3-4957-ade6-7b85098ad987 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1810 microversion: 2.1 time: 3.495537 Oct 06 13:06:42.959520 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1913/3858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:39 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1810 bytes in 3514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:43.047240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-deleted", "tag": "cb82a658-1f41-4072-b041-52bc688aef5a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:43.059484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:43.074262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:43.078191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:43.078954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:43.114694 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] Creating event network-vif-deleted:cb82a658-1f41-4072-b041-52bc688aef5a for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:43.128694 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4e432576-35fc-4857-82ac-4f13d59e3f87 req-5ac70361-7de4-42ca-ad97-f12fd44db2f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083526 Oct 06 13:06:43.132317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1914/3859] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:43.264876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:43.266030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:43.275828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:43.276336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:43.276788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:43.277505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:43.277994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:43.278428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:43.521914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:43.537475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:43.543896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:43.545782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56701fd2-3c6c-42c4-b900-36e091368bdd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.300662 Oct 06 13:06:43.547698 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1946/3860] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:42 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:43.968104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:43.968728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:43.977045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:43.977537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:43.978007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:43.978714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:43.979170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:43.979606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:44.096359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:44.112765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74655dcf-baf3-4d3a-9162-34727db13615 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1278 microversion: 2.1 time: 0.844682 Oct 06 13:06:44.113443 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1915/3861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:43 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1278 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:44.282292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-unplugged", "status": "completed", "tag": "74a994a2-b14c-4b0a-867c-a0f80f287047"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:44.306231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:44.307778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:44.308507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:44.340118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] Creating event network-vif-unplugged:74a994a2-b14c-4b0a-867c-a0f80f287047 for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:44.353860 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-31821c4e-0389-4378-8cb6-2d79a123d17b req-0c64d7c9-b3e1-46ab-bda7-8db0517971bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074267 Oct 06 13:06:44.358676 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1916/3862] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:44.577338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:44.579242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:44.596870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:44.597756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:44.598401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:44.599561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:44.600346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:44.600850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:44.711360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:44.721520 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-641bb8bc-4b73-40a3-b15a-5823c78d79bc tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1631 microversion: 2.1 time: 0.757380 Oct 06 13:06:44.729342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1947/3863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:43 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1631 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:44.798497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:45.138900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:45.139529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:45.150541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:45.151046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:45.151490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:45.152199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:45.157822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:45.162107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:45.685290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:45.699462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:45.702143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:45.705309 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee19c87b-57a3-441d-a45b-e0d645e883b8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.133455 Oct 06 13:06:45.711211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1917/3864] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:44 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:06:45.757813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:45.758898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:45.773713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:45.775381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:45.777085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:45.779391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:45.781404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:45.782246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:46.235038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:46.255115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-124de6ff-d5f1-4ac5-832f-82ed6a4aa21a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 1.120329 Oct 06 13:06:46.258772 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1948/3865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:45 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:46.272667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-deleted", "tag": "74a994a2-b14c-4b0a-867c-a0f80f287047"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:46.321786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:46.327211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:46.328876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:46.358533 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] Creating event network-vif-deleted:74a994a2-b14c-4b0a-867c-a0f80f287047 for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:46.365436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-401d8465-79c4-47cd-af6e-9b804a72de36 req-2aa5004d-7fb7-4ab5-b701-f130ee81fd5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105088 Oct 06 13:06:46.366666 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1949/3866] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:46.482550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-unplugged", "status": "completed", "tag": "c343dba6-304c-4b89-962c-947f463af8cc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:46.520286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:46.522487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:46.527305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:46.551787 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] Creating event network-vif-unplugged:c343dba6-304c-4b89-962c-947f463af8cc for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:46.570642 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0235208c-89b8-42d4-ab86-2e5ee488e5c2 req-e100e207-de67-4d9e-b4a2-66329f3b14b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104377 Oct 06 13:06:46.580425 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1950/3867] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:06:46.741096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:46.753824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:46.787114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:46.793654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:46.795640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:46.797483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:46.799290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:46.802052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:47.075835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:47.281084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:47.290958 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18277803-0f77-4fd4-bcc1-ec25e86c9920 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1610 microversion: 2.1 time: 1.538153 Oct 06 13:06:47.299549 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1918/3868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:45 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1610 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:47.304619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:47.305242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:47.325569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:47.326115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:47.326551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:47.327464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:47.327989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:47.328694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:47.667929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:47.720856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:47.732216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:47.733658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:47.749582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-748a08aa-4fdf-4a5d-a89e-ed148f5c6321 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.012582 Oct 06 13:06:47.754951 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1951/3869] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:46 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:47.977698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:47.992123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b22b5df3-9246-4bc7-bf74-981cc63c25ad tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.691191 Oct 06 13:06:48.008997 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1919/3870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:47 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:48.323034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:48.324738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:48.342587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:48.346409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:48.349209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:48.350686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:48.351663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:48.353777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:48.570124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:48.589765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4725576e-16d7-4289-a443-179b23e72e32 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1453 microversion: 2.1 time: 0.273639 Oct 06 13:06:48.592600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1952/3871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:48 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1453 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:48.732862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1a1ff-2161-46d5-8754-741314519965", "name": "network-vif-deleted", "tag": "c343dba6-304c-4b89-962c-947f463af8cc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:48.763363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:48.764490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:48.767164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:48.781874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:48.782499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:48.815300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:48.815798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:48.816237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:48.817049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:48.817509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:48.828290 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] Creating event network-vif-deleted:c343dba6-304c-4b89-962c-947f463af8cc for instance ece1a1ff-2161-46d5-8754-741314519965 on n-h2-860556-1 Oct 06 13:06:48.835651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:48.850206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f15ccee7-ab19-4ce8-8ab1-048c97dab453 req-1ff059d0-6819-4b05-aeba-c3e7cbced1ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120547 Oct 06 13:06:48.852683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1920/3872] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:49.030490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:49.031599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:49.050062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:49.050671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:49.054831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:49.055853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:49.059956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:49.061834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:49.197458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:49.212845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:49.221999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:49.223438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f79b3d2-9e6a-4d0c-988a-1cab97687f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.447111 Oct 06 13:06:49.255603 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1953/3873] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:48 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:06:49.617204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:49.618169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:49.638802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:49.639572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:49.640587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:49.646126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:49.647734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:49.651102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:49.702225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:49.712270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ee1044e-0dad-4ad8-9c1f-0780ff49cc54 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.687528 Oct 06 13:06:49.735560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1921/3874] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:49 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:06:49.851682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:49.851682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:49.851682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:49.851682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lazy-loading 'fault' on Instance uuid ece1a1ff-2161-46d5-8754-741314519965 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:06:49.917566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:49.929994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7cea10f-5522-49fb-b9ee-5eea7b641f44 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 200 len: 1302 microversion: 2.1 time: 0.316543 Oct 06 13:06:49.932062 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1954/3875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:49 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 1302 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:50.272187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:50.273462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:50.287038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:50.288146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:50.290336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:50.293286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:50.294759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:50.295382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:50.748022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:50.748694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:50.771170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:50.771672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:50.772118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:50.772838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:50.773307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:50.773765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:51.627793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:51.656285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:51.659206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:51.666314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da010fcd-9927-42eb-9082-5e8966a74f74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.396348 Oct 06 13:06:51.668090 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1922/3876] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:50 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:51.683704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:51.684533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:51.699529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:51.700276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:51.700879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:51.704285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:51.704990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:51.708408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:51.747092 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 HTTP/1.1 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ece1a1ff-2161-46d5-8754-741314519965'} Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:51.749801 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:06:51.754334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:06:51.759440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:51.761388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a01a50a9-b5ec-48bb-9b7e-233e17976e34 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 404 len: 111 microversion: 2.1 time: 0.091589 Oct 06 13:06:51.771377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1923/3877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:51 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:06:51.796594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d0f2ba-f7f9-4f5c-8536-fc4f1768b411", "tag": "ddc2fa45-dea8-4545-b3c1-d2dba46724cd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:06:51.830748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:51.832720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:51.833324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:51.876247 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] Creating event network-changed:ddc2fa45-dea8-4545-b3c1-d2dba46724cd for instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 on n-h1-860556-1 Oct 06 13:06:51.907273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a2461043-388c-4d0a-944f-33839f93e6b4 req-48083815-9f78-4131-b879-f13b6de04612 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134410 Oct 06 13:06:51.909854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1924/3878] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:06:52.259578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:52.278031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c8496a2f-5d4c-4a3b-baa4-9a56cdd6b635 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 1.537898 Oct 06 13:06:52.282818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1955/3879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:50 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:52.696698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:52.697526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:52.720337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:52.722876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:52.723469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:52.725124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:52.730128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:52.732400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:53.590459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e087e6c8-82c3-42fa-aff3-e7fc7b9a9557 tempest-ListImageFiltersNegativeTestJSON-2009027304 tempest-ListImageFiltersNegativeTestJSON-2009027304-project] Calling method '.version_select at 0x7f7d3e4d0ee0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:53.631416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e087e6c8-82c3-42fa-aff3-e7fc7b9a9557 tempest-ListImageFiltersNegativeTestJSON-2009027304 tempest-ListImageFiltersNegativeTestJSON-2009027304-project] HTTP exception thrown: Image not found. Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e087e6c8-82c3-42fa-aff3-e7fc7b9a9557 tempest-ListImageFiltersNegativeTestJSON-2009027304 tempest-ListImageFiltersNegativeTestJSON-2009027304-project] Request method failure captured: Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/images/2fa4e241-a915-4ce5-b1ad-f2b8523647d2 HTTP/1.1 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtLstlkq8dKD-ALsAxyVN3k9mlLte-z5-QPLr6__JlKBYBpfAxCHL3T5fhcZXJeZa8P8qaC3trSOSFrPkbyf5-XaHS6qbRYYtWX8H97hCl1Mw0buk1eAgwpKO9DJxtuHSq77aGB-SXmVzyH4c02p0kJcTJw-1X62Oiq8R5k4fFe1hYo Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f31db854d1dc483b96326b5e1eaaea17 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2009027304 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f31db854d1dc483b96326b5e1eaaea17", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f31db854d1dc483b96326b5e1eaaea17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f31db854d1dc483b96326b5e1eaaea17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f31db854d1dc483b96326b5e1eaaea17"}]}] Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2009027304 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f31db854d1dc483b96326b5e1eaaea17 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2009027304 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListImageFiltersNegativeTestJSON-2009027304-project Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f011dded810a412bbbea317c44993f49 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2009027304-project Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: exception: Image not found. Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2fa4e241-a915-4ce5-b1ad-f2b8523647d2'} Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2fa4e241-a915-4ce5-b1ad-f2b8523647d2 Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 06 13:06:53.634007 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2fa4e241-a915-4ce5-b1ad-f2b8523647d2 could not be found. Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 06 13:06:53.637125 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:06:53.641305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e087e6c8-82c3-42fa-aff3-e7fc7b9a9557 tempest-ListImageFiltersNegativeTestJSON-2009027304 tempest-ListImageFiltersNegativeTestJSON-2009027304-project] Returning 404 to user: Image not found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:06:53.643042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e087e6c8-82c3-42fa-aff3-e7fc7b9a9557 tempest-ListImageFiltersNegativeTestJSON-2009027304 tempest-ListImageFiltersNegativeTestJSON-2009027304-project] 10.222.0.26 "GET /compute/v2.1/images/2fa4e241-a915-4ce5-b1ad-f2b8523647d2" status: 404 len: 62 microversion: 2.1 time: 0.565913 Oct 06 13:06:53.644282 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1956/3880] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Oct 6 13:06:53 2022] GET /compute/v2.1/images/2fa4e241-a915-4ce5-b1ad-f2b8523647d2 => generated 62 bytes in 569 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 06 13:06:53.657572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:53.658562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:53.670017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:53.670742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:53.671402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:53.672376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:53.673051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:53.674382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:53.881255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:53.900087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:53.901694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:53.911265 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-060ec9c3-57d0-4ee1-a58f-b43aab374599 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.218663 Oct 06 13:06:53.917151 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1925/3881] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:52 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:54.235179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:54.243589 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-35239cc6-c24b-47ff-9f64-0040d4fe5374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.597820 Oct 06 13:06:54.244175 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1957/3882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:53 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:54.948475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:54.949100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:54.967013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:54.967617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:54.968839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:54.970104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:54.971602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:54.972203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:55.278329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:55.279961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:55.299336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:55.300801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:55.302609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:55.310491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:55.341590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:55.344993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:55.353818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:55.381124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:55.395952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:55.398082 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdebd824-7974-44f4-bb1d-d47ed8070866 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.464092 Oct 06 13:06:55.400196 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1926/3883] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:54 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:56.023015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:56.035288 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6cb7008c-1bd4-4abc-a841-35933ac84638 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.765190 Oct 06 13:06:56.035901 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1958/3884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:55 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:56.431335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:56.431950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:56.442767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:56.448012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:56.448978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:56.450549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:56.452956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:56.454340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:56.959388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:56.977324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:56.980583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:56.984260 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec6588b8-edf2-4be3-aaac-5b8ead092ddb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.554848 Oct 06 13:06:56.986930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1927/3885] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:56 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:57.062042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:57.062687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:57.083224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:57.083749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:57.084183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:57.084904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:57.085368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:57.091280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:57.163523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:58.013645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:58.015082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:58.028820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:58.029995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:58.031254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:58.032940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:58.035421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:58.039184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:58.216549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:58.228194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6932783-6d70-4daf-8263-b3cb2a59b290 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 1.172321 Oct 06 13:06:58.242030 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1959/3886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:57 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:06:58.764916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:58.781251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:58.800835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:06:58.802435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec33ed0c-e48c-4ee5-aa2a-59d3000b6ce1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.793655 Oct 06 13:06:58.828482 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1928/3887] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:58 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:06:59.258399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:59.259654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:59.272128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:06:59.277154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:59.279295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:59.280774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:59.282644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:59.285615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:59.288318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:59.846519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:06:59.847161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:06:59.868890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:59.869416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:59.871003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:06:59.873335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:06:59.874117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:06:59.877122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:00.227867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:00.243383 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d26cdf56-f4a8-496c-8087-aaa01ac91da9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.989913 Oct 06 13:07:00.255520 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1960/3888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:06:59 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:00.280491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d0f2ba-f7f9-4f5c-8536-fc4f1768b411", "name": "network-vif-plugged", "status": "completed", "tag": "ddc2fa45-dea8-4545-b3c1-d2dba46724cd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:00.344966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:00.348686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:00.349208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:00.353267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:00.365522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:00.370348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:00.373813 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1646aa2-5fd9-4a2d-8461-696b15eb119e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.531081 Oct 06 13:07:00.389855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1929/3889] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:06:59 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:00.391328 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] Creating event network-vif-plugged:ddc2fa45-dea8-4545-b3c1-d2dba46724cd for instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 on n-h1-860556-1 Oct 06 13:07:00.418465 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4c895b97-e752-4831-9f4e-5b0acd6d1638 req-b5a08028-6b40-4f72-9de8-5dca877da393 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153125 Oct 06 13:07:00.425308 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1961/3890] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:01.282192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:01.283529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:01.298318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:01.299272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:01.300373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:01.301447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:01.304446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:01.305133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:01.376244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:01.411771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:01.412391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:01.430283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:01.431269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:01.431996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:01.432969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:01.433584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:01.434283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:01.973986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:01.982836 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d5a97b3-9876-43da-8448-c7e549a3c69e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1320 microversion: 2.1 time: 0.705750 Oct 06 13:07:01.994762 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1930/3891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:01 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1320 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:02.000292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:02.010142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:02.011599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:02.012785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a773d37a-532f-435d-acf7-03286f6c50c7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.608400 Oct 06 13:07:02.034721 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1962/3892] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:01 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:03.017926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:03.018554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:03.028462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:03.028967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:03.029415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:03.030454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:03.030886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:03.031300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:03.057329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:03.058517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:03.068118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:03.086933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:03.087708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:03.088551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:03.089014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:03.089447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:03.774929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:03.822027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:03.824813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:03.826650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14d8dd18-fe6f-45ca-8b15-c71e733e346e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.774167 Oct 06 13:07:03.840623 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1963/3893] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:03 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:04.001024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:04.013844 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c01b48b-f1ee-4466-a61e-d84f2e4fa494 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1501 microversion: 2.1 time: 0.999620 Oct 06 13:07:04.014827 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1931/3894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:03 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1501 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:04.037297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:04.038194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:04.055370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.056230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.056787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.057798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.058340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.060261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.427444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:04.454316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9999f3eb-56f3-4ee2-876b-7692e800193f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1501 microversion: 2.1 time: 0.420957 Oct 06 13:07:04.457941 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1964/3895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:04 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:04.485653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:04.487116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:04.510891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.516209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.516921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.518616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.523400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.524536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.565404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:07:04.717354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3caad5e8-8c65-46f0-8a6e-88f199a448ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 204 len: 0 microversion: 2.1 time: 0.236345 Oct 06 13:07:04.718934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1932/3896] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:07:04 2022] DELETE /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:04.727192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:04.727811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:04.734521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.735478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.737005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.738247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.739870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.740685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.858685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:04.859623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:04.883873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.891357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.897449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:04.901761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:04.904382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:04.913808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:05.283878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:05.297368 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15bb0b5b-e5ad-4a5e-8d55-0e6c7a853cd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1507 microversion: 2.1 time: 0.569634 Oct 06 13:07:05.311320 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1965/3897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:04 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:05.421233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:05.443923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:05.469070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:05.476889 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5340d4a7-1151-4db5-ac53-10b6e9634e4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 0.622687 Oct 06 13:07:05.481483 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1933/3898] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:04 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:05.937292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-216563297", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "dcdc11f3-5352-41dc-bcd5-734e9a6d7e04"}, {"uuid": "467a92ae-c33b-4fd0-8129-180c1b947faf"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:06.126638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] validate_networks() for [('dcdc11f3-5352-41dc-bcd5-734e9a6d7e04', None, None, None, None, None), ('467a92ae-c33b-4fd0-8129-180c1b947faf', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:06.932290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-846467104", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "74e5e102-1598-4686-ad34-796caff9ee8a"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:07.056573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] validate_networks() for [('74e5e102-1598-4686-ad34-796caff9ee8a', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:10.421385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:10.422188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:10.422679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:10.423104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:10.423562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:10.460678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.461183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.461640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.467776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.468287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.468729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.535756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:10.536450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Getting quotas for project fd5484d7b1ad4548ae264d9678e98dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:10.536552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:10.536730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:10.537301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:10.537546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:10.550017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Getting quotas for user b855dd230b4543a7bf55692282b2fa66 and project fd5484d7b1ad4548ae264d9678e98dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:10.555764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.556260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.556705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.557446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.557938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.558460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.585465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:10.591824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:10.614222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Getting quotas for project 292eb01305864b36bf5564aca04deeec. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:10.630087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Getting quotas for user 0df15d438aab4b3da00d48111df5e866 and project 292eb01305864b36bf5564aca04deeec. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:10.669965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:10.679968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:10.711862 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-690027f6-0f80-44a4-811f-8c8c984f7cf7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.502915 Oct 06 13:07:10.718577 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1934/3899] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:07:10.764805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:10.771022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:10.793596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.795026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.795696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.797481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:10.801386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:10.802186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:10.805692 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c53806f4-05fe-41fb-a97e-5b15c2bf61de tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.872567 Oct 06 13:07:10.806387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1966/3900] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:07:11.215519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:11.242108 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f2ec7b8-ddae-49b6-ae67-c00cf3c8e47c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 200 len: 1465 microversion: 2.1 time: 0.518503 Oct 06 13:07:11.253246 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1935/3901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:10 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 1465 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:11.281150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:11.283370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:11.317313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:11.322934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:11.324810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:11.326270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:11.336566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:11.338015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.273239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:12.291851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-733131244", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:12.293217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:12.295584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:12.297042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abc8393e-b7fc-4128-8a8c-b1e88e666afe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.035007 Oct 06 13:07:12.314740 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1936/3902] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:11 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:12.327162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-plugged", "status": "completed", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:12.366534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.367018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.367454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.405306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:12.417214 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] Creating event network-vif-plugged:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:07:12.429990 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-31977830-712a-4e06-b8d8-77756fc8b5b3 req-56d08e06-cc93-4bbc-b032-a356cfde7d76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113533 Oct 06 13:07:12.432191 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1937/3903] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:12.445992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:12.446971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:12.463451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.463953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.464401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.465186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.465563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.473941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.633853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:12.647344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9d9f808-dd7d-4e3f-960a-f71a3c01c7cf tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1228 microversion: 2.1 time: 0.212699 Oct 06 13:07:12.648210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1938/3904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:12 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1228 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:12.665701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:12.666360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:12.687361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.691629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.692195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.693153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.696936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.697602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:12.878794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:12.893089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-796bf2a1-8c03-4ebe-9521-edc818efe761 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1216 microversion: 2.1 time: 0.242170 Oct 06 13:07:12.896129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1939/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:12 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:12.912016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d0f2ba-f7f9-4f5c-8536-fc4f1768b411", "name": "network-vif-deleted", "tag": "ddc2fa45-dea8-4545-b3c1-d2dba46724cd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:12.951067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:12.952415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:12.953497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:13.001254 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] Creating event network-vif-deleted:ddc2fa45-dea8-4545-b3c1-d2dba46724cd for instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 on n-h1-860556-1 Oct 06 13:07:13.013772 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-af9113b0-0687-4c18-96cd-50f00b1f2973 req-2f3ba763-8aa4-4006-825b-3be5bcb1d61f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116208 Oct 06 13:07:13.019242 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1940/3906] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:13.034012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:13.035862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:13.055363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:13.055896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:13.056350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:13.057086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:13.060142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:13.060603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:13.102525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 HTTP/1.1 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '20d0f2ba-f7f9-4f5c-8536-fc4f1768b411'} Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:13.105595 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:07:13.110966 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:13.113974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:13.115295 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f6c6db6-d720-427a-a9d3-780f4d2085de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 404 len: 111 microversion: 2.1 time: 0.094076 Oct 06 13:07:13.116155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1941/3907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:13 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:13.137608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6bd995d-99d1-4e34-9341-ce7a6ebfac4b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: .version_select at 0x7f7d477ca8b0>, body: {"keypair": {"name": "tempest-key-2111597307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI0jlA9w88Cm3UWM+Uxm9C+kzA9MBl5A6l+thFa8kku4UpwSl93f9XkTCblGtV1cziLOFV6tGHVmM8k6vmhCZU5qc6nfjh5IgGQT1Ez4QiJ8t7T7kP685Q2TIAuM52l6Q=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:13.222539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d6bd995d-99d1-4e34-9341-ce7a6ebfac4b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:13.235579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d6bd995d-99d1-4e34-9341-ce7a6ebfac4b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:13.278224 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6bd995d-99d1-4e34-9341-ce7a6ebfac4b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.150492 Oct 06 13:07:13.287313 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1942/3908] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:07:13 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:13.300672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0dcb3d5-8c99-499b-a55c-d74aa39315a3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '.version_select at 0x7f7d3e5e7940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:13.312686 n-d-860556-1 devstack@n-api.service[129614]: WARNING oslo_db.sqlalchemy.utils [None req-b0dcb3d5-8c99-499b-a55c-d74aa39315a3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 06 13:07:13.326248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0dcb3d5-8c99-499b-a55c-d74aa39315a3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.035304 Oct 06 13:07:13.340997 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1943/3909] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 13:07:13 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:13.346780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:13.348358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:13.352451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:13.357002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:13.357710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:13.358488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:13.359392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:13.360273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:13.360734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.241886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:15.252211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:15.253678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:15.263121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdb4980e-4ea5-41e4-b923-e83bb5f50601 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 1.920729 Oct 06 13:07:15.274134 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1944/3910] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:13 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:15.279002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:15.280298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:15.293008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.293521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.294001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.294718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.297175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.297841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.613051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:15.621810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a249b46e-8ebe-4626-ae76-dccfb2be67c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1282 microversion: 2.1 time: 0.346477 Oct 06 13:07:15.628126 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1945/3911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:15 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:15.646898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-162432694", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-key-2111597307", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:15.751034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:15.771644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:15.772093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:15.772625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:15.773042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:15.773918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:15.787952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.788452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.788893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.789626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.790208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.790639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.824549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:15.837255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:15.870969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:15.873781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:15.942468 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd207f7e-f8b7-479f-b5fe-d4f54e9178f0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.125407 Oct 06 13:07:15.943969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1967/3912] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:07:15.950976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:15.953257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:15.961311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.962180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.962951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:15.963874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:15.964594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:15.965229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:16.492933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:16.506086 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2042b04b-c9ef-4510-b25f-0e786ccd19b6 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1270 microversion: 2.1 time: 0.559960 Oct 06 13:07:16.508141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1968/3913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:15 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1270 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:16.526240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b70ebff2-7336-4383-828f-1c21f538934f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:16.528728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b70ebff2-7336-4383-828f-1c21f538934f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:16.984060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b70ebff2-7336-4383-828f-1c21f538934f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:16.997697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b70ebff2-7336-4383-828f-1c21f538934f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1214 microversion: 2.1 time: 0.485788 Oct 06 13:07:17.000944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1969/3914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:16 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1214 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:17.011111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:17.011991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:17.040106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:17.052092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:17.052608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:17.053607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:17.057278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:17.059966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:19.066652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:19.119694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:19.131642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:19.135136 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f91f2851-d1c6-42ef-a954-d9aabd5caaaf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1810 microversion: 2.20 time: 2.130730 Oct 06 13:07:19.167533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1970/3915] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:17 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1810 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:19.198246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:19.198860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:19.223187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:19.223683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:19.224118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:19.224824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:19.225273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:19.236461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:19.811428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:19.811877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:19.812329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:19.813030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:19.813155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:19.834254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:19.835084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:19.836419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:19.845094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:19.845852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:19.846459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:19.904696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:19.924221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:19.951133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:19.954490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:20.043617 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-75288a1d-bca1-45a5-aae3-4f8c758885fc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.414107 Oct 06 13:07:20.047215 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1946/3916] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:07:20.061855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:20.063122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:20.105210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:20.113210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:20.113783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:20.115474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:20.116094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:20.118351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:20.770291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:20.797610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea0f4ad0-9243-47f5-82a2-dde9950bf62c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1270 microversion: 2.1 time: 0.748883 Oct 06 13:07:20.798800 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1947/3917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:20 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1270 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:20.809704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:20.811668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:20.834144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:20.835879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:20.838054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:20.841529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:20.842395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:20.843720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:21.122956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:21.131713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:21.141192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d18b136c-3340-4ded-b7b8-4fbc7769dfa6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1272 microversion: 2.1 time: 0.339030 Oct 06 13:07:21.146838 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1948/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:20 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:21.148276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0535d7a-9e72-49c2-9d65-4f9ab73e78c9 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 1.960275 Oct 06 13:07:21.148876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1971/3919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:19 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:21.170885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:21.171363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:21.185332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:21.189366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:21.190059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:21.191102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:21.195418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:21.196011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:21.586155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:21.616431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3748c7e-0ec5-475f-affc-5e8846267cae tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1224 microversion: 2.1 time: 0.454125 Oct 06 13:07:21.616431 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1972/3920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:21 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1224 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:21.625961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:21.642713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:21.680693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:21.681210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:21.681659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:21.690833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:21.691396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:21.691849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:21.920955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Calling method '.version_select at 0x7f7d3e64d9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:22.121980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:07:22.122634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Neutron security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:07:22.123186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] HTTP exception thrown: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.123186 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Request method failure captured: Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/844a32f6-6bbf-46d9-8f2c-33d6a257cb43 HTTP/1.1 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtMH1EeRt7X7ieuip1C2nBnwP8jn5Ca_n-q08nbbk_g5A9ZMX4z3vYkbqGF5t9hjFKUoWt3kCqZ-7gkCCmlNrtlLXeo7Q6fQhU3O3AfOsaX9Xc3938zhdxCvSDJKVEuvUPYsNHzIM2nKsgdqwLSFLHuYvcWSRVcRC9IE6TuF4BlxX_E Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c25110f6f4cd44a1a76973e663cd7a8b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}] Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c9c56c3d5e3d4665a2252d0dd67942a5 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '844a32f6-6bbf-46d9-8f2c-33d6a257cb43'} Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:07:22.125284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Returning 404 to user: Security group 844a32f6-6bbf-46d9-8f2c-33d6a257cb43 does not exist Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-dc59238f-a3ae-41dd-a52c-c0a40ae7344e'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-faf3c27d-5d76-48dd-a223-54914679d818 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/844a32f6-6bbf-46d9-8f2c-33d6a257cb43" status: 404 len: 194 microversion: 2.1 time: 0.978550 Oct 06 13:07:22.129865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1949/3921] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:07:21 2022] DELETE /compute/v2.1/os-security-groups/844a32f6-6bbf-46d9-8f2c-33d6a257cb43 => generated 194 bytes in 981 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:22.139545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:22.147152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:22.165633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.170353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.170861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:22.171661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.172223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.172649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:22.506660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:22.518014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:22.525501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:22.528677 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3decd71c-bf3b-4a26-b116-c2b9b2781717 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1797 microversion: 2.20 time: 0.910258 Oct 06 13:07:22.531080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1973/3922] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:07:21 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1797 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:07:22.544145 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64b0aa81-f472-42bc-b885-e2e26ca35339 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011845 Oct 06 13:07:22.544888 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1974/3923] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Oct 6 13:07:22 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 13:07:22.562739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:22.567028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:22.575946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.579607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.580413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:22.584478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.589991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.590444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:22.789147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:22.802746 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90486a86-978e-4135-958c-344e896e04ce tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1272 microversion: 2.1 time: 0.253116 Oct 06 13:07:22.806017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1975/3924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:22 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:22.819659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:22.836056 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e6917e5-3f55-405c-900b-5c22bb80a769 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1312 microversion: 2.1 time: 0.705963 Oct 06 13:07:22.837477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:22.839078 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1950/3925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:22 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:22.840273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:22.855754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19748e98-e2fb-46bc-b9bb-d244c22a724d tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Calling method '.version_select at 0x7f7d3e5995e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:22.866372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.866906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.867355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:22.868091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:22.868550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:22.868980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:23.378428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:23.447833 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80e62c9d-b314-4f43-a88b-7813b015b106 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.640476 Oct 06 13:07:23.457662 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1976/3926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:22 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:23.471434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:23.475770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:23.501379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:23.502270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:23.502996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:23.503956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:23.504622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:23.506081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:24.118734 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19748e98-e2fb-46bc-b9bb-d244c22a724d tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.276380 Oct 06 13:07:24.121035 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1951/3927] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Oct 6 13:07:22 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:24.132314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:24.135909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:24.173947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:24.174744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:24.176510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:24.177432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:24.178087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:24.178829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:24.335484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:24.355441 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-06e4ef41-46f2-4e37-bf40-418c36883d06 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 0.895330 Oct 06 13:07:24.356870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1977/3928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:23 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:24.373407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:24.374385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:24.385456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:24.388479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:24.389216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:24.391779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:24.392838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:24.393472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:24.755878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:24.757760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:24.767063 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-176b3fd8-9963-4b9a-ad9f-117c936551fd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.644284 Oct 06 13:07:24.769315 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1952/3929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:24 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:24.790810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Calling method '.version_select at 0x7f7d3e5dc670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:25.105334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:25.114348 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c4a8832-23cd-49ec-89d7-0f3d91dd4e8d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.754735 Oct 06 13:07:25.117382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1978/3930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:24 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:25.137457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:25.138273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:25.146277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:25.147177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:25.147950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:25.148878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:25.149576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:25.150320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:25.806984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:26.016089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:07:26.016875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 06 13:07:26.016875 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Request method failure captured: Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-security-groups/39146fb0-2f75-48b4-9b5e-8b8c3c8bf07c HTTP/1.1 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtMH1EeRt7X7ieuip1C2nBnwP8jn5Ca_n-q08nbbk_g5A9ZMX4z3vYkbqGF5t9hjFKUoWt3kCqZ-7gkCCmlNrtlLXeo7Q6fQhU3O3AfOsaX9Xc3938zhdxCvSDJKVEuvUPYsNHzIM2nKsgdqwLSFLHuYvcWSRVcRC9IE6TuF4BlxX_E Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c25110f6f4cd44a1a76973e663cd7a8b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}] Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c9c56c3d5e3d4665a2252d0dd67942a5 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: exception: Insufficient rights for removing default security group. Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '39146fb0-2f75-48b4-9b5e-8b8c3c8bf07c'} Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:07:26.019934 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] Oct 06 13:07:26.023669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.029182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 06 13:07:26.029182 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-d2914009-d881-4310-9cb1-54d40634d870'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:26.030727 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-236c76de-0338-4a4b-980f-004dad24f491 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/39146fb0-2f75-48b4-9b5e-8b8c3c8bf07c" status: 400 len: 182 microversion: 2.1 time: 1.259601 Oct 06 13:07:26.031871 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1953/3931] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:07:24 2022] DELETE /compute/v2.1/os-security-groups/39146fb0-2f75-48b4-9b5e-8b8c3c8bf07c => generated 182 bytes in 1261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:07:26.043337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7640fa25-aa6e-4723-b2b5-ee3becfd5708", "tag": "b694a2d5-7531-4686-87bd-0398369a20ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:26.054633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.055134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.055580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.067551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] Creating event network-changed:b694a2d5-7531-4686-87bd-0398369a20ed for instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 on n-h2-860556-1 Oct 06 13:07:26.069192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:26.073382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8ed610a7-4c8d-4335-a904-58d6af10b347 req-bb432c0e-a9a3-47cc-94ad-825f946ced1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039933 Oct 06 13:07:26.074451 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1954/3932] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:26.080698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:26.081688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:26.082974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4479c039-aab6-4b32-8876-57af61719ce1 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.950426 Oct 06 13:07:26.084267 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1979/3933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:25 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:26.093631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:26.094528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:26.114506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.115014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.115466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.116186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.123961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.123961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.123961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.124295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.124295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.124555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.126920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.128294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.137879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:26.700259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:26.718858 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-280eb699-35a8-440b-b103-e515af852ef6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 0.643090 Oct 06 13:07:26.733822 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1955/3934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:26 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:26.733822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Calling method '.version_select at 0x7f7d3e5dc940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:26.738421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:26.746577 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78c750e5-c5ca-4bba-82f7-122f8c94a3e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.661016 Oct 06 13:07:26.762573 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1980/3935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:26 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:26.768289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:26.768915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:26.775334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.775833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.776275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.777132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.777595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.778052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.810561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:07:26.810923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Neutron security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:07:26.813044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] HTTP exception thrown: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.813044 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Request method failure captured: Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-security-groups/f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a HTTP/1.1 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtMH1EeRt7X7ieuip1C2nBnwP8jn5Ca_n-q08nbbk_g5A9ZMX4z3vYkbqGF5t9hjFKUoWt3kCqZ-7gkCCmlNrtlLXeo7Q6fQhU3O3AfOsaX9Xc3938zhdxCvSDJKVEuvUPYsNHzIM2nKsgdqwLSFLHuYvcWSRVcRC9IE6TuF4BlxX_E Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c25110f6f4cd44a1a76973e663cd7a8b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}] Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c9c56c3d5e3d4665a2252d0dd67942a5 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a'} Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:07:26.815831 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Returning 404 to user: Security group f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a does not exist Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-0fc9a70a-89a9-4fb7-8e36-e01ad4a10b54'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:26.819852 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41e23691-f562-43db-8240-4a846adaf959 tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a" status: 404 len: 194 microversion: 2.1 time: 0.096415 Oct 06 13:07:26.823939 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1956/3936] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:07:26 2022] GET /compute/v2.1/os-security-groups/f9bdd9bf-a40f-4ec8-8a2a-02762c4b471a => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:26.833827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdd73eb-16ee-44a7-9c96-e88480cd7330", "tag": "333eee94-bdd9-49a4-a57a-2be874bf7667"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:26.853042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:26.853701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:26.854379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:26.870993 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] Creating event network-changed:333eee94-bdd9-49a4-a57a-2be874bf7667 for instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 on n-h1-860556-1 Oct 06 13:07:26.876633 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-24948d8b-2164-4ba9-ab9c-e8288e70c0a8 req-f9909059-f75c-4bbc-8b94-06d0cd439300 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052087 Oct 06 13:07:26.877660 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1957/3937] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:26.893551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Action: 'update', calling method: .version_select at 0x7f7d3e5b14c0>, body: {"security_group": {"name": "tempest-sg-1323825140", "description": "tempest-description-430293086"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:26.962401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG neutronclient.v2_0.client [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist", "detail": ""}} {{(pid=129614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 06 13:07:26.963209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.security_group_api [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Neutron security group 0dd2e0dd-cd82-4544-aa18-497108945dcd not found {{(pid=129614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 06 13:07:26.963948 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] HTTP exception thrown: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.963948 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Request method failure captured: Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: request: PUT /compute/v2.1/os-security-groups/0dd2e0dd-cd82-4544-aa18-497108945dcd HTTP/1.1 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 101 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtMH1EeRt7X7ieuip1C2nBnwP8jn5Ca_n-q08nbbk_g5A9ZMX4z3vYkbqGF5t9hjFKUoWt3kCqZ-7gkCCmlNrtlLXeo7Q6fQhU3O3AfOsaX9Xc3938zhdxCvSDJKVEuvUPYsNHzIM2nKsgdqwLSFLHuYvcWSRVcRC9IE6TuF4BlxX_E Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c25110f6f4cd44a1a76973e663cd7a8b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c25110f6f4cd44a1a76973e663cd7a8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c25110f6f4cd44a1a76973e663cd7a8b"}]}] Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c25110f6f4cd44a1a76973e663cd7a8b Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c9c56c3d5e3d4665a2252d0dd67942a5 Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1126526635-project Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: {"security_group": {"name": "tempest-sg-1323825140", "description": "tempest-description-430293086"}} Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: exception: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0dd2e0dd-cd82-4544-aa18-497108945dcd', 'body': {'security_group': {'name': 'tempest-sg-1323825140', 'description': 'tempest-description-430293086'}}} Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 06 13:07:26.965968 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] Oct 06 13:07:26.970379 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:26.978115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] Returning 404 to user: Security group 0dd2e0dd-cd82-4544-aa18-497108945dcd does not exist Oct 06 13:07:26.978115 n-d-860556-1 devstack@n-api.service[129614]: Neutron server returns request_ids: ['req-6a74085f-a082-4ffc-83ed-c83c989b4dc3'] {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:26.979925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70454e8b-39fd-483a-a33a-93f5ae161d7a tempest-SecurityGroupsNegativeTestJSON-1126526635 tempest-SecurityGroupsNegativeTestJSON-1126526635-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/0dd2e0dd-cd82-4544-aa18-497108945dcd" status: 404 len: 194 microversion: 2.1 time: 0.099381 Oct 06 13:07:26.988506 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1958/3938] 10.222.0.26 () {60 vars in 1290 bytes} [Thu Oct 6 13:07:26 2022] PUT /compute/v2.1/os-security-groups/0dd2e0dd-cd82-4544-aa18-497108945dcd => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:26.996592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:27.113594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:27.131625 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73f37f75-db24-410a-bfae-1060cd1ae448 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.364778 Oct 06 13:07:27.133777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1981/3939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:26 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:27.135915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:27.138056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:27.160923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.161612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.162191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:27.164223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.164871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.166064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:27.576278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:27.596477 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e039ba4f-becd-4f2d-baa6-0bed574f1398 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.477846 Oct 06 13:07:27.597094 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1959/3940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:27 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:27.742617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:27.743238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:27.771082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.774122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:27.775097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:27.775469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.775969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:27.776727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.780585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.781055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:27.789097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.789858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.791693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:27.793868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:27.797327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:27.798257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.287359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:28.299203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d6bf265e-8df5-4cd6-a226-3aba67859f27 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.529024 Oct 06 13:07:28.300367 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1960/3941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:27 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:28.318742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a82044e-4db0-4c80-88d9-d0adfe01a0bf", "tag": "cdcae1db-d547-4e17-85d9-92b564404598"}, {"name": "network-changed", "server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "tag": "40205222-9134-4444-857c-4b37ba8f3f77"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:28.331463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:28.331964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:28.332403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.349821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Creating event network-changed:cdcae1db-d547-4e17-85d9-92b564404598 for instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf on n-h1-860556-1 Oct 06 13:07:28.350757 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] Creating event network-changed:40205222-9134-4444-857c-4b37ba8f3f77 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:07:28.361881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-99df1e77-55a1-498b-a1d7-23f89b36b21a req-97cd896a-68c9-43ee-b408-dbda0143a4cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059865 Oct 06 13:07:28.363359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1961/3942] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:28.369599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:28.370165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:28.371042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:28.377500 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac09d067-3253-4046-a3f5-d813abb255de tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 0.638814 Oct 06 13:07:28.378125 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1982/3943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:27 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:28.388396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:28.389516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:28.390108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.391050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:28.391825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:28.392392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.620172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:28.621251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:28.629722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:28.630607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:28.631278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.632257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:28.632931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:28.633592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:28.974713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:28.991309 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f33f650-1e48-4beb-9aae-b5c5a342a47a tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.625727 Oct 06 13:07:28.993019 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1962/3944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:28 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:29.336303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:29.337585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:29.348130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:29.349587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:29.351044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:29.352606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:29.353265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:29.354303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:29.545578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:29.556196 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-571e4539-8e56-4369-97a9-8abcffa2d777 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.940135 Oct 06 13:07:29.557264 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1983/3945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:28 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:29.566081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:29.566810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:29.568572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:29.573932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:29.574423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:29.574860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:29.575558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:29.576004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:29.576589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:29.863486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:29.945708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=16 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:30.233651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:30.263708 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b834a878-aff3-40aa-b472-c6253e01e54a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.938381 Oct 06 13:07:30.266124 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1963/3946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:29 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:30.278006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:30.279336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:30.292463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:30.298520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:30.300761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:30.301776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:30.303150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:30.304807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:30.393337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:30.407028 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2932bbee-1577-4dc4-bbb5-9af8f2148125 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 0.848099 Oct 06 13:07:30.408583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1984/3947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:29 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:30.580910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:30.581534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:30.593058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:30.602882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:30.603503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:30.604820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:30.605418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:30.606035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:30.991905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:31.006741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0150410-b071-421d-861c-1f3a9962660c tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.738946 Oct 06 13:07:31.007603 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1964/3948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:30 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:31.243323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:31.273530 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f2a3156-46f6-4d23-af79-0fdcd01be8d8 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.696555 Oct 06 13:07:31.275886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1985/3949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:30 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:31.289509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:31.290153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:31.300648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:31.301488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:31.302597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:31.303656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:31.306438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:31.307113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:31.434755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:31.435497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:31.446173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:31.447067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:31.447843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:31.448751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:31.449760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:31.450894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.076610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:32.090199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ded6f14d-7c32-4468-a1b2-c163dbc8c40e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.805045 Oct 06 13:07:32.090703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1965/3950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:31 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:32.107332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdd73eb-16ee-44a7-9c96-e88480cd7330", "name": "network-vif-plugged", "status": "completed", "tag": "333eee94-bdd9-49a4-a57a-2be874bf7667"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:32.128277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:32.132522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:32.133880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.161288 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] Creating event network-vif-plugged:333eee94-bdd9-49a4-a57a-2be874bf7667 for instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 on n-h1-860556-1 Oct 06 13:07:32.171762 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ed796969-2290-4300-8632-3f9440e44b57 req-0084b926-703c-4d87-bd41-d6eb0953921b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076347 Oct 06 13:07:32.172399 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1966/3951] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:32.192750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:32.193633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:32.209904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:32.211019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:32.214545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.215635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:32.216419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:32.217269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.628502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:32.643886 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-154146d6-7166-4ed2-b993-549c61e5f19c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 1.214318 Oct 06 13:07:32.644820 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1986/3952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:31 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:32.653508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:32.660163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:32.668115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:32.668657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:32.669097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.669838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:32.670285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:32.671128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:32.967878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:32.976625 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5fb476a1-3879-4146-9e2c-8ffa7e71efa3 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.799358 Oct 06 13:07:32.977519 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1967/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:32 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:33.065039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:33.074299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8865787-c9fc-4d80-905b-8291f575a317 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.427169 Oct 06 13:07:33.078512 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1987/3954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:32 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:33.114946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:33.116131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:33.123414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:33.124224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:33.124926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:33.125936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:33.126657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:33.127326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:33.425146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "tag": "5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:33.447428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:33.452008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:33.473268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:33.504075 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] Creating event network-changed:5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:07:33.522478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-27f0b065-d44f-4933-bc2e-55ed75631086 req-ed337b3f-8c69-468f-a7b3-5fd7fb9ccfe2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103352 Oct 06 13:07:33.523394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1988/3955] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:07:33.670827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:33.672505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:33.682030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:33.686800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:33.687594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:33.688432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:33.691172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:33.692721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:33.694181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:33.717427 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d53c43d-7209-4ae6-a6bb-9681384b9e88 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.607313 Oct 06 13:07:33.721799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1968/3956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:33 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:34.003016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:34.003716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:34.014189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.017941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.019203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.020629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.021368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.022262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.062727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:34.072303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5df33e75-93f6-4b62-bef1-4cdb592e2d52 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1328 microversion: 2.1 time: 0.405925 Oct 06 13:07:34.079017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1989/3957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:33 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1328 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:34.106027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:34.106857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:34.116933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.117598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.118963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.120158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.120861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.121440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.397198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:34.406595 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-447814e5-d33e-46bc-8cd2-3dedeec55d57 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.409171 Oct 06 13:07:34.430307 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1969/3958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:33 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:34.442447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a82044e-4db0-4c80-88d9-d0adfe01a0bf", "name": "network-vif-plugged", "status": "completed", "tag": "cdcae1db-d547-4e17-85d9-92b564404598"}, {"server_uuid": "7640fa25-aa6e-4723-b2b5-ee3becfd5708", "name": "network-vif-plugged", "status": "completed", "tag": "b694a2d5-7531-4686-87bd-0398369a20ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:34.468819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.469603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.471146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.491152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:34.500704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Creating event network-vif-plugged:cdcae1db-d547-4e17-85d9-92b564404598 for instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf on n-h1-860556-1 Oct 06 13:07:34.502926 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] Creating event network-vif-plugged:b694a2d5-7531-4686-87bd-0398369a20ed for instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 on n-h2-860556-1 Oct 06 13:07:34.512528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6a37851-7e25-4d3d-b52f-f4a668eb7005 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.409903 Oct 06 13:07:34.515044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-486c451e-84cd-45a4-9ad8-5be359d73ddd req-f734aa76-2996-43aa-a5dd-55b2c82c3674 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083062 Oct 06 13:07:34.515224 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1990/3959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:34 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:34.515929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1970/3960] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:34.745813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:34.746443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:34.762835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.763599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.764222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:34.765163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:34.767716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:34.770114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.105883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:35.106946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:35.123111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.124101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.124958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.126291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.127177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.128341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.166834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:35.179508 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fefa7d12-c4dc-4793-97be-90998523b26d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1314 microversion: 2.1 time: 0.437232 Oct 06 13:07:35.179826 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1991/3961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:34 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:35.366034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:35.399638 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4246d66-a1e8-4ecf-a1c3-6cb4a283e116 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1508 microversion: 2.1 time: 0.278222 Oct 06 13:07:35.402577 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1971/3962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:35 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:35.442222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:35.443291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:35.444169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:35.444804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:35.453948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.455200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.457479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.457766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.458151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.458722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.459683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.460178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.460720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.463447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.464173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.464732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.726905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:35.740573 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9aa029c-baa1-4b6a-9bf7-12a5b82110ef tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1508 microversion: 2.1 time: 0.298312 Oct 06 13:07:35.743106 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1972/3963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:35 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:35.749443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:35.758696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:35.788993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.790005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.791332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.795273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.812423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.818103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.879940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:35.897022 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93174353-213a-4f5b-abb6-b9ee4e62b8bd tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.456620 Oct 06 13:07:35.900728 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1992/3964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:35 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:35.914100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:35.917029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:35.944544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.945040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.945492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:35.959388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:35.959898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:35.964489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.020794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:07:36.304911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b9d7174-c3da-49ed-9643-65a8b15ce812 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 204 len: 0 microversion: 2.1 time: 0.400114 Oct 06 13:07:36.310427 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1993/3965] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:07:35 2022] DELETE /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:36.313349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:36.324902 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-febe7ac2-63b1-4836-b4ca-1039803bf613 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.580420 Oct 06 13:07:36.328806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1973/3966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:35 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:36.340267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:36.343572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:36.350086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:36.350994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:36.352945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.354000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.354480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.356549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.356549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.356549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.370062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.376627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.377399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.378838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.382646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.383467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.621245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:36.631758 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8e376e8-5f1f-4cbb-8233-0426c9abb289 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1514 microversion: 2.1 time: 0.300547 Oct 06 13:07:36.635891 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1974/3967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:36 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:36.717427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:36.740872 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12d42426-6e21-4186-be9a-97839929c199 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1502 microversion: 2.1 time: 0.428083 Oct 06 13:07:36.741622 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1994/3968] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:36 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:36.769516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:36.775702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:36.800780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.801346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.801845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.802612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.803084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.803523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.863204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:07:36.875616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:36.928919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:36.929541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:36.944568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.945082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.945527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:36.946432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:36.947088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:36.947671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.036386 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4391934a-901b-4b46-9247-4acb48ee4f2d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 204 len: 0 microversion: 2.1 time: 0.271882 Oct 06 13:07:37.039408 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1975/3969] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:07:36 2022] DELETE /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:37.059641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:37.062429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:37.080726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.081214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.081677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.082434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.082895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.084624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.181639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:37.185177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:37.201583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7515a26a-31ff-4aa4-8497-71585b98ef68 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.276371 Oct 06 13:07:37.203355 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1995/3970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:36 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:37.351681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:37.354524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:37.355886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:37.365371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7cbecb1-1a16-4e23-b059-4963aee132a4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1508 microversion: 2.1 time: 0.320841 Oct 06 13:07:37.367426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.368067 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1976/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:37 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:37.368646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.369297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.370341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.371035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.372391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.619597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:37.633911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42ae021f-38e8-4228-8910-c61f8697fdb7 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1324 microversion: 2.1 time: 0.283904 Oct 06 13:07:37.653219 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1996/3972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:37 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:37.661298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:37.662411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:37.670359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.671040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.671670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.672540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:37.673184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:37.673801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:37.853230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:37.861671 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04c00fe0-5b6a-4da5-8409-44eb40c64632 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1514 microversion: 2.1 time: 0.205626 Oct 06 13:07:37.862736 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1977/3973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:37 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:38.230213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:38.234496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:38.251099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.254044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.255545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:38.259906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.260496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.262428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:38.392623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:38.393321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:38.411825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.412345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.415056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:38.415877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.418382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.439300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:38.908874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:38.924869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-004b49af-ab36-4084-be7b-960dc897fe4f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1508 microversion: 2.1 time: 0.537168 Oct 06 13:07:38.939510 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1978/3974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:38 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:38.950186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:38.951699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:38.961592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.962365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.964620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:38.965910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:38.967100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:38.967690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:39.037277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:39.044932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8f32d07-ee61-4ede-a6a7-6d1e84142960 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.822644 Oct 06 13:07:39.045513 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1997/3975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:38 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:39.060399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:39.060968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:39.078096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:39.078591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:39.079087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:39.079774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:39.080239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:39.080671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.270378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:40.279405 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4babb1a5-7260-4767-9397-b997326c6b8e tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1521 microversion: 2.1 time: 1.338175 Oct 06 13:07:40.283927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1979/3976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:38 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1521 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:40.311207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdd73eb-16ee-44a7-9c96-e88480cd7330", "name": "network-vif-deleted", "tag": "333eee94-bdd9-49a4-a57a-2be874bf7667"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:40.339776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.344363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.345430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.362690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:40.369353 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] Creating event network-vif-deleted:333eee94-bdd9-49a4-a57a-2be874bf7667 for instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 on n-h1-860556-1 Oct 06 13:07:40.374422 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-878d63bd-be8a-4024-b9cc-209bfbce98ff req-a2476914-8505-4947-b5f8-3350780c0eae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067176 Oct 06 13:07:40.378711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52321146-2c6d-4379-95bb-f780368376e5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 200 len: 1514 microversion: 2.1 time: 1.329784 Oct 06 13:07:40.381224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1980/3977] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:40.381886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1998/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:39 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 1514 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:40.391106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:40.393533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:40.396171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:40.400512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:40.405910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.406439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.406892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.407742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.408199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.410580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.413508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.413874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.414535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.415626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.416627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.417271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.792482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:40.800407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e9043a5-8a3e-4adb-8c14-4316476ead46 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.417147 Oct 06 13:07:40.800982 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 1999/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:40 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:40.825158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:40.825667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:40.849277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:40.859493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.860660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.862249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.863107 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b1641f5-a71a-4e32-b20a-32004f04ca58 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 200 len: 1508 microversion: 2.1 time: 0.479368 Oct 06 13:07:40.886420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.887432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.887823 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1981/3980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:40 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:40.888577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.943144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] HTTP exception thrown: Instance is not a member of specified network Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Request method failure captured: Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708/ips/invalid HTTP/1.1 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5XiTQrO1LpkoFbkm7qoEZzZkZsZFwdvHWv3M5JqC4uBuhWgq3axCuQEhc-9IlCuKobjo04S7O9-J7JInYb9fiY1sWjCwCAxuGR3ciN1M0Y14ZWGG8vrY0Ao-zQ8MNQXca1fI8fbdBT9eWSAYhst62gbldk1S98cd9Z7PlUUOtm18 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd5484d7b1ad4548ae264d9678e98dfd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}] Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b855dd230b4543a7bf55692282b2fa66 Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance is not a member of specified network Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': '7640fa25-aa6e-4723-b2b5-ee3becfd5708', 'id': 'invalid'} Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 06 13:07:40.950911 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.955393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Returning 404 to user: Instance is not a member of specified network {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:40.956415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-980d0072-d369-4cb9-8e81-fade38e037dd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.154333 Oct 06 13:07:40.963000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2000/3981] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:07:40 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708/ips/invalid => generated 91 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:07:40.968594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:40.969247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Failed to fetch instance by id 999 {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 06 13:07:40.969884 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] HTTP exception thrown: Instance 999 could not be found. Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Request method failure captured: Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5XiTQrO1LpkoFbkm7qoEZzZkZsZFwdvHWv3M5JqC4uBuhWgq3axCuQEhc-9IlCuKobjo04S7O9-J7JInYb9fiY1sWjCwCAxuGR3ciN1M0Y14ZWGG8vrY0Ao-zQ8MNQXca1fI8fbdBT9eWSAYhst62gbldk1S98cd9Z7PlUUOtm18 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd5484d7b1ad4548ae264d9678e98dfd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}] Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b855dd230b4543a7bf55692282b2fa66 Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 999 could not be found. Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '999'} Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 06 13:07:40.971847 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:40.975722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Returning 404 to user: Instance 999 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:40.975722 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0653aca2-5f23-46e5-bdaf-f7cd6dc91273 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010780 Oct 06 13:07:40.983319 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1982/3982] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 13:07:40 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 06 13:07:40.984814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:40.986133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:40.993873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.994350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.994792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:40.995497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:40.996218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:40.996819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.011783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a82044e-4db0-4c80-88d9-d0adfe01a0bf", "name": "network-vif-deleted", "tag": "cdcae1db-d547-4e17-85d9-92b564404598"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:41.035785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.038333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.040099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.071310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] Creating event network-vif-deleted:cdcae1db-d547-4e17-85d9-92b564404598 for instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf on n-h1-860556-1 Oct 06 13:07:41.075257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:07:41.083508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-abfc9d37-0e1c-4647-91e4-1abd2faca4f6 req-b81bb8ca-3c7a-4da6-8811-b93505cce1a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075283 Oct 06 13:07:41.084224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1983/3983] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:07:41.216790 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a90259e5-c115-41ea-9270-55268bcee4bc tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 204 len: 0 microversion: 2.1 time: 0.236392 Oct 06 13:07:41.218067 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2001/3984] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:07:40 2022] DELETE /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:41.228131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:41.228828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:41.251409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.252204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.252655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.253373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.253885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.254313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.409909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:41.410813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:41.428683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.431156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.433394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.434604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.436909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.438262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.476385 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 HTTP/1.1 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'bfdd73eb-16ee-44a7-9c96-e88480cd7330'} Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:41.485102 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:07:41.489547 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:41.490791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:41.496167 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-916ee5ef-52fe-47dc-b11c-f9690dfd2f32 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 404 len: 111 microversion: 2.1 time: 0.091652 Oct 06 13:07:41.498756 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2002/3985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:41 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:41.512384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2deae5d-dbac-484d-9439-88a37b51f898 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '.version_select at 0x7f7d3e661700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:41.568933 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2deae5d-dbac-484d-9439-88a37b51f898 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-2111597307" status: 202 len: 0 microversion: 2.1 time: 0.065484 Oct 06 13:07:41.570195 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2003/3986] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Oct 6 13:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2111597307 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:07:41.697574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:41.730808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-064fab6f-2b2d-40dd-a7d4-12179173f234 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1527 microversion: 2.1 time: 0.507338 Oct 06 13:07:41.759989 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1984/3987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:41 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1527 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:41.812000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-298210865", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:41.822663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:41.823699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:41.839506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.840151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.842552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.846188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:41.846836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:41.847439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:41.965696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:42.379515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:42.391974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9856a02-3271-4c36-8b17-3519adce5641 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.572450 Oct 06 13:07:42.392629 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1985/3988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:41 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:42.411971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:42.419358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:42.429643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:42.432166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:42.432621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:42.436723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:42.437246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:42.437682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:42.467352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf HTTP/1.1 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '2a82044e-4db0-4c80-88d9-d0adfe01a0bf'} Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:42.469359 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:07:42.474138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:42.482149 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2fc46a8-eeb2-4ddd-887e-c974fd4470d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 404 len: 111 microversion: 2.1 time: 0.077832 Oct 06 13:07:42.482812 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1986/3989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:42 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:42.679324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1686370561", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:42.787753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:07:43.312493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:43.313894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:43.314574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:43.315001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:43.315702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:43.343185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:43.343952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:43.344623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:43.346559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:43.349092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:43.349832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:43.405379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:43.420728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:43.459914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:43.462751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:43.582286 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be86a3b8-d832-42f0-989f-848d935b7f2e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774220 Oct 06 13:07:43.586133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2004/3990] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:07:43.596363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:43.600108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:43.617343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:43.619856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:43.620501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:43.622616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:43.624406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:43.625016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:44.301981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:44.311516 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30d7906d-8744-40bd-bd2a-c509235c877b tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1527 microversion: 2.1 time: 0.724100 Oct 06 13:07:44.312105 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2005/3991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:43 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1527 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:44.336033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:44.336652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:44.356068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:44.356571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:44.362413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:44.365786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:44.366598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:44.367347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.026403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:07:45.027367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:07:45.028037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:07:45.028609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:07:45.029204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:07:45.031868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:45.041947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.042653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.043258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.044489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.045030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.045464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.086659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:45.124612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:45.151694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:07:45.154990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:07:45.252454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87fd4154-8ab8-494e-9cce-2f5e98d1c782 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.579558 Oct 06 13:07:45.260545 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1987/3992] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:07:45.265688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "name": "network-vif-plugged", "status": "completed", "tag": "40205222-9134-4444-857c-4b37ba8f3f77"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:45.310614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.312307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.313003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.350710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] Creating event network-vif-plugged:40205222-9134-4444-857c-4b37ba8f3f77 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:07:45.360407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6a5831a1-77e4-4efa-b90d-c04107506048 req-6ddeb559-bb4d-4cc1-92c5-ad6d8ce8bf83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098310 Oct 06 13:07:45.362082 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1988/3993] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:45.370185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:45.371112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:45.379202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.380428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.382527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.384451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.385159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.385774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.591300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:45.603986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:45.611296 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a17a3b0c-9933-4be3-a8af-d350ccdf92aa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1260 microversion: 2.1 time: 0.246912 Oct 06 13:07:45.611901 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1989/3994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:45 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:45.620496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24ab650b-8a17-4ac8-92ce-5531126d3bef tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 1.295118 Oct 06 13:07:45.621121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2006/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:44 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:45.629786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5229da36-58e5-4705-9c5a-2e694727879d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:45.630437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5229da36-58e5-4705-9c5a-2e694727879d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:45.639335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:45.644299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:45.660106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.676466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.678830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.679606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:45.680080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:45.680523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:45.948768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5229da36-58e5-4705-9c5a-2e694727879d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:45.970789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5229da36-58e5-4705-9c5a-2e694727879d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1215 microversion: 2.1 time: 0.346438 Oct 06 13:07:45.990016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1990/3996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:45 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:45.999812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7640fa25-aa6e-4723-b2b5-ee3becfd5708", "name": "network-vif-deleted", "tag": "b694a2d5-7531-4686-87bd-0398369a20ed"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:46.012190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:46.013366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:46.014389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:46.027602 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] Creating event network-vif-deleted:b694a2d5-7531-4686-87bd-0398369a20ed for instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 on n-h2-860556-1 Oct 06 13:07:46.036619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2f7e9231-6473-4170-9762-2736ce90f6ed req-0a5dccbb-fb3a-4bda-a37e-23647e33cb75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044205 Oct 06 13:07:46.037354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1991/3997] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:46.120856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b855dd230b4543a7bf55692282b2fa66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5484d7b1ad4548ae264d9678e98dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:46.152782 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b0bb2ed-9eca-42d1-9085-babb8abdd879 tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 200 len: 1309 microversion: 2.1 time: 0.513598 Oct 06 13:07:46.154384 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2007/3998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:45 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 1309 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:46.638152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:46.638987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:46.647937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:46.648701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:46.657272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:46.658259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:46.659163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:46.659365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:46.660258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:46.660835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:46.661110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:46.661634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:46.661968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:46.665142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:46.665770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:46.666325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:46.863683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:46.895978 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d06fff2c-59d4-46e6-94db-77c91e69ac1d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1266 microversion: 2.1 time: 0.262613 Oct 06 13:07:46.896576 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1992/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:46 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:47.006127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:47.006683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:47.021218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.022105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.022553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.024388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.024857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.025294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.037509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:47.046526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-860cc6ef-cc2c-49b0-991c-1bb7da41257d tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.402401 Oct 06 13:07:47.047125 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2008/4000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:46 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:47.177375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:47.182052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:47.182681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] [instance: 7640fa25-aa6e-4723-b2b5-ee3becfd5708] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:47.191156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.191936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.192957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.193908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.194548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.195132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.195656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f26a351e-99c0-46c5-ba76-4be67ecc25b3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1267 microversion: 2.1 time: 0.194566 Oct 06 13:07:47.197101 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1993/4001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:46 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:47.210670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] HTTP exception thrown: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Request method failure captured: Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 HTTP/1.1 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5XiTQrO1LpkoFbkm7qoEZzZkZsZFwdvHWv3M5JqC4uBuhWgq3axCuQEhc-9IlCuKobjo04S7O9-J7JInYb9fiY1sWjCwCAxuGR3ciN1M0Y14ZWGG8vrY0Ao-zQ8MNQXca1fI8fbdBT9eWSAYhst62gbldk1S98cd9Z7PlUUOtm18 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd5484d7b1ad4548ae264d9678e98dfd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd5484d7b1ad4548ae264d9678e98dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd5484d7b1ad4548ae264d9678e98dfd"}]}] Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: fd5484d7b1ad4548ae264d9678e98dfd Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1192927763 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b855dd230b4543a7bf55692282b2fa66 Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1192927763-project Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7640fa25-aa6e-4723-b2b5-ee3becfd5708'} Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:47.212361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. Oct 06 13:07:47.216327 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:07:47.217944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] Returning 404 to user: Instance 7640fa25-aa6e-4723-b2b5-ee3becfd5708 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:07:47.219061 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3b95092b-606d-4570-aebf-c77f0cbea0fd tempest-ServerAddressesNegativeTestJSON-1192927763 tempest-ServerAddressesNegativeTestJSON-1192927763-project] 10.222.0.26 "GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708" status: 404 len: 111 microversion: 2.1 time: 0.041678 Oct 06 13:07:47.236689 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2009/4002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:47 2022] GET /compute/v2.1/servers/7640fa25-aa6e-4723-b2b5-ee3becfd5708 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:07:47.706084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "name": "network-vif-plugged", "status": "completed", "tag": "5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:47.730181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.734091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.734766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.762952 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] Creating event network-vif-plugged:5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:07:47.769832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9f6fc2bf-79bf-4f2d-8c15-13595343b91c req-758a64ba-c86a-4b4b-8273-1ab1858a1f01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068383 Oct 06 13:07:47.770985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1994/4003] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:07:47.920964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:47.921600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:47.940774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.942013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.943743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:47.944520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:47.945010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:47.945438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:48.071236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:48.071919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:48.087811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:48.088652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:48.089261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:48.090189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:48.094799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:48.095439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:48.441529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:48.449386 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ad9b11b-6369-44de-9917-4e3a1cbc35ab tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.533355 Oct 06 13:07:48.453023 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2010/4004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:47 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:48.474037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:48.474677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:48.480980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:48.481651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:48.482303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:48.483159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:48.494473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:48.495184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:48.584938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:48.592828 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7586c13-8cd7-4709-9fb2-7f1dddcbd746 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.526906 Oct 06 13:07:48.609614 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1995/4005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:48 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:49.003081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:49.014456 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4cfed71-8bd5-4cc8-b803-9399805e0912 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1273 microversion: 2.1 time: 0.560158 Oct 06 13:07:49.015697 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2011/4006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:48 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1273 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:49.479800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:49.480439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:49.492391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:49.492766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:49.495300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:49.499429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:49.500313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:49.501628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:49.617167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:49.618393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:49.625145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:49.626769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:49.627367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:49.628560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:49.629217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:49.631461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:50.142259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:50.153981 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16cd60c3-da87-4c04-8bcc-edb8560d957f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.678102 Oct 06 13:07:50.155726 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1996/4007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:49 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:50.169565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:50.170554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:50.180888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:50.181702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:50.182323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:50.183273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:50.184221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:50.184964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:50.204200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:50.340597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:50.350844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfd3628c-8fa6-4fd7-8991-10953789a5ab tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1333 microversion: 2.1 time: 0.737882 Oct 06 13:07:50.351855 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2012/4008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:49 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1333 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:50.586962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:50.612121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e43a77e9-c9c3-4592-be72-1b584ec41f80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.448084 Oct 06 13:07:50.613907 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1997/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:50 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:50.913723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3487538d-f8ac-49b5-b551-8765c92c2b62", "tag": "429af193-7cdc-42a5-aa7d-8128f23ef575"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:50.939376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:50.941781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:50.943484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:50.983797 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] Creating event network-changed:429af193-7cdc-42a5-aa7d-8128f23ef575 for instance 3487538d-f8ac-49b5-b551-8765c92c2b62 on n-h1-860556-1 Oct 06 13:07:50.996906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-aa6c7736-9b81-4c99-8c5b-34d28459fb50 req-c8cc2149-6670-4a81-abbd-0447052b16ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087895 Oct 06 13:07:50.999239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2013/4010] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:51.178882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:51.186589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:51.202625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.203643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.205229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:51.206592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.215643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.217570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:51.376701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:51.378241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:51.392459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.393166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.393612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:51.394360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.394819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.395247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:51.800375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:51.823746 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1cf4586-a32a-49cd-ad7b-4d65e83c2636 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.645873 Oct 06 13:07:51.826053 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1998/4011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:51 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:51.838570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:51.845907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:51.861752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.862921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.863387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:51.864113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:51.866733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:51.867307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.014070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:52.018792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:52.028708 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-199289ff-f91c-4cba-a632-ed6a37c48d36 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1667 microversion: 2.1 time: 0.656141 Oct 06 13:07:52.046292 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2014/4012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:51 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1667 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:52.057112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.058066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:52.070905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.071669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.072695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.073887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.075166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.075980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.125504 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f86a7c95-221a-4bce-af54-8c8b32ae5d76 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05/ips" status: 200 len: 178 microversion: 2.1 time: 0.072421 Oct 06 13:07:52.134379 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2015/4013] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:07:52 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05/ips => generated 178 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:52.148430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.151696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:52.163471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.164204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.170397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.171861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.172341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.172840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.217216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:07:52.311139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:52.358550 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be18777d-32bb-4b02-aac4-1e6469ab52d5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.526408 Oct 06 13:07:52.360638 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 1999/4014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:51 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:52.402273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.404343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:52.411325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9a8bf1ac-d5ad-4172-bef3-eff4fc497b18 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 204 len: 0 microversion: 2.1 time: 0.268498 Oct 06 13:07:52.411832 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2016/4015] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:07:52 2022] DELETE /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:52.421821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.422750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.423410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.424424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.425664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.426379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.441450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.442111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:52.453666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:52.456002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.460403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.465716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.465716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.465716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.465716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.472331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-951e5cd9-91f0-4e75-bd38-f535d5b57d15 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments/df77c013-59e7-4d51-bdfa-ccdf0539f73c" status: 200 len: 194 microversion: 2.20 time: 0.105690 Oct 06 13:07:52.481160 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2000/4016] 10.222.0.26 () {60 vars in 1454 bytes} [Thu Oct 6 13:07:52 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments/df77c013-59e7-4d51-bdfa-ccdf0539f73c => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:07:52.614873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.617243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:52.635100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.636913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.637572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.640151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:52.641133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:52.644233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:52.814421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lazy-loading 'services' on Instance uuid f947c19c-0ca6-46d8-a257-45e62a15a37c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:07:52.970179 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-609d8d44-3e2a-439c-9837-2acd6018c539 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments/df77c013-59e7-4d51-bdfa-ccdf0539f73c" status: 202 len: 0 microversion: 2.20 time: 0.366590 Oct 06 13:07:52.971752 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2001/4017] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Oct 6 13:07:52 2022] DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments/df77c013-59e7-4d51-bdfa-ccdf0539f73c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:07:52.983855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:52.987842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:53.004711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.007560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.008180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.009110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.010341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.011864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.213995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:53.237316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-08b6a21e-5cfb-47be-b450-b6e5791d55f5 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1673 microversion: 2.1 time: 0.818458 Oct 06 13:07:53.240554 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2017/4018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:52 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1673 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:53.253080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:53.270657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:53.288368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.288863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.298322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.306890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.307401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.307854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.386186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:53.425675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:53.436867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b65fdec9-fd74-4ceb-bd06-5430842d8f0e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.463635 Oct 06 13:07:53.449860 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2002/4019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:52 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:53.450063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:53.455562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74390366-e72c-43da-8620-2b7ea6da61e4", "tag": "992042b7-e380-4894-af43-122795e48950"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:53.466651 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec0af6c6-6e5f-42b8-96e2-def3ea00adea tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.224096 Oct 06 13:07:53.467311 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2018/4020] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:07:53 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:07:53.476233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.476723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.481552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.500016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:53.501424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:53.523888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.524388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.524827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.525547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:53.527750 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] Creating event network-changed:992042b7-e380-4894-af43-122795e48950 for instance 74390366-e72c-43da-8620-2b7ea6da61e4 on n-h1-860556-1 Oct 06 13:07:53.536935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:53.537501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:53.550569 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8c331221-8dc8-4744-b457-ab587ae7d4d7 req-4a4a3f21-7f1f-4691-8ac5-2e02707e47d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101918 Oct 06 13:07:53.554930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2003/4021] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:53.879120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21be4639-6388-415a-8c62-1cb60a0ec40e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Action: 'create', calling method: .version_select at 0x7f7d3e530820>, body: {"keypair": {"name": "tempest-keypair-1803938758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzv7NFAcNOhpdDIlI10zVJKTY3zkgBll16sLiIvZh+qB9hAupfjIPf9TgKsO7K4NgpLbTGiVtLT1+Ou21AYyaZSolLEJ7pl2dTWQN4pDCENXVusbUFkB0GdLkzFvl9DA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:53.947250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-21be4639-6388-415a-8c62-1cb60a0ec40e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for project d00c5dcc24cc466e9a065a74299c9150. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:07:53.972054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-21be4639-6388-415a-8c62-1cb60a0ec40e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for user d117be3ea1514c02ba14a1f02d403265 and project d00c5dcc24cc466e9a065a74299c9150. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:07:53.977140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:53.991077 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5253d40-05cd-495c-a0d3-41211da6739d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.511646 Oct 06 13:07:53.992858 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2019/4022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:53 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:54.058301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21be4639-6388-415a-8c62-1cb60a0ec40e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483623 Oct 06 13:07:54.058917 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2004/4023] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:07:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:07:54.274004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:54.274676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:54.290182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:54.293117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:54.293790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:54.295400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:54.297279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:54.298297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:54.464171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:54.465051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:54.476788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:54.477889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:54.478374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:54.481327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:54.481863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:54.483148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:55.064110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:07:56.253933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:56.272272 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64a8649c-0fec-4b59-94a8-a70abf16f6d1 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1673 microversion: 2.1 time: 2.004780 Oct 06 13:07:56.272272 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2020/4024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:54 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1673 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:56.286409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:56.293103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:56.297681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:56.305855 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c676858-f491-4a28-b241-e23e7ce9f0c6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 1.846178 Oct 06 13:07:56.308806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.309379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.311586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.312696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.316549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.317113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.324553 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2005/4025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:54 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:56.334874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:56.346182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:56.353540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.354319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.354923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.355782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.356377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.365289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.411846 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0dca5a3-2d4c-4f25-9317-4897c5951e95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138023 Oct 06 13:07:56.413452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2021/4026] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:07:56 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:07:56.538526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Calling method '.version_select at 0x7f7d3ed69b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:56.540535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.541233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.542035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.611937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.612543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.614159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.639847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:56.640741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:56.641455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:56.648852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3183d590-fa1a-47a8-a9d2-8418e17b0c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1455604701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.233460 Oct 06 13:07:56.650176 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2022/4027] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:07:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:56.989035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "name": "network-vif-deleted", "tag": "5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:07:56.993201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:57.013109 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4838587-2ae8-4391-9ba5-4b77d952304e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.687299 Oct 06 13:07:57.020075 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2006/4028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:56 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:57.027845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:57.028614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:57.032591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:57.061497 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] Creating event network-vif-deleted:5b7aedd2-d0e9-4465-ad9a-15ae2c5a3637 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:07:57.075458 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d071e3a7-3297-49b3-94ea-2905415e1a4c req-a2b64f13-de43-4d9b-ae61-3b923ab39d8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090071 Oct 06 13:07:57.081371 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2023/4029] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:07:57.295517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:57.296286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:57.307792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:57.310185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:57.311069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:57.313466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:57.315427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:57.316897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:57.333077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:57.334400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:57.357645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:57.359440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:57.371628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:57.372573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:57.373168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:57.373758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:58.626885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:58.639997 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44947384-b147-4d88-97e9-1ff1dc8ad1fa tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 1.311384 Oct 06 13:07:58.643300 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2024/4030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:57 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:07:58.655634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:58.663498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:58.677855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:58.678485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:58.683698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:58.684885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:58.685644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:58.686344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:58.765807 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51129283-d480-4f18-b49e-d4933bf298d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120329 Oct 06 13:07:58.769617 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2025/4031] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:07:58 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:07:58.781839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:58.783314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:58.800725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:58.804033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:58.804857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:58.806341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:58.809795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:58.810544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:59.543805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:59.547309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:07:59.551973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-006eeeec-5890-45e5-8d40-105688a7b311 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1495 microversion: 2.1 time: 2.260574 Oct 06 13:07:59.552555 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2007/4032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:57 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1495 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:59.555485 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bbb5676d-4ed1-473b-95bd-8bce83ae018c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.782192 Oct 06 13:07:59.561370 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2026/4033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:58 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:07:59.665679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:59.666363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:59.675945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:59.680427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:59.681237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:59.682311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:59.688065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:59.689562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:59.781420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:07:59.784569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:07:59.799499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:59.806124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:59.814957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:59.816729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:07:59.825289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:07:59.826019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:07:59.911711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7cd79a22-3470-4c4d-b05a-2d58513e2825 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134653 Oct 06 13:07:59.921178 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2027/4034] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:07:59 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:08:00.179674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3487538d-f8ac-49b5-b551-8765c92c2b62", "name": "network-vif-plugged", "status": "completed", "tag": "429af193-7cdc-42a5-aa7d-8128f23ef575"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:00.197854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.198542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.199141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.233569 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] Creating event network-vif-plugged:429af193-7cdc-42a5-aa7d-8128f23ef575 for instance 3487538d-f8ac-49b5-b551-8765c92c2b62 on n-h1-860556-1 Oct 06 13:08:00.247552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0baad498-af2c-4192-a4a5-525fa5721a1e req-33a639ee-59c3-4857-9ab7-96e5950bb874 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072809 Oct 06 13:08:00.249643 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2028/4035] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:08:00.560870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8ab0e5-5208-444a-92b1-2fb54fc9ff05", "name": "network-vif-deleted", "tag": "40205222-9134-4444-857c-4b37ba8f3f77"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:00.601370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.601833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.602347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.625257 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] Creating event network-vif-deleted:40205222-9134-4444-857c-4b37ba8f3f77 for instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 on n-h2-860556-1 Oct 06 13:08:00.627217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:00.637087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b6f16d7c-0e52-4a5e-9b8a-ec12f14d639a req-3fd51166-4d35-4f6d-84fe-f7daf5f6d37c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080774 Oct 06 13:08:00.637715 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2029/4036] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:00.639259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab66f6ec-b9de-42f0-ad2f-5780283e43a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.978563 Oct 06 13:08:00.642837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:00.657824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2008/4037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:07:59 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:00.657824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:00.657824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:00.663727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:00.670385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.671311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.672046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.677508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.679023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.681921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.690174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.693506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.696184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.697042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.701013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.701672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.746757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.747543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.748188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.749154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lazy-loading 'fault' on Instance uuid df8ab0e5-5208-444a-92b1-2fb54fc9ff05 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:08:00.884718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df15d438aab4b3da00d48111df5e866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292eb01305864b36bf5564aca04deeec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:00.910424 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8c89528-e5ca-4d53-9ef3-254a2610d7a8 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 200 len: 1302 microversion: 2.1 time: 0.271407 Oct 06 13:08:00.911245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2030/4038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:00 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 1302 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:00.936315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:00.939890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:00.955197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.957384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.958023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:00.962118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:00.962822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:00.963422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:01.013578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:01.017332 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ed03beb-5adf-4ff4-b13e-ccb40feadc95 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086982 Oct 06 13:08:01.018845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2031/4039] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:08:00 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:08:01.060325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1820269992", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ec6ba954-5406-4ec8-842b-7b36bee09307"}], "security_groups": [{"name": "tempest-securitygroup--2121107955"}], "key_name": "tempest-keypair-1803938758", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:01.105597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:01.121663 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f0765b8-8783-4949-8188-27c50e94eda5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.475302 Oct 06 13:08:01.122332 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2009/4040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:00 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:01.433154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] validate_networks() for [('ec6ba954-5406-4ec8-842b-7b36bee09307', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:01.685514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:01.686518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:01.701402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:01.702223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:01.708393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:01.709551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:01.710293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:01.710890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.407014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:02.419266 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a6834ce-ee58-4914-80be-022dd6f51df5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1308 microversion: 2.1 time: 0.747504 Oct 06 13:08:02.420185 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2010/4041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:01 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:02.432156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:02.433886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:02.443537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.444051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.444501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.445415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.446729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.447383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.464557 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 HTTP/1.1 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'df8ab0e5-5208-444a-92b1-2fb54fc9ff05'} Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:02.467044 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:02.471357 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:02.473322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:02.474989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea8d8886-8c69-45d8-b72c-58192a762188 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 404 len: 111 microversion: 2.1 time: 0.052852 Oct 06 13:08:02.475699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2011/4042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:02 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:02.482007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:02.487769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:02.494862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.495607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.496219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.500385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.502308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.502957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.558322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f1cb7954-5859-4d83-a4a6-e0e854b3d7a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081324 Oct 06 13:08:02.560611 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2012/4043] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:08:02 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:02.568087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:02.568555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:02.576988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.577505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.577984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.578939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.580068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.580528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.613649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for project d00c5dcc24cc466e9a065a74299c9150. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:02.631645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for user d117be3ea1514c02ba14a1f02d403265 and project d00c5dcc24cc466e9a065a74299c9150. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:02.678473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:02.678904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:02.680074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:02.680408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:02.680829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:02.690331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.690891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.691388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.692120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.692577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.693005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.711344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for project d00c5dcc24cc466e9a065a74299c9150. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:02.717536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Getting quotas for user d117be3ea1514c02ba14a1f02d403265 and project d00c5dcc24cc466e9a065a74299c9150. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:02.731224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:02.733905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:02.809944 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25bbfe0b-1c55-45ae-a497-350ef016046f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.758760 Oct 06 13:08:02.819021 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2032/4044] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:02.826200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:02.826965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:02.836351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.837059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.837512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.838264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:02.838720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:02.839376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:02.879288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:03.006878 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1bd45609-f28f-420b-815a-97a69f834e63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 204 len: 0 microversion: 2.20 time: 0.185211 Oct 06 13:08:03.011003 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2033/4045] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:08:02 2022] DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:08:03.014641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7ea575f-04e9-4560-8fd1-1c65041a96f4 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:03.015503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7ea575f-04e9-4560-8fd1-1c65041a96f4 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:03.027766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.037949 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd0b124b-0ccf-48a9-908c-392e0bd48f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.476238 Oct 06 13:08:03.041025 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2013/4046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:02 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:03.061018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:03.061658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:03.073079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:03.073706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:03.074195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:03.074816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:03.075279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:03.076054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:03.136558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e7ea575f-04e9-4560-8fd1-1c65041a96f4 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.147778 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7ea575f-04e9-4560-8fd1-1c65041a96f4 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1278 microversion: 2.1 time: 0.138490 Oct 06 13:08:03.150266 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2034/4047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:03 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:03.443901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:03.445437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:03.461853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:03.462441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:03.463111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:03.464051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:03.465211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:03.467068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:03.589301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.599437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.606396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.607891 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5adbcbd-28a8-4e66-a523-04995f4d58fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 0.565489 Oct 06 13:08:03.608385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2014/4048] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:03 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:03.760322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74390366-e72c-43da-8620-2b7ea6da61e4", "name": "network-vif-plugged", "status": "completed", "tag": "992042b7-e380-4894-af43-122795e48950"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:03.782662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:03.786235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:03.786968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:03.814935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:03.835358 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] Creating event network-vif-plugged:992042b7-e380-4894-af43-122795e48950 for instance 74390366-e72c-43da-8620-2b7ea6da61e4 on n-h1-860556-1 Oct 06 13:08:03.836464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0700392-54be-4694-b39b-a153b2bedbb7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1488 microversion: 2.1 time: 0.395273 Oct 06 13:08:03.838182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2035/4049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:03 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1488 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:03.847500 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c8c62a38-a41e-4a4b-8798-7947002477f6 req-9bd65306-0aeb-4ac6-84f6-50f85abb8ab1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090677 Oct 06 13:08:03.848314 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2015/4050] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:08:04.068058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:04.068827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:04.069627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-298210865", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:04.080111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:04.080856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:04.082362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:04.084884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:04.086698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:04.086698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:04.146027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:04.193319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:04.753393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:04.767925 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff2f7f1d-e030-4ff8-b016-124917e0955a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 0.706384 Oct 06 13:08:04.768553 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2036/4051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:04 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:04.773709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:04.786826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:04.796312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:04.797150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:04.798350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:04.799719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:04.800206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:04.800676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:04.974936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:04.986143 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85c92050-ee79-4443-b690-19c3ce440832 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1336 microversion: 2.1 time: 0.216368 Oct 06 13:08:04.986774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2037/4052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:04 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:04.993777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:04.994598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:05.003605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:05.004330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:05.004942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:05.005845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:05.006444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:05.007208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:05.772713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:05.783975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:05.813496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:05.815136 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae524cbc-70e4-4d48-9d23-c8f3e48f289e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 0.827189 Oct 06 13:08:05.830331 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2038/4053] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:04 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:05.839934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:05.843400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:05.858106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:05.858612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:05.859061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:05.862701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:05.863303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:05.863758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:06.106224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:06.106701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:06.108821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:06.109559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:06.110390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:06.133343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:06.135085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:06.138210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:06.139386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:06.142207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:06.142861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:06.256263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:06.269855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:06.295219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:06.301540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:06.444442 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e35ec6c8-b02a-479e-9132-b963f2926e3c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381239 Oct 06 13:08:06.451537 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2016/4054] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:06.462714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:06.463685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:06.483699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:06.486266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:06.486822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:06.488607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:06.489694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:06.492292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:06.555952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:07.632923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:07.644525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dbf1ba11-528f-4f3d-a48f-2c4afc1c569d tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1336 microversion: 2.1 time: 1.191372 Oct 06 13:08:07.659016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2017/4055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:06 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1336 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:07.666978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:07.667605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:07.669491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:07.676606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.677132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.677551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.678291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.678774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.679401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.753283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:07.765047 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bfd7be33-9c62-4f08-b8ef-9b79d16df5fe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1315 microversion: 2.1 time: 1.932261 Oct 06 13:08:07.770152 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2039/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:05 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1315 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:07.776111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:07.779598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:07.798076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.798595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.799041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.799970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.800640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.802097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.936829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:07.947011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df759189-d72a-4b56-9554-e22949cc6a6c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1260 microversion: 2.1 time: 0.286602 Oct 06 13:08:07.947789 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2018/4057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:07 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:07.954037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:07.955522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:07.967449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.968077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.968603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.969444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:07.969955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:07.970401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:07.985468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 HTTP/1.1 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'df8ab0e5-5208-444a-92b1-2fb54fc9ff05'} Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:07.989158 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-792767b5-eb9a-4578-afdb-f24e9108d432 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 404 len: 111 microversion: 2.1 time: 0.041646 Oct 06 13:08:07.993268 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2019/4058] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:07 2022] DELETE /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:07.996381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-unplugged", "status": "completed", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:08.007572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.008461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.009127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.024693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] Creating event network-vif-unplugged:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:08:08.032454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2cb74898-29f6-461a-b249-8910ba1b4ee7 req-44c2450f-ae4f-4066-95ca-b9a9f07f6b04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038179 Oct 06 13:08:08.033591 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2020/4059] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:08.041694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.042543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: df8ab0e5-5208-444a-92b1-2fb54fc9ff05] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.059964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.060485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.060944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.061687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.062208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.062652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.090692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 HTTP/1.1 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'df8ab0e5-5208-444a-92b1-2fb54fc9ff05'} Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.092385 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance df8ab0e5-5208-444a-92b1-2fb54fc9ff05 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01bebc26-bfee-4be1-88cc-2515fe147902 tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05" status: 404 len: 111 microversion: 2.1 time: 0.058987 Oct 06 13:08:08.096675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2021/4060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:08 2022] GET /compute/v2.1/servers/df8ab0e5-5208-444a-92b1-2fb54fc9ff05 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:08.108264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.109012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.116102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.116834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.117428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.118336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.118950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.119532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.139201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 HTTP/1.1 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ece1a1ff-2161-46d5-8754-741314519965'} Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:08.141197 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.144803 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.146748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:08.147629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55910000-8af8-4302-919b-0720cee8f4fe tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 404 len: 111 microversion: 2.1 time: 0.045112 Oct 06 13:08:08.148195 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2022/4061] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:08 2022] DELETE /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:08.167937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.173853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] [instance: ece1a1ff-2161-46d5-8754-741314519965] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.182885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.184553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.185654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.188189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.188897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.189534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.204914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] HTTP exception thrown: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Request method failure captured: Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 HTTP/1.1 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtKbE_HqpY2TJk9OUZvdkZb11bGelA1bxb8Y5aO-g7NHaW6fN-9RGJuHShmQ0qiyCTIBqcaPWNayvBqCIQzvhpkJ8j2e4Fy06ujAPvVXZiZkB0R5D0uEhK83FCxjQs4FqbZFE1glyk8dpD9fCUMBUWu2HfERABD2Uxr5rNJ5IJiCRnY Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_292eb01305864b36bf5564aca04deeec", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/292eb01305864b36bf5564aca04deeec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/292eb01305864b36bf5564aca04deeec"}]}] Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 292eb01305864b36bf5564aca04deeec Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestMultiNic-502482435 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 0df15d438aab4b3da00d48111df5e866 Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestMultiNic-502482435-project Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ece1a1ff-2161-46d5-8754-741314519965'} Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:08.206959 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. Oct 06 13:08:08.210585 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:08.215590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] Returning 404 to user: Instance ece1a1ff-2161-46d5-8754-741314519965 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:08.218207 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2dd5555d-936b-4966-a9dc-fe05e4a615db tempest-ServersTestMultiNic-502482435 tempest-ServersTestMultiNic-502482435-project] 10.222.0.26 "GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965" status: 404 len: 111 microversion: 2.1 time: 0.059345 Oct 06 13:08:08.218965 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2023/4062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:08 2022] GET /compute/v2.1/servers/ece1a1ff-2161-46d5-8754-741314519965 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:08.672772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.674315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.681359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.682201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.682863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.683796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.684468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.685137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.777364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:08.787219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:08.799867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:08.801730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c0cb7a5-6beb-4724-924f-ac06612d4d3d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1725 microversion: 2.20 time: 1.030279 Oct 06 13:08:08.818528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2040/4063] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:07 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1725 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:08.827334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.827962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.834228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.834736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.835173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.836130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.836783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.837566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.924077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:08.943216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f97c97a6-21b3-4d99-8461-29ee18b03f2c tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1336 microversion: 2.1 time: 0.274701 Oct 06 13:08:08.943799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2024/4064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:08 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1336 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:08.972614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:08.973230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:08.990871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.991457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.991975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:08.992801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:08.993337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:08.993876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:09.246572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:09.258089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c2de50c-4758-4f82-9d59-d2f363805ae4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1266 microversion: 2.1 time: 0.287868 Oct 06 13:08:09.259839 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2025/4065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:08 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:09.536032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:09.544529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c07e0d24-8eaf-41f0-a266-4c61facf967a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1502 microversion: 2.1 time: 0.724606 Oct 06 13:08:09.558610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2041/4066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:08 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1502 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:09.835607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:09.836316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:09.849480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:09.854985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:09.855520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:09.856289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:09.859284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:09.860399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:09.967033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:09.967533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:09.979612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:09.985424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:09.986336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:09.987114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:09.987747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:09.988036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:10.198880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:10.217389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:10.220973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:10.226659 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20f2a77d-dfeb-447f-921b-b81ef9235f9f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1657 microversion: 2.20 time: 0.397719 Oct 06 13:08:10.254107 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2026/4067] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:09 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1657 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:10.283159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:10.284167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:10.296108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:10.296618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:10.297063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:10.303528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:10.304216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:10.304937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:10.974066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:11.012466 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed5734de-f08c-49f1-8f56-2030a0400fd7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1266 microversion: 2.1 time: 0.722778 Oct 06 13:08:11.013143 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2027/4068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:10 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1266 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:11.263724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:11.265018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:11.274004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:11.280664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:11.284565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:11.285917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:11.286883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:11.287348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:11.290360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:11.293352 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0edb9308-0d46-4d47-88d1-1fa43c98d5e2 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 1.330483 Oct 06 13:08:11.294656 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2042/4069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:09 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:11.365931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947c19c-0ca6-46d8-a257-45e62a15a37c", "name": "network-vif-deleted", "tag": "6dbeebb8-0a57-4277-a63b-bd2f472a083a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:11.392469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:11.393361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:11.393968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:11.441650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] Creating event network-vif-deleted:6dbeebb8-0a57-4277-a63b-bd2f472a083a for instance f947c19c-0ca6-46d8-a257-45e62a15a37c on n-h1-860556-1 Oct 06 13:08:11.455029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e6421392-88be-4692-bfc6-64b7238d1fd3 req-0a5b2742-1968-41a3-8512-dd30ee4d3535 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093144 Oct 06 13:08:11.457690 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2043/4070] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:08:11.582329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:11.592273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:11.600226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:11.605975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd1e54c6-1381-4015-b8d6-5cc7e36156ad tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 200 len: 1657 microversion: 2.20 time: 0.345635 Oct 06 13:08:11.606753 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2028/4071] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:11 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 1657 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:08:12.042357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:12.044161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:12.062710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.065522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.068456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.073426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.075948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.076380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.258480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92b61e9c-6ff9-42bf-85af-753c330de08a"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:12.263968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:12.272749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.277606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.281647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.283322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.287046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.288082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.380756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:12.397098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d90c2fce-3144-4342-b778-a8042a9269e9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1266 microversion: 2.1 time: 0.360177 Oct 06 13:08:12.435136 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2044/4072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:12 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:12.441795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:12.442942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:12.457430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.458290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.459134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.460859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.461519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.462138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.706428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:12.768328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b88ef15-8d3d-438b-8b1d-5f8adcc65bfe tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514773 Oct 06 13:08:12.789369 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2029/4073] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:08:12 2022] POST /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:12.809021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:12.810200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:12.823348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.824086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.824919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.845464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:12.847177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:12.848136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:12.866417 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c HTTP/1.1 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f947c19c-0ca6-46d8-a257-45e62a15a37c'} Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:12.869233 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:08:12.872963 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:12.877252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:12.878626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fed57251-7dd7-47f5-bbe7-0e3e3ed28459 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 404 len: 111 microversion: 2.20 time: 0.079810 Oct 06 13:08:12.880427 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2030/4074] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:12 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:08:12.898971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e527ed80-47a0-488e-b467-b6cc20167800 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '.version_select at 0x7f7d3e51ae50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:12.949168 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e527ed80-47a0-488e-b467-b6cc20167800 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180489035" status: 204 len: 0 microversion: 2.20 time: 0.062825 Oct 06 13:08:12.949770 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2031/4075] 10.222.0.26 () {60 vars in 1259 bytes} [Thu Oct 6 13:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180489035 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:08:13.142146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:13.263863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:13.288062 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-772cc1e3-e97f-480c-97b4-1f06a79dd65e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 0.851403 Oct 06 13:08:13.288660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2045/4076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:12 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:13.447422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:13.448043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:13.458905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:13.459587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:13.460275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:13.461301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:13.462631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:13.463345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:14.312144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:14.314400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:14.328068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:14.330569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:14.332578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:14.333502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:14.334987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:14.335956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:14.641797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:14.650530 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60576087-9fbc-4a25-b446-71371164f077 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 1.208127 Oct 06 13:08:14.667571 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2032/4077] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:13 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:15.096174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:15.108862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3fca976f-4924-4cf4-8324-3173fd5efe14 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 0.800809 Oct 06 13:08:15.111950 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2046/4078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:14 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:15.675819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:15.677035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:15.688231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:15.689173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:15.690766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:15.691983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:15.695352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:15.697824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:16.001500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477fc43f-bc46-459c-beb3-a2f44805a331", "tag": "05d5ae8b-b5c6-4848-8832-c716490dc3cd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:16.023504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:16.025548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:16.027935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:16.068157 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] Creating event network-changed:05d5ae8b-b5c6-4848-8832-c716490dc3cd for instance 477fc43f-bc46-459c-beb3-a2f44805a331 on n-h2-860556-1 Oct 06 13:08:16.075072 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a21eff14-e7a1-4302-a9be-b651401c2e52 req-6d5599cb-88df-4941-a862-3aa534b8f992 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078618 Oct 06 13:08:16.079696 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2047/4079] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:16.133396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:16.134427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:16.145404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:16.146026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:16.150064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:16.150900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:16.151467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:16.151974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:16.203894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:16.285689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:16.391972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:16.403345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5fde9a5c-7c69-452d-a753-8d14053721cf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 0.733038 Oct 06 13:08:16.408594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2033/4080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:15 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:16.661323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-24c8d6dc-7721-4c16-a017-fc8d77de1a7d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: .version_select at 0x7f7d3e51a8b0>, body: {"keypair": {"name": "tempest-keypair-1403137545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRFavI8hTlVU9DYgOYH0zKNUaVvLVmTmNLIE91vthQTEZIv0xp+jQzAUcKlI7zd2mosFp3FBlwcgKjzR6W72ZsKXCiKtn9wdN9dDtuDv0YT/UWSlApFGAAs1aAcRsxSwA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:16.697584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-24c8d6dc-7721-4c16-a017-fc8d77de1a7d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for project 844e3815b5a545ab8fc1821d284f9504. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:16.708027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-24c8d6dc-7721-4c16-a017-fc8d77de1a7d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for user 1adca22b5c8a44fcbe1e6ef0f39ba69b and project 844e3815b5a545ab8fc1821d284f9504. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:16.793148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-24c8d6dc-7721-4c16-a017-fc8d77de1a7d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.134531 Oct 06 13:08:16.795191 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2034/4081] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Oct 6 13:08:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 13:08:16.888280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:16.901711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e9df1a9-3093-43e7-807c-e51c4a702bca tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 0.772321 Oct 06 13:08:16.902440 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2048/4082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:16 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:17.429017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:17.429650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:17.438728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:17.440759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:17.441386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:17.442515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:17.443208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:17.444337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:17.938806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:17.939724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:17.943312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:17.950359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:17.951111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:17.952004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:17.952915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:17.954098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:17.954886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:19.135481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:19.153470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-83259844-f970-40f4-bc63-ae4e806eee83 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 1.727793 Oct 06 13:08:19.154691 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2035/4083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:17 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:19.161409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4cd4c1-c809-4afe-a4ff-2026752b777d", "tag": "2e8cba33-8be1-4542-b6a0-90a3474f9168"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:19.172790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:19.173647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:19.174272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:19.189231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] Creating event network-changed:2e8cba33-8be1-4542-b6a0-90a3474f9168 for instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d on n-h2-860556-1 Oct 06 13:08:19.195031 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fec19f96-1e13-4a3b-9d23-1a295356943e req-073ffb6c-2279-4e77-b1d9-8dad1dc9ec13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038941 Oct 06 13:08:19.196135 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2036/4084] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:19.503995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:19.507128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:19.525413 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6f89118-6651-4bda-aa02-787e228dcd45 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 1.596184 Oct 06 13:08:19.536280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2049/4085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:17 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:20.178634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:20.179355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:20.203877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:20.210933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:20.211449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:20.212251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:20.212745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:20.213192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:20.565122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:20.566030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:20.579970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:20.580476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:20.580923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:20.583831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:20.584308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:20.587904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:21.027064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:21.054842 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a474832-3b55-4775-919a-be3f79b733a0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 0.868726 Oct 06 13:08:21.056336 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2037/4086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:20 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:21.373967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:21.412298 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-277f5925-a332-430c-aa48-235b3254a364 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 0.851564 Oct 06 13:08:21.428483 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2050/4087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:20 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:22.086873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:22.088306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:22.106276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:22.108105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:22.108980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:22.112448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:22.113647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:22.115758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:22.459683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:22.461499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:22.473107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:22.473869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:22.474780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:22.480343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:22.481516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:22.482222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:23.474820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:23.484409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3fc533c4-85e4-4078-8dfd-246037ffb282 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 1.405625 Oct 06 13:08:23.486208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2038/4088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:22 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:23.492060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-958586612", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18f3fe7e-30f7-47b4-afdf-deb0bca1ef46"}], "security_groups": [{"name": "tempest-securitygroup--472991809"}], "key_name": "tempest-keypair-1403137545", "user_data": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:23.633939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:23.646969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88e1ae72-8a76-44ce-9dea-ea4aaee9a9b3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 1.191049 Oct 06 13:08:23.648960 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2051/4089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:22 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:23.653980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477fc43f-bc46-459c-beb3-a2f44805a331", "name": "network-vif-plugged", "status": "completed", "tag": "05d5ae8b-b5c6-4848-8832-c716490dc3cd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:23.668772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:23.669684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:23.670578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:23.684966 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] Creating event network-vif-plugged:05d5ae8b-b5c6-4848-8832-c716490dc3cd for instance 477fc43f-bc46-459c-beb3-a2f44805a331 on n-h2-860556-1 Oct 06 13:08:23.691346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dd912ceb-2d93-4c30-9d47-a4bd28ad1a0b req-f45ca885-8fd2-4160-973a-e5932c2b1110 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040879 Oct 06 13:08:23.692156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2052/4090] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:24.511993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:24.512770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:24.514814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] validate_networks() for [('18f3fe7e-30f7-47b4-afdf-deb0bca1ef46', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:24.545022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:24.545538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:24.546011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:24.557315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:24.559981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:24.562357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:25.587770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:25.600478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ac09c37-ecef-4a1a-a263-652726635ee7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 1.095170 Oct 06 13:08:25.616511 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2053/4091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:24 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:25.627380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:25.628161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:25.634953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:25.636296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:25.636843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:25.637836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:25.638410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:25.639086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:26.730635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:26.864081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:26.864521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:26.865006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:26.865483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:26.866697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:26.893919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:26.894421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:26.894867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:26.895607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:26.896068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:26.896503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:26.924918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:26.942723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for project 844e3815b5a545ab8fc1821d284f9504. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:26.952758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Getting quotas for user 1adca22b5c8a44fcbe1e6ef0f39ba69b and project 844e3815b5a545ab8fc1821d284f9504. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:26.969675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:26.973647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:27.030152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:27.048346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7284224-d191-4f8c-bfbc-7d1abe4fc648 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1404 microversion: 2.1 time: 1.430159 Oct 06 13:08:27.054394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2054/4092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:25 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1404 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:27.071021 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a2bf2d9-7dde-46c0-9cef-fcbc3c4615e2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.583331 Oct 06 13:08:27.072233 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2039/4093] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:08:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:08:27.077542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:27.080191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:27.108311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:27.110689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:27.111178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:27.114349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:27.118925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:27.120229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:27.570778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Action: 'create', calling method: .version_select at 0x7f7d476a8280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:27.630151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Getting quotas for project 5b3b7222ae1841dcbee309bf234feb01. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:27.648069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Getting quotas for user 9f6a1aff67d14791a60183bd11fcec98 and project 5b3b7222ae1841dcbee309bf234feb01. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:27.800521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Getting quotas for project 5b3b7222ae1841dcbee309bf234feb01. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:27.826069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Getting quotas for user 9f6a1aff67d14791a60183bd11fcec98 and project 5b3b7222ae1841dcbee309bf234feb01. Resources: {'server_groups'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:27.857992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d2be56c-db86-4aaa-9658-001cb5426a2e tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.800407 Oct 06 13:08:27.870610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2055/4094] 10.222.0.26 () {62 vars in 1214 bytes} [Thu Oct 6 13:08:27 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:08:27.876757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:27.877601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:27.908714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:27.916630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cfd0679a-75ea-4d4c-96d5-09302d17306f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 0.843051 Oct 06 13:08:27.917212 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2040/4095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:27 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:27.929977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:27.930602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:27.955774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:27.956532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:27.956968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:27.962175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:27.962994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:27.963358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:28.021322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:28.090806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:28.118728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:28.122328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:28.137375 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e882493c-29d5-4cfc-bb69-8bf89bfc49bc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1281 microversion: 2.20 time: 0.259305 Oct 06 13:08:28.139569 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2056/4096] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:27 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:28.160591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27079cb4-a837-45df-9a3c-d238ced02899 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:28.199385 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27079cb4-a837-45df-9a3c-d238ced02899 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.055349 Oct 06 13:08:28.212812 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2057/4097] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Oct 6 13:08:28 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:08:28.217792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:28.218427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:28.246620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:28.249908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:28.251282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:28.252377 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10a6f84c-9406-4feb-88f8-bb6c82a9e9f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 204 len: 0 microversion: 2.1 time: 0.329484 Oct 06 13:08:28.253720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2041/4098] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:27 2022] DELETE /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:08:28.261661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:28.262868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:28.263656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:28.275288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c5f4571-04d2-44af-ab59-989e0668c7d3 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:28.298834 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c5f4571-04d2-44af-ab59-989e0668c7d3 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847" status: 200 len: 235 microversion: 2.64 time: 0.040704 Oct 06 13:08:28.307173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2042/4099] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Oct 6 13:08:28 2022] GET /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847 => generated 235 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:08:28.327076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:28.335313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:28.365404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:28.366222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:28.370687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:28.371603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:28.372425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:28.374809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.048794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:29.066559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa6782da-11ed-496c-bda7-36c2cb5ace26 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1554 microversion: 2.1 time: 0.752772 Oct 06 13:08:29.068648 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2043/4100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:28 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1554 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:29.086353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-681cf38b-81c1-4cb7-9baf-e1f79d5db473 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:29.128348 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-681cf38b-81c1-4cb7-9baf-e1f79d5db473 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847" status: 204 len: 0 microversion: 2.64 time: 0.055815 Oct 06 13:08:29.130140 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2044/4101] 10.222.0.26 () {60 vars in 1307 bytes} [Thu Oct 6 13:08:29 2022] DELETE /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:08:29.140615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:29.141240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:29.147901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.148397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.148852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.149581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.150254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.150847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.170342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:29.181018 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6417c06-39d3-40d7-a4d6-e5210da4f71f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1591 microversion: 2.1 time: 0.967044 Oct 06 13:08:29.202526 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2058/4102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:28 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1591 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:29.214782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecec8d7d-cc90-4a69-8a86-5c394e0f2846 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:29.226676 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ecec8d7d-cc90-4a69-8a86-5c394e0f2846 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] HTTP exception thrown: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecec8d7d-cc90-4a69-8a86-5c394e0f2846 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Request method failure captured: Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847 HTTP/1.1 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtNJjUGoswenqcz9qY4U3YfruqPKbzs5jip_tLEV247xtA_yqfW-sqfaB5hWP9tVIFhkX3RIJWJcMI5_2Y17u8viVUiF_InKT231tGU-42yXGvRuS5ULgSXNIQu9fPLltbSFwy4oFT2ASi-pEIMq-zwxv_XX_zP1uIL-0s7OnGyJVk8 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.64 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5b3b7222ae1841dcbee309bf234feb01 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerGroup264TestJSON-1300158445 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b3b7222ae1841dcbee309bf234feb01", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b3b7222ae1841dcbee309bf234feb01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b3b7222ae1841dcbee309bf234feb01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b3b7222ae1841dcbee309bf234feb01"}]}] Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerGroup264TestJSON-1300158445 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5b3b7222ae1841dcbee309bf234feb01 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1300158445 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerGroup264TestJSON-1300158445-project Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9f6a1aff67d14791a60183bd11fcec98 Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerGroup264TestJSON-1300158445-project Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7be7ac55-bd21-4dd9-99cc-025e269ed847'} Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 379, in get_by_uuid Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 234, in _get_from_db_by_uuid Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:29.239170 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecec8d7d-cc90-4a69-8a86-5c394e0f2846 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] Returning 404 to user: Instance group 7be7ac55-bd21-4dd9-99cc-025e269ed847 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:29.243654 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ecec8d7d-cc90-4a69-8a86-5c394e0f2846 tempest-ServerGroup264TestJSON-1300158445 tempest-ServerGroup264TestJSON-1300158445-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847" status: 404 len: 117 microversion: 2.64 time: 0.039241 Oct 06 13:08:29.245571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2059/4103] 10.222.0.26 () {60 vars in 1307 bytes} [Thu Oct 6 13:08:29 2022] DELETE /compute/v2.1/os-server-groups/7be7ac55-bd21-4dd9-99cc-025e269ed847 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:08:29.265095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:29.275849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:29.285868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.292081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.292985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.293937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.294884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.298751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.495848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:29.505462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:29.506960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:29.515331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5cc8590f-69ce-4625-b914-ab53c1f0b6ac tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1333 microversion: 2.20 time: 0.258252 Oct 06 13:08:29.516060 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2060/4104] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:29 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1333 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:29.532200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:29.532712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:29.542132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.542635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.543081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.543798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.544343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.544779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.894239 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ad0d22f-8c96-45cd-afbf-0212ce880dd6 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.376749 Oct 06 13:08:29.903534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2061/4105] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:08:29 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331/os-interface => generated 284 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:29.908745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4cd4c1-c809-4afe-a4ff-2026752b777d", "name": "network-vif-plugged", "status": "completed", "tag": "2e8cba33-8be1-4542-b6a0-90a3474f9168"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:29.928468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:29.928966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:29.929409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:29.947222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] Creating event network-vif-plugged:2e8cba33-8be1-4542-b6a0-90a3474f9168 for instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d on n-h2-860556-1 Oct 06 13:08:29.956774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ee7284d5-0765-4919-8a58-d0d14fc66a88 req-562287f1-0b0a-465f-a506-c9981a0c4021 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051740 Oct 06 13:08:29.958660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2062/4106] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:30.039003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:30.047252 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7281778c-73cb-468d-bc20-bc4c27eb204f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 0.910826 Oct 06 13:08:30.061954 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2045/4107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:29 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:30.092186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:30.092905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:30.101565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:30.102122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:30.102631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:30.103279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:30.103746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:30.104185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:30.540740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:30.553080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:30.574655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:30.576562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:30.580205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:30.581214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:30.584299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:30.587407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:30.916169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:30.925794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:30.928633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:30.930065 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85562f33-2cda-4332-8bbf-5fb0cd62d934 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1339 microversion: 2.20 time: 0.393481 Oct 06 13:08:30.942444 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2046/4108] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:30 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1339 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:31.082078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:31.083527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:31.091245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:31.092041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:31.092740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:31.094357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:31.096510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:31.097191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:31.643826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:31.654788 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bb937333-903c-4dcb-a897-3827d667571b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1554 microversion: 2.1 time: 1.567041 Oct 06 13:08:31.655386 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2063/4109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:30 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1554 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:31.960168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:31.961944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:31.972135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:31.972683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:31.973949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:31.974985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:31.975459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:31.975986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:32.577193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:32.579001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:32.588676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:32.589527 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-135d71d0-c9e8-4484-ab6a-f52b396a59f6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1308 microversion: 2.1 time: 1.520145 Oct 06 13:08:32.600649 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2047/4110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:31 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1308 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:32.611260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:32.613090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b2a269b-434c-4f11-b5d3-8f2ea05be633 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1339 microversion: 2.20 time: 0.660189 Oct 06 13:08:32.613688 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2064/4111] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:31 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1339 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:32.683979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:32.684847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:32.694969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:32.700228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:32.702064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:32.703368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:32.705803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:32.706546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:32.708859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:33.467856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:33.482460 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4dce1f8-7cc4-4d80-9a18-ba4ef6efbcef tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1554 microversion: 2.1 time: 0.798695 Oct 06 13:08:33.483379 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2048/4112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:32 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1554 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:33.499526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74390366-e72c-43da-8620-2b7ea6da61e4", "name": "network-vif-unplugged", "status": "completed", "tag": "992042b7-e380-4894-af43-122795e48950"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:33.518374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:33.519045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:33.519637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:33.536554 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] Creating event network-vif-unplugged:992042b7-e380-4894-af43-122795e48950 for instance 74390366-e72c-43da-8620-2b7ea6da61e4 on n-h1-860556-1 Oct 06 13:08:33.554234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1245639774", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c87a539f-0cf2-4484-86b9-2723624dce2d"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:33.563548 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-94fb4deb-f7c7-48bc-97d2-f1fa4881ef24 req-ad5fba21-10bc-4ce1-a82e-b16cb8fe2c76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077904 Oct 06 13:08:33.568658 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2049/4113] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:33.620883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:33.621649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:33.631371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:33.632060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:33.632981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:33.633278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] validate_networks() for [('c87a539f-0cf2-4484-86b9-2723624dce2d', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:33.634251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:33.634960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:33.636363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:34.910184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:34.924010 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d0a62ec-ec58-491d-94a6-93ddeab8d8ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1488 microversion: 2.1 time: 1.309914 Oct 06 13:08:34.925837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2050/4114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:33 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1488 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:34.939944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:34.940750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:34.968131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:34.968763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:34.970277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:34.971035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:34.971515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:34.971966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:36.263282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:36.307359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:36.309851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:36.343130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-06a40203-b5be-4d92-8b76-dcc32eff7ba0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 1.414516 Oct 06 13:08:36.343800 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2051/4115] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:34 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:36.383135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:36.388219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:36.427722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:36.428148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:36.428607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:36.429363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:36.429858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:36.438381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:36.700436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:36.716865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dba4a471-17c2-4156-99a9-9617fff138c6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1346 microversion: 2.1 time: 0.365750 Oct 06 13:08:36.718260 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2052/4116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:36 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1346 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:36.725672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:36.730537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:36.748554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:36.759996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:36.761024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:36.764211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:36.767495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:36.768168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:36.925683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:36.967055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:36.994014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:36.994541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:36.994968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:36.995393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:36.997667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:37.019952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:37.020452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:37.020897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:37.021635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:37.040844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:37.041860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:37.102493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Getting quotas for project 35e935b42b20479b8e9934e907c5af28. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:37.122650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Getting quotas for user 91a5757e2cc644798be932dcd7bde127 and project 35e935b42b20479b8e9934e907c5af28. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:37.147480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:37.150595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:37.313985 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8f896f6-9ad6-4918-a498-083f5ee632a9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.030632 Oct 06 13:08:37.321075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2065/4117] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:37.343374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74390366-e72c-43da-8620-2b7ea6da61e4", "name": "network-vif-deleted", "tag": "992042b7-e380-4894-af43-122795e48950"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:37.385338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:37.387301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:37.387825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:37.420333 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] Creating event network-vif-deleted:992042b7-e380-4894-af43-122795e48950 for instance 74390366-e72c-43da-8620-2b7ea6da61e4 on n-h1-860556-1 Oct 06 13:08:37.447616 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-29b99d12-55df-4777-8cf6-ac12a5df140c req-361b62f6-1617-4080-8738-2abd6b520c25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119447 Oct 06 13:08:37.454208 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2066/4118] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:37.483344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9057973b-583a-4b7c-8a5e-0e8e414ee50a tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:37.487895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9057973b-583a-4b7c-8a5e-0e8e414ee50a tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:38.022864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:38.033161 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-80dede2e-b71e-4acf-b794-b0140c52b9a6 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1488 microversion: 2.1 time: 1.312816 Oct 06 13:08:38.038805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9057973b-583a-4b7c-8a5e-0e8e414ee50a tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:38.053378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2053/4119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:36 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1488 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:38.059415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9057973b-583a-4b7c-8a5e-0e8e414ee50a tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1217 microversion: 2.1 time: 0.603499 Oct 06 13:08:38.077046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2067/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:37 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1217 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:38.095296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:38.096398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:38.100679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:38.101687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:38.119761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:38.120909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:38.122268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:38.126775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:38.129488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:38.130220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:38.140347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:38.145958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:38.147026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:38.147765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:38.148457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:38.148857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:39.300908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:39.313164 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c8ae0fd-1e7b-4ac2-a485-5e33383dacaa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1346 microversion: 2.1 time: 1.230902 Oct 06 13:08:39.313774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2068/4121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:38 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1346 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:39.321210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:39.321851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:39.349565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:39.350088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:39.350529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:39.351245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:39.357689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:39.358329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.213307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:40.222904 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4d6bb95-2ccd-4368-9442-8c3a5b90e917 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1591 microversion: 2.1 time: 0.908080 Oct 06 13:08:40.238695 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2069/4122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:39 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1591 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:40.243640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:40.244382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:40.251014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.254869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.255443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.256298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.257012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.257671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.356770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:40.367644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:40.371364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:40.374268 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1aa96820-f2d6-4304-aac1-e2b0806e48b0 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 2.317872 Oct 06 13:08:40.378437 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2054/4123] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:38 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:40.395101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:40.397259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:40.408557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.413528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.414406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.415411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.416116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.416775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.594985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:40.610123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4489947f-8033-4e42-8713-2cf76c9fa90d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1275 microversion: 2.1 time: 0.229194 Oct 06 13:08:40.610899 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2055/4124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:40 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:40.623207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477fc43f-bc46-459c-beb3-a2f44805a331", "tag": "05d5ae8b-b5c6-4848-8832-c716490dc3cd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:40.648565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.655121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.657918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.677418 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] Creating event network-changed:05d5ae8b-b5c6-4848-8832-c716490dc3cd for instance 477fc43f-bc46-459c-beb3-a2f44805a331 on n-h2-860556-1 Oct 06 13:08:40.692484 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b09413f8-dad1-42c1-9286-83f2f127bb02 req-85574c68-eae9-47d2-aacb-af5856f3f885 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079576 Oct 06 13:08:40.695287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2056/4125] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:40.702521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:40.704625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:40.713798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.714899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.716040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:40.717117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:40.717668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:40.718235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.021322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:41.035369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59912c87-786a-4389-81a7-016b8834ea80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1346 microversion: 2.1 time: 0.338234 Oct 06 13:08:41.036173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2057/4126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:40 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1346 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:41.242167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:41.250588 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-98bd41f1-90fa-41a3-8243-eaa641abe6a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1488 microversion: 2.1 time: 1.010099 Oct 06 13:08:41.254845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2070/4127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:40 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1488 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:41.285157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:41.287378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:41.299318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.300263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.301015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.302563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.303287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.303936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.309969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:41.349715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:41.409211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:41.409998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:41.419993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.420847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.421462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.423402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.424056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.424879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.542253 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-368756cb-7442-4271-a3bb-c98a335fed24 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 204 len: 0 microversion: 2.1 time: 0.262208 Oct 06 13:08:41.543493 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2058/4128] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:41 2022] DELETE /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:08:41.556764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:41.560847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:41.572088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.572757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.573331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:41.574205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:41.574781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:41.575339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.029790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.066823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.068526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.073900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6a747e2-3bd6-4c0b-85cc-3ee8bd3e4036 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.668828 Oct 06 13:08:42.099593 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2071/4129] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:41 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:42.105385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:42.106044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:42.121929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:42.122435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:42.129649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.130658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:42.131154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:42.131607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.165603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.198338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9b21e71-aab4-4889-8e9d-f0eb1095edf8 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1494 microversion: 2.1 time: 0.643498 Oct 06 13:08:42.209760 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2059/4130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:41 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1494 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:42.209760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:42.209760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:42.228055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:42.228302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:42.228730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.229447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:42.230147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:42.230364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.827039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.844845 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dfd191e5-feed-4675-8222-4a7c6cb057b9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1275 microversion: 2.1 time: 0.743840 Oct 06 13:08:42.846368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2072/4131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:42 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1275 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:42.853836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:42.873199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:42.874179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:42.875792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:42.897054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] Creating event network-changed:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h2-860556-1 Oct 06 13:08:42.909624 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-380ddeaa-c333-4afe-a2d7-bb80ad8e6f65 req-ba105b7d-25de-4cab-980a-212ac88f2905 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058890 Oct 06 13:08:42.910924 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2073/4132] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:42.911253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:42.920735 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36b3e7eb-d63b-4bc2-9066-1bc79a16ad70 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 200 len: 1346 microversion: 2.1 time: 0.720361 Oct 06 13:08:42.922141 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2060/4133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:42 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 1346 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:43.106144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:43.108173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:43.118890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:43.119911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:43.120784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:43.121868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:43.122593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:43.123273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:43.225533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:43.226387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:43.233421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:43.234173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:43.235069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:43.235815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:43.236282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:43.236895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:43.935187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:43.948724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:43.950422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:43.951550 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5fb97a34-1653-4c34-bfa0-05e11b5d1a25 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.850858 Oct 06 13:08:43.978141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2074/4134] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:43 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:43.983359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:43.984724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:43.997424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:43.998226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.003456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.004431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.005063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.005648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.009696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:44.016500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:44.024698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdf0799a-59f7-4239-a7c4-fa01fa281883 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1494 microversion: 2.1 time: 0.803221 Oct 06 13:08:44.025552 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2061/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:43 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1494 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:44.030160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:44.030780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:44.052831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.053346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.053837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.054573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.055045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.055481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.081080 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 HTTP/1.1 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '74390366-e72c-43da-8620-2b7ea6da61e4'} Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:44.083325 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.088779 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.089820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:44.090986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec5e0d1a-082d-4814-86b3-6a16cbaff36b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 404 len: 111 microversion: 2.1 time: 0.064306 Oct 06 13:08:44.092294 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2062/4136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:44 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:44.232218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:44.236703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:44.251914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.252577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.253364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.254395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.254921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.255375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.271404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4/os-volume_attachments HTTP/1.1 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '74390366-e72c-43da-8620-2b7ea6da61e4'} Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:44.273075 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:44.276792 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-19c0bdb7-d11f-40de-9769-b86f3aacca98 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046933 Oct 06 13:08:44.283620 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2063/4137] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:08:44 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:08:44.487272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1386579208", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:44.556493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:44.570358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:44.584665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c604908-44d7-4390-a760-93c8cd2dc3bb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.604574 Oct 06 13:08:44.586013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2075/4138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:43 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:44.909211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4cd4c1-c809-4afe-a4ff-2026752b777d", "name": "network-vif-deleted", "tag": "2e8cba33-8be1-4542-b6a0-90a3474f9168"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:44.941076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:44.943045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:44.943876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:44.968061 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] Creating event network-vif-deleted:2e8cba33-8be1-4542-b6a0-90a3474f9168 for instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d on n-h2-860556-1 Oct 06 13:08:44.977874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b5306c7d-b8ec-4444-8755-9a41fdbd5f3b req-c13d828e-5757-4121-aaea-56f6a26d4bc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085654 Oct 06 13:08:44.982719 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2076/4139] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:44.992370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:44.995697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:45.011142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:45.016512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:45.017424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:45.018202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:45.019186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:45.021043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:45.022098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:45.864620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:45.877156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:45.878823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:45.880352 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c50ffc2-0b43-41b3-90e1-d39bb2ac43fd tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.894630 Oct 06 13:08:45.881074 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2077/4140] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:44 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:45.886633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:45.887598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:45.896211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:45.897857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:45.898550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:45.899408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:45.899982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:45.900542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.016895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:46.027837 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4670c5a3-d46e-42b3-bb1e-f6f67369462a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1452 microversion: 2.1 time: 0.145417 Oct 06 13:08:46.030516 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2078/4141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:45 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:46.041228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:46.054897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:46.062447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.063177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.063779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.064650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.065298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.065853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.103324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:46.104276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:46.104921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:46.105340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:46.105786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:46.124335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.125407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.126894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.132815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.133867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.135465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.171803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:46.181231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:46.198936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:46.202156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:46.286201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aea39aed-6a91-4763-a15e-7e500a1b88d8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803522 Oct 06 13:08:46.291310 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2064/4142] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:46.305111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b656fb6e-ade3-4284-8980-c2671c6efff8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:46.305906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b656fb6e-ade3-4284-8980-c2671c6efff8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:46.362525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:46.379541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b656fb6e-ade3-4284-8980-c2671c6efff8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:46.380431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-494abcef-69da-42d7-ada7-12f9f153ffeb tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.347819 Oct 06 13:08:46.383644 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2079/4143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:46 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:46.391682 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b656fb6e-ade3-4284-8980-c2671c6efff8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a" status: 200 len: 1215 microversion: 2.1 time: 0.093083 Oct 06 13:08:46.392448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2065/4144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:46 2022] GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:46.416473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3471e01-1c04-4a22-8d6e-f7692dd5dab0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:46.416972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3471e01-1c04-4a22-8d6e-f7692dd5dab0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:46.435833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3471e01-1c04-4a22-8d6e-f7692dd5dab0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:46.612994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3565d0e4-e36f-400d-9d53-06b787930c4d", "tag": "9d4becf3-a835-4606-b17e-86b0a86cc552"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:46.631946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.632632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.633404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.668688 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] Creating event network-changed:9d4becf3-a835-4606-b17e-86b0a86cc552 for instance 3565d0e4-e36f-400d-9d53-06b787930c4d on n-h1-860556-1 Oct 06 13:08:46.675258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-facc8d6c-2b58-47b0-84c6-b228fb3345e1 req-080c4042-b8d8-49e3-923b-f92e6abae566 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070497 Oct 06 13:08:46.677363 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2066/4145] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:08:46.772137 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3471e01-1c04-4a22-8d6e-f7692dd5dab0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a" status: 204 len: 0 microversion: 2.1 time: 0.359565 Oct 06 13:08:46.773227 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2080/4146] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:46 2022] DELETE /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:08:46.790177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:46.791346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:46.844992 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a HTTP/1.1 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a'} Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in get_by_instance_uuid Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 167, in _get_by_instance_uuid_from_db Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:46.862823 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0212c333-24eb-4d85-aac8-c4356374eb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a" status: 404 len: 111 microversion: 2.1 time: 0.086724 Oct 06 13:08:46.866380 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2067/4147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:46 2022] GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:46.908389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:46.909626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:46.921037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.925886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.926631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:46.930403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:46.931356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:46.932478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:47.000552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-177778571", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:47.073144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:47.114292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:47.635225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:47.657714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:47.661068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:47.662953 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff0bd90d-bfe7-4d50-ba27-1dca26e80df1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.759733 Oct 06 13:08:47.663837 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2081/4148] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:46 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:47.690763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:47.692968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:47.704900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:47.705654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:47.706247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:47.707239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:47.707774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:47.708598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:47.748190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:47.749365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:47.750956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:47.751501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lazy-loading 'fault' on Instance uuid 8f4cd4c1-c809-4afe-a4ff-2026752b777d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:08:47.895684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:47.906503 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-17ea92a4-2f88-4a2e-ac07-6b9419cd57bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 200 len: 1298 microversion: 2.1 time: 0.240674 Oct 06 13:08:47.907847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2082/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:47 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:47.916840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:47.917705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:47.925077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:47.926083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:47.927201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:47.928595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:47.929236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:47.930571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.199508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:48.200062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:48.200458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:48.200787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:48.201201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:48.212243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.213397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.214055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.214953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.215567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.216150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.245405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:48.252076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:48.267784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:48.268082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:48.270262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:48.276410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef42813b-5e56-499e-9030-b65d336c2a26 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.366601 Oct 06 13:08:48.277110 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2083/4150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:47 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:48.317765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6c649866-b43b-4935-81e3-db9c538d095a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323657 Oct 06 13:08:48.318951 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2068/4151] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:48.331477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-df9e27f4-e1a6-4f88-b2a9-bcd19fe39a8a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:48.332107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-df9e27f4-e1a6-4f88-b2a9-bcd19fe39a8a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:48.400425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-df9e27f4-e1a6-4f88-b2a9-bcd19fe39a8a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:48.412128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-df9e27f4-e1a6-4f88-b2a9-bcd19fe39a8a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1214 microversion: 2.1 time: 0.086067 Oct 06 13:08:48.429127 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2084/4152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:48 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:48.693389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:48.694075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:48.706226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.707093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.707931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.709106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.709919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.710705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.930683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:48.931887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:48.944475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.947089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.947926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.948809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:48.949366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:48.949808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:48.949934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:48.959968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:48.962027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:48.963545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a25b1d6-20fd-4ac0-9bea-e8d48cd7a6d2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.275502 Oct 06 13:08:48.964174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2069/4153] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:48 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:48.983515 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d HTTP/1.1 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8f4cd4c1-c809-4afe-a4ff-2026752b777d'} Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:48.985833 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12b37b60-e4eb-4cab-b475-8a318fbab0f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 404 len: 111 microversion: 2.1 time: 0.060732 Oct 06 13:08:48.990014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2085/4154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:48 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:48.996772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:48.997263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:49.004054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.004554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.005004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.005763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.006244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.006684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.032509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:49.131407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0888cf3b-5e91-4653-bf58-d684cfbcccc5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 204 len: 0 microversion: 2.1 time: 0.138621 Oct 06 13:08:49.135305 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2070/4155] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:48 2022] DELETE /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:08:49.141338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:49.142097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:49.148780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.149279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.149918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.150638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.151097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.151527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.302837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:49.303564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:49.316549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.318017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.319946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.320915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.324857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.325539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.325694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:49.336824 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01c8e0a1-09f9-4ebb-ac36-9a1d4de15336 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1494 microversion: 2.1 time: 0.199662 Oct 06 13:08:49.338514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2086/4156] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:49 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1494 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:49.437336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:49.439125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:49.448856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.449676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.450565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.452147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.452831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.454811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.559142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:49.563462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:49.568347 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6153c3ec-830e-4cc4-82a8-b9ef551e1e5d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.270551 Oct 06 13:08:49.569208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2071/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:49 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:49.581864 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30426b97-3a26-4a7d-b266-28cc3e6a08ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1266 microversion: 2.1 time: 0.143938 Oct 06 13:08:49.592572 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2087/4158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:49 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:49.601021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "name": "network-vif-plugged", "status": "completed", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:49.613721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:49.614453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:49.615045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:49.630194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] Creating event network-vif-plugged:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h2-860556-1 Oct 06 13:08:49.636853 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e8e5a6a1-2b21-4509-abce-0ec0839e9265 req-e7b69126-dd9b-4acc-b1dc-1fcdc377bc21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042802 Oct 06 13:08:49.637679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2088/4159] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:49.990613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:49.991522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:50.001463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.002329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.002816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.003707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.004217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.004654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.243875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:50.291928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:50.300125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:50.311607 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7109e8e1-0757-49c1-8fa9-d165b9cc83d7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.316491 Oct 06 13:08:50.314473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2072/4160] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:49 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:50.365060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:50.368999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:50.385251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.388786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.389473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.392280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.393791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.395615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.595548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:50.596212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:50.606701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.607210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.607673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.613138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:50.613926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:50.616117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:50.984391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:50.995452 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5eda6c24-2371-4948-9e51-411e61b799a9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1494 microversion: 2.1 time: 0.637929 Oct 06 13:08:50.998407 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2089/4161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:50 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1494 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:51.004674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:51.006020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:51.019350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:51.019660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:51.020676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:51.022044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:51.022685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:51.023274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:51.039051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:51.057180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a8c8cfd-8943-4454-bd53-297857810f11 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.466223 Oct 06 13:08:51.059443 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2073/4162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:50 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:51.187177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:51.198334 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28caaaaa-a296-4966-9bb6-0a643a4a1cea tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1272 microversion: 2.1 time: 0.198784 Oct 06 13:08:51.209942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2090/4163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:50 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:51.339734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:51.340901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:51.348525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:51.349250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:51.352062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:51.352062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:51.352062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:51.352062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:51.768224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:51.786900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:51.789405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:51.791310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf12aad8-22e7-4103-a574-76d42e083f39 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1406 microversion: 2.20 time: 0.456258 Oct 06 13:08:51.793787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2074/4164] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:51 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:52.020904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:52.021635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:52.033308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.034554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.035596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.036589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.037290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.038009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.089361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:52.090507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:52.098999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:52.104591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.106142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.107729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.108707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.109451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.110176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.452092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:52.470936 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-320a687a-9bd3-46a8-b9a6-a7af78dba12f tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1494 microversion: 2.1 time: 0.453988 Oct 06 13:08:52.478760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2091/4165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:52 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1494 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:52.484736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:52.485608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:52.492269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.493409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.494072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.495019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.495689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.496318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.571904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:52.580816 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5695a2d-ac36-4905-8d49-a825b56bdef2 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.499301 Oct 06 13:08:52.581590 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2075/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:52 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:52.695980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3487538d-f8ac-49b5-b551-8765c92c2b62", "name": "network-vif-deleted", "tag": "429af193-7cdc-42a5-aa7d-8128f23ef575"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:52.711207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.711996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.712450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.735417 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] Creating event network-vif-deleted:429af193-7cdc-42a5-aa7d-8128f23ef575 for instance 3487538d-f8ac-49b5-b551-8765c92c2b62 on n-h1-860556-1 Oct 06 13:08:52.740462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e077a391-6f0b-4e62-a569-f49790cb1968 req-373c5462-ebbc-417b-8b18-463854204f51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049389 Oct 06 13:08:52.741385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2076/4167] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:52.827284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:52.828561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:52.836971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.837876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.838540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.840149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:52.841044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:52.842331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:52.887736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:52.897027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:52.908325 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56604edb-2448-4e8d-bb7e-06ab9e30e18c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 0.427360 Oct 06 13:08:52.911177 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2092/4168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:52 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:53.505338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:53.506145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:53.521965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.522696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.524130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.529132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.531661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.532537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.619814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.621280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.621728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.623599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lazy-loading 'fault' on Instance uuid 3487538d-f8ac-49b5-b551-8765c92c2b62 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:08:53.675295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:53.706722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:53.711158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:53.714865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e917aad5-f371-4aa2-b861-f9b04f24f07d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1598 microversion: 2.20 time: 0.894012 Oct 06 13:08:53.717145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2077/4169] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:08:52 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1598 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:08:53.724994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:53.726597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:53.730781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:53.736525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.737209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.738660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.739689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.740616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.741209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.755354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0dba01ae-d832-4b39-8164-8465432fc549 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 200 len: 1298 microversion: 2.1 time: 0.253810 Oct 06 13:08:53.762705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2093/4170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:53 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:53.774543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:53.775702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:53.785930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.786859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.787800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:53.789389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:53.790205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:53.794293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.054330 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e5064d4-b658-4155-8cc1-080341cd865a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.289973 Oct 06 13:08:54.055265 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2094/4171] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Oct 6 13:08:53 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:08:54.060265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:54.060926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:54.075699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.079382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.079841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.080613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.081083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.081520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.122502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:54.364587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:54.374331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7b5b810-ea28-46f3-9078-464638471002 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.655674 Oct 06 13:08:54.375509 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2078/4172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:53 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:54.397272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3565d0e4-e36f-400d-9d53-06b787930c4d", "name": "network-vif-plugged", "status": "completed", "tag": "9d4becf3-a835-4606-b17e-86b0a86cc552"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:54.408338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.409270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.410029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.425211 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] Creating event network-vif-plugged:9d4becf3-a835-4606-b17e-86b0a86cc552 for instance 3565d0e4-e36f-400d-9d53-06b787930c4d on n-h1-860556-1 Oct 06 13:08:54.432193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7f2f6d82-564c-42fd-98f8-43eab47eab89 req-06f2aa84-7e29-4af1-aae9-1c945d2d32ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Oct 06 13:08:54.433522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2079/4173] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:54.732230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:54.748178 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-970b2a8e-7f97-481e-9b3f-7f8c1d1d5962 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 0.691813 Oct 06 13:08:54.749088 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2095/4174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:54 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:54.804951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7966dd-0d16-42ca-b53c-c517770759ee", "tag": "6a8009eb-71a1-47d1-a834-b3c91da1744b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:54.806665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:54.815135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:54.831652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.832168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.832639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.837394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.837799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:54.838315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.838851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:54.839305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.841446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:54.870535 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] Creating event network-changed:6a8009eb-71a1-47d1-a834-b3c91da1744b for instance 8c7966dd-0d16-42ca-b53c-c517770759ee on n-h2-860556-1 Oct 06 13:08:54.878186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 HTTP/1.1 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3487538d-f8ac-49b5-b551-8765c92c2b62'} Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:08:54.880199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:08:54.884115 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:08:54.890894 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bf17b59c-8e01-49b6-96af-637f6aafe3ff req-a6fe8c26-1092-4024-b986-f76a8dfc1d88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081949 Oct 06 13:08:54.891967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:08:54.892841 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2096/4175] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:08:54.893939 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d9493fe-7411-4335-95b7-7dc76d1a283e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 404 len: 111 microversion: 2.1 time: 0.105665 Oct 06 13:08:54.895047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2080/4176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:54 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:08:55.047693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-407068169", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:55.118770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:08:55.404037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:55.405073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:55.427372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:55.428278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:55.428964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:55.430111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:55.430824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:55.431496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:56.106877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:56.116130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-362cb6f4-93bb-433e-80fc-d423dfe7943d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1317 microversion: 2.1 time: 0.718058 Oct 06 13:08:56.116734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2081/4177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:55 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:56.132420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:56.133050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:56.149615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:56.162613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:56.163328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:56.164252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:56.164855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:56.165452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:56.641946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:56.643583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:08:56.644662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:08:56.645323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:08:56.652747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:08:56.653379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:08:56.654489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3699a607-6b81-46bd-8356-5726cb96fff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 0.536539 Oct 06 13:08:56.656623 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2082/4178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:56 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:56.678691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=23 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:56.681175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:56.681699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:56.682472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:56.683559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:56.683995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:56.684371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:56.710109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:08:56.716034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:08:56.730695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:08:56.733349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:08:56.818644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf9c9cb6-7d8b-452f-b048-07cf9b3cc2ba tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.777210 Oct 06 13:08:56.821989 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2097/4179] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:08:56.831544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8f88b57-030c-4cee-9090-4f4bda779f04 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:56.831845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8f88b57-030c-4cee-9090-4f4bda779f04 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:57.062734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:08:57.090649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8f88b57-030c-4cee-9090-4f4bda779f04 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:57.095123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:57.096377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:57.097786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:57.103538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8f88b57-030c-4cee-9090-4f4bda779f04 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1208 microversion: 2.1 time: 0.276724 Oct 06 13:08:57.106450 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2083/4180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:56 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1208 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:57.135222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] Creating event network-changed:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h2-860556-1 Oct 06 13:08:57.144894 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d25f422c-1998-4433-9296-d4eb600ed81e req-ddd2f3af-d7d7-42ec-bced-59b399c64956 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093013 Oct 06 13:08:57.147245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2098/4181] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:57.152161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:57.152770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:57.167381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:57.170468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:57.172833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:57.173717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:57.174233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:57.178673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:57.683502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:57.684769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:57.700949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:57.701628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:57.702279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:57.703198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:57.703835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:57.704317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:58.227784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:08:58.876806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:58.891626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ad1616e-8d66-4836-903b-197f93f580ec tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 1.210617 Oct 06 13:08:58.906822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2099/4182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:57 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:58.915445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:58.917102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:58.928916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:58.930412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:58.931135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:58.932316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:58.932988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:58.933904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.061087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:59.077039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d2e08c3-3f6e-4f44-87fb-48b4494786e9 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1506 microversion: 2.1 time: 1.940805 Oct 06 13:08:59.077688 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2084/4183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:57 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1506 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:08:59.110367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:08:59.111967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.112500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.126599 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9b0d502-32b6-4ca6-b50e-9aeb20c41e19 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1260 microversion: 2.1 time: 0.215538 Oct 06 13:08:59.142197 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2100/4184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:58 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:08:59.153843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.154360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.158706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.160818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.164386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.165065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.228034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59047352-8b24-4113-b767-227c50e9ae4b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips" status: 200 len: 109 microversion: 2.1 time: 0.130914 Oct 06 13:08:59.228958 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2085/4185] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:08:59 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips => generated 109 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:59.242276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.242927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.253982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.257021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.257613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.258484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.260249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.260825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.326494 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5a4f1b71-b883-4e4f-a7ca-75edb9ef049b tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips" status: 200 len: 109 microversion: 2.1 time: 0.088544 Oct 06 13:08:59.327765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2101/4186] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:08:59 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips => generated 109 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:08:59.338499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.339015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.348548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.350076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.350076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.350801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.351506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.352157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.410320 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85c6a435-bdc4-42c1-baac-5de8c6cc1f48 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips/tempest-ServerAddressesTestJSON-1077648299-network" status: 200 len: 94 microversion: 2.1 time: 0.074105 Oct 06 13:08:59.418672 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2086/4187] 10.222.0.26 () {58 vars in 1401 bytes} [Thu Oct 6 13:08:59 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d/ips/tempest-ServerAddressesTestJSON-1077648299-network => generated 94 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:08:59.425019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.425878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.451878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.453354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.454058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.455034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.458660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.459544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.519204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:08:59.676860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90734167-71e6-4ca5-934c-8f064ea8d9e8 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 204 len: 0 microversion: 2.1 time: 0.256382 Oct 06 13:08:59.696437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.697336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.705866 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2102/4188] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:08:59 2022] DELETE /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:08:59.716658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.717332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.717819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.719098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.719597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.720034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.921513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:08:59.923522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:08:59.932406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.933161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.933597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:08:59.934493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:08:59.935265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:08:59.935701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:00.097429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:00.112051 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5eebe043-f1a3-4460-ad64-d8131ee5772e tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1512 microversion: 2.1 time: 0.426481 Oct 06 13:09:00.112663 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2087/4189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:59 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:00.156861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:00.158106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:00.166561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:00.167662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:00.167662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:00.168291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:00.168709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:00.169150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:00.315541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:00.329017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:00.329724 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56f1d439-fb52-4cf2-b7ba-31e24d8c14f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1266 microversion: 2.1 time: 0.176689 Oct 06 13:09:00.331685 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2088/4190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:00 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:00.344785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8daf899a-cb89-4851-ad12-ec80632922b8 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 0.431000 Oct 06 13:09:00.345785 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2103/4191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:08:59 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:01.136505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:01.137357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:01.147648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:01.148320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:01.149038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:01.150175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:01.151202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:01.151860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:01.358382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:01.360308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:01.391377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:01.391969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:01.392428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:01.393357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:01.401977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:01.402484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:01.966444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:01.980747 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6c416224-f6e8-409f-9ce5-ceccee0747b1 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1512 microversion: 2.1 time: 0.848134 Oct 06 13:09:01.986081 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2089/4192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:01 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1512 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:02.006879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:02.007529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:02.047819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:02.048719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:02.049749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:02.050417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:02.052550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:02.055366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:02.119771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:02.134960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf48b45d-20de-480f-a5f2-6516ef7a9586 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.781885 Oct 06 13:09:02.136074 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2104/4193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:01 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:02.806109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7966dd-0d16-42ca-b53c-c517770759ee", "name": "network-vif-plugged", "status": "completed", "tag": "6a8009eb-71a1-47d1-a834-b3c91da1744b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:02.842632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:02.844254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:02.845148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:02.867970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] Creating event network-vif-plugged:6a8009eb-71a1-47d1-a834-b3c91da1744b for instance 8c7966dd-0d16-42ca-b53c-c517770759ee on n-h2-860556-1 Oct 06 13:09:02.878844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-827dde3d-217b-4d1a-9d4d-f2e03c38e0c1 req-badfaaf0-eacc-4d9c-a86b-40f1a8757ff3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080256 Oct 06 13:09:02.880132 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2105/4194] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:03.011889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:03.012931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:03.023788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:03.024290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:03.024986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:03.025977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:03.026782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:03.027719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:03.121178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:03.145416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2844285c-17e4-402d-926c-f75c0ce5d253 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 1.157963 Oct 06 13:09:03.146928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2090/4195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:01 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:03.168557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:03.170026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:03.182846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:03.183785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:03.184392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:03.185282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:03.185932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:03.186517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:03.548658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:03.556661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef2ae495-fcdf-446c-872c-966b9ce11020 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1512 microversion: 2.1 time: 0.552404 Oct 06 13:09:03.568732 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2106/4196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:03 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:03.680826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:03.689510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ff947b7-58af-4682-8523-75b92be2d781 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.525963 Oct 06 13:09:03.709919 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2091/4197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:03 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:04.029436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3565d0e4-e36f-400d-9d53-06b787930c4d", "name": "network-vif-deleted", "tag": "9d4becf3-a835-4606-b17e-86b0a86cc552"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:04.062453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.062876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.063313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.104115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] Creating event network-vif-deleted:9d4becf3-a835-4606-b17e-86b0a86cc552 for instance 3565d0e4-e36f-400d-9d53-06b787930c4d on n-h1-860556-1 Oct 06 13:09:04.123849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-81a9b3a8-fbf0-448a-b245-f604b89e8ccf req-f39d5de2-8b1f-4cb8-bdc5-04956705ef52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099519 Oct 06 13:09:04.127010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2107/4198] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:04.148515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee5a13a4-ab7d-4469-9425-dc100582036e", "tag": "455776d2-dca7-4617-a92a-17d14ce0ae25"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:04.169999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:04.170718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:04.183704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.184196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.184637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.190973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:04.200549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.201111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.201495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.202243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.203448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.203880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.226786 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] Creating event network-changed:455776d2-dca7-4617-a92a-17d14ce0ae25 for instance ee5a13a4-ab7d-4469-9425-dc100582036e on n-h1-860556-1 Oct 06 13:09:04.237597 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-935e8e5e-80a4-49cc-bf5e-8f42631bb883 req-128b32e4-95d2-4e59-a416-fda023314fc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092659 Oct 06 13:09:04.240419 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2092/4199] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:04.587447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:04.588171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:04.613699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.614249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.617953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.618803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.621025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.622437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.708208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.708724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.709326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.709869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lazy-loading 'fault' on Instance uuid 3565d0e4-e36f-400d-9d53-06b787930c4d {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:04.873226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:04.890427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-627df799-774f-46c6-98fb-6dfe18dd7935 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1314 microversion: 2.1 time: 0.722764 Oct 06 13:09:04.905466 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2108/4200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:04 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:04.906799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:04.907643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:04.909687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a5757e2cc644798be932dcd7bde127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e935b42b20479b8e9934e907c5af28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:04.922990 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a203abb-a7ea-4b0f-b427-4292c25f005d tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 200 len: 1307 microversion: 2.1 time: 0.341522 Oct 06 13:09:04.924772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.932495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.933148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:04.934351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2093/4201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:04 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:04.935271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:04.937816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:04.938482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:05.664375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:05.679944 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0120fa3c-b7ce-44e6-87f9-a70f3750d798 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.782210 Oct 06 13:09:05.681201 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2109/4202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:04 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:05.889485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: .version_select at 0x7f7d3e5644c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1181954867", "policies": ["affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:05.911873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:05.917526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:05.918178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:05.920475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:05.931568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:05.932264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:05.933018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:05.933800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:05.934651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:05.935247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:05.995134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.015117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.041434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c7328f2-dff5-488a-bab1-706c93e03adf tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.464451 Oct 06 13:09:06.043042 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2094/4203] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Oct 6 13:09:05 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:06.050236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.051262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] [instance: 3565d0e4-e36f-400d-9d53-06b787930c4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:06.057851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.058703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.059552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:06.061680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.065551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.066348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:06.090115 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] HTTP exception thrown: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Request method failure captured: Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d HTTP/1.1 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNRbVCW2u9PkEF6A0Mu98dGzwy5Sx_HtJU7o3x3Qn8bpPgIj-bX1ruPNdR-9jty-RL6i41o0Huu_FEqz7frXzcv7iiumrt2H4mu579uPAm6QUPMfxStQOGZJUfrSjrSNKmJ-JDRDMd92a6GipgEf88iH-qRe_eZj51vMuWTezXoFiY Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 35e935b42b20479b8e9934e907c5af28 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerAddressesTestJSON-1885344006 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35e935b42b20479b8e9934e907c5af28", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35e935b42b20479b8e9934e907c5af28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35e935b42b20479b8e9934e907c5af28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35e935b42b20479b8e9934e907c5af28"}]}] Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerAddressesTestJSON-1885344006 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 35e935b42b20479b8e9934e907c5af28 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1885344006 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerAddressesTestJSON-1885344006-project Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 91a5757e2cc644798be932dcd7bde127 Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerAddressesTestJSON-1885344006-project Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3565d0e4-e36f-400d-9d53-06b787930c4d'} Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:06.092399 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. Oct 06 13:09:06.099315 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:06.102076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] Returning 404 to user: Instance 3565d0e4-e36f-400d-9d53-06b787930c4d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:06.103881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-352f88bf-7282-417e-939f-ad4dc0e38337 tempest-ServerAddressesTestJSON-1885344006 tempest-ServerAddressesTestJSON-1885344006-project] 10.222.0.26 "GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d" status: 404 len: 111 microversion: 2.1 time: 0.058590 Oct 06 13:09:06.104946 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2095/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:06 2022] GET /compute/v2.1/servers/3565d0e4-e36f-400d-9d53-06b787930c4d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:06.111488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: .version_select at 0x7f7d3e5649d0>, body: {"server_group": {"name": "tempest-server-group-1655430521", "policies": ["affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:06.133921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.143783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.235580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.249019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.277914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7cb3abe8-3449-4f06-9b79-dbe05952428a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.171601 Oct 06 13:09:06.285344 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2096/4205] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 13:09:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:06.290718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: .version_select at 0x7f7d476c01f0>, body: {"server_group": {"name": "tempest-server-group-1655430521", "policies": ["affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:06.302247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:06.314450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.321698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.416344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.423967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.446747 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a104b711-825e-41ad-bf93-7960f96e4ead tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.159853 Oct 06 13:09:06.454029 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2097/4206] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 13:09:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:06.459877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad2a3fd7-2d0f-4665-8af8-e83299f1e42f tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.491965 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad2a3fd7-2d0f-4665-8af8-e83299f1e42f tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a0779407-b023-481e-a94c-c63ff40d5d12" status: 204 len: 0 microversion: 2.1 time: 0.035764 Oct 06 13:09:06.496845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2098/4207] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:06 2022] DELETE /compute/v2.1/os-server-groups/a0779407-b023-481e-a94c-c63ff40d5d12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:06.503437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ba1a71e-0471-42ef-bdac-81eff9b4ce92 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.521236 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ba1a71e-0471-42ef-bdac-81eff9b4ce92 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.022830 Oct 06 13:09:06.528953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2099/4208] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:09:06 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:06.535916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-594d4dad-89b6-45fe-acce-d4fef00042a2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.585675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-594d4dad-89b6-45fe-acce-d4fef00042a2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/da13b343-c781-4942-ae73-3efc3791850c" status: 204 len: 0 microversion: 2.1 time: 0.055280 Oct 06 13:09:06.590251 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2100/4209] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:06 2022] DELETE /compute/v2.1/os-server-groups/da13b343-c781-4942-ae73-3efc3791850c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:06.596519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3c5566b-cf6a-4a70-a287-faf31ce765da tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.611897 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3c5566b-cf6a-4a70-a287-faf31ce765da tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019936 Oct 06 13:09:06.612758 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2101/4210] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:09:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:06.634955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: .version_select at 0x7f7d3f276e50>, body: {"server_group": {"name": "tempest-server-group-1013078793", "policies": ["affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:06.678101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.683889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.695742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:06.731643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:06.808685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:06.817218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:06.834900 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7c4b3e9-3fab-4565-a88b-7066e379cf9a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.203694 Oct 06 13:09:06.841045 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2102/4211] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 13:09:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:06.842525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.843205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:06.851392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.852409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.852409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:06.853027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.853489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.853975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:06.863226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:06.872116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6cb8d609-59ef-4298-b352-80cdf60da8f5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1501 microversion: 2.1 time: 0.959451 Oct 06 13:09:06.876974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2110/4212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:05 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1501 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:06.882070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4cf5d11-0059-4579-8897-469c469d6c41 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:06.956458 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4cf5d11-0059-4579-8897-469c469d6c41 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a6972718-bbbc-4622-9b9c-82c1ab853903" status: 204 len: 0 microversion: 2.1 time: 0.078007 Oct 06 13:09:06.957631 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2111/4213] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:06 2022] DELETE /compute/v2.1/os-server-groups/a6972718-bbbc-4622-9b9c-82c1ab853903 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:06.970320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:06.974995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:06.991598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.992359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.992987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:06.993911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:06.994548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:06.998403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:07.194768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6147cbbb-1951-4c34-bfab-30cf85284265 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee/action" status: 202 len: 0 microversion: 2.1 time: 0.235483 Oct 06 13:09:07.196003 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2112/4214] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:09:06 2022] POST /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:09:07.202050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42aa007a-1e3a-47f0-aad4-c305c8b232dd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:07.226492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42aa007a-1e3a-47f0-aad4-c305c8b232dd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.028983 Oct 06 13:09:07.232168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2113/4215] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:09:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:07.237794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:07.244853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:07.256490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:07.259076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:07.271465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ceba186-793b-435f-a599-cda04f122f67 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.432538 Oct 06 13:09:07.275456 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2103/4216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:06 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:07.275781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:07.276255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:07.277011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:07.277470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:07.281513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:07.285065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: .version_select at 0x7f7d3fe32dc0>, body: {"server_group": {"name": "tempest-server-group-312986062", "policies": ["anti-affinity"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:07.334463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=49 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:07.341229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:07.358612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:07.470954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:07.485785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_groups'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:07.517653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:07.522060 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-974d9a39-dc29-4af2-83cd-1af72c1ec162 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.244970 Oct 06 13:09:07.532228 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2104/4217] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 13:09:07 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:07.547006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fbd98ed2-292b-456a-b83f-ea8265bf0890 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:07.635089 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fbd98ed2-292b-456a-b83f-ea8265bf0890 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/df7e2b50-bcdf-4481-9410-45d11c0175a5" status: 204 len: 0 microversion: 2.1 time: 0.101487 Oct 06 13:09:07.640848 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2105/4218] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:07 2022] DELETE /compute/v2.1/os-server-groups/df7e2b50-bcdf-4481-9410-45d11c0175a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:07.649471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7fd34fbf-5566-4f31-baa5-6fe2dd0d4e82 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:07.675135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7fd34fbf-5566-4f31-baa5-6fe2dd0d4e82 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032848 Oct 06 13:09:07.676171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2106/4219] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:09:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:07.776565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1629205448", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "029d23aa-1c32-477c-98b0-07ae15b33edb"}]}, "os:scheduler_hints": {"group": "7a90b0ed-6df2-48a6-b975-5176dc8afcd2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:07.875637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] validate_networks() for [('029d23aa-1c32-477c-98b0-07ae15b33edb', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:07.915881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:07.933879 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9eba9a7-cf94-45d1-940d-f3121beb0197 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1506 microversion: 2.1 time: 0.699656 Oct 06 13:09:07.935519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2114/4220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:07 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:08.301416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:08.302058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:08.315957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:08.316743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:08.317957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:08.318852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:08.322401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:08.323053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:08.334799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:09.076136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:09:09.076687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:09:09.078332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:09:09.079122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:09:09.079724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:09:09.098210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:09.114645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.115436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.116045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.116960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.117602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.118863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.123052 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ee12c8e-d984-4e4a-8e69-280c7ddddafe tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.825505 Oct 06 13:09:09.137761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2115/4221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:08 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:09.147899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:09.148552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:09.150544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:09.158776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.159697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.160151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.161221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.161751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.162990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.169050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:09.187900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:09:09.190637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:09:09.266443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129614) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 06 13:09:09.294613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_group_members'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:09.306598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_group_members'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:09.369445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_group_members'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:09.378037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Getting quotas for user ac020e1b27464cee865fde723aa2ad06 and project 02371acd4cdd49cca981c64e3a349865. Resources: {'server_group_members'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:09.430566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-adb74623-c36a-48de-af96-68bb64672e7d tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659222 Oct 06 13:09:09.444270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2107/4222] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:09:09.449673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-679f7ee5-60cc-4ced-bb0e-3d935615f13c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:09.451722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-679f7ee5-60cc-4ced-bb0e-3d935615f13c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:09.563557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:09.584965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c1f4380-829a-49f4-b44c-74f1bbda9ee4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1486 microversion: 2.1 time: 0.457823 Oct 06 13:09:09.591726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2116/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:09 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1486 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:09.612797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-679f7ee5-60cc-4ced-bb0e-3d935615f13c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:09.622106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:09.623005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:09.628585 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-679f7ee5-60cc-4ced-bb0e-3d935615f13c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1213 microversion: 2.1 time: 0.183012 Oct 06 13:09:09.629211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2108/4224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:09 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:09.641394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.642191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.649120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.650062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.650643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.651181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.698340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:09:09.918906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-642da5ce-16bf-48cf-8ca8-52e8be0a0fd0 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 204 len: 0 microversion: 2.1 time: 0.304111 Oct 06 13:09:09.919966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2117/4225] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:09:09 2022] DELETE /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:09.931208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:09.933214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:09.959062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.959663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.960077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:09.960818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:09.961868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:09.962326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:10.151161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:10.152732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:10.169234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:10.170608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:10.171233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:10.172088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:10.175509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:10.176070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:10.645362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:10.661499 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71a3948c-906f-4679-a6e1-d637f449ab3f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1492 microversion: 2.1 time: 0.736410 Oct 06 13:09:10.665801 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2109/4226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:09 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1492 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:10.681327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:10.682022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:10.695454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:10.695977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:10.696426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:10.697161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:10.697626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:10.698087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:10.817581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:10.851663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45454be2-9072-4c97-b14b-e72826bd97e3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.707512 Oct 06 13:09:10.852290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2118/4227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:10 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:10.980473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:10.983388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:10.993878 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-270471a1-3967-43bc-89a6-cf9501515e28 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1209 microversion: 2.1 time: 0.328750 Oct 06 13:09:10.995086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2110/4228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:10 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1209 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:11.684499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:11.685798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:11.703110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:11.705683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:11.706427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:11.709215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:11.709950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:11.712226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:11.881407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:11.883568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:11.897672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:11.898118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:11.898707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:11.903077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:11.904813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:11.905940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:12.423110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:12.436337 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7973757e-80c6-4f9c-918d-aec370c153c3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1492 microversion: 2.1 time: 0.754799 Oct 06 13:09:12.442216 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2119/4229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:11 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1492 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:12.450064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:12.450820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:12.460188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:12.460822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:12.462055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:12.462886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:12.463777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:12.464345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:12.687386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:12.701811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:12.723212 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cdae8fe-f495-446b-b4ec-77a9f15deb5c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.845889 Oct 06 13:09:12.728456 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2111/4230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:11 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:12.731303 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acc6539b-34b6-4e64-8fd2-77e7e86a1d8c tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1271 microversion: 2.1 time: 0.286865 Oct 06 13:09:12.745886 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2120/4231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:12 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:13.470221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:13.471957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:13.480648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.481383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.484614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:13.485641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.486388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.488480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:13.603933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:13.612957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7166ea42-9e2c-4020-bbe8-f9b4c9525017 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1450 microversion: 2.1 time: 0.147397 Oct 06 13:09:13.618402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2112/4232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:13 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:13.751236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:13.751996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:13.758208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:13.758840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:13.783443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.783965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.784417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:13.786450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.787464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.791650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.792559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:13.793276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.794280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:13.795007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:13.798730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:13.800693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:14.792552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:14.797902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:14.819649 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2bb7e9c2-6655-45c8-b3ec-d30264e0a7f4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 1.072870 Oct 06 13:09:14.823545 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ece402e-4f71-429a-99d4-e3badfcc1559 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 1.068821 Oct 06 13:09:14.826209 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2113/4233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:13 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:14.826626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2121/4234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:13 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:14.856449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:14.857954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7966dd-0d16-42ca-b53c-c517770759ee", "name": "network-vif-deleted", "tag": "6a8009eb-71a1-47d1-a834-b3c91da1744b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:14.858093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:14.875652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:14.882321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:14.883711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:14.888397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:14.889129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:14.890422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:14.892186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:14.897543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:14.899824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:14.937272 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] Creating event network-vif-deleted:6a8009eb-71a1-47d1-a834-b3c91da1744b for instance 8c7966dd-0d16-42ca-b53c-c517770759ee on n-h2-860556-1 Oct 06 13:09:14.950578 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b08b375d-e2ba-46ef-a807-51bcddf64f81 req-7f724035-acdc-4612-aa46-8fe0d3326e38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121212 Oct 06 13:09:14.953663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2122/4235] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:14.972380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5a13a4-ab7d-4469-9425-dc100582036e", "name": "network-vif-plugged", "status": "completed", "tag": "455776d2-dca7-4617-a92a-17d14ce0ae25"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:14.993268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:14.996583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:15.002150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.007272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:15.007484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.008325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:15.011452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lazy-loading 'fault' on Instance uuid 8c7966dd-0d16-42ca-b53c-c517770759ee {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:15.041505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] Creating event network-vif-plugged:455776d2-dca7-4617-a92a-17d14ce0ae25 for instance ee5a13a4-ab7d-4469-9425-dc100582036e on n-h1-860556-1 Oct 06 13:09:15.048939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-585b15fa-67f9-40c8-90e7-eac17c9b1c48 req-4d52d8ef-7c11-4ed6-b235-c7a5fc59374b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093788 Oct 06 13:09:15.050717 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2123/4236] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:15.174134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:15.182876 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d0e4f72-c2be-4471-baa0-42fe47bf6873 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 200 len: 1304 microversion: 2.1 time: 0.352711 Oct 06 13:09:15.183839 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2114/4237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:14 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 1304 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:15.850905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:15.852199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:15.863386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:15.864572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:15.873526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:15.875947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:15.876604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.877265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.877898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:15.878504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:15.879366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:15.880235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:15.881710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.882192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:15.885402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:15.885902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:16.268788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:16.275899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:16.283846 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49c922f8-df69-4075-8184-f5a2ba0f33c7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1308 microversion: 2.1 time: 0.436364 Oct 06 13:09:16.284893 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2124/4238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:15 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:16.287910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b7f68ea-444b-4908-b330-c371f912f7c6 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 0.429163 Oct 06 13:09:16.295171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:16.301185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:16.308777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2115/4239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:15 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:16.314341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:16.316030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:16.316627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:16.318014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:16.319165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:16.320345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:16.343878 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee HTTP/1.1 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8c7966dd-0d16-42ca-b53c-c517770759ee'} Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:16.347186 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:16.352734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:16.355924 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-54e73e36-97e6-45bd-b131-e3bca42a80c2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 404 len: 111 microversion: 2.1 time: 0.067412 Oct 06 13:09:16.358302 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2125/4240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:16 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:16.471117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-632609303", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:16.529775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:17.044181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc440f7-d926-44fc-a65d-91036b0013e1", "tag": "7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:17.056740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.058297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.059194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.080338 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] Creating event network-changed:7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6 for instance dfc440f7-d926-44fc-a65d-91036b0013e1 on n-h1-860556-1 Oct 06 13:09:17.086318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4193a2d8-d6d7-455b-ae1a-637d87aa2eeb req-579c2769-27f5-4899-8a48-d8ae7dede1cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046475 Oct 06 13:09:17.089175 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2126/4241] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:17.317872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:17.318592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:17.340967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.343162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.344838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.348529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.350902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.351948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.582920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:09:17.583443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:09:17.584066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:09:17.584595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:09:17.585125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:09:17.603738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.607297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.607922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.611817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.613620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.614249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.660191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:17.674997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:17.723955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:17.732970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:09:17.735874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43f6f9ce-066d-4759-ba19-9d41f048499a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1489 microversion: 2.1 time: 0.429971 Oct 06 13:09:17.736706 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2127/4242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:17 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1489 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:17.738270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:09:17.742826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:17.743618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:17.753989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.755338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.756095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.757055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.757679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.758351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.849683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd75692d-ca36-461c-b4a5-aa7125c572b7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382769 Oct 06 13:09:17.850431 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2116/4243] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:09:17.870034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:17.876035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:17.893674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.894466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.896284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:17.897933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:17.898840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:17.899550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:18.022371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e62bf14-dec4-41bb-bc0b-2308c18e3eec tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "PUT /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1084 microversion: 2.1 time: 0.166203 Oct 06 13:09:18.023083 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2117/4244] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:09:17 2022] PUT /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1084 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:18.038924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e8f30ff-223a-478f-aa01-be37378117c5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:18.040624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e8f30ff-223a-478f-aa01-be37378117c5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:18.162361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e8f30ff-223a-478f-aa01-be37378117c5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:18.172153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e8f30ff-223a-478f-aa01-be37378117c5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1214 microversion: 2.1 time: 0.146036 Oct 06 13:09:18.188988 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2118/4245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:18 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:18.198750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:18.199645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:18.211941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:18.212622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:18.213475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:18.214112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:18.215295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:18.216112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:18.216701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:18.227900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c34d478-1008-43ff-be6f-7a881799bb01 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 0.489928 Oct 06 13:09:18.228497 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2128/4246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:17 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:18.663131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:18.673937 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37b298fc-396a-41c2-8217-4534d5c302f7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1510 microversion: 2.1 time: 0.483691 Oct 06 13:09:18.679751 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2119/4247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:18 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:18.698488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:18.699133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:18.709560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:18.710143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:18.710593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:18.711301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:18.713017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:18.713546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.122629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:19.131396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bab6483e-38de-4052-be04-1b4b416d0b41 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1510 microversion: 2.1 time: 0.436843 Oct 06 13:09:19.132342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2129/4248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:18 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:19.161524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:19.162422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:19.171423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:19.179310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.179819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.180272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.181011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.181479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.181949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.214015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:19.215246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:19.224603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:09:19.236847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.241144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.242823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.244714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.245356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.246106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.384056 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d0ffbdb-3274-4e30-b1d3-d8591f50eb78 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 204 len: 0 microversion: 2.1 time: 0.230047 Oct 06 13:09:19.385500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2120/4249] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:09:19 2022] DELETE /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:19.393122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:19.394187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:19.402206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.403009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.404420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.405164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.405914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.406868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.589582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:19.602363 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ee3264fb-62a9-45a7-9c0f-3bb3cdf67616 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1266 microversion: 2.1 time: 0.401768 Oct 06 13:09:19.605644 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2130/4250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:19 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:19.611001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:19.617928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:19.645449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.646302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.646754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:19.648945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:19.650503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:19.654659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:20.311404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:20.333291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18d36f87-ef8e-4e25-a997-ddc8796766ac tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 0.945463 Oct 06 13:09:20.349010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2121/4251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:19 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:20.562997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:20.573475 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59fd0c55-dc6c-4bf5-9692-2532d6f5a42b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1516 microversion: 2.1 time: 0.966516 Oct 06 13:09:20.574702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2131/4252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:19 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:20.630172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:20.630960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:20.640170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:20.640909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:20.641611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:20.642594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:20.643277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:20.643928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:21.050760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:21.064042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea62e35d-9888-4e57-bcbb-620b2408f79f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.438508 Oct 06 13:09:21.067921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2122/4253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:20 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:21.359866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:21.360997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:21.368882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:21.374976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:21.382738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:21.383659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:21.384380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:21.385064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:21.606335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:21.607146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:21.616657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:21.618373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:21.619095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:21.620174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:21.620870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:21.621559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:21.887552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:21.902430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a6fccd9-6855-4be7-b973-c92dbdb6ca96 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1474 microversion: 2.1 time: 0.300377 Oct 06 13:09:21.905262 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2123/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:21 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1474 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:22.033755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5a13a4-ab7d-4469-9425-dc100582036e", "name": "network-vif-deleted", "tag": "455776d2-dca7-4617-a92a-17d14ce0ae25"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:22.050920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:22.054300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:22.060108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.066606 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b6c3009-41f8-41cb-a102-8ed46e4a7306 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 0.710637 Oct 06 13:09:22.066974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.069048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:22.070327 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2132/4255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:21 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:22.096872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:22.101208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:22.118685 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] Creating event network-vif-deleted:455776d2-dca7-4617-a92a-17d14ce0ae25 for instance ee5a13a4-ab7d-4469-9425-dc100582036e on n-h1-860556-1 Oct 06 13:09:22.122434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.124744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.125784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:22.128003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.131885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.135240 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1bb6eea5-3c27-4618-b7b8-40af809f40f6 req-534e7b4c-3c53-43c8-bf22-77f46f4685fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107448 Oct 06 13:09:22.135403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:22.137912 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2124/4256] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 06 13:09:22.832152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc440f7-d926-44fc-a65d-91036b0013e1", "name": "network-vif-plugged", "status": "completed", "tag": "7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:22.844696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.847168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.847673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:22.865444 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] Creating event network-vif-plugged:7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6 for instance dfc440f7-d926-44fc-a65d-91036b0013e1 on n-h1-860556-1 Oct 06 13:09:22.879755 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fa6a3dd7-df15-4ed1-a639-07cbd48ea4fd req-6cc60c2c-4ae9-438c-8901-f6dfb840f4e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229564 Oct 06 13:09:22.881918 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2125/4257] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:22.932227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:22.933015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:22.956975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.959441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.962002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:22.963037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:22.963594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:22.965920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:23.058800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:23.063067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:23.063561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:23.065039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lazy-loading 'fault' on Instance uuid ee5a13a4-ab7d-4469-9425-dc100582036e {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:23.320191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:23.344482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:23.345554 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e6e08d68-2452-459a-910e-1156eb521401 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 200 len: 1319 microversion: 2.1 time: 0.417956 Oct 06 13:09:23.348920 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2126/4258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:22 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:23.367184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:23.367838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:23.374593 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d13f6f12-e451-4b64-9eb1-cf7ba00f15cd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 1.283890 Oct 06 13:09:23.377715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:23.377932 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2133/4259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:22 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:23.392554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:23.393088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:23.404690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:23.405562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:23.406215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:23.443653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:24.206479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed120aa5-ed81-4986-a4b7-3de3be7f8603", "tag": "fff21119-da37-4cfc-8797-999c10981220"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:24.219557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:24.220051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:24.220588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:24.243361 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] Creating event network-changed:fff21119-da37-4cfc-8797-999c10981220 for instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 on n-h2-860556-1 Oct 06 13:09:24.251781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1c6b31ca-3ea7-4eef-96bd-6a9cca2f484b req-6ed5d8cf-b705-4307-a144-b43279ba3bec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050286 Oct 06 13:09:24.253059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2134/4260] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:24.371836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:24.372655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:24.379604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:24.380096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:24.380525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:24.381235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:24.381695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:24.382152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:24.397110 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e HTTP/1.1 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ee5a13a4-ab7d-4469-9425-dc100582036e'} Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:24.399457 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:09:24.404038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:24.404761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:24.406838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5b8be71-1d26-4fb2-9654-e3f6461a7190 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 404 len: 111 microversion: 2.1 time: 0.039068 Oct 06 13:09:24.420793 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2135/4261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:24 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:09:24.420793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:24.420793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:24.428681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:24.429437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:24.430309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:24.431519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:24.432965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:24.433690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:24.673614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:24.684411 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca2b5d80-bf7f-43e8-b55e-a870468e85e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1313 microversion: 2.1 time: 1.324494 Oct 06 13:09:24.697107 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2127/4262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:23 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1313 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:24.713088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1202518152", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "083ffbd5-bd63-4014-9d3c-189c487e59a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:24.778171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] validate_networks() for [('083ffbd5-bd63-4014-9d3c-189c487e59a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:25.050319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:25.059602 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-784d533d-469c-464e-9302-10b2887282dd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.650494 Oct 06 13:09:25.060460 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2136/4263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:24 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:25.719882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:25.721674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:25.729788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:25.730286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:25.730729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:25.734427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:25.734908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:25.735420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.214463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:09:26.215035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:09:26.215393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:09:26.216082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:09:26.216511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:09:26.226285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.226858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.227371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.228173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.228730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.229230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.237003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:26.246594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11210f07-1726-4b67-86df-fc7ad18dd9e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1497 microversion: 2.1 time: 0.534591 Oct 06 13:09:26.252056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:26.257902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Getting quotas for user 2c7e547383b945d4b413fefa29185193 and project 169fffc04e8f4e588bf1f3cb4182aa3b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:26.259141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2137/4264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:25 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1497 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:26.264085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:26.265336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:26.271399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.272100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.272541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.273236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.273692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.274148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.278979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:09:26.281781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:09:26.330600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5bf988ba-7367-4375-b451-4749b76827d5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632390 Oct 06 13:09:26.330600 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2128/4265] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:09:26.335630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:26.351589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.server_groups [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Querying cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) for 1 instances {{(pid=129614) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 06 13:09:26.352457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.353196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.353928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.396242 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1ef55c3-dec3-4845-bebe-9ec733465563 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2" status: 200 len: 222 microversion: 2.1 time: 0.064259 Oct 06 13:09:26.396849 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2129/4266] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:09:26 2022] GET /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2 => generated 222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:26.413451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-918b5ba3-7eac-48b6-8383-3c8d76ff2b34 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:26.418347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-918b5ba3-7eac-48b6-8383-3c8d76ff2b34 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:26.612637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-918b5ba3-7eac-48b6-8383-3c8d76ff2b34 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:26.615550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:26.628728 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-521ff100-3bee-4111-9fa3-682017ef6ef9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.368397 Oct 06 13:09:26.631763 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2138/4267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:26 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:26.636599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-918b5ba3-7eac-48b6-8383-3c8d76ff2b34 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1209 microversion: 2.1 time: 0.237075 Oct 06 13:09:26.637808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2130/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:26 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:26.658175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:26.659964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:26.674163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.675683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.677197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.679877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:26.681408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:26.683207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:26.789470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:09:26.977976 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a70ea032-ef57-4f34-94fa-0cb2709225e5 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 204 len: 0 microversion: 2.1 time: 0.344397 Oct 06 13:09:26.982564 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2139/4269] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:09:26 2022] DELETE /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:26.994033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:26.994673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:27.004152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.004661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.005115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:27.006019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.006501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.006947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:27.643842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:27.665208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:27.666178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:27.678864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0b64d22-d5aa-4228-850e-4d1888cd5840 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1503 microversion: 2.1 time: 0.694230 Oct 06 13:09:27.686214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2131/4270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:26 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1503 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:27.687732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.688954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.696218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:27.698351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.703188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.704217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:27.725189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:27.726280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:27.777435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.779125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.779809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:27.791939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:27.794028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:27.794828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:28.004099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:28.023555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3dc0d5b3-596e-4661-a771-25c2715f3374 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1213 microversion: 2.1 time: 0.332175 Oct 06 13:09:28.024748 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2132/4271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:27 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1213 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:28.157533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:28.175037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7b2173f-e299-4ef7-af0b-537b86ca5ff3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.515806 Oct 06 13:09:28.176068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2140/4272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:27 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:28.711715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:28.712823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:28.721471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:28.722421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:28.723501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:28.725120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:28.726147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:28.727240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:28.987554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:28.999857 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32896eef-8eee-418d-9e4f-19e0833cae5b tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1503 microversion: 2.1 time: 0.291366 Oct 06 13:09:29.001406 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2133/4273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:28 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1503 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:29.052288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:29.053203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:29.060265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:29.070534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:29.070991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:29.071925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:29.072550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:29.073158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:29.200530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:29.201387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:29.207857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:29.208362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:29.208868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:29.209586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:29.210244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:29.210840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:29.283809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:29.294324 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e8b6bb6-eb84-4cce-87c2-ef8d65f53dcc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1269 microversion: 2.1 time: 0.245706 Oct 06 13:09:29.297187 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2141/4274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:29 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:29.690874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed120aa5-ed81-4986-a4b7-3de3be7f8603", "name": "network-vif-plugged", "status": "completed", "tag": "fff21119-da37-4cfc-8797-999c10981220"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:29.713081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:29.714086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:29.714308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:29.765634 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] Creating event network-vif-plugged:fff21119-da37-4cfc-8797-999c10981220 for instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 on n-h2-860556-1 Oct 06 13:09:29.794936 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-67d9fcd2-e327-4c16-a1d2-df08f189b25c req-f87a6732-782a-4935-8076-ca33425e8fab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097287 Oct 06 13:09:29.799939 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2142/4275] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:29.850027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:29.881328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05b87aa5-bbbf-4b2c-bd14-e55b339ebc60 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.664476 Oct 06 13:09:29.898897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2134/4276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:29 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:30.029931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:30.032086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:30.059206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.067858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.069200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.070382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.094491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.100295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.281966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac020e1b27464cee865fde723aa2ad06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02371acd4cdd49cca981c64e3a349865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:30.294693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b57b2e81-7493-445c-a8f2-ff50842b41d7 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 200 len: 1461 microversion: 2.1 time: 0.271263 Oct 06 13:09:30.300264 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2143/4277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:30 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 1461 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:30.329617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:30.330469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:30.348888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.349659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.350300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.351244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.352141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.352803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.475795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc440f7-d926-44fc-a65d-91036b0013e1", "name": "network-vif-deleted", "tag": "7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:30.490048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.490204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:30.490770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.491494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.506277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ced5c7c-70c9-40a2-9302-b3995f2eb378 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1267 microversion: 2.1 time: 0.180180 Oct 06 13:09:30.506992 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2135/4278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:30 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:30.512564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] Creating event network-vif-deleted:7b20cda8-dab7-4ea7-b4f0-e7c2a76197f6 for instance dfc440f7-d926-44fc-a65d-91036b0013e1 on n-h1-860556-1 Oct 06 13:09:30.518876 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6dcf8305-e262-4b03-95a8-fab11e93a029 req-4c08af4a-62ae-4eee-ac30-ea0fa2359ee1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182055 Oct 06 13:09:30.520289 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2144/4279] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:30.912846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:30.914191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:30.929227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.929756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.930207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:30.933088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:30.933781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:30.934383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.339069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.340000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:31.350530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.353444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.355089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.361984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.362519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.362958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.414546 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 HTTP/1.1 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dfc440f7-d926-44fc-a65d-91036b0013e1'} Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.416564 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.422312 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.428816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.429972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f815ee3-9497-49d5-8049-c72922b49aa8 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 404 len: 111 microversion: 2.1 time: 0.108922 Oct 06 13:09:31.440582 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2145/4280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:31 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:09:31.447249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.488211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.server_groups [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Querying cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) for 1 instances {{(pid=129615) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 06 13:09:31.488936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.489416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.489891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.513189 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea26b0d2-a7bc-4ac8-a6c4-c52d830460e1 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.071169 Oct 06 13:09:31.513816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2146/4281] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:09:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:31.527043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.557895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:31.568451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.server_groups [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Querying cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) for 1 instances {{(pid=129615) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 06 13:09:31.571047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.572079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.574997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.588264 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37f96c43-37bb-411a-995a-1c3af22a5199 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2" status: 200 len: 184 microversion: 2.1 time: 0.066655 Oct 06 13:09:31.595233 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2147/4282] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:09:31 2022] GET /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2 => generated 184 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:31.595233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.595233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:31.601822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.602655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.603357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.604318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.605849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.606531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.670352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:31.684152 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33e79936-6daf-4f1c-a247-c6473a1c423c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1314 microversion: 2.1 time: 0.775828 Oct 06 13:09:31.685372 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2136/4283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:30 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:31.709193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.709954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:31.725875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.728630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.729501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.732193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.735704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.736797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.758811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 HTTP/1.1 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'dfc440f7-d926-44fc-a65d-91036b0013e1'} Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:31.761995 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4832dfeb-f9ed-4364-9c16-922440c27f57 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 404 len: 111 microversion: 2.1 time: 0.079374 Oct 06 13:09:31.769381 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2137/4284] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:31.781874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.783612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] [instance: dfc440f7-d926-44fc-a65d-91036b0013e1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:31.809175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.810141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.810268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.810987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:31.811529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:31.811964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:31.839806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 HTTP/1.1 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'dfc440f7-d926-44fc-a65d-91036b0013e1'} Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.846257 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. Oct 06 13:09:31.850304 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.852316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance dfc440f7-d926-44fc-a65d-91036b0013e1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.853984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48429d95-35d1-46d7-bc5f-8d4fb48f8d91 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1" status: 404 len: 111 microversion: 2.1 time: 0.080441 Oct 06 13:09:31.855069 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2138/4285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:31 2022] GET /compute/v2.1/servers/dfc440f7-d926-44fc-a65d-91036b0013e1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:31.863420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-392148fa-baea-4f6b-9b79-dc6cc10e3fd2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.870258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-392148fa-baea-4f6b-9b79-dc6cc10e3fd2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-392148fa-baea-4f6b-9b79-dc6cc10e3fd2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-server-groups/df7e2b50-bcdf-4481-9410-45d11c0175a5 HTTP/1.1 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'df7e2b50-bcdf-4481-9410-45d11c0175a5'} Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 379, in get_by_uuid Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 234, in _get_from_db_by_uuid Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.872825 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. Oct 06 13:09:31.876863 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.880409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-392148fa-baea-4f6b-9b79-dc6cc10e3fd2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance group df7e2b50-bcdf-4481-9410-45d11c0175a5 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.882203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-392148fa-baea-4f6b-9b79-dc6cc10e3fd2 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/df7e2b50-bcdf-4481-9410-45d11c0175a5" status: 404 len: 117 microversion: 2.1 time: 0.022062 Oct 06 13:09:31.883371 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2139/4286] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/os-server-groups/df7e2b50-bcdf-4481-9410-45d11c0175a5 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:31.894290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-254d663c-e3b9-4bab-a046-01f32dcae3bd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.902777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-254d663c-e3b9-4bab-a046-01f32dcae3bd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-254d663c-e3b9-4bab-a046-01f32dcae3bd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-server-groups/a6972718-bbbc-4622-9b9c-82c1ab853903 HTTP/1.1 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a6972718-bbbc-4622-9b9c-82c1ab853903'} Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 379, in get_by_uuid Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 234, in _get_from_db_by_uuid Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.904624 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. Oct 06 13:09:31.909723 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.912454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-254d663c-e3b9-4bab-a046-01f32dcae3bd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance group a6972718-bbbc-4622-9b9c-82c1ab853903 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.913563 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-254d663c-e3b9-4bab-a046-01f32dcae3bd tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a6972718-bbbc-4622-9b9c-82c1ab853903" status: 404 len: 117 microversion: 2.1 time: 0.024712 Oct 06 13:09:31.914814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2140/4287] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/os-server-groups/a6972718-bbbc-4622-9b9c-82c1ab853903 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:31.930514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a395bc3b-c5cb-434a-8168-5baa8faace85 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.937251 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a395bc3b-c5cb-434a-8168-5baa8faace85 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a395bc3b-c5cb-434a-8168-5baa8faace85 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-server-groups/da13b343-c781-4942-ae73-3efc3791850c HTTP/1.1 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'da13b343-c781-4942-ae73-3efc3791850c'} Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 379, in get_by_uuid Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 234, in _get_from_db_by_uuid Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.939074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a395bc3b-c5cb-434a-8168-5baa8faace85 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance group da13b343-c781-4942-ae73-3efc3791850c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a395bc3b-c5cb-434a-8168-5baa8faace85 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/da13b343-c781-4942-ae73-3efc3791850c" status: 404 len: 117 microversion: 2.1 time: 0.020988 Oct 06 13:09:31.943590 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2141/4288] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/os-server-groups/da13b343-c781-4942-ae73-3efc3791850c => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:09:31.951496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04c8fcd7-f6fe-4330-98bc-4d8c5553963a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:31.959402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-04c8fcd7-f6fe-4330-98bc-4d8c5553963a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] HTTP exception thrown: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04c8fcd7-f6fe-4330-98bc-4d8c5553963a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Request method failure captured: Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-server-groups/a0779407-b023-481e-a94c-c63ff40d5d12 HTTP/1.1 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtNxeYwgFgBSkSLRf2JoNLbDA92Z-Hw72IJVnY_FtJCfRPzcvIVrwJRsrId3_NLkRHZ2T7n_Ztc7vqbv1K5V5bh2JFTZu_1sbBNzfFhwuo-AJGeMKKsJnyiXAIKDlTLhocNxtqEOYnc8pAVle8G1n4SMMT7JjCp7sc2xANiv9VTH_jQ Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02371acd4cdd49cca981c64e3a349865", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02371acd4cdd49cca981c64e3a349865"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02371acd4cdd49cca981c64e3a349865"}]}] Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 02371acd4cdd49cca981c64e3a349865 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1933260215 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: ac020e1b27464cee865fde723aa2ad06 Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerGroupTestJSON-1933260215-project Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a0779407-b023-481e-a94c-c63ff40d5d12'} Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 379, in get_by_uuid Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 234, in _get_from_db_by_uuid Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.961096 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. Oct 06 13:09:31.964824 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:31.966605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04c8fcd7-f6fe-4330-98bc-4d8c5553963a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Returning 404 to user: Instance group a0779407-b023-481e-a94c-c63ff40d5d12 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:31.967472 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04c8fcd7-f6fe-4330-98bc-4d8c5553963a tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a0779407-b023-481e-a94c-c63ff40d5d12" status: 404 len: 117 microversion: 2.1 time: 0.019734 Oct 06 13:09:31.968993 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2142/4289] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/os-server-groups/a0779407-b023-481e-a94c-c63ff40d5d12 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:09:31.980848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a25cf93-994e-4ae2-9448-d6c82e8f3910 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:32.036555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a25cf93-994e-4ae2-9448-d6c82e8f3910 tempest-ServerGroupTestJSON-1933260215 tempest-ServerGroupTestJSON-1933260215-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2" status: 204 len: 0 microversion: 2.1 time: 0.059561 Oct 06 13:09:32.039733 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2143/4290] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Oct 6 13:09:31 2022] DELETE /compute/v2.1/os-server-groups/7a90b0ed-6df2-48a6-b975-5176dc8afcd2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:32.629280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:32.650940 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33b6ae49-6032-4b3e-bfe4-6752a6bd958c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 1.060577 Oct 06 13:09:32.653863 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2148/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:31 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:32.711836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:32.712464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:32.719891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:32.720403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:32.720857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:32.721627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:32.722305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:32.722749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.170818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:33.180996 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0daf1e98-e49d-44eb-9683-38feedb00720 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1502 microversion: 2.1 time: 0.473460 Oct 06 13:09:33.181964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2144/4292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:32 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1502 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:33.209302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:33.209911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:33.219734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.220946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.221638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.223854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.224703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.225899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.263681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lazy-loading 'flavor' on Instance uuid ed120aa5-ed81-4986-a4b7-3de3be7f8603 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:33.618370 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-54773b5b-1f15-407e-b057-5e2481c3a78e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603/action" status: 202 len: 0 microversion: 2.1 time: 0.416283 Oct 06 13:09:33.620334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2149/4293] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:09:33 2022] POST /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:09:33.630913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:33.631548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:33.639893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.640848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.641458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.642476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.644871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.649332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.679342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:33.681424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:33.710992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.711503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.711947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.712670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:33.715968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:33.716444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:33.767445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:34.216870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:34.232295 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acab02e6-dd73-493e-ba95-739777fa2db0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.558332 Oct 06 13:09:34.233213 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2150/4294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:33 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:34.246988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:34.277114 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00916b52-8601-49b1-9735-16459f0f0c62 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.648445 Oct 06 13:09:34.277999 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2145/4295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:33 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:34.375354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-336118353", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:34.503015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] validate_networks() for [('f6d47836-baeb-4053-a057-5836e3c6a445', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:34.875109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b429baa5-454a-4d95-936d-f7f1b1562d0b", "tag": "d1c5e09b-9628-4461-b30e-3f30cc2f09b6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:34.912767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:34.913285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:34.914587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:34.950518 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] Creating event network-changed:d1c5e09b-9628-4461-b30e-3f30cc2f09b6 for instance b429baa5-454a-4d95-936d-f7f1b1562d0b on n-h1-860556-1 Oct 06 13:09:34.957825 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7e214fa6-2e6e-4cf5-b703-2af0c334e356 req-3c657d47-c6b1-4710-b49b-6d807ed8d91f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232898 Oct 06 13:09:34.962120 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2146/4296] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:09:35.266724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:35.268193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:35.276411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:35.277206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:35.278138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:35.279417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:35.280088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:35.280831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:35.750467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:35.768116 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94833ac3-61fe-475e-8ef1-ae19fcc103cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.507504 Oct 06 13:09:35.772682 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2147/4297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:35 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:35.783319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:35.793472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:35.815512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:35.821346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:35.822271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:35.823235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:35.823909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:35.826177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:35.969426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:09:35.970394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:09:35.970895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:09:35.971508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:09:35.972171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:09:35.996510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:36.001153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:36.002681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:36.005806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:36.006325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:36.006774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:36.105553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:36.124831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for user db39e3800b574bb7abd3922b5ad8e282 and project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:36.155895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:09:36.159008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:09:36.238872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:36.282483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba2f12c2-59f3-4b0c-b871-b1eabfaa248a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.042035 Oct 06 13:09:36.284329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2151/4298] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:09:36.297542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53fa428e-6f89-4169-8e3c-464516afb4ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:36.298277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53fa428e-6f89-4169-8e3c-464516afb4ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:36.379439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:36.402129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e001540b-132d-471b-b70c-7b41392997eb tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.617307 Oct 06 13:09:36.423727 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2148/4299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:35 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:36.455193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53fa428e-6f89-4169-8e3c-464516afb4ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:36.462771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53fa428e-6f89-4169-8e3c-464516afb4ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1221 microversion: 2.1 time: 0.170982 Oct 06 13:09:36.463380 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2152/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:36 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:36.537824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-217005068", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:36.623075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] validate_networks() for [('f6d47836-baeb-4053-a057-5836e3c6a445', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:36.634385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=39 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:36.801422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:36.802480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:36.832702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:36.833295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:36.833773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:36.834520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:36.834990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:36.835425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:37.396301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:09:37.396836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:09:37.397225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:09:37.397660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:09:37.398101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:09:37.418438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:37.419023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:37.421721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:37.422713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:37.423208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:37.423661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:37.471945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:09:37.484806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for user db39e3800b574bb7abd3922b5ad8e282 and project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:09:37.497756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:37.508702 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4f6a611-74f4-4c3d-9f64-dc91e4bd9616 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.712936 Oct 06 13:09:37.510025 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2153/4301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:36 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:37.516399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:37.517182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:37.518566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:37.522725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:09:37.524650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:37.525333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:37.525982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:37.526882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:37.527522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:37.528097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:37.528803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:09:37.666465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a85a86e-c24f-4c86-86bf-76e877c5f1bb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.133141 Oct 06 13:09:37.667145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2149/4302] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:09:37.679789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-272b0524-71eb-4fc9-b67a-a1283db603c0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:37.705015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-272b0524-71eb-4fc9-b67a-a1283db603c0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:37.942697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-272b0524-71eb-4fc9-b67a-a1283db603c0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:37.961273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-272b0524-71eb-4fc9-b67a-a1283db603c0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1221 microversion: 2.1 time: 0.283280 Oct 06 13:09:37.978353 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2150/4303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:37 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:38.116849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:38.128342 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c98fefd-3dee-4e58-b382-754a56d0cad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.616930 Oct 06 13:09:38.150088 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2154/4304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:37 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:38.538492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:38.539121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:38.549782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:38.550286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:38.553904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:38.554720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:38.555268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:38.555771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:38.988330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:38.989623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:39.005453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:39.006338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:39.006980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:39.007940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:39.008617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:39.009255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:39.287743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:39.300713 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3d022e3-bfe2-449f-b8e6-88b1cfc124d6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1217 microversion: 2.1 time: 0.316227 Oct 06 13:09:39.301699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2155/4305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:38 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1217 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:39.306333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:39.307130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:39.313422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:39.314161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:39.314745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:39.315617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:39.316226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:39.316804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:39.504916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:39.514835 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-69820623-a164-458e-90e4-c680690e4d1e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.979929 Oct 06 13:09:39.526368 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2151/4306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:38 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:39.648677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:39.674480 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf461f65-60ce-4d85-a441-b3d12cbac515 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.370785 Oct 06 13:09:39.677783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2156/4307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:39 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:40.323521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:40.324759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:40.332374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.333048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.333651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.334579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.335190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.335789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.455957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:40.475647 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50537a32-38c5-4b70-8786-91039779aa83 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1279 microversion: 2.1 time: 0.154494 Oct 06 13:09:40.499620 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2152/4308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:40 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:40.545375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:40.546971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:40.564845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.566776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.568137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.570158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.570787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.572216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.714273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:40.715181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:40.739329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.741097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.744544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.745851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:40.746445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:40.747030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:40.982176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:41.009282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60dd8bde-bbe7-40cc-ad7e-e77e8aa83e30 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.473640 Oct 06 13:09:41.012450 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2157/4309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:40 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:41.027847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b429baa5-454a-4d95-936d-f7f1b1562d0b", "name": "network-vif-plugged", "status": "completed", "tag": "d1c5e09b-9628-4461-b30e-3f30cc2f09b6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:41.060168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.060684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.061316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.103804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] Creating event network-vif-plugged:d1c5e09b-9628-4461-b30e-3f30cc2f09b6 for instance b429baa5-454a-4d95-936d-f7f1b1562d0b on n-h1-860556-1 Oct 06 13:09:41.104739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:41.110961 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b97c3339-1c99-4bb2-bab6-a86e43535c1b req-36807cc0-ec66-4c89-b824-6a8d5c604abb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096668 Oct 06 13:09:41.114514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2158/4310] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:41.115810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9cf0a3d5-9dfc-41ef-9c74-4385d813ed1b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.421081 Oct 06 13:09:41.119458 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2153/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:40 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:41.510947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:41.511865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:41.523972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.524479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.524929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.525652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.526147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.526583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.666234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:41.675511 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2fc421e9-cfff-4bfb-9d6a-042cd6fa7de8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1279 microversion: 2.1 time: 0.168961 Oct 06 13:09:41.707010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2159/4312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:41 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:41.759474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:41.765234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:41.771917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Searching by: {'deleted': False, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:09:41.783344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.792083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.792790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.793637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.794175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.794618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.856824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:09:41.926753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:41.929394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2db9d0c-7ead-4afd-b03c-9e61df72d81f tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.174009 Oct 06 13:09:41.930340 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2154/4313] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:09:41 2022] GET /compute/v2.1/servers => generated 340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:41.943777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:41.949217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:41.950115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Searching by: {'deleted': False, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:09:41.963302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.966340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.968771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:41.970149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:41.972603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:41.973245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.029008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:09:42.036887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:42.037514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:42.048819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.049327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.049796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.050522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.057936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.058035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.089312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:42.098144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.098832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.099341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.434503 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53fb2d68-0c3b-4e4f-8e8a-a53433a4dfe0 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.494292 Oct 06 13:09:42.435998 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2160/4314] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:09:41 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:42.454298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:42.455221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:42.461130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:42.470533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d344078-3525-4929-bc64-5b76dd837ef5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1309 microversion: 2.1 time: 0.437620 Oct 06 13:09:42.478364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.479673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.480362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.481783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.489358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2155/4315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:42 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:42.490992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.491639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.495777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b7775b6d-9183-49fe-9401-8039a21ec3fd tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:42.530807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b7775b6d-9183-49fe-9401-8039a21ec3fd tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039494 Oct 06 13:09:42.544221 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2156/4316] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 13:09:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:42.707944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:42.708562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:42.726021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.726705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.729195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:42.743458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:42.744053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:42.744522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.146640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:43.159911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4be5c0aa-fce3-446a-86d0-56685d93cb71 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.453422 Oct 06 13:09:43.159911 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2157/4317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:42 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:43.190375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:43.191096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:43.200163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.200932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.202309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.204923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.205847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.206801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.221062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:43.234095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ffe36813-8084-4269-a371-0947b6cedd1c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.795887 Oct 06 13:09:43.234697 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2161/4318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:42 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:43.269512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:09:43.408520 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4fbb717a-0492-4048-9fd6-7287b1096417 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "DELETE /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 204 len: 0 microversion: 2.1 time: 0.227358 Oct 06 13:09:43.410600 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2158/4319] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:09:43 2022] DELETE /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:09:43.418950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:43.419788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:43.436817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.437324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.437796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.438517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.439061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.439649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.505371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:43.506581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:43.513864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.515247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.515894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.516910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:43.517576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:43.518234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:43.986251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:43.995265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:43.999917 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52563ac8-1902-4111-bd49-405c6b6b2c83 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1716 microversion: 2.1 time: 0.584601 Oct 06 13:09:44.001074 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2162/4320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:43 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1716 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:44.006404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21154b35-ca0a-47c2-bac6-5059440bece4 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1489 microversion: 2.1 time: 0.513608 Oct 06 13:09:44.008708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd0fa67-05ab-4aa9-8b83-bbac6933a041", "tag": "e3e1cb25-f848-4c4c-997f-00d612055274"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:44.019003 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2159/4321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:43 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1489 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:44.029402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.029402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.029402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.043168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1012174602"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:44.045887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:44.048921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] Creating event network-changed:e3e1cb25-f848-4c4c-997f-00d612055274 for instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 on n-h2-860556-1 Oct 06 13:09:44.057635 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-617562e1-fe16-40f9-a014-b59931b65c7f req-5a6033be-bfcf-462f-b90c-46b68b644a5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053008 Oct 06 13:09:44.059015 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2163/4322] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:44.067989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.068718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.069335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.073571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.074286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.076393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.187843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:44.188563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:44.201555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.203551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.205958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.209327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.212860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.213367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.261226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02da02da-9a48-48d5-b142-9dcf7763eeac tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "PUT /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1074 microversion: 2.1 time: 0.223749 Oct 06 13:09:44.261932 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2160/4323] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:09:44 2022] PUT /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1074 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:44.282054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:44.283147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:44.291757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.292684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.306238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.312136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.312646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.313101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.886452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:44.901584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da14c7de-ae64-4af5-a466-b5e0e8903fba tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.637094 Oct 06 13:09:44.903437 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2161/4324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:44 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:44.920015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:44.924095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:44.941502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.942049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.945918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.955225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:44.958143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:44.958648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:44.976286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:45.016523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-26b6d721-d897-478c-947e-cbb0f3b00353 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.828980 Oct 06 13:09:45.017916 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2164/4325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:44 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:45.036016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:45.036974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:45.052301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.054966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.055482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:45.056248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.056725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.060148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:45.489971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:45.506716 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0292c454-d0ff-47ab-802a-d32c135d3674 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1716 microversion: 2.1 time: 0.483161 Oct 06 13:09:45.507996 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2165/4326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:45 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1716 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:45.512878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:45.524344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d83de321-912f-4ce8-91a3-1de7a179bbd9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1500 microversion: 2.1 time: 0.615735 Oct 06 13:09:45.524985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2162/4327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:44 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1500 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:45.552098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:45.554254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:45.573156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.573773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.574288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:45.575094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.575630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.576129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:45.928764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:45.929374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:45.937657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.938687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.939350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:45.940283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:45.941085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:45.941762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.002335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:46.013418 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3045bdc-2a74-4094-a63c-ac3a7d39e40d tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1500 microversion: 2.1 time: 0.465964 Oct 06 13:09:46.015029 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2166/4328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:45 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:46.042309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:46.052593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.053850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.054564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.091923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:09:46.197178 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-907579d7-1eca-419c-b6a5-07ec0b390e89 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "POST /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b/action" status: 202 len: 0 microversion: 2.1 time: 0.162643 Oct 06 13:09:46.202514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2167/4329] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:09:46 2022] POST /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:09:46.210996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:46.215998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:46.231067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.232014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.234009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.236343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.237174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.239570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.265258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:46.424339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:46.433973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a11e14ed-54b2-4e52-b7dd-e06716142cda tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.509847 Oct 06 13:09:46.447151 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2163/4330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:45 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:46.464142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c762195-c17a-4a39-88ad-1d1df05bff2d", "tag": "aa49d155-9939-4704-af13-8cd4cda416cc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:46.475450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.475937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.476987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.490210 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] Creating event network-changed:aa49d155-9939-4704-af13-8cd4cda416cc for instance 1c762195-c17a-4a39-88ad-1d1df05bff2d on n-h1-860556-1 Oct 06 13:09:46.495130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3da2ee1b-b6ed-4956-8fdc-72028a12dfcc req-11f208eb-5582-4cc9-a8a1-c5a1bfa155e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046155 Oct 06 13:09:46.495908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2164/4331] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:46.501511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:46.502248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:46.508628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.509124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.509661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:46.510406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:46.510870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:46.511305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:47.035996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:47.050423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f99cd065-55a0-4387-af59-27171c2eda95 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.845544 Oct 06 13:09:47.063101 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2168/4332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:46 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:47.068970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:47.070051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:47.082436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:47.083363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:47.084996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:47.086074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:47.086708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:47.087365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:47.276345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:47.288480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-053debaa-4de0-4179-a81c-56f907f7791e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.791164 Oct 06 13:09:47.289179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2165/4333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:46 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:47.453342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:47.467065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15ac0286-6acb-4487-99bc-81f9a7c448bb tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1716 microversion: 2.1 time: 0.402622 Oct 06 13:09:47.468003 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2169/4334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:47 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1716 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:47.468362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:47.469181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:47.478681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:47.481831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:47.482350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:47.483661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:47.485297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:47.485949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:47.953188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:48.075728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:48.078188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:48.094021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.100047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.100724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.101633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.110076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.110758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.540805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:48.558154 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71977cd0-adee-4084-b4f0-122ec1a1925f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 1.092040 Oct 06 13:09:48.558692 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2166/4335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:47 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:48.580561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:48.582560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:48.600218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.600730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.605661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.607981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.611456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.612095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.688748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:48.700333 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60e02003-cde5-4317-b823-d3113f899d24 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.628451 Oct 06 13:09:48.703072 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2170/4336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:48 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:48.714608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477fc43f-bc46-459c-beb3-a2f44805a331", "name": "network-vif-deleted", "tag": "05d5ae8b-b5c6-4848-8832-c716490dc3cd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:48.734783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.738907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.739633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.767126 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] Creating event network-vif-deleted:05d5ae8b-b5c6-4848-8832-c716490dc3cd for instance 477fc43f-bc46-459c-beb3-a2f44805a331 on n-h2-860556-1 Oct 06 13:09:48.780500 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8dfe9a7a-a6c9-4d89-8a76-f40d73946d3a req-e8ec5078-f944-4734-a0dc-5f26c8dfb34e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073187 Oct 06 13:09:48.782251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2171/4337] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:48.791076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:48.797561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:48.807105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.809961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.813281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.814378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:48.815056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:48.818733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:48.993367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:49.002257 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89fc3083-d9c8-457f-a96a-442e1f04c1c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1648 microversion: 2.1 time: 0.218554 Oct 06 13:09:49.012743 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2172/4338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:48 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1648 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:49.127629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:49.138585 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c310d783-d822-4ef7-88f3-5dab2c88560c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.578804 Oct 06 13:09:49.150344 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2167/4339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:48 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:49.582802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:49.584706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:49.602881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:49.603666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:49.605283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:49.607767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:49.609574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:49.613124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:49.726441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:49.727262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:49.740217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:49.740879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:49.741704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:49.744038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:49.745375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:49.747349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.136963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:50.146906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63be63a4-84f0-426a-a0c3-68df4c168ae4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.568197 Oct 06 13:09:50.154178 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2173/4340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:49 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:50.160371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:50.175570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:50.182949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.183953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.184410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.185124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.185583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.186086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.257312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.267743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.268202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.268677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lazy-loading 'fault' on Instance uuid 477fc43f-bc46-459c-beb3-a2f44805a331 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:50.311980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:50.324992 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08e21bc0-bfc8-450b-8f93-c963fc05c5fd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.602443 Oct 06 13:09:50.326742 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2168/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:49 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:50.338722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:50.339371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:50.386781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.387282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.387727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.388445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.397430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.400395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.648808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117be3ea1514c02ba14a1f02d403265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00c5dcc24cc466e9a065a74299c9150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:50.658723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85f582be-5296-4ab9-ac9c-2d4f208485c3 tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 200 len: 1368 microversion: 2.1 time: 0.502498 Oct 06 13:09:50.663123 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2174/4342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:50 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:50.682668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c762195-c17a-4a39-88ad-1d1df05bff2d", "name": "network-vif-plugged", "status": "completed", "tag": "aa49d155-9939-4704-af13-8cd4cda416cc"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:50.702794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:50.706404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:50.706856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:50.727394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:50.735237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] Creating event network-vif-plugged:aa49d155-9939-4704-af13-8cd4cda416cc for instance 1c762195-c17a-4a39-88ad-1d1df05bff2d on n-h1-860556-1 Oct 06 13:09:50.736649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b744d97a-4dc1-4a53-954d-b6cf787f5aaf tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.408124 Oct 06 13:09:50.740541 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2169/4343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:50 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:50.755761 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9180c6f5-f558-4b58-ad5e-9468aa2b44f0 req-bc724aad-3720-483a-bcb4-db44bfd7cf4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085140 Oct 06 13:09:50.756440 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2175/4344] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:51.175198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:51.176292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:51.185256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.186298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.186903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.188086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.188705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.189296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.209270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:51.350429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:51.351526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:51.359618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.360452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.361137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.362158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.362831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.363453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.615766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:51.624145 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e0e677c-9324-493f-8bee-53f64c6492e5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.453516 Oct 06 13:09:51.624924 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2170/4345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:51 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:51.691271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:51.692365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] [instance: 477fc43f-bc46-459c-beb3-a2f44805a331] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:51.703206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.704815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.705556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.706698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.707833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.708509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.729912 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] HTTP exception thrown: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. Oct 06 13:09:51.734925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Request method failure captured: Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 HTTP/1.1 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtMpMXC7BBEyw0Xp3oE6oAUYGBnKGrqRSu-fPv0anARQZsTAhXnA0kfokpd6QKiwwCFV3QVpLhdxkzaNcYSONn4SP-d2CrIWTRmrGWJD5E0BkjCi7Fa2hDwz-5NgPH-vx4zxJNzFKjTxGiNPiP4mO9BrW4JPLC5O-ZekfSX9DitO2rA Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: d00c5dcc24cc466e9a065a74299c9150 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestManualDisk-1263912541 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d00c5dcc24cc466e9a065a74299c9150", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d00c5dcc24cc466e9a065a74299c9150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d00c5dcc24cc466e9a065a74299c9150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d00c5dcc24cc466e9a065a74299c9150"}]}] Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestManualDisk-1263912541 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: d00c5dcc24cc466e9a065a74299c9150 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestManualDisk-1263912541 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestManualDisk-1263912541-project Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d117be3ea1514c02ba14a1f02d403265 Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestManualDisk-1263912541-project Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '477fc43f-bc46-459c-beb3-a2f44805a331'} Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:09:51.745407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Returning 404 to user: Instance 477fc43f-bc46-459c-beb3-a2f44805a331 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:09:51.752514 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7dd63b11-22a6-492b-b775-d549c3a7952b tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331" status: 404 len: 111 microversion: 2.1 time: 0.063281 Oct 06 13:09:51.753795 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec33166c-0acc-4065-99fe-744dbf057989 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1321 microversion: 2.1 time: 0.402763 Oct 06 13:09:51.753795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2176/4346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:51 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:51.756110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2171/4347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:51 2022] GET /compute/v2.1/servers/477fc43f-bc46-459c-beb3-a2f44805a331 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:09:51.778951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:51.779532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:51.782122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f286ea36-5071-4149-9867-db0cb9290d1e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] Calling method '.version_select at 0x7f7d3f00f4c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:51.794036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.794351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.794799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.798552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:51.799320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:51.799931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:51.831183 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f286ea36-5071-4149-9867-db0cb9290d1e tempest-ServersTestManualDisk-1263912541 tempest-ServersTestManualDisk-1263912541-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803938758" status: 202 len: 0 microversion: 2.1 time: 0.073839 Oct 06 13:09:51.832722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:51.834433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2177/4348] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803938758 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:09:52.573864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:52.582641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6c73c96f-f914-47ef-ac5c-a8296c5d125e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.823005 Oct 06 13:09:52.585214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2172/4349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:51 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:52.647997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:52.648968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:52.651511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:52.652447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:09:52.672571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:52.673434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:52.674267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:52.675897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:52.676933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:52.679932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:52.776097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:52.776734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:52.804482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:52.810581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:52.811091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:52.811876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:52.812357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:52.813079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.110663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:53.126455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7e726e6-59bb-4614-8333-6ea19701b4f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.475793 Oct 06 13:09:53.142753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2178/4350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:52 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:53.147985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0fa67-05ab-4aa9-8b83-bbac6933a041", "name": "network-vif-plugged", "status": "completed", "tag": "e3e1cb25-f848-4c4c-997f-00d612055274"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:53.186391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.189435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.189784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.230223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] Creating event network-vif-plugged:e3e1cb25-f848-4c4c-997f-00d612055274 for instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 on n-h2-860556-1 Oct 06 13:09:53.252354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ee033b99-bebf-4d53-a36a-61d1189fe652 req-fb69057f-37bc-4d37-b946-331a0542df55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108023 Oct 06 13:09:53.255063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2179/4351] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:09:53.411076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:53.423219 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5acb0fd6-59aa-4647-ae82-92f507de20d3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1515 microversion: 2.1 time: 0.651988 Oct 06 13:09:53.423812 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2173/4352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:52 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1515 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:09:53.448722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:53.451630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:53.468018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.470172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.471091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.472889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.474283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.475568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.544993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lazy-loading 'flavor' on Instance uuid 1c762195-c17a-4a39-88ad-1d1df05bff2d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:09:53.614170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:53.615098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:53.645377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.646295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.646899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.648238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.648869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.649481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.739729 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0965b92e-2358-463a-bbc9-ea65074b79cc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action" status: 200 len: 32 microversion: 2.1 time: 0.295502 Oct 06 13:09:53.741055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2180/4353] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:09:53 2022] POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:09:53.756512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:53.759914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:53.772077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.772854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.773454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:53.774441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:53.775058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:53.775823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:54.676470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:54.678471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:54.723616 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-121dd9db-97a1-4a68-b8e3-5ab5fb75db5a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.976410 Oct 06 13:09:54.724811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2181/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:53 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:54.739573 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df671262-60be-425b-88ba-ed91d4616bcb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 1.129423 Oct 06 13:09:54.746578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:54.748312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:54.756523 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2174/4355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:53 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:54.757522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:54.758451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:54.760198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:54.761374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:54.762372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:54.763228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:55.075923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:55.093067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-06e15413-e678-46b6-8193-bb4494aa114c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.366304 Oct 06 13:09:55.094020 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2182/4356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:54 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:55.751170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:55.756792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:55.782378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:55.783222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:55.821535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:55.822821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:55.823533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:55.824594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:55.825221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:55.825893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:55.834985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:55.835500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:55.835954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:55.840846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:55.841383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:55.842779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:56.184306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:56.190982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:56.201457 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff39868a-7e53-49d3-849c-9702c92b2cbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.456303 Oct 06 13:09:56.218040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93809fb6-060d-4099-a4de-cd52a46b469b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.443975 Oct 06 13:09:56.219455 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2175/4357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:55 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:56.221203 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2183/4358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:55 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:56.227705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:56.228597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:56.236636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:56.237134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:56.237579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:56.238324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:56.238965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:56.239431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:56.510225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:56.520398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55e3be1e-45c2-43f6-98e6-16d17d65988a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.298521 Oct 06 13:09:56.520398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2176/4359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:56 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:57.227889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:57.228509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:57.240661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:57.241876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:57.272238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.272803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.273257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.278280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.281563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.282966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.283724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.284548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.285556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.286586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.293957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.295008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.824662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:57.834924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:57.836003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1faa0f57-ac7a-411d-b965-5098f2992450 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.603393 Oct 06 13:09:57.849771 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2177/4360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:57 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:57.849771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:57.849771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:57.851142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c0f77ff-ad38-4e95-8af0-b7a9a3b2a21e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.627291 Oct 06 13:09:57.854342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.855293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.857700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.859993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:57.861355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:57.862027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:57.863991 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2184/4361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:57 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:58.206237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:58.215501 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c692caaa-d586-45c8-a78f-c0d9c5d833f1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.376614 Oct 06 13:09:58.216587 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2178/4362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:57 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:58.543609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-467376132", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:09:58.673898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] validate_networks() for [('88baa1d6-9bc7-4188-9362-4661dd279cde', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:09:58.870768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:58.873055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:58.889388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:58.895279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:58.895858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:58.901490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:58.904018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:58.906090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:59.189973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:09:59.207454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bca7fbb-87b5-455e-a7d3-451fa90dfd0b tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.346377 Oct 06 13:09:59.211357 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2179/4363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:58 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:09:59.227570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:09:59.228427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:09:59.239096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:59.240656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:59.241329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:09:59.242548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:09:59.243266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:09:59.243924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.265381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:00.295929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31c5a3f1-e4e6-43e2-8355-350b39941458 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 1.077902 Oct 06 13:10:00.315987 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2180/4364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:09:59 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:00.339259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:00.353589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:00.364874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.365467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.366042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.366636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.367107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.367548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.519766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:10:00.521214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:10:00.523604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:10:00.524262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:10:00.524893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:10:00.532516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:00.543492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.544850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.547723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.548779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.549431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.550051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.611507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Getting quotas for project 494f0709ae414368a797dd058a1d69bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:10:00.631898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Getting quotas for user 7f6a370d0e6a41efac924ac5c7e62ab3 and project 494f0709ae414368a797dd058a1d69bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:10:00.646774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:10:00.649601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:10:00.712931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9cb9e9ae-084e-4a32-89f5-43e914ba6789 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.647833 Oct 06 13:10:00.715156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2185/4365] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:09:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:10:00.721691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:00.722575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:00.731681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.732553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.733773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.734793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:00.735421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:00.736364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:00.773589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:00.872620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:00.886969 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7c90d3d-a39c-4c71-b7c9-bb25ef235149 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1508 microversion: 2.1 time: 0.567033 Oct 06 13:10:00.887867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2181/4366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:00 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1508 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:00.898429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c580a9fb-11b0-4a12-90ee-02511f49a2e0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:00.902077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c580a9fb-11b0-4a12-90ee-02511f49a2e0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:01.186826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c580a9fb-11b0-4a12-90ee-02511f49a2e0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:01.202427 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c580a9fb-11b0-4a12-90ee-02511f49a2e0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1213 microversion: 2.1 time: 0.310719 Oct 06 13:10:01.204847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2182/4367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:00 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:01.267611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:01.276885 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5a6179d-f33b-47d6-a833-c168789c94a5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.560316 Oct 06 13:10:01.277490 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2186/4368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:00 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:01.324676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:01.325317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:01.353346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:01.356566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:01.357073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:01.362852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:01.363426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:01.368367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:01.834307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:01.854044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0ffefff3-10f1-49de-ab79-2b47ca7bca45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.534092 Oct 06 13:10:01.855344 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2183/4369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:01 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:01.912148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:01.916685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:01.925291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:01.926585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:01.927221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:01.928737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:01.930882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:01.932100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.236250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:02.240085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:02.242245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:02.258253 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38970319-7250-49be-a5f4-b88172c88703 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1529 microversion: 2.1 time: 0.349664 Oct 06 13:10:02.262511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.263251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2187/4370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:01 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1529 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:02.264055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.264842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.265879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.266551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.267233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.301455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:02.303199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:02.313968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.314797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.315795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.317467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.318230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.320160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.422452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:02.461731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2a2b3bd-b27e-4ec0-b993-faa8ed8c52ba tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1265 microversion: 2.1 time: 0.230150 Oct 06 13:10:02.465445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2184/4371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:02 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:02.890293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:02.890986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:02.902572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.906220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.906685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:02.907711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:02.910497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:02.918976 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-576f9393-f09a-4387-a424-ad711284b8bc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.621719 Oct 06 13:10:02.920008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:02.923317 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2188/4372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:02 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:02.925422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.287938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:03.288855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:03.296532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.297434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.298198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.299163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.299959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.300657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.450476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:03.466012 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-665f1779-ab63-4236-b7c1-cbf4f85a42a9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.589931 Oct 06 13:10:03.466894 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2185/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:02 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:03.492350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:03.493302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:03.507772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.508907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.510666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.512591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.513060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.513504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.739021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:03.747762 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e051bc01-533a-445f-8ad5-6db64d4eb8e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1271 microversion: 2.1 time: 0.259767 Oct 06 13:10:03.751867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2186/4374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:03 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:03.949013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:03.950086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:03.961206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.961719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.962208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:03.962924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:03.963384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:03.963815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.040594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:04.060416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc8073dc-54f7-4df9-83cc-1fac09e046e9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1529 microversion: 2.1 time: 0.778403 Oct 06 13:10:04.075326 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2189/4375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:03 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1529 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:04.147176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed120aa5-ed81-4986-a4b7-3de3be7f8603", "name": "network-vif-plugged", "status": "completed", "tag": "fff21119-da37-4cfc-8797-999c10981220"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:04.166124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:04.166614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:04.167148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.198059 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] Creating event network-vif-plugged:fff21119-da37-4cfc-8797-999c10981220 for instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 on n-h2-860556-1 Oct 06 13:10:04.211092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b4abed2d-cc48-4001-886f-f66b66a1fedd req-7855ead0-07cf-4738-a9e5-10534885928e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069430 Oct 06 13:10:04.212883 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2190/4376] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:04.358880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:04.379599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37f4dca1-7ac5-48a4-9ea2-3ee401ad31cc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.434970 Oct 06 13:10:04.381000 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2187/4377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:03 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:04.493249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:04.494808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:04.506364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:04.507223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:04.507908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.509259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:04.510032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:04.510682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.778747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:04.779635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:04.807759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:04.810201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:04.810952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.811506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:04.811984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:04.820800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:04.829574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:04.844753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12d2f9ff-a05c-4cbe-9752-79d6322bbde5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.355230 Oct 06 13:10:04.858361 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2191/4378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:04 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:05.099689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:05.100316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:05.118264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.119022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.120602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:05.122447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.124475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.125263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:05.161051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:05.177344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:05.186795 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a65e71e-f1ff-41b7-a129-e22ef892b83e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 0.410236 Oct 06 13:10:05.190404 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2188/4379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:04 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:05.403279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:05.404161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:05.419924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.422415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.423064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:05.427979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.428758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.429418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:05.644086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:05.657746 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ccd490b-b2ca-4135-b164-cfee28e2d306 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1529 microversion: 2.1 time: 0.566077 Oct 06 13:10:05.662272 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2192/4380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:05 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1529 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:05.871130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:05.871764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:05.893024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.895736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.900567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:05.901669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:05.902198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:05.902644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:06.131086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:06.141542 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0ccf4004-627f-49f0-9681-6988878f3cea tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.742857 Oct 06 13:10:06.142182 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2189/4381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:05 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:06.214482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:06.215390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:06.224163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:06.229258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:06.229970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:06.231252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:06.235559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:06.236208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:06.276201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:06.288960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64b7aa65-1af4-4fea-b445-305e69ee9499 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.419165 Oct 06 13:10:06.292301 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2193/4382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:05 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:06.585966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:06.597959 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7750fe8f-a5b7-4e30-9d62-1d1d67adef91 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 0.391069 Oct 06 13:10:06.619508 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2190/4383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:06 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:06.689021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:06.689656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:06.728181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:06.729322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:06.729984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:06.730899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:06.731544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:06.732382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.173389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:07.174875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:07.185042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:07.189891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:07.191228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.196775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:07.209212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:07.216171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:07.216882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.218512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dc6f034-90cb-4427-8a0d-2b43ac69108f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.532289 Oct 06 13:10:07.221316 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2194/4384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:06 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:07.319531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:07.321598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:07.339043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:07.341711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:07.343765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.345029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:07.368127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:07.371020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.900422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:07.910123 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e95863b-7b20-43e2-9ff0-af64265c2e40 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.597216 Oct 06 13:10:07.916810 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2195/4385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:07 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:07.922408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942f79f4-09a8-444c-9600-c253b7610519", "tag": "add9419a-564d-4ded-8730-dc4f25d55735"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:07.949112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:07.959100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96dfa2f6-a830-4b88-93cf-4314dea6d7d9 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.792002 Oct 06 13:10:07.959702 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2191/4386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:07 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:07.961925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:07.962609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:07.963238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:07.988883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:07.989869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:07.991983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:08.000156 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] Creating event network-changed:add9419a-564d-4ded-8730-dc4f25d55735 for instance 942f79f4-09a8-444c-9600-c253b7610519 on n-h2-860556-1 Oct 06 13:10:08.004929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:08.006004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:08.006699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:08.008571 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b8aab5d6-b663-4074-876e-39ad6a869eb7 req-79f2f9ff-9b62-48fa-a404-24f3156c5572 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090288 Oct 06 13:10:08.009672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:08.010438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:08.011090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:08.011954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2196/4387] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:08.243422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:08.244520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:08.257584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:08.261783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:08.274455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:08.275252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:08.275736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:08.276175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:09.181681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:09.193477 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd141e6e-91f1-46a9-ad7f-0730f6115674 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 1.223845 Oct 06 13:10:09.196522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2192/4388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:07 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:09.215226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:09.222938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:09.237864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:09.242548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:09.244653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:09.245790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:09.247926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:09.248652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:09.568414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:09.580931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6996a8aa-05fd-40ad-836e-9f22d679ae9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.368243 Oct 06 13:10:09.582222 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2193/4389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:09 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:09.608423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:09.622517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-978c25e1-271e-4d60-9d85-ee3f06f7c1aa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 1.381354 Oct 06 13:10:09.625479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2197/4390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:08 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:09.649187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:09.658170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:09.669450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:09.675386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:09.676178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:09.677146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:09.677850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:09.678486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:09.929868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1221483330", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "26874134-22dd-44a6-bd5e-2418f390e25a"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:10.047046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:10.056709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4cb273b-b070-4db0-8f60-9f4eeb27f54c tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1510 microversion: 2.1 time: 0.429926 Oct 06 13:10:10.058891 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2198/4391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:09 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:10.224851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:10.226144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:10.234918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:10.235900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:10.236561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:10.237484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:10.238850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:10.244524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:10.427120 n-d-860556-1 devstack@n-api.service[129614]: Exception ignored in: . at 0x7f7d3f277940> Oct 06 13:10:10.428157 n-d-860556-1 devstack@n-api.service[129614]: Traceback (most recent call last): Oct 06 13:10:10.428309 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 06 13:10:10.436331 n-d-860556-1 devstack@n-api.service[129614]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 06 13:10:10.436331 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 06 13:10:10.436783 n-d-860556-1 devstack@n-api.service[129614]: connection_record.checkin() Oct 06 13:10:10.436783 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 06 13:10:10.437259 n-d-860556-1 devstack@n-api.service[129614]: pool.dispatch.checkin(connection, self) Oct 06 13:10:10.437259 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 06 13:10:10.448544 n-d-860556-1 devstack@n-api.service[129614]: fn(*args, **kw) Oct 06 13:10:10.449459 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 06 13:10:10.462050 n-d-860556-1 devstack@n-api.service[129614]: time.sleep(0) Oct 06 13:10:10.465428 n-d-860556-1 devstack@n-api.service[129614]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 06 13:10:10.473184 n-d-860556-1 devstack@n-api.service[129614]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 06 13:10:10.476510 n-d-860556-1 devstack@n-api.service[129614]: AssertionError: do not call blocking functions from the mainloop Oct 06 13:10:10.578411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:10.601454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:10.612434 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c55a0f8-8e98-4639-8ee0-7f6429b7a130 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 0.395616 Oct 06 13:10:10.627949 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2199/4392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:10 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:10.632931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:10.633546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:10.643817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:10.653336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:10.653861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:10.654300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:10.655650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:10.656116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:10.656536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.003449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:11.031833 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e334954-222f-4c0b-944d-8ee0353a580f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.402655 Oct 06 13:10:11.035563 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2200/4393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:10 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:11.049808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:11.053876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:11.075668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.076816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.078563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.080015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.082256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.082900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.192394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:11.332736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:11.343974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1139a3c-b900-4ce4-95e3-2fbf07b28202 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.307257 Oct 06 13:10:11.359982 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2201/4394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:11 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:11.750972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:11.751489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:11.801990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.821007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.821968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.823355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.825155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.826318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.910110 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd9c439e-45b3-4f3c-b67b-d7f206b8f545 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/ips" status: 200 len: 152 microversion: 2.20 time: 0.548546 Oct 06 13:10:11.912014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2202/4395] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Oct 6 13:10:11 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/ips => generated 152 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:10:11.931009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:11.935189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:11.947520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.948490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.949178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:11.954505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:11.956655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:11.957358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:12.585652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:12.600317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0eec334-278e-4bd3-8eb1-2406cb6065f1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1487 microversion: 2.1 time: 0.684340 Oct 06 13:10:12.601547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2203/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:11 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1487 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:12.620786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:12.621533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:12.630505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:12.634774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:12.637623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:12.640266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:12.644324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:12.645022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:13.350308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:13.353436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:13.360839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d951ccdb-7ecb-4301-9506-182b494a8f24 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 0.757957 Oct 06 13:10:13.366953 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2204/4397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:12 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:13.377209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:13.378093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:13.391170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:13.392868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:13.393502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:13.397702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:13.398394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:13.399010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:13.795181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:13.838704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1dedded8-13ec-4007-9cb7-228a34220f08 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.470256 Oct 06 13:10:13.841159 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2205/4398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:13 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:13.857220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:13.858243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:13.870169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:13.870923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:13.873538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:13.874474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:13.875981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:13.877495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.201036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:14.212261 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fbab4bc2-a22f-470e-a328-fa8b6752785c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.368005 Oct 06 13:10:14.216048 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2206/4399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:13 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:14.226712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1396282873"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:14.235408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:14.258500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.259035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.259498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.266403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.266923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.267382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.448006 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9095c566-70e9-4dbc-a9b6-bb1ee9a6a36e tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "PUT /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1060 microversion: 2.1 time: 0.229886 Oct 06 13:10:14.449956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2207/4400] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:10:14 2022] PUT /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1060 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:14.454823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:14.459254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:14.476241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.476748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.478601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.482047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.483427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.484606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.712978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:14.723709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4aa1c7aa-2406-4b8d-851e-1302f9a2bf9f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1313 microversion: 2.1 time: 0.272431 Oct 06 13:10:14.724931 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2208/4401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:14 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:14.738942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:14.739794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:14.746475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.747034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.747570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:14.748928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:14.749451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:14.749972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.028071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:15.055861 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5a3427c4-d885-4980-9bc0-9a3b734d03b2 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1487 microversion: 2.1 time: 0.329534 Oct 06 13:10:15.058005 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2209/4402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:14 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:15.064549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:15.065387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:15.071824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.072501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.073119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.075406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.076040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.077203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.339282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:15.350592 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a6ce75c-5c23-4009-854d-c19787b51f66 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.291241 Oct 06 13:10:15.351730 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2210/4403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:15 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:15.356534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:15.357376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:15.365472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.366239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.366858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.367729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.368327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.368937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.623924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:15.633613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1f8b958-eee3-49d0-9aa2-3208a121087a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1487 microversion: 2.1 time: 0.279670 Oct 06 13:10:15.634239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2211/4404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:15 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1487 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:15.641254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942f79f4-09a8-444c-9600-c253b7610519", "name": "network-vif-plugged", "status": "completed", "tag": "add9419a-564d-4ded-8730-dc4f25d55735"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:15.652941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.653430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.653916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.676076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] Creating event network-vif-plugged:add9419a-564d-4ded-8730-dc4f25d55735 for instance 942f79f4-09a8-444c-9600-c253b7610519 on n-h2-860556-1 Oct 06 13:10:15.682798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-70171b32-20ff-4bf6-9212-ad6185f76805 req-f5d79f82-f0b0-4bdb-a706-dde1989acc3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046207 Oct 06 13:10:15.683657 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2212/4405] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:15.696767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:15.697494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:15.704883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.705722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.706366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:15.707245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:15.708160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:15.708757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:16.119771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:16.129864 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11537ead-3131-47e4-9f5f-eeb00968520a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.444247 Oct 06 13:10:16.138033 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2213/4406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:15 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:16.143785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:16.146466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:16.158041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:16.158991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:16.159681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:16.161133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:16.161864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:16.162512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:16.203283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lazy-loading 'flavor' on Instance uuid f37b88cd-d04c-425d-931d-855840f39907 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:19.573763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=31 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:20.000213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:20.144535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] validate_networks() for [('26874134-22dd-44a6-bd5e-2418f390e25a', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:10:20.288520 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67292e65-b30d-4ad8-868f-6ff478ee0889 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/action" status: 202 len: 0 microversion: 2.20 time: 4.148360 Oct 06 13:10:20.299326 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2214/4407] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:10:16 2022] POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/action => generated 0 bytes in 4160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:10:20.306345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:20.307786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:20.315614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:20.316412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:20.317062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:20.317981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:20.318639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:20.319217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:20.355037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:10:20.500518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9f0c7cc-253d-4243-a1bb-af66e34071fd tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 204 len: 0 microversion: 2.1 time: 0.197125 Oct 06 13:10:20.502481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2215/4408] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:20 2022] DELETE /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:10:20.512149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:20.514741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:20.530059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:20.534410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:20.536434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:20.538112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:20.538770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:20.539992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.043288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:21.059803 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dab2fd21-7c2b-4bc8-b4b8-17fe89068544 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1498 microversion: 2.1 time: 0.555530 Oct 06 13:10:21.066904 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2216/4409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:20 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1498 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:21.073951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:21.074569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:21.111365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.112139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.113100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.114251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.114941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.115676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.414797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:21.430789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:21.439957 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1909cf50-43b8-47bd-991f-993dddf0f24f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 0.370928 Oct 06 13:10:21.441339 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2217/4410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:21 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:21.455962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:21.457427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:21.473554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.477766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.478880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.479863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.486665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.487899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.508638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:10:21.509892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:10:21.510550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:10:21.511147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:10:21.511735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:10:21.539478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.542162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.543156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.549918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.552124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.554870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.613904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:10:21.631201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for user dda013ee00f241fe86330565456fc678 and project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:10:21.654821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:10:21.660148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:10:21.731975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:21.742164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71d914ea-8d3e-462d-9b04-d0544f85c946 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.156703 Oct 06 13:10:21.743161 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2194/4411] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 12160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:10:21.745226 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b9ffbf8-8aed-4e93-9292-b036e31d0ff2 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.301997 Oct 06 13:10:21.747845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:21.749215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:21.756000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.756723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.757356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.758305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.758963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.759577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.771042 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2218/4412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:21 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:21.784285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:21.784922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:21.800690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.801191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.801634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:21.804994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:21.821035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:21.821827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:22.221440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:22.231630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:22.236995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:22.239546 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6732d734-1851-4384-b18d-9908f5a39f2b tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.495360 Oct 06 13:10:22.261716 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2195/4413] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:21 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:22.269561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:22.280099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:22.295499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:22.296190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:22.296809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:22.297979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:22.298836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:22.299493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:22.318368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:22.345259 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa7b322e-67d4-46bd-9020-94076b35c4bb tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1493 microversion: 2.1 time: 0.569234 Oct 06 13:10:22.345918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2219/4414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:21 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1493 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:22.356654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1339658177", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "26874134-22dd-44a6-bd5e-2418f390e25a"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:22.372107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lazy-loading 'flavor' on Instance uuid 942f79f4-09a8-444c-9600-c253b7610519 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:22.477977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] validate_networks() for [('26874134-22dd-44a6-bd5e-2418f390e25a', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:10:22.604511 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6facfa41-b68e-4479-b66a-5a636d285ccc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "POST /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519/action" status: 200 len: 32 microversion: 2.1 time: 0.340929 Oct 06 13:10:22.606016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2196/4415] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:22 2022] POST /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:10:22.619462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:22.623282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:22.638041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:22.640022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:22.647274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:22.648463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:22.649189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:22.649823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:24.511340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:24.531128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d0b5d16-d1fa-49ff-afcd-edbfc8c6f707 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1521 microversion: 2.1 time: 1.923508 Oct 06 13:10:24.532765 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2197/4416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:22 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1521 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:24.551365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:24.552395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:24.575754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:24.579310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:24.579921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:24.580708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:24.581194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:24.590904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:24.689454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:10:24.690461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:10:24.691103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:10:24.704359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:10:24.705048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:10:24.743650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:24.770505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:24.771272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:24.772276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:24.772928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:24.773524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:24.823578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:10:24.838647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for user dda013ee00f241fe86330565456fc678 and project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:10:24.874392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:10:24.884640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:10:24.947405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:24.993365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-015052f3-f79d-44c2-8226-054b8fcb3525 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.644909 Oct 06 13:10:24.994344 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2220/4417] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:10:25.002115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:25.002736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:25.036429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.038664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.041852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.055796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.058822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.060715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.354554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:25.364832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3f0772e-32c3-4313-b62c-5b7a2ec61c6b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.829974 Oct 06 13:10:25.365430 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2198/4418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:24 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:25.377819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:25.379844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:25.397929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.398702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.399343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.400235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.400868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.402370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.716083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:25.734139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:25.734786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:25.736381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:25.738007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8c3ddc9-fe88-46b0-92eb-f25f012c431a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.367168 Oct 06 13:10:25.748464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e402c8ce-397d-4468-a77a-24d6eb750a29 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 0.752882 Oct 06 13:10:25.751947 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2221/4419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:24 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:25.756828 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2199/4420] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:25 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:25.768418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b429baa5-454a-4d95-936d-f7f1b1562d0b", "name": "network-vif-deleted", "tag": "d1c5e09b-9628-4461-b30e-3f30cc2f09b6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:25.775255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:25.780290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:25.804048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.804554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.805021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.805723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.806215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.806654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.809821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.810351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.811337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.842264 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] Creating event network-vif-deleted:d1c5e09b-9628-4461-b30e-3f30cc2f09b6 for instance b429baa5-454a-4d95-936d-f7f1b1562d0b on n-h1-860556-1 Oct 06 13:10:25.868756 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3b7dbe5f-9296-46a0-affa-db7a11dc0056 req-2b1c3455-5081-47bc-a90d-83749c4d081d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110255 Oct 06 13:10:25.870112 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2200/4421] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:25.881626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-452697354", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "451", "networks": [{"uuid": "26874134-22dd-44a6-bd5e-2418f390e25a"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:25.888809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:25.889312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:25.889784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:25.890259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lazy-loading 'fault' on Instance uuid b429baa5-454a-4d95-936d-f7f1b1562d0b {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:26.056545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] validate_networks() for [('26874134-22dd-44a6-bd5e-2418f390e25a', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:10:26.136102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:26.147001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0090cfa7-c9da-4644-84ad-b4c0f767cde5 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 200 len: 1310 microversion: 2.1 time: 0.391089 Oct 06 13:10:26.147602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2222/4422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:25 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 1310 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:26.177398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:26.178338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:26.195323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:26.196109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:26.197651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:26.201181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:26.202442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:26.207366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:27.204721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:27.216107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-152608ba-a7df-4066-93e4-42dcf1223a2e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1501 microversion: 2.1 time: 1.062867 Oct 06 13:10:27.244612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2223/4423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:26 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1501 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:27.261931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:27.269694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:27.300883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:27.301688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:27.302328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:27.303238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:27.303873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:27.304470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.004531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:28.012995 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a0c5c53-c171-437a-8c10-24491ac26d54 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.767220 Oct 06 13:10:28.014471 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2224/4424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:27 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:28.019354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:28.019789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:28.039456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.040660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.041581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.042979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.043708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.053326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.241080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:10:28.244035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:10:28.244811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:10:28.246301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:10:28.246996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:10:28.272129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.273050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.273800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.279341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.280205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.280926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.335088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:10:28.341811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Getting quotas for user dda013ee00f241fe86330565456fc678 and project f542e391c37440a0901558ec9c88eb29. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:10:28.375012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:10:28.382162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:10:28.497764 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e16334d5-af33-41a4-8001-22720e06f4cc tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.625026 Oct 06 13:10:28.499343 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2201/4425] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:10:28.511704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:28.515030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:28.533103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.533917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.534222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.537988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.538513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.539078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.870834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:28.879485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:28.880958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:28.882193 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75c4b1bd-d38e-4a42-b88d-45a7f657e338 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.866682 Oct 06 13:10:28.882768 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2225/4426] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:28 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:28.896202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:28.896871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:28.925334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.925873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.926327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.927045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:28.927537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:28.927945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:28.982129 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b HTTP/1.1 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b429baa5-454a-4d95-936d-f7f1b1562d0b'} Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:28.984675 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:28.988793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:28.991025 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86080dd2-4400-439b-9b5e-94726c7928a7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 404 len: 111 microversion: 2.1 time: 0.099265 Oct 06 13:10:28.998640 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2226/4427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:28 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:29.005258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.016366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.035724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.036230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.040192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.040970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.041454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.044452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.560200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:29.574255 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa15d1f9-720c-4928-9ad7-b67036d255ad tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1524 microversion: 2.1 time: 1.071526 Oct 06 13:10:29.590706 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2202/4428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:28 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1524 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:29.603350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-559026bf-0076-4568-a360-3e8a38102229 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.607001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-559026bf-0076-4568-a360-3e8a38102229 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.670535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:29.686844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07213348-cee3-4e55-b419-1b54614b7f9a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1515 microversion: 2.1 time: 0.685425 Oct 06 13:10:29.703321 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2227/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:28 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1515 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:29.712961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.713927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.721395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.722113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.722884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.725169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.725841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.726445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.754276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b HTTP/1.1 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b429baa5-454a-4d95-936d-f7f1b1562d0b'} Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:29.758038 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.762731 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.781430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:29.783610 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71b7da9d-d45c-4795-b967-8661b962b2ff tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 404 len: 111 microversion: 2.1 time: 0.078842 Oct 06 13:10:29.788626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2228/4430] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:29 2022] DELETE /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:29.794156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.795646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.809811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.812617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.813291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.819756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.820248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.820889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.866600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-559026bf-0076-4568-a360-3e8a38102229 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:29.876449 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-559026bf-0076-4568-a360-3e8a38102229 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1220 microversion: 2.1 time: 0.283352 Oct 06 13:10:29.878842 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2203/4431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:29 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1220 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:29.883938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:29.887070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.895298 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/84ba3d5e-275d-44bd-a7d9-8310eacb7e3e/action HTTP/1.1 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 14 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: {"rescue": {}} Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '84ba3d5e-275d-44bd-a7d9-8310eacb7e3e', 'body': {'rescue': {}}} Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.903451 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. Oct 06 13:10:29.908030 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.909810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 404 to user: Instance 84ba3d5e-275d-44bd-a7d9-8310eacb7e3e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:29.911158 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-934a1234-93a7-4bcf-bdc9-53e2fea34d99 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/84ba3d5e-275d-44bd-a7d9-8310eacb7e3e/action" status: 404 len: 111 microversion: 2.1 time: 0.030826 Oct 06 13:10:29.912245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2204/4432] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:29 2022] POST /compute/v2.1/servers/84ba3d5e-275d-44bd-a7d9-8310eacb7e3e/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:29.920220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.920878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: b429baa5-454a-4d95-936d-f7f1b1562d0b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:29.927325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.927820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.928261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.928978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:29.929439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:29.929906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:29.954652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b HTTP/1.1 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'b429baa5-454a-4d95-936d-f7f1b1562d0b'} Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:29.963408 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:29.969446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance b429baa5-454a-4d95-936d-f7f1b1562d0b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:29.971760 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17fe32ac-10f1-4f24-b0dd-072c6a81b592 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b" status: 404 len: 111 microversion: 2.1 time: 0.058061 Oct 06 13:10:29.976076 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2205/4433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:29 2022] GET /compute/v2.1/servers/b429baa5-454a-4d95-936d-f7f1b1562d0b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:29.998737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:29.999523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.006418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.006924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.007371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.008094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.008553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.008984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.480113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:30.507692 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5d1a4424-9cc6-4d32-8340-5dc71de2a3e9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.716352 Oct 06 13:10:30.511138 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2229/4434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:29 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:30.528833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:30.530234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.537894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:30.543772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.544535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.547426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.548174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.551250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.553333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:30.554977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:30.555132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.556679 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc80d22b-eed2-49be-967c-83fbfcaf4468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.578906 Oct 06 13:10:30.557726 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2206/4435] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:29 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:30.565659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:30.566844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.575048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.575795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.577024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.578116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.578844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.580671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.605769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e HTTP/1.1 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ee5a13a4-ab7d-4469-9425-dc100582036e'} Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:30.609932 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.615950 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.618633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:30.620069 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6e28952d-cb32-416b-b010-b0c9562bfdbc tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 404 len: 111 microversion: 2.1 time: 0.060445 Oct 06 13:10:30.620872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2207/4436] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:30 2022] DELETE /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:30.628931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:30.630237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.641654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.642760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.643443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.644585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.645234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.645976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.703127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a03585b-12dc-43ae-8c3b-67455cfa0826 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action" status: 202 len: 0 microversion: 2.1 time: 0.187526 Oct 06 13:10:30.707877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2230/4437] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:30 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:10:30.718249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:30.719267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: ee5a13a4-ab7d-4469-9425-dc100582036e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.727584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.728352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.728998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.729820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.730480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.730912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.759685 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e HTTP/1.1 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ee5a13a4-ab7d-4469-9425-dc100582036e'} Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:30.771668 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance ee5a13a4-ab7d-4469-9425-dc100582036e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cd789f7d-1616-4225-9abc-70242ca8f82a tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e" status: 404 len: 111 microversion: 2.1 time: 0.064502 Oct 06 13:10:30.776032 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2231/4438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:30 2022] GET /compute/v2.1/servers/ee5a13a4-ab7d-4469-9425-dc100582036e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:30.787503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:30.789237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:30.803678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.811116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.811935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:30.813049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:30.813755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:30.814416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.708375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:31.722266 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c64952bd-51fe-4f08-b725-4d40dd5153d4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1506 microversion: 2.1 time: 1.100042 Oct 06 13:10:31.734669 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2208/4439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:30 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1506 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:31.745722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:31.746638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:31.754437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.755373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.756099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.757286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.758146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.758818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.771058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:31.776390 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d HTTP/1.1 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '8f4cd4c1-c809-4afe-a4ff-2026752b777d'} Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:31.778214 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:31.784312 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:31.789318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:31.790481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10ac05fe-ca0e-4594-ba14-bb22395d1715 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 404 len: 111 microversion: 2.1 time: 0.054468 Oct 06 13:10:31.791297 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2209/4440] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:31 2022] DELETE /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:31.795730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b0ddd61-fa82-495c-8010-47e578c38058 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1520 microversion: 2.1 time: 1.013556 Oct 06 13:10:31.796382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2232/4441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:30 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1520 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:31.800640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:31.801274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:31.804715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:31.805672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:31.807971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.808653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.809216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.810110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.810763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.811349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.814093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.814837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.815461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.816249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.817114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.821327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.968817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:31.976951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c7fdd50-af50-4cc1-88c7-39f882f2b709 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1278 microversion: 2.1 time: 0.181232 Oct 06 13:10:31.977808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2210/4442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:31 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:31.982781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:31.983572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:31.996309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.997041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:31.997553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:31.998902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:31.999569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.000276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.494734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:32.503938 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad0fb798-d9d1-4321-8af1-057957c94ae3 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.704989 Oct 06 13:10:32.504738 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2233/4443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:31 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:32.511784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.512553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 8f4cd4c1-c809-4afe-a4ff-2026752b777d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.520798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.521291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.521728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.522455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.522914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.523339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.540087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d HTTP/1.1 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8f4cd4c1-c809-4afe-a4ff-2026752b777d'} Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.542072 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.547354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 8f4cd4c1-c809-4afe-a4ff-2026752b777d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.548075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:32.549543 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0752ec36-5765-444d-ba27-544c7f478727 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d" status: 404 len: 111 microversion: 2.1 time: 0.040072 Oct 06 13:10:32.549543 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2234/4444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:32 2022] GET /compute/v2.1/servers/8f4cd4c1-c809-4afe-a4ff-2026752b777d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.559257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.559871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.565479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:32.567206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:32.568086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.568706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.569753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.570745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.571146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.571413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dfd37777-9a35-41c5-bc55-28d61a8cf172 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.589457 Oct 06 13:10:32.571878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.572043 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2211/4445] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:31 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:32.591556 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 HTTP/1.1 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3487538d-f8ac-49b5-b551-8765c92c2b62'} Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.593985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.597927 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.600766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.601924 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a59fd3d5-4e49-449d-905a-7da3ad8e6844 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 404 len: 111 microversion: 2.1 time: 0.047752 Oct 06 13:10:32.602722 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2235/4446] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:32 2022] DELETE /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.611402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.612025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 3487538d-f8ac-49b5-b551-8765c92c2b62] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.619032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.619534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.620117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.620848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.621302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.621952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.638464 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 HTTP/1.1 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3487538d-f8ac-49b5-b551-8765c92c2b62'} Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.640235 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. Oct 06 13:10:32.644970 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.646288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 3487538d-f8ac-49b5-b551-8765c92c2b62 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.647303 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49fe9142-f938-441f-8bc3-47058fbca820 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62" status: 404 len: 111 microversion: 2.1 time: 0.040486 Oct 06 13:10:32.648479 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2212/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:32 2022] GET /compute/v2.1/servers/3487538d-f8ac-49b5-b551-8765c92c2b62 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.658444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.659058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.666247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.667354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.668037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.669084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.670345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.671051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.688240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 HTTP/1.1 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'bfdd73eb-16ee-44a7-9c96-e88480cd7330'} Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.690237 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.696427 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.699761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.700992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27b61eb4-5d34-485f-a998-12f625ccace7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 404 len: 111 microversion: 2.1 time: 0.047797 Oct 06 13:10:32.701960 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2236/4448] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:32 2022] DELETE /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.710620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.711169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: bfdd73eb-16ee-44a7-9c96-e88480cd7330] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.732065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.733147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.735466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.736280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.736741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.737186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.750103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.750814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.761053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.761637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.762170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.762312 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 HTTP/1.1 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'bfdd73eb-16ee-44a7-9c96-e88480cd7330'} Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.763861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.768365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance bfdd73eb-16ee-44a7-9c96-e88480cd7330 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.768863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.768947 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ddb1a49-7b2d-4d34-9a6c-dadb669d10a1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330" status: 404 len: 111 microversion: 2.1 time: 0.058980 Oct 06 13:10:32.769030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.769030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.769179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2213/4449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:32 2022] GET /compute/v2.1/servers/bfdd73eb-16ee-44a7-9c96-e88480cd7330 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.776453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.777287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.786057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.786869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.787569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.789014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.790213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.790915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.816917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 HTTP/1.1 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '20d0f2ba-f7f9-4f5c-8536-fc4f1768b411'} Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:32.819200 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:32.823924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:32.826611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:32.827841 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2fa5212-904a-4f10-8980-f10831aecfd1 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 404 len: 111 microversion: 2.1 time: 0.057503 Oct 06 13:10:32.829101 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2214/4450] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:32 2022] DELETE /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:32.835156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:32.836536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:32.844967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.845840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.846807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:32.847696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:32.848367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:32.848944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.209407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:33.218755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:33.222893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aac690cc-66ab-4e2f-a01e-916e5af5680c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1506 microversion: 2.1 time: 0.478122 Oct 06 13:10:33.225053 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2237/4451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:32 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:33.231871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:33.234300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.245980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.249419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.250399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.252944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.254358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.256561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.287749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 HTTP/1.1 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '20d0f2ba-f7f9-4f5c-8536-fc4f1768b411'} Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.289727 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. Oct 06 13:10:33.293899 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.297894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:33.299063 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-697716d2-2dc6-4112-b530-71743fa7c522 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411" status: 404 len: 111 microversion: 2.1 time: 0.072117 Oct 06 13:10:33.299249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:33.300056 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2238/4452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:33 2022] GET /compute/v2.1/servers/20d0f2ba-f7f9-4f5c-8536-fc4f1768b411 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:33.308137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:33.309264 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-419abe6d-b0c9-448c-a9ad-15d5efb921ea tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1500 microversion: 2.1 time: 0.478765 Oct 06 13:10:33.309447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.310253 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2215/4453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:32 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1500 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:33.326610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.327302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed120aa5-ed81-4986-a4b7-3de3be7f8603", "name": "network-vif-unplugged", "status": "completed", "tag": "fff21119-da37-4cfc-8797-999c10981220"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:33.327904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.328366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.329143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.329712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.330213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.349879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.350367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.350809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.370547 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] Creating event network-vif-unplugged:fff21119-da37-4cfc-8797-999c10981220 for instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 on n-h2-860556-1 Oct 06 13:10:33.380051 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4344d862-5d91-4adc-ab0e-4f5976c0e9e6 req-806fdb30-5341-4303-81d3-91c57cc0b66e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056826 Oct 06 13:10:33.384673 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2216/4454] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:33.392715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:33.393328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.401566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e HTTP/1.1 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5e037f4b-32f0-441b-b03a-b08633c1c99e'} Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.405045 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9680abe1-b508-42ca-925c-85c54b0f1802 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e" status: 404 len: 111 microversion: 2.1 time: 0.021996 Oct 06 13:10:33.409340 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2217/4455] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:33 2022] DELETE /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:33.415316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:33.418563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.428332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.429259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.430020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.431060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.431727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.432472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.449086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:33.489207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lazy-loading 'flavor' on Instance uuid dfd0fa67-05ab-4aa9-8b83-bbac6933a041 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:33.512396 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Cannot 'rescue' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state paused Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action HTTP/1.1 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 14 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: {"rescue": {}} Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'rescue' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state paused Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'dfd0fa67-05ab-4aa9-8b83-bbac6933a041', 'body': {'rescue': {}}} Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 in vm_state paused. Cannot rescue while the instance is in this state. Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state paused Oct 06 13:10:33.517039 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state paused Oct 06 13:10:33.521498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.524422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 409 to user: Cannot 'rescue' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state paused {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:33.525563 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00f21d3f-6c1b-4ef0-bc1a-d68087b718af tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action" status: 409 len: 144 microversion: 2.1 time: 0.115681 Oct 06 13:10:33.526976 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2218/4456] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:33 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action => generated 144 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:10:33.534908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5486573-4894-43fb-b47d-8a8f3a54ce3f", "tag": "4b7df47e-0c0f-4f66-8099-1346fc8dee39"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:33.547472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.548087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.548718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.562690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] Creating event network-changed:4b7df47e-0c0f-4f66-8099-1346fc8dee39 for instance a5486573-4894-43fb-b47d-8a8f3a54ce3f on n-h1-860556-1 Oct 06 13:10:33.568576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a17f2557-3c5b-4488-92a8-0c2cb014a9dd req-df562832-233b-47ce-ad36-c4ba873d87f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039813 Oct 06 13:10:33.569565 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2219/4457] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:33.575022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:33.576475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 5e037f4b-32f0-441b-b03a-b08633c1c99e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.584106 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e HTTP/1.1 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5e037f4b-32f0-441b-b03a-b08633c1c99e'} Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:33.586026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 5e037f4b-32f0-441b-b03a-b08633c1c99e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:33.590689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-041c124d-a2e4-4fba-bdbb-7110e59e7ae0 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e" status: 404 len: 111 microversion: 2.1 time: 0.018561 Oct 06 13:10:33.593050 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2220/4458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:33 2022] GET /compute/v2.1/servers/5e037f4b-32f0-441b-b03a-b08633c1c99e => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:33.599457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:33.600281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.610558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.611165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.611738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.612608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.614081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.614765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.938625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:33.951024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-736de1fe-7633-49be-8a8c-de3aaf0f67ab tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.649636 Oct 06 13:10:33.952761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2239/4459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:33 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:33.970536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:33.971522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:33.979709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.981609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.983018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:33.984510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:33.985175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:33.986358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.059648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:34.072415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4f70b18-f1d1-499a-b7ae-287f336a7f73 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.477818 Oct 06 13:10:34.077215 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2221/4460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:33 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:34.087893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:34.089970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:34.109105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.109618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.110134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.116971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.117473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.117966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.149898 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-618a3de5-2007-42ec-ab76-d756846c91f7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action" status: 202 len: 0 microversion: 2.1 time: 0.195038 Oct 06 13:10:34.151809 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2240/4461] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:33 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:10:34.166407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:34.168138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:34.182987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.184823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.186592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.188264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.190457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.191183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.238818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:10:34.382703 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6a2d03e-2bb8-4bed-8a4f-a9bc6a9b56f3 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 204 len: 0 microversion: 2.1 time: 0.224242 Oct 06 13:10:34.385923 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2241/4462] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:34 2022] DELETE /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:10:34.394800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:34.395951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:34.408978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.409969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.410651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.411687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.412395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.413281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.804244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:34.813263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:34.817566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:34.826507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:34.826748 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77a4cbba-5282-4bfe-90bd-1dd8a0f20c34 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1507 microversion: 2.1 time: 0.438724 Oct 06 13:10:34.827965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:34.832325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-acd34136-787a-4439-839b-99f7f083dd74 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.753612 Oct 06 13:10:34.833153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2222/4463] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:34 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:34.837768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:34.839758 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2242/4464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:34 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:34.840979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:34.851183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:34.851824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:34.858934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:34.861021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.861453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.861984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.862110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.862463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.862875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.863190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.863657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.864093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:34.864761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:34.867289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:34.868118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.178063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:35.178802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:35.190132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0652005f-76f3-436e-b3ec-a6d05468dfb1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 200 len: 1449 microversion: 2.1 time: 0.355570 Oct 06 13:10:35.190563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23c419f6-b3ef-45ca-a586-dfd4fde5ec28 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1479 microversion: 2.1 time: 0.349643 Oct 06 13:10:35.191168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2243/4465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:34 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1479 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:35.192096 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2223/4466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:34 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 1449 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:35.197601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0347be9b-8cd0-4927-a4a1-9a450136b421", "tag": "f2eba058-d524-45d7-9092-5a055d1a9909"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:35.209042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.209946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.210689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.226587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:35.227209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:35.227927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] Creating event network-changed:f2eba058-d524-45d7-9092-5a055d1a9909 for instance 0347be9b-8cd0-4927-a4a1-9a450136b421 on n-h1-860556-1 Oct 06 13:10:35.235614 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bbe51cc5-ae97-4ef4-83a8-bd60dc04926f req-a01a747b-e8b5-4a76-bc9a-c09cfdf9d14c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041404 Oct 06 13:10:35.237254 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2224/4467] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:35.244629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:35.246493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:35.251655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.252381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.252747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.253463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.253952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.254379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.281536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.282641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.285342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.289465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.290430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.291155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.699528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:35.704869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:35.715999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ef59b63-1876-444b-ad11-98b62d6a1627 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.493181 Oct 06 13:10:35.716201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49e16e81-5b17-4f72-858d-3069f63dcbe0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.477116 Oct 06 13:10:35.717290 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2225/4468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:35 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:35.724622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:35.730099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:35.735637 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2244/4469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:35 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:35.742381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.743169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.743782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.745273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.746906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4361a7-1f89-41f0-bce2-0fd7d9911017", "tag": "7b35f39a-39a2-4f7b-997d-8d34c586440f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:35.747610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.748833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.772534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.773418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.773998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.803868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] Creating event network-changed:7b35f39a-39a2-4f7b-997d-8d34c586440f for instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 on n-h2-860556-1 Oct 06 13:10:35.819555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a5e19b4f-14e9-4b8e-ba9f-9b379f04e00f req-86632ff2-dbcb-42a3-b37d-e1f8567d94a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082454 Oct 06 13:10:35.820342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2245/4470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:35.823211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:10:35.836596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Working on deleting snapshot 61953bc1-fdbd-4ef6-8bf3-329800d88bb0 from shelved instance... Oct 06 13:10:35.858222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:35.859907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:35.879455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.880083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.883023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:35.883903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:35.884331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:35.884776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:36.424678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:36.448317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4205f71-6332-4d63-a547-86a29885c81a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1515 microversion: 2.1 time: 0.599243 Oct 06 13:10:36.449058 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2246/4471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:35 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1515 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:36.466283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:36.468681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:36.483864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:36.484413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:36.485979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:36.486997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:36.487832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:36.488461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:36.744803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:36.770131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:36.771004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Doing local delete in cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129614) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 06 13:10:36.772808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:36.773712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:36.774671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:36.775050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:36.776059 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 06 13:10:36.776292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d47afc9f-1034-497d-b456-e920f7ef5c4e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.316714 Oct 06 13:10:36.780979 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2247/4472] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:36 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:36.795421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:36.798014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] deallocate_for_instance() {{(pid=129614) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 06 13:10:36.816381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:36.824478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:36.825131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:36.825681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:36.826760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:36.827328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:36.827991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:37.622812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:37.636518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d545a18-5bd4-430e-8efb-cc2f89e38159 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1479 microversion: 2.1 time: 0.853854 Oct 06 13:10:37.641091 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2248/4473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:36 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1479 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:37.662883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:37.669112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:37.698903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:37.701358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:37.705511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:37.710068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:37.713937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:37.714895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:38.315313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:38.929593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:38.938598 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2958693-e5ca-45b7-ac67-a6b77838a649 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 1.295617 Oct 06 13:10:38.939212 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2249/4474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:37 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:38.952524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:38.953157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:38.969163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:38.971999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:38.974182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:38.975300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:38.978572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:38.979281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:39.448863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:39.474468 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7dd2479c-477f-4bb5-b1f8-8609ff716ade tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.528875 Oct 06 13:10:39.475796 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2250/4475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:38 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:39.492410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:39.495497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:39.518667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:39.519080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:39.522278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:39.523122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:39.523608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:39.524059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:39.877345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:40.056367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Updating instance_info_cache with network_info: [] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:10:40.108808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:40.119269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:40.126993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:40.128300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39525ca4-1d91-4230-ac2a-53692961c131 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1744 microversion: 2.20 time: 0.650463 Oct 06 13:10:40.130519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2251/4476] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:39 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1744 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:40.137396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:40.138855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.153729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.155294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.155981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.161532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.164604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.167984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.229225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.230123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.230814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.231491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lazy-loading 'fault' on Instance uuid 154dffdc-e1fe-439f-9061-c89b7be5d49c {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:40.244709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:40.336335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7e547383b945d4b413fefa29185193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fffc04e8f4e588bf1f3cb4182aa3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:40.339153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:40.352352 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ea3b238-9870-4d21-b0fd-89dea43f3564 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 200 len: 1283 microversion: 2.1 time: 0.218789 Oct 06 13:10:40.354141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2252/4477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:40 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 1283 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:40.366735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:40.377416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.398713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.403396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.407883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.416410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9905842-bc32-48b5-80b2-2168705d3714 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 204 len: 0 microversion: 2.1 time: 4.697803 Oct 06 13:10:40.422833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.423341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.423788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.424328 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2226/4478] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:10:35 2022] DELETE /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 0 bytes in 4706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:10:40.440126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154dffdc-e1fe-439f-9061-c89b7be5d49c", "name": "network-vif-deleted", "tag": "208ed6b6-a098-4f99-8907-1e44f8a52186"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:40.471656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.474283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.474824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.494480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lazy-loading 'flavor' on Instance uuid dfd0fa67-05ab-4aa9-8b83-bbac6933a041 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:10:40.514836 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] Creating event network-vif-deleted:208ed6b6-a098-4f99-8907-1e44f8a52186 for instance 154dffdc-e1fe-439f-9061-c89b7be5d49c on n-h1-860556-1 Oct 06 13:10:40.520394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-aa267cc8-535a-4551-88be-39f70ccd1610 req-bf67658b-30ed-4231-b2de-7edd80394db8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091190 Oct 06 13:10:40.521886 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2227/4479] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:40.528325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:40.530091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.539761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.540632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.541471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.545405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.546234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.546907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.627716 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f1d3209-984e-418a-9916-336eec376500 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action" status: 200 len: 32 microversion: 2.1 time: 0.270878 Oct 06 13:10:40.629203 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2253/4480] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:10:40 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:10:40.651266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:40.652494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.667072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.667719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.668258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.669196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.670904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.672188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.706669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 HTTP/1.1 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ed120aa5-ed81-4986-a4b7-3de3be7f8603'} Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:40.709161 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07dc811b-c9bd-4abe-a93a-00946a88fba6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 404 len: 111 microversion: 2.1 time: 0.079971 Oct 06 13:10:40.713381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2254/4481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:40 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:40.719180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:40.720703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.728031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.728746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.730339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.731305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.732685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.733320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.859294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:40.870219 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-03ba2854-314b-4a15-b0de-ece8f3f54098 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.344056 Oct 06 13:10:40.872922 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2228/4482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:40 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:40.886941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:40.888735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:40.901204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.905796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.906521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:40.907784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:40.908425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:40.909090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:41.422463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:41.437379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae26d9e0-abdd-44f4-9455-6fa4aa74935c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.720258 Oct 06 13:10:41.450658 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2255/4483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:40 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:41.462619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1065912250", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:41.576711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:10:41.673852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:41.682869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d49d6eb7-81f1-4073-9db0-3c23b115ed6d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.808401 Oct 06 13:10:41.689245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2229/4484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:40 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:41.694530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:41.701501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:41.722287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:41.723196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:41.723882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:41.724885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:41.725570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:41.726324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.027259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:42.046070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:42.047523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:42.048760 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9408cbff-99ef-44ac-b42b-88bdb9eff7df tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1744 microversion: 2.20 time: 0.358140 Oct 06 13:10:42.062146 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2230/4485] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:41 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1744 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:42.075489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:42.076923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] [instance: 154dffdc-e1fe-439f-9061-c89b7be5d49c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:42.084777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.085556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.086192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.087865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.088509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.089102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.129433 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] HTTP exception thrown: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Request method failure captured: Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c HTTP/1.1 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtK6-jl8F823vrg3iM_IFmr3uu-QEB6E6DmvKVSaB1Z20Zsji_-3kRhin_KdOuSWu-6EPrFSGZr1jmo1IFBDme3Wi7k2dF-YzBuVVW9PrmZ5ywWtd22PwPrd_KIUhpEGBbJqvNjVuY17zRAKDh2QkSw3cKK6de_6io61hl4xC6xkMBM Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169fffc04e8f4e588bf1f3cb4182aa3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169fffc04e8f4e588bf1f3cb4182aa3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169fffc04e8f4e588bf1f3cb4182aa3b"}]}] Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersTestJSON-2081219367 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 169fffc04e8f4e588bf1f3cb4182aa3b Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersTestJSON-2081219367 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2c7e547383b945d4b413fefa29185193 Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersTestJSON-2081219367-project Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '154dffdc-e1fe-439f-9061-c89b7be5d49c'} Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:42.132650 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] Returning 404 to user: Instance 154dffdc-e1fe-439f-9061-c89b7be5d49c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-333fae4a-7af8-4e96-8c51-e7c8a9a31ac7 tempest-ServersTestJSON-2081219367 tempest-ServersTestJSON-2081219367-project] 10.222.0.26 "GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c" status: 404 len: 111 microversion: 2.1 time: 0.071675 Oct 06 13:10:42.136986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2231/4486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:42 2022] GET /compute/v2.1/servers/154dffdc-e1fe-439f-9061-c89b7be5d49c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:10:42.145881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5486573-4894-43fb-b47d-8a8f3a54ce3f", "name": "network-vif-plugged", "status": "completed", "tag": "4b7df47e-0c0f-4f66-8099-1346fc8dee39"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:42.163756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.164322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.165091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.173472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:42.190612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] Creating event network-vif-plugged:4b7df47e-0c0f-4f66-8099-1346fc8dee39 for instance a5486573-4894-43fb-b47d-8a8f3a54ce3f on n-h1-860556-1 Oct 06 13:10:42.200577 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5d316eca-91ea-4423-b6eb-56d4549cf47f req-3906c089-2ed1-4c35-81e3-02843094d100 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061771 Oct 06 13:10:42.202213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2232/4487] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:42.208277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:42.209883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:42.218797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.219508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.220163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.221388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.222077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.222777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.890746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:42.903468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36df1b10-beb3-4e7a-9375-cc159bbd6b22 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.699779 Oct 06 13:10:42.906175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2233/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:42 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:42.914257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:42.921783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:42.937872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.938388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.938839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:42.939567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:42.940031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:42.940465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.548533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:43.556555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0450e4f-1cfa-4418-a278-4e239b1a70a1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.649102 Oct 06 13:10:43.557335 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2234/4489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:42 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:43.580638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed120aa5-ed81-4986-a4b7-3de3be7f8603", "name": "network-vif-deleted", "tag": "fff21119-da37-4cfc-8797-999c10981220"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:43.597256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.597767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.598383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.616531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.server_external_events [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] Unable to find a host for instance ed120aa5-ed81-4986-a4b7-3de3be7f8603. Dropping event network-vif-deleted {{(pid=129614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 13:10:43.617435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3dbcbf44-fd3f-43e4-bec6-fbe7e8cfdcfe req-ffab8761-0db0-460b-b527-dc4b4b459969 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.046632 Oct 06 13:10:43.618489 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2235/4490] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 13:10:43.626762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:43.627603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:43.639807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.640766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.641285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.642167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.642885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.643858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.686948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:10:43.689652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:10:43.690916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:10:43.692108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:10:43.693619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:10:43.710008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.710505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.713144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.713144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.713144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.713144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.735116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:10:43.752754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:10:43.769855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:10:43.772784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:10:43.874243 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-162723ad-0b78-498d-98a6-0c7e22050b8c tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.421459 Oct 06 13:10:43.878486 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2256/4491] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:10:43.883606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:43.885121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:43.887658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:43.898866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.899951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.901614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:43.904169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:43.905227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:43.905932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:44.157795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:44.173552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-adcefccc-5c55-4404-9404-285cb3578f7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.553053 Oct 06 13:10:44.185885 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2236/4492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:43 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:44.207333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5cbc688-80e9-4832-9e83-7589468fb8a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:44.207956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5cbc688-80e9-4832-9e83-7589468fb8a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:44.313029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5cbc688-80e9-4832-9e83-7589468fb8a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:44.328125 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5cbc688-80e9-4832-9e83-7589468fb8a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1215 microversion: 2.1 time: 0.139926 Oct 06 13:10:44.329631 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2237/4493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:44 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:44.343335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:44.345275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:44.353153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:44.354417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:44.355234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:44.357264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:44.358142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:44.359005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:44.459081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:44.475523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:44.486399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:44.487884 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-390d153c-19ab-43ba-8768-cd0e0ff658e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1744 microversion: 2.20 time: 0.608250 Oct 06 13:10:44.489169 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2257/4494] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:43 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1744 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:44.497450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "name": "network-vif-plugged", "status": "completed", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:44.531031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:44.545659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:44.546258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:44.585255 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] Creating event network-vif-plugged:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h2-860556-1 Oct 06 13:10:44.608859 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f45bdffd-eaaf-417e-a85f-b5bd6c19d205 req-c2802be2-29ea-48fb-a6dd-d79f7f80e33f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116787 Oct 06 13:10:44.609775 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2258/4495] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:44.631778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:44.647016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:44.665177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:44.665998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:44.667540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:44.668276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:44.669236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:44.669915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.312595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:45.333260 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c7f8d8f-f304-4a9d-a937-380f51d3c0f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 1.000920 Oct 06 13:10:45.334170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2238/4496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:44 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:45.350286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:45.358050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:45.379588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.380498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.380862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.385575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.394240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.396918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.585539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:45.594478 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b92cefb4-2a16-40c7-bfe2-b6b13f47399f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.983277 Oct 06 13:10:45.606719 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2259/4497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:44 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:45.616261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:45.617204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:45.624828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.626334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.627329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.628547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.629371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.630062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.753522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:45.760288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:45.762424 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-258e0348-6dd0-48aa-9b0c-ea24650f6930 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1267 microversion: 2.1 time: 0.154225 Oct 06 13:10:45.777765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2260/4498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:45 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:45.778255 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8f6dfe5-395c-4e9c-b230-c7a6db279583 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.436305 Oct 06 13:10:45.778255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2239/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:45 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:45.778414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:45.778688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:45.796940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.797643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.798033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:45.798737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:45.803315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:45.803817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:46.087451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:46.122434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:46.124770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:46.126192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d24ec81b-c0c2-4d9f-87e5-85c0f5cf5d4d tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1744 microversion: 2.20 time: 0.357735 Oct 06 13:10:46.128124 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2261/4500] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:45 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:46.371229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:46.371894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:46.380718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:46.381766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:46.385651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:46.386571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:46.387269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:46.392499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:46.620048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:46.621394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:46.628857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:46.629620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:46.630537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:46.631635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:46.632322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:46.632953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:46.930648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:46.954880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b5a412b-0151-462f-aabd-8ca9b12044bf tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.587712 Oct 06 13:10:46.955601 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2240/4501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:46 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:46.972301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0347be9b-8cd0-4927-a4a1-9a450136b421", "name": "network-vif-plugged", "status": "completed", "tag": "f2eba058-d524-45d7-9092-5a055d1a9909"}, {"server_uuid": "9d4361a7-1f89-41f0-bce2-0fd7d9911017", "name": "network-vif-plugged", "status": "completed", "tag": "7b35f39a-39a2-4f7b-997d-8d34c586440f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:47.007668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.012608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.013572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.057198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Creating event network-vif-plugged:f2eba058-d524-45d7-9092-5a055d1a9909 for instance 0347be9b-8cd0-4927-a4a1-9a450136b421 on n-h1-860556-1 Oct 06 13:10:47.058039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] Creating event network-vif-plugged:7b35f39a-39a2-4f7b-997d-8d34c586440f for instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 on n-h2-860556-1 Oct 06 13:10:47.092157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f0108aad-12c4-4bc3-8ae8-c04bc8a6c828 req-6cf56baa-a494-4ff0-9f00-ccfaa2f5eaea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133437 Oct 06 13:10:47.093441 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2241/4502] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:47.104454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:47.105521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:47.113185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.114669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.115812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.116970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.117447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.117934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.268423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:47.285940 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dee11ac0-e7ba-46b8-b8d0-7134a4c4c768 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.669596 Oct 06 13:10:47.292784 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2262/4503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:46 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:47.298757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:47.305780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:47.317963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.320612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.321394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.323761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.324480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.327674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.329320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:47.337670 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51dc8677-c854-4b44-be39-a35f015cb2ae tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1273 microversion: 2.1 time: 0.238311 Oct 06 13:10:47.350041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2242/4504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:47 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:47.356296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:47.358294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:47.401283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.404736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.407252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.411576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:47.421938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:47.422850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:47.989278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.007944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.010023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.013223 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d22fa988-79f6-4ef3-82ae-36aca1378160 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.669888 Oct 06 13:10:48.015409 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2243/4505] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:47 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:48.030208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:48.031600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:48.040115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.040960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.041608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.042542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.043182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.043801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.065215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.078538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f889c5a-5524-44d6-9efb-2ce4da3162ce tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.784000 Oct 06 13:10:48.091951 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2263/4506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:47 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:48.301049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.309096 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e349b3ab-bb9c-4d1d-a4f1-a316da8dff12 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.292405 Oct 06 13:10:48.316364 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2244/4507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:48 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:48.336855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:48.338995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:48.345832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.346597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.347875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.348981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.351978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.352905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.367687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:48.369481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:48.380024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.382118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.382796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.386266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:48.390439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:48.391146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:48.944054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:48.952077 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95468da8-4f36-405e-bc10-559365b3e0d3 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 0.590851 Oct 06 13:10:48.976053 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2245/4508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:48 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:49.029516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:49.043713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:49.044629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:49.052650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dbb03b6f-29ed-4426-bd20-23847ed0ab4a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1320 microversion: 2.1 time: 0.723588 Oct 06 13:10:49.054688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.057057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.060703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.061195 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2264/4509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:48 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1320 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:49.062367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.063480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.067653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.104337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:49.105578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:49.115555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.116064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.116506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.124940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.125994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.126674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.565627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:49.582487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:49.586481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:49.588877 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7f39e5b9-a28a-4c01-9c46-e0aca554d468 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.549055 Oct 06 13:10:49.614535 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2246/4510] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:49 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:10:49.625675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:49.630830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:49.650640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.655431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.656327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.659456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:49.660225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:49.660895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:49.887535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:49.897677 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6e34b7e0-388c-4ab8-b758-a70ffa2c3fdc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.797103 Oct 06 13:10:49.918486 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2265/4511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:49 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:10:49.994420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:49.995672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:50.011902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.013218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.019225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.020142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.020693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.021969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.057174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:50.070097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-632fed49-b9a2-4d80-b935-55b8e4b26b9b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.453845 Oct 06 13:10:50.094345 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2247/4512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:49 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:50.107732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:50.109654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:50.123542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.124428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.125098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.126059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.130283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.131030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.562647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:50.585480 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-205e8ae4-e618-4577-be3a-455f1a5ee928 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 0.610627 Oct 06 13:10:50.601764 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2266/4513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:49 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:50.627936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:50.628721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:50.649125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.651414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.652196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.657991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.672507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.675785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.722022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:50.736169 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-686423dd-5c61-472b-b2bc-c0e84e22d110 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1510 microversion: 2.1 time: 0.640007 Oct 06 13:10:50.737151 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2248/4514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:50 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1510 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:50.760519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:50.760906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:50.771702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.782219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.786552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:50.787679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:50.788346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:50.789034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:51.452393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:51.472440 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b7a1694b-7aa3-414b-93c3-35d125c8ac65 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1511 microversion: 2.1 time: 0.716754 Oct 06 13:10:51.498725 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2249/4515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:50 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1511 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:51.513845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:51.514478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:51.530480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:51.531003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:51.531458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:51.534405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:51.535158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:51.535341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:51.548125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:51.570107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:51.576703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:51.580703 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d283ac4-cbf3-45c5-a41f-c9648235d49a tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.964066 Oct 06 13:10:51.584092 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2267/4516] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:50 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:51.592458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:51.603054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:51.623864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:51.625726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:51.626719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:51.634733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:51.635476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:51.636175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:52.622108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:52.635159 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-947232eb-9e1d-4a8f-a379-44bf0ac3c372 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 1.139915 Oct 06 13:10:52.635836 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2250/4517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:51 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:52.652169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:52.657051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:52.669356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:52.672857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:52.674167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:52.675092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:52.678251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:52.679731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:52.683452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:52.693008 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2457faae-7fe9-48ec-b1c3-1ca62fb055a0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 1.104821 Oct 06 13:10:52.710942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2268/4518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:51 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:52.719739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:52.721118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:52.743950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:52.744703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:52.745309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:52.746234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:52.746932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:52.748159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:52.789412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:53.726269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:53.762778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:53.870344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:53.901173 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2dd19318-8b23-420b-bc6e-427d926881a1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 1.188801 Oct 06 13:10:53.907795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2269/4519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:52 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:53.916815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:53.921495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:53.932931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:53.933884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:53.934032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47263dc9-fcb3-4020-8a05-95b90d79b54b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1512 microversion: 2.1 time: 1.291327 Oct 06 13:10:53.942159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:53.943654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:53.944335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:53.945330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:53.946788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:53.947655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:53.951116 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2251/4520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:52 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1512 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:53.964864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3f7f79-d045-4458-b548-bf0b530bbc3d", "tag": "070e77d4-a27e-4cd8-98f8-d64143b4ff2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:53.994598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:53.995101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:53.995553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.024206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] Creating event network-changed:070e77d4-a27e-4cd8-98f8-d64143b4ff2d for instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d on n-h1-860556-1 Oct 06 13:10:54.035905 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d5ecfe89-466b-42b8-9cb5-6e1965848556 req-95eec88a-5981-465b-9e1a-c4a519227b12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083437 Oct 06 13:10:54.041339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2252/4521] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:10:54.059568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:54.062346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:54.079091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.082607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.087365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.088475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.089200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.089898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.326940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:10:54.469781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:54.495641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:54.500711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:54.503540 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-781e09e1-ef89-4b72-87b7-f5647faf8f98 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.594655 Oct 06 13:10:54.506945 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2270/4522] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:53 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:54.520865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:54.525107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:54.541977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.548424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.549179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.557261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.558407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.559067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.620003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:54.635651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ed7ed17-6e82-4227-8a86-85d07b017035 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.592576 Oct 06 13:10:54.637581 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2253/4523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:54 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:54.662238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:54.689379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:54.700968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:10:54.744041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.746940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.747370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:54.748188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:54.748663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:54.749099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.047924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:10:55.126756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:55.141419 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a80ab4b4-3683-44b0-a1ab-a119676b6a29 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1504 microversion: 2.1 time: 0.633259 Oct 06 13:10:55.142286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2271/4524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:54 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:55.147068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:55.147962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:55.155743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.156433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.157042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.158267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.158918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.159521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.231864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:55.247005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.248060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.249445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.541045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:55.554609 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0f7f491-e020-4d6f-bd36-d7166ccd7ad5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 0.410883 Oct 06 13:10:55.560680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2272/4525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:55 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:55.565875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:55.594679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:55.623527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.624029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.624476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.625192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.625652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.626111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.679533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b96c11a-73f6-4c16-b1bc-756eab46f898 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.039896 Oct 06 13:10:55.681179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2254/4526] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 13:10:54 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:55.689089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:55.691353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:55.717965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.718498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.721966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:55.724530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:55.724978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:55.725428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:56.582212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:56.592514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:56.602795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:56.615451 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d25b40ef-4510-43b4-a16b-88231a9b6cb7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 1.053360 Oct 06 13:10:56.620059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2273/4527] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:55 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:56.634382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:56.640131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:56.661125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1221483330', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:56.735684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:56.986345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:56.995743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55499c73-b08b-4307-8c48-f13437359c86 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 1.312568 Oct 06 13:10:57.005866 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2255/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:55 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:57.020528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:10:57.021696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:57.027745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:57.047655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.048174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.048630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.054360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.055047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.056233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.244938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:57.258373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.261274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.264351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.710396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:57.720862 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb63c9e1-c4d4-4ce5-9123-bbe1a286f357 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1484 microversion: 2.1 time: 0.712937 Oct 06 13:10:57.742493 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2256/4529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:57 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1484 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:57.751434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:57.761521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:57.811506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.818545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.819360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.826176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.827093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.828922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.908723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-947f1bc1-7732-449f-bdc5-22c02129a5cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1221483330" status: 200 len: 1514 microversion: 2.1 time: 1.287460 Oct 06 13:10:57.909555 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2274/4530] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:10:56 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1221483330 => generated 1514 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:57.914510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:57.915834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:57.951777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.955830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.956335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:57.961754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:57.964283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:57.964839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:58.883367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:58.894852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:58.897867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:58.901194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3067f33-25aa-4234-9dcc-840a0cc377a5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.990363 Oct 06 13:10:58.923972 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2275/4531] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:10:57 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:10:58.934866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:58.941176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:58.944834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:10:58.956351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:58.957245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:58.957875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:58.959574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:58.960221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:58.960826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:58.978079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:58.987523 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e458eca-369e-42e4-829d-004c7b198d96 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 1.239814 Oct 06 13:10:58.991284 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2257/4532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:57 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:58.999195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:59.001617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:59.028198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.028898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.029467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.032393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.033306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.034612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.139265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:10:59.266598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:59.286882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.287791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.288616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.615764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:59.636322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62fff6d8-c99c-4a87-9e84-a999f06f9b97 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1501 microversion: 2.1 time: 0.640763 Oct 06 13:10:59.637675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2258/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:10:58 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1501 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:59.654755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-437676656", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:59.699701 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7480f00d-029b-4fa3-a486-910933b32e4b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.774451 Oct 06 13:10:59.713764 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2276/4534] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Oct 6 13:10:58 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:10:59.713764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6627285-05e3-4e7d-9592-41a43348e12f"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:10:59.713764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:10:59.736299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.740375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.744510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.745329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.745826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.746269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.815586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] validate_networks() for [('88baa1d6-9bc7-4188-9362-4661dd279cde', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:10:59.831784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Cannot 'attach_volume' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state rescued Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/os-volume_attachments HTTP/1.1 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 74 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: {"volumeAttachment": {"volumeId": "f6627285-05e3-4e7d-9592-41a43348e12f"}} Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'attach_volume' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state rescued Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'dfd0fa67-05ab-4aa9-8b83-bbac6933a041', 'body': {'volumeAttachment': {'volumeId': 'f6627285-05e3-4e7d-9592-41a43348e12f'}}} Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 06 13:10:59.836708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state rescued Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state rescued Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 409 to user: Cannot 'attach_volume' instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 while it is in vm_state rescued {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04d534ed-01f9-4f10-a73f-01481a2aab45 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.136374 Oct 06 13:10:59.846103 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2277/4535] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:10:59 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/os-volume_attachments => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:10:59.850414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:10:59.867415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:10:59.867865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.servers [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Removing options 'limit' from query {{(pid=129615) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 06 13:10:59.870522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:10:59.883194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.883594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.887258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.888700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:10:59.889556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:10:59.892161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:10:59.985962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:00.000856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:00.004491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:00.005021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.111587 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70d3d44d-369d-4e11-a74e-938cdb24a777 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 1.266480 Oct 06 13:11:01.112560 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2278/4536] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 13:10:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:01.121021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:01.122295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:01.142201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.143824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.145895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.147941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.148545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.149929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.316827 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dfb66922-c90c-47de-9148-a62ee8605ea9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action" status: 202 len: 0 microversion: 2.1 time: 0.202445 Oct 06 13:11:01.318304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:11:01.318859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:11:01.319437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:11:01.319966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:11:01.320565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:11:01.337685 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2279/4537] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:01 2022] POST /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:11:01.339110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.339779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.340294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.347882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.350501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:01.351226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.351450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:01.354463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.360339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.360759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.361207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.362112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.362634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.363071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.408482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Getting quotas for project 494f0709ae414368a797dd058a1d69bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:01.415419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Getting quotas for user 7f6a370d0e6a41efac924ac5c7e62ab3 and project 494f0709ae414368a797dd058a1d69bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:01.435589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:11:01.439213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:11:01.505333 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45d8c117-9bbb-437e-bb7a-96bc0bf3e67e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.865955 Oct 06 13:11:01.506359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2259/4538] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:10:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:11:01.514124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:01.515015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:01.542699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.548759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.549334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:01.558652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:01.562437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:01.563019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:02.678960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:02.689302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:02.696879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:02.708274 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea9fe946-c939-4b71-a732-4787225556f2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 1.367458 Oct 06 13:11:02.712414 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2280/4539] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:01 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:02.721331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:02.730278 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0ade02b3-4640-4358-935f-699384d78b7d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 1.220788 Oct 06 13:11:02.742203 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2260/4540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:01 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:02.743602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3f7f79-d045-4458-b548-bf0b530bbc3d", "name": "network-vif-plugged", "status": "completed", "tag": "070e77d4-a27e-4cd8-98f8-d64143b4ff2d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:02.758831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:02.760736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:02.761228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:02.761663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:02.773312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:02.778593 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] Creating event network-vif-plugged:070e77d4-a27e-4cd8-98f8-d64143b4ff2d for instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d on n-h1-860556-1 Oct 06 13:11:02.779655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:02.787457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-70860139-ae34-4748-8b19-18dd5a131424 req-883ac467-333d-4b34-b7ca-e9cb7348f626 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073442 Oct 06 13:11:02.788647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2281/4541] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:02.795676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:02.797477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:02.798101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:02.798712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:02.802405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:02.804480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:02.805189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:02.805939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:02.819178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:02.820004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:02.821178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:02.822114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:02.824705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:02.828148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.091914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:03.235698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c9c6ed3-32fa-491e-bfeb-d2a4196b5eec tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.483419 Oct 06 13:11:03.238837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2261/4542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:11:02 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:03.250961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:03.267850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:03.293718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.300919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.310472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.312510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.317137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.317613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.677841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:03.698246 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7df73e7b-6f47-4d37-b1d3-7c8a3663f97f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1265 microversion: 2.1 time: 0.448272 Oct 06 13:11:03.714221 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2262/4543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:03 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1265 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:03.725913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:03.739380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:03.739746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.servers [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Removing options 'limit' from query {{(pid=129614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 06 13:11:03.740733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:03.758647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.759142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.759590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.760404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.760870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.761298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.808717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:03.822975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0024a423-da3f-4ecb-9ec2-7cb02fdd77fe tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1509 microversion: 2.1 time: 1.032627 Oct 06 13:11:03.824253 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2282/4544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:02 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1509 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:03.829911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:03.833708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:03.840306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:03.867651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.867939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.872011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.873662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.878681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.879986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.933453 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a425654c-c3ea-4cbf-91d1-fe3b112b0f5a tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.217774 Oct 06 13:11:03.942462 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2263/4545] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Oct 6 13:11:03 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:03.951684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:03.961471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:03.969085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.970000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.973138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:03.974885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:03.975605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:03.976263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.222396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.232650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.258293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.259626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac0d9583-4c60-48e6-a8f4-a0194bb73314 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 1.432427 Oct 06 13:11:05.260956 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2283/4546] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:03 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:05.270593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:05.305845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.307200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:05.314712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.315448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.316048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.318073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.318761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.319347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.360503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.363114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:05.380605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdcbc34b-1199-4246-a659-224c255f59fa tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1315 microversion: 2.1 time: 1.435261 Oct 06 13:11:05.389293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2264/4547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:03 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1315 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:05.408058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:05.418129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:05.421751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:05.447210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:05.455714 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b44d5a2d-1065-4155-82ff-113a5dad7373 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.192657 Oct 06 13:11:05.461567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2284/4548] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:11:05 2022] GET /compute/v2.1/servers => generated 1011 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:05.465934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.465934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.465934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.466348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.468669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.470324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.486303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:05.487156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:05.494527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.495427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.496094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.497036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.498533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.499180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.835248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.850525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca0da57f-7c96-4380-8403-daa4cd482415 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1271 microversion: 2.1 time: 0.459062 Oct 06 13:11:05.854375 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2265/4549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:05 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:05.867998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:05.881754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:05.882747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:05.896011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.896802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.897436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:05.898385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:05.899019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:05.899620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.082042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:06.237332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:06.250889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ec5a861-eba3-4529-8f54-15d96a02cd5c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1509 microversion: 2.1 time: 0.780830 Oct 06 13:11:06.277406 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2285/4550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:05 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1509 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:06.303870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:06.304497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:06.324162 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39f91547-f96c-4ccc-ab08-4f70e80887c1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.467710 Oct 06 13:11:06.337863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.337863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.337863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.338274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.338790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.339250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.342855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2266/4551] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:11:05 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:06.352283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:06.387855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:06.390622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.servers [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Removing options 'limit' from query {{(pid=129614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 06 13:11:06.391797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:06.459629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.460513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.461057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.462498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.462498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.462903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.521994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-747b3cf6-8fd2-4b19-9666-e4029559090c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.177448 Oct 06 13:11:06.522922 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2267/4552] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Oct 6 13:11:06 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:06.536666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:06.537273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:06.568731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.570945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.572604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:06.575786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:06.576379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:06.576951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:07.982243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:07.986311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:07.996806 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50e4e2f4-c075-4938-91e8-ca9e0cca9ed9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1503 microversion: 2.1 time: 1.469974 Oct 06 13:11:08.000904 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2268/4553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:06 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1503 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:08.010278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:08.055503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:08.057015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1221483330', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:08.081591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.087820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.094128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:08.102527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:08.108194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.110397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:08.111236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.112985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:08.124032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:08.140289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1357968-a1fb-44c9-9db7-52bc0c6687d6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 1.840913 Oct 06 13:11:08.148566 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2286/4554] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:06 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:08.166529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:08.183285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:08.215487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.216049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.216486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:08.217700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.238787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.240139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:08.517674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:08.683659 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61c939f8-c56b-423b-82cf-df8fd272afe5 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1221483330" status: 200 len: 346 microversion: 2.1 time: 0.678263 Oct 06 13:11:08.696043 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2269/4555] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 13:11:08 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1221483330 => generated 346 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:08.702457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:08.703390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:08.712283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.713118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.714311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:08.715269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:08.716497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:08.717198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:09.301369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:09.316569 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f582782-04f7-4497-a120-583ef80c38d2 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 1.159029 Oct 06 13:11:09.332818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2287/4556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:08 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:09.344859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:09.360764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:09.367274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:09.368850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:09.401259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:11:09.630946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53dadca8-e8f5-438b-a10b-33ad57517446 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d/action" status: 202 len: 0 microversion: 2.1 time: 0.292669 Oct 06 13:11:09.636776 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2288/4557] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:09 2022] POST /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:11:09.686250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:09.742877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:09.751134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:09.751971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:09.752453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:09.762270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c054228-a93d-47f0-9e56-8a9fcd13e9ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1515 microversion: 2.1 time: 1.064684 Oct 06 13:11:09.766867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2270/4558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:08 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1515 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:09.792484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:09.798990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:09.821943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:09.822450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:09.822901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:09.832291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:09.832805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:09.834192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:09.900563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:11:09.992244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:10.086066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5d154ed6-c3fe-4d81-8155-dcdb2c9b4483 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "POST /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f/action" status: 202 len: 0 microversion: 2.1 time: 0.444706 Oct 06 13:11:10.090413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2289/4559] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:09 2022] POST /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:11:10.108848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:10.116004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:10.146298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:10.152485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:10.156029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:10.160315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:10.161076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:10.164850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:10.354345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:10.393435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:10.407133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:10.428279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-426d5dae-2b97-4e6c-ad09-145aaaea2ab2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.649638 Oct 06 13:11:10.428994 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2271/4560] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:09 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:10.447745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:10.454297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:10.480464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:10.481491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:10.483334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:10.493109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:10.495930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:10.501172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:11.038793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:11.055377 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c6e6edb-fc3f-4f9e-9018-170cc55cecde tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.961094 Oct 06 13:11:11.072280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2290/4561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:10 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:11.080960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:11.096176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:11.120224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:11.125695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:11.130578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:11.132644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:11.138941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:11.139642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:11.427587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:11.451780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:11.463386 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae2b6c59-58ad-4c61-94e3-995f81c86253 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1521 microversion: 2.1 time: 1.029712 Oct 06 13:11:11.465273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2272/4562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:10 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1521 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:11.478267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:11.479179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:11.500930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:11.501814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:11.529252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:11.533578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:11.535605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:11.554922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:11.900091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:11.928083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddfe2796-a44d-4de0-a1be-8206cacde69b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.849854 Oct 06 13:11:11.929433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2291/4563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:11 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:12.081392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:12.083868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:12.101439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:12.103034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:12.103813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:12.104859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:12.105645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:12.106294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.489151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:13.507696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:13.509395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:13.513729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8721a3a-b960-4189-b96b-d5d475f7d1e5 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 2.042844 Oct 06 13:11:13.516331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:13.517834 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2273/4564] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:11 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:13.526385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d78768-ccdc-460a-a0ab-2e2c2575a236", "tag": "f013e0a1-3a00-4ef2-b041-6a4091503a75"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:13.545063 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e7375f8-4e79-4f66-b111-42712e513f54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 1.467442 Oct 06 13:11:13.547623 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2292/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:12 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:13.551606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:13.553593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:13.554297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:13.554928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.566675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:13.585265 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] Creating event network-changed:f013e0a1-3a00-4ef2-b041-6a4091503a75 for instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 on n-h2-860556-1 Oct 06 13:11:13.599941 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-467f7df4-7466-4728-b754-f067e7f8d45f req-38385196-bc5a-4027-849c-b55e96dd8403 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078823 Oct 06 13:11:13.600839 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2274/4566] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:13.609508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:13.615106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:13.615927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:13.616615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.618746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:13.632065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:13.632601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:13.636430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:13.636650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:13.638476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.639965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.640887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:13.650911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:13.652242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:13.950091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:13.960310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7df702d1-7a17-412d-b543-e0addbee7ad0 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.356786 Oct 06 13:11:13.978271 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2275/4567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:13 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:14.077382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:14.113084 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed41da96-c959-486e-99c4-9dc7d73206d7 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1521 microversion: 2.1 time: 0.564075 Oct 06 13:11:14.114049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2293/4568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:13 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:14.119300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-418ab66f-2fde-4ffe-91cd-0ce9eb6e1034 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: .version_select at 0x7f7d3e2e14c0>, body: {"keypair": {"name": "tempest-keypair-112984061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaLhHa25J0Fxo6L0jSPwbwahfziRLBwjI4wyuO9jjfa4xHzLy9RehkhQwm3B8Nt9JPBouNCSvo7Rk1Bta6koYq2799XKdRl6NqlV1JqXDUlWcqI9m4fUTiK017PB3IYvQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:14.161704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-418ab66f-2fde-4ffe-91cd-0ce9eb6e1034 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:14.168179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-418ab66f-2fde-4ffe-91cd-0ce9eb6e1034 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for user db39e3800b574bb7abd3922b5ad8e282 and project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:14.250103 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-418ab66f-2fde-4ffe-91cd-0ce9eb6e1034 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133325 Oct 06 13:11:14.255096 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2276/4569] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:11:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:14.543063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:14.544496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:14.567670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=80 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:14.573082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:14.575272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:14.577211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:14.583814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:14.584621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:14.585818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:14.589968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:14.591401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:14.594551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:14.597093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:14.598376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:14.599144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:14.599786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:14.602583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:15.155016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:15.167935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:15.172460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:15.174627 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb864164-4ee7-44b8-9bd9-91c581702290 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.635769 Oct 06 13:11:15.176536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2294/4570] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:14 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:15.190591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:15.194240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:15.226632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:15.227133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:15.227654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:15.228557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:15.229185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:15.229858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:15.331614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:15.544820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:15.562595 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48742dba-0b0f-4d5d-b486-3d9a03d4017a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.991925 Oct 06 13:11:15.563199 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2277/4571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:14 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:15.567671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:15.568279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:15.582724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:15.583890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:15.584657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:15.585555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:15.588572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:15.589538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:15.913273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:15.944225 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bb8a82fc-95d5-4a98-a29b-483e94b363ab tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.763505 Oct 06 13:11:15.946300 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2295/4572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:15 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:16.143640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:16.156086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b20baae-8692-4c01-9083-6db34ee17f57 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1521 microversion: 2.1 time: 0.591780 Oct 06 13:11:16.158620 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2278/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:15 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:16.207995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c476976-f724-48be-ae5a-a3ab657a3cd7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: .version_select at 0x7f7d3e4c1040>, body: {"keypair": {"name": "tempest-keypair-1184475204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWVVebySTAi1/MtAbW4Jj7oA2QgFmboBXpHqsCJ9CAb1ZFypkWmTICWM/5sSAFzMn9ZA5DusP7B18jCBPAA310L446G0k/pLD5KfkjqviDweKN6FnWLZEqBxPnzLAc3cQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:16.208297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:16.209144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:16.218336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:16.223982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:16.224703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:16.227232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:16.234094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:16.234672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:16.257566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6c476976-f724-48be-ae5a-a3ab657a3cd7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:16.270603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6c476976-f724-48be-ae5a-a3ab657a3cd7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for user 5d1f3078e7b3489f962470c753bdf574 and project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:16.350381 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c476976-f724-48be-ae5a-a3ab657a3cd7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.402253 Oct 06 13:11:16.351085 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2296/4574] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:11:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:16.599200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:16.600231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:16.623557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:16.628049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:16.631275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:16.634770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:16.636587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:16.639396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:16.695788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:16.708089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:16.725838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:16.727407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88b8f7af-0a13-45b8-bfe6-f619b88f04e9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.523328 Oct 06 13:11:16.728158 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2279/4575] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:16 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:16.900958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:16.916160 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14844bc3-d1ab-442e-bede-09022c674551 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.330034 Oct 06 13:11:16.918727 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2297/4576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:16 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:11:16.974590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:16.975217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:16.995151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.011905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.012695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:17.016378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.020916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.023118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:17.183632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:17.184587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:17.197214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.198175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.199572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:17.201510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.203459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.204066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:17.730709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:17.748360 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-83fa124a-2612-4996-8004-38e7cdf71df7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.777295 Oct 06 13:11:17.749296 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2280/4577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:16 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:17.755154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:17.760606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:17.771989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.773077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.773777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:17.780680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:17.781418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:17.782079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:18.008539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:18.062265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e55e27cf-f5e8-46cc-b7d7-83875385891f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1521 microversion: 2.1 time: 0.883245 Oct 06 13:11:18.078791 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2298/4578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:17 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1521 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:18.084727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:18.085364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:18.097875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:18.098369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:18.103730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:18.104744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:18.106371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:18.108926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:18.315999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:18.361290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:18.388333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:18.390838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:18.392451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abf5fe8c-fd14-47fd-8484-d173ed645ea9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1739 microversion: 2.20 time: 0.641824 Oct 06 13:11:18.415680 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2281/4579] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:17 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1739 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:18.636665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:18.649248 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d1d9eaa-256e-46d3-8d4d-3d499fbac3f9 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.567536 Oct 06 13:11:18.650749 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2299/4580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:18 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:18.774651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:18.775328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:18.804340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:18.805234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:18.807261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:18.811568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:18.813893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:18.814508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:19.088354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:19.089040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:19.103624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:19.105531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:19.106170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:19.107149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:19.107803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:19.108529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:19.116456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:19.881438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:19.920894 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba0fb848-6630-4198-9aa0-b85575cc3f36 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 1.146152 Oct 06 13:11:19.941699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2282/4581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:18 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:19.944347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:19.952849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:19.953473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:19.963768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0405bdde-6b18-414a-906e-3e0b5ac90863 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1521 microversion: 2.1 time: 0.880172 Oct 06 13:11:19.971470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:19.971972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:19.972750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:19.973116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:19.973575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:19.974047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:19.978614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2300/4582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:19 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1521 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:20.004295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-782133988", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6d47836-baeb-4053-a057-5836e3c6a445"}], "security_groups": [{"name": "tempest-securitygroup--579985445"}], "key_name": "tempest-keypair-112984061", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:20.334265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] validate_networks() for [('f6d47836-baeb-4053-a057-5836e3c6a445', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:11:20.495689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:20.525480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:20.528747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:20.536195 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4fa03e58-14b3-46c7-8fa6-1e2d6e937900 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1721 microversion: 2.20 time: 0.592864 Oct 06 13:11:20.542012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2283/4583] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:19 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1721 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:20.561452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:20.561452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:20.567452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:20.567963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:20.568460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:20.569205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:20.569671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:20.570133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:20.971383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:20.985941 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36e91a27-2433-4647-a499-b7be7386cdc1 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.442691 Oct 06 13:11:20.987198 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2284/4584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:20 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:21.003086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d78768-ccdc-460a-a0ab-2e2c2575a236", "name": "network-vif-plugged", "status": "completed", "tag": "f013e0a1-3a00-4ef2-b041-6a4091503a75"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:21.022280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.023022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.023626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.060328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] Creating event network-vif-plugged:f013e0a1-3a00-4ef2-b041-6a4091503a75 for instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 on n-h2-860556-1 Oct 06 13:11:21.067415 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8b2f5107-79fa-4b40-81d3-88e78d1f500a req-9706b1c2-c043-4b47-9874-0cd08a1936b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078788 Oct 06 13:11:21.068348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2285/4585] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:21.077820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:21.078538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:21.095737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.096544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.097156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.098089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.098707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.099549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.465021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:21.476426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b296e1f5-e193-4af5-9e31-cbb6370eb889 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.406482 Oct 06 13:11:21.478130 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2286/4586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:21 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:21.485381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:21.486146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:21.496566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.499199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.499848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.500754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.501389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.502062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.526246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:21.559085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:11:21.559616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:11:21.560000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:11:21.560608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:11:21.561024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:11:21.572558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.573250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.573884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.574807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.575456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.576067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.594772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:21.600952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Getting quotas for user db39e3800b574bb7abd3922b5ad8e282 and project 74ed3c9630104e48abc5fc6770a610b0. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:21.616350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:11:21.619197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:11:21.682405 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a9d0507d-cfee-4d6c-acbf-ab92d8467b65 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.694948 Oct 06 13:11:21.692805 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2301/4587] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:11:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:11:21.700381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:21.702484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:21.713239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.717647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.719831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.722510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.723151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.727288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.736116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:21.746493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7d62a18-eddf-4b22-b83d-e164c932b670 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1498 microversion: 2.1 time: 0.266970 Oct 06 13:11:21.762225 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2287/4588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:21 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:21.762225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-800032e9-80af-48eb-8111-c875e5c80038 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:21.762225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-800032e9-80af-48eb-8111-c875e5c80038 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:21.872506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-800032e9-80af-48eb-8111-c875e5c80038 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:21.883837 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-800032e9-80af-48eb-8111-c875e5c80038 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1244 microversion: 2.1 time: 0.132331 Oct 06 13:11:21.884742 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2288/4589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:21 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:21.892881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:21.897769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:21.906978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:21.922173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.922677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.923132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.923869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:21.924335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:21.924769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:21.953521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:22.010116 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1405d532-ac04-47c5-afa8-a859d8ce068b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.122573 Oct 06 13:11:22.015962 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2289/4590] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Oct 6 13:11:21 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:22.026929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:22.041722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:22.059100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:22.062616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:22.064652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:22.066195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:22.068994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:22.070177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:22.834284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:22.849084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:22.851278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:22.852633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e303679-9ac6-474a-a585-6e21e25001d3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1721 microversion: 2.20 time: 1.158472 Oct 06 13:11:22.870001 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2302/4591] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:21 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1721 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:22.884736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:22.905034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:22.905538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:22.911181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:22.912212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:22.924397 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c795b46-906e-414a-89d6-66ec6dd9615d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.907174 Oct 06 13:11:22.925769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2290/4592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:22 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:22.930767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:22.931640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:22.939084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:22.939908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:22.940834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:22.941989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:22.942841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:22.943619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:22.959343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Going to try to start instance {{(pid=129615) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:11:23.068942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00a0b3b7-5d64-4cbe-abf0-8a4a442a7637 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "POST /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f/action" status: 202 len: 0 microversion: 2.1 time: 0.196187 Oct 06 13:11:23.073454 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2303/4593] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:22 2022] POST /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:11:23.081715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:23.087757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:23.096331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:23.097130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:23.097836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:23.099008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:23.099690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:23.100742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:23.317154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:23.322618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:23.331259 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9abc41a-64b8-416e-ad3e-29a63c0f646c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1296 microversion: 2.1 time: 0.254285 Oct 06 13:11:23.331935 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2304/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:23 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:23.334437 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-481dff86-d3a0-4fac-8902-493efc8ad62a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1313 microversion: 2.1 time: 0.407308 Oct 06 13:11:23.346207 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2291/4595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:22 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:23.346207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:23.346207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:23.347122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1623109568", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f6db9c2-b018-4d3e-ac2e-c3143e453914"}], "security_groups": [{"name": "tempest-securitygroup--358498466"}], "key_name": "tempest-keypair-1184475204", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:23.379247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:23.383978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:23.385755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:23.388869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:23.390568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:23.391346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:23.611827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] validate_networks() for [('9f6db9c2-b018-4d3e-ac2e-c3143e453914', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:11:23.998209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:24.009364 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1e3124d-0dcf-4c56-b337-b92c1fe81b4f tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1507 microversion: 2.1 time: 0.670099 Oct 06 13:11:24.010245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2292/4596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:23 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:24.019203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:24.024258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:24.040435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.041400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.042059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.042989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.043636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.044421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.568809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:24.582192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:24.588908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:24.589989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:11:24.590688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:11:24.591130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:11:24.591580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:11:24.592003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:11:24.592388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23df164c-736c-44fd-a786-6f164362fb45 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1724 microversion: 2.20 time: 0.576623 Oct 06 13:11:24.594628 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2293/4597] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:24 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:24.599887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:24.600858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:24.612289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.615806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.619889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.620632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.621292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.621496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.622481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.622980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.623190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.623645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.623904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.624067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.668426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:24.677119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for user 5d1f3078e7b3489f962470c753bdf574 and project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:24.708946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:11:24.713177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:11:24.790881 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dfb45c22-3e27-497f-9f8d-c1ea608353d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.455739 Oct 06 13:11:24.791968 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2305/4598] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:11:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:11:24.798443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "name": "network-vif-unplugged", "status": "completed", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:24.828361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.829110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.829731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.848380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.server_external_events [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] Unable to find a host for instance f37b88cd-d04c-425d-931d-855840f39907. Dropping event network-vif-unplugged {{(pid=129615) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 13:11:24.849574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-591371c5-bff1-4281-aeda-815ac7b7a269 req-39fe5417-b552-48c4-b3b2-eff4aab09653 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056222 Oct 06 13:11:24.852113 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2306/4599] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 13:11:24.861433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:24.862462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:24.870060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.870752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.871363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:24.872864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:24.873484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:24.874108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.036981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:25.053983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84b4eca1-60aa-4dec-9e44-c922926a43ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.457810 Oct 06 13:11:25.054591 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2294/4600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:24 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:25.061880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:25.061880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:25.069576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:25.089211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.089726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.092272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.093672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.097356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.098056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.102339 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddaabba3-55c9-4844-8965-ac19f480512d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1302 microversion: 2.1 time: 0.248894 Oct 06 13:11:25.118952 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2307/4601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:24 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1302 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:25.118952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbaf9394-6ed9-4ff5-b459-586db8495d91"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:25.118952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:25.143087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.143589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.144032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.144745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.145199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.145625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.395593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:25.409442 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81d1c979-6d08-44ee-a1df-6fa25d33766a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1498 microversion: 2.1 time: 0.353768 Oct 06 13:11:25.410307 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2295/4602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:25 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:25.415230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd5984f-6850-4839-9a30-fa1c9614a368 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:25.416008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2dd5984f-6850-4839-9a30-fa1c9614a368 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:25.475582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2dd5984f-6850-4839-9a30-fa1c9614a368 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:25.487462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2dd5984f-6850-4839-9a30-fa1c9614a368 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1238 microversion: 2.1 time: 0.075020 Oct 06 13:11:25.501251 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2296/4603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:25 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:25.512815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:25.520386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:25.531955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.535924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.536559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.537550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.538217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.538958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.760739 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-55e90709-6596-4a81-9f99-1b89891b9fde tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.654058 Oct 06 13:11:25.762046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2308/4604] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Oct 6 13:11:25 2022] POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments => generated 188 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:11:25.768576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:25.787571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:25.810104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.816453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.818629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.821016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:25.824762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:25.831466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:25.897472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lazy-loading 'flavor' on Instance uuid a2d78768-ccdc-460a-a0ab-2e2c2575a236 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:11:25.913500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:25.924873 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67252437-2ef0-42fc-ba43-ee291960525c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1507 microversion: 2.1 time: 0.421999 Oct 06 13:11:25.925633 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2297/4605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:25 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:26.063992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:26.065494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.079629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.081524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.082859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.085157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.087197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.088227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.097972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38a818dd-9b64-4b30-9a01-8ff72126de50 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "POST /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236/action" status: 200 len: 32 microversion: 2.1 time: 0.331634 Oct 06 13:11:26.099981 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2309/4606] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:25 2022] POST /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236/action => generated 32 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:11:26.110505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:26.122710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.149621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.150414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.151071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.153218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.156585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.157238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.502638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:26.510932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7318c503-0a03-46a0-bbc5-777f6867c3de tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.409344 Oct 06 13:11:26.522116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2310/4607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:26 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:26.522116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:26.522116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.546369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.546875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.547323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.548035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.548498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.548933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.656665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9f0c972-6616-44c1-a6b5-35a23a490412 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments/bbaf9394-6ed9-4ff5-b459-586db8495d91" status: 202 len: 0 microversion: 2.20 time: 0.598014 Oct 06 13:11:26.657801 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2298/4608] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Oct 6 13:11:26 2022] DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments/bbaf9394-6ed9-4ff5-b459-586db8495d91 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:11:26.672225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:26.674431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.699581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.701021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.701647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.703221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.704856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.706944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.892724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:26.904931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:26.908880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0805917-08dd-46ae-b060-e83860b4df18 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1302 microversion: 2.1 time: 0.249446 Oct 06 13:11:26.915288 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2299/4609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:26 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:26.923613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4c2e67e-7693-4790-a68c-0e9e8255df43 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.407305 Oct 06 13:11:26.931086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:26.931720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.934839 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2311/4610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:26 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:26.954116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:26.955542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:26.974730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.975247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.975704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.982394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:26.982900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:26.985533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:26.998666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.016381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.017566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:27.019293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.024195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.025633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:27.198438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 13:11:27.277353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:27.353877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d8160b5-c76a-4950-8066-13ce8fba550f tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/action" status: 202 len: 0 microversion: 2.20 time: 0.415296 Oct 06 13:11:27.355097 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2312/4611] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:11:26 2022] POST /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:11:27.385981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:27.386770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:27.417025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.417331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.419158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:27.422864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.423612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.426872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:27.484978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:27.496365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fbfb2c34-0125-4985-bf6e-a32f70be3ef6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1290 microversion: 2.1 time: 0.579258 Oct 06 13:11:27.499883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2300/4612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:26 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1290 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:27.510129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:27.514097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:27.537434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.541172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.542394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:27.546405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:27.556163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:27.557974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:28.844526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:28.858137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:28.860155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:28.861515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-997f1057-e866-4337-914c-fa5f49bd8ad9 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1672 microversion: 2.20 time: 1.360409 Oct 06 13:11:28.861658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:28.880802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2301/4613] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:27 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1672 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:28.883320 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c794caa-a742-47bd-965c-01d68b810e42 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1511 microversion: 2.1 time: 1.525571 Oct 06 13:11:28.888080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2313/4614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:27 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1511 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:28.891992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:28.892188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:28.894730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:28.905526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:28.911022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:28.913784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:28.913784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:28.913784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:28.918127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:28.923649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:28.944280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:28.944796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:28.949123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:28.953117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:28.954295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:28.955291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.460333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:29.469905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:29.486847 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9912b396-3ee7-4b88-b087-3815a610f975 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.597517 Oct 06 13:11:29.488423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6f5f091-938e-4ece-82db-a4377a17be25 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.601563 Oct 06 13:11:29.498224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2302/4615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:28 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:29.506038 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2314/4616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:28 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:29.512150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:29.513282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:29.515976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:29.516607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:29.521676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.522129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.522624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.523342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.523931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.524211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.533425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.534012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.534472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.536431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.540174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.541372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.555630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:29.719272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:29.732015 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f20f188e-b3ca-490f-970b-fb41e742ab70 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1296 microversion: 2.1 time: 0.223754 Oct 06 13:11:29.733220 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2315/4617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:29 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1296 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:29.739185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:29.746041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:29.746891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.servers [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Removing options 'limit' from query {{(pid=129615) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 06 13:11:29.749145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:29.750668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.751461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.752212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.753142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.753791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.756851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.760216 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-906644b8-14fb-443a-9976-e054554c80cb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.024932 Oct 06 13:11:29.762362 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2316/4618] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Oct 6 13:11:29 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:11:29.771102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:29.806110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.806901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.807908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.859231 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] Creating event network-changed:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:11:29.870572 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-54a08932-c3bb-408d-81dd-64a5e09b6395 req-4be9adcd-c352-4722-a526-63bd20dbce04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105862 Oct 06 13:11:29.872949 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2317/4619] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:29.882760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:29.885295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:29.894582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.895410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.895855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.896648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:29.897107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:29.897697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:29.955285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:29.967757 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b38a8af-b01e-43f8-9a69-29ee4c44708f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.464550 Oct 06 13:11:29.983163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2303/4620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:29 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:29.992888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:29.993832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:30.002848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.004063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.004736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:30.005668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.006520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.007530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:30.333954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:30.344457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70b92459-46eb-4520-b0b3-b680aa0a877d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1511 microversion: 2.1 time: 0.469342 Oct 06 13:11:30.345528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2318/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:29 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:30.367523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:30.368141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:30.375288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.376026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.376643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:30.377526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.378171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.378750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:30.537680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:30.553780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:30.559386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:30.563918 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a611046f-c517-4e24-bcae-c474a79da361 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.577846 Oct 06 13:11:30.566668 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2304/4622] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:29 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:30.576752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:30.577374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:30.590012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.590012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.590012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:30.590012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:30.590012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:30.590397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.090353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:31.112854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a6eceb8-4b1f-49c0-83fc-dcca3b378508 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1512 microversion: 2.1 time: 0.749269 Oct 06 13:11:31.113449 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2319/4623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:30 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:11:31.132825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:31.132825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:31.138458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.139187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.139802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.141003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.141620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.142239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.404964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:31.418251 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a07fe8e6-41af-47be-a16b-7a082640415d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.849631 Oct 06 13:11:31.430209 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2305/4624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:30 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:31.451858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:31.452782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:31.467441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.467948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.468391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.469107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.469563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.470023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.728431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:31.747665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ae6e5ae-6165-427d-8ccd-0fd6f37344bf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.623548 Oct 06 13:11:31.748274 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2320/4625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:31 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:31.767204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:31.779295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:31.788918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:31.796079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.796914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.797150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.798200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.798837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.799458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.908546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:31.921510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d426a1b6-03b8-47e6-bf3d-1f99b8a21a37 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.489342 Oct 06 13:11:31.940157 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2306/4626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:31 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:31.957275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:31.958264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:31.965293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:31.966856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:31.968848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.970847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.971462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:31.972978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:31.973600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:31.974229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:32.502802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:32.517394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea0138bf-9ca4-4f59-b30d-61fe29074465 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.753982 Oct 06 13:11:32.522398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2321/4627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:31 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:32.526785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:32.538746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:32.539767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:32.542098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71cdf90b-f55e-45d1-8068-cdf465a9c161 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1510 microversion: 2.1 time: 0.598941 Oct 06 13:11:32.543423 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2307/4628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:31 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:32.552074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:32.553152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:32.565883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:32.566941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:32.567612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:32.568709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:32.569514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:32.570442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:32.570738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:32.573626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:32.574161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:32.575184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:32.575667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:32.576107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.132794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.149914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.152093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.153685 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37de3d9d-d0c0-4d42-8d42-c15e853d4983 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.627967 Oct 06 13:11:33.156665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.165267 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-36a9081d-79c6-497f-83e5-d79034ae3563 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.619256 Oct 06 13:11:33.167737 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2322/4629] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:32 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:33.169062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2308/4630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:32 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:33.179070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:33.181407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:33.188806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:33.194941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.195424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.196055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.196920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.202173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.203354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:33.210483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.210934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.681504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.682972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.684253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.685998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.686949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.688209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.803691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:33.834583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:33.845765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00ae3abb-e8f9-42b3-aa0d-964a1bb03992 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1513 microversion: 2.1 time: 0.675459 Oct 06 13:11:33.864328 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2309/4631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:33 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1513 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:33.869357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:33.882675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:33.889421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.890123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.890722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.891607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.892220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.892803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.928576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bdf602c8-4e07-4688-a865-f24fb5cf3028 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.759605 Oct 06 13:11:33.929728 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2323/4632] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Oct 6 13:11:33 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:33.935515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:33.949288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.950485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.951148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.966520 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] Creating event network-changed:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h1-860556-1 Oct 06 13:11:33.973304 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7f8fdbad-52db-4fb6-961c-6f7f904bb566 req-b212f926-7f53-4227-bf3c-ca4c9ab1f2ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042091 Oct 06 13:11:33.974578 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2324/4633] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:33.980559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:33.985227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:33.992426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.992924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.993360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:33.994098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:33.994553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:33.995232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:34.276261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:34.289371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32379ddb-94cf-4921-832a-8544f92b7165 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.423584 Oct 06 13:11:34.291248 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2310/4634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:33 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:34.296895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:34.298381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:34.309883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:34.311795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:34.313036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:34.314569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:34.316539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:34.317666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:34.499972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:34.508706 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-937d3604-8142-43a7-b9a4-1c0d3e048ade tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.532757 Oct 06 13:11:34.509296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2325/4635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:33 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:34.526716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:34.527553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:34.534182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:34.534670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:34.535304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:34.536010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:34.536465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:34.537059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:34.700331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=16 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:34.971251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:34.985599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d83854a-a333-432e-a4c2-776c06d4ccf4 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1511 microversion: 2.1 time: 0.692938 Oct 06 13:11:34.987512 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2311/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:34 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:35.003106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:35.009894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:35.019881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.026520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.027429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.028727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.029201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.029998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.382270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:35.408814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:35.411460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:35.413911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-669f23ac-bd44-4880-9eba-fa5183045e40 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.890928 Oct 06 13:11:35.415517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2326/4637] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:34 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:35.424786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0206ff63-f48c-4f6c-a7f2-24359b70d5ec", "tag": "70e098cb-4607-40bd-9654-c5d405325dba"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:35.440679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.441481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.442352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.480544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:35.500749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] Creating event network-changed:70e098cb-4607-40bd-9654-c5d405325dba for instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec on n-h2-860556-1 Oct 06 13:11:35.512944 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-56ddc989-c176-44aa-9b4e-050db146d30b req-aa72d3a1-cad4-4ea8-a8c6-e41adda0a073 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095849 Oct 06 13:11:35.515308 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2327/4638] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:35.524243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:35.527529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:35.549236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.553138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.558213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.560263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.566043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.566843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.882410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:35.903397 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd2b695d-34c7-40e9-9711-64e7f0e3ccf5 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.899023 Oct 06 13:11:35.926490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2312/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:34 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:35.947632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:35.948392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:35.973899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.974562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.974866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:35.983746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:35.984316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:35.984777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:36.439915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:36.451515 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3082eeca-2b7b-4e0e-aded-213259832700 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1490 microversion: 2.1 time: 0.934495 Oct 06 13:11:36.462393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2328/4640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:35 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1490 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:36.469116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:36.473500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:36.485208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:36.498695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:36.499621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:36.500859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:36.501816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:36.502563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:36.804570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:36.814440 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c95e1d7-106a-4a97-9173-e84ea1dc08bd tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1512 microversion: 2.1 time: 0.883105 Oct 06 13:11:36.820091 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2313/4641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:35 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1512 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:36.842911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:36.843884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:36.851910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:36.852748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:36.853400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:36.854808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:36.855716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:36.856847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.216034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:37.227039 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91f4a2d6-afb9-4a6d-8d45-fd9ff98c3c6d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.763040 Oct 06 13:11:37.234210 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2329/4642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:36 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:37.240467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:37.245276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:37.259260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.260103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.263250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.264229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.265001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.265989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.364956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:37.377027 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ffcbc4a-1ae2-4f54-b21c-ecc8def15b0d tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.555719 Oct 06 13:11:37.388110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2314/4643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:36 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:37.402289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:37.403617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:37.452111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.453023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.453780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.454793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.455458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.456377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.563574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:11:37.655546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:37.667750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:37.677130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:37.678836 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7ab5174-0ff3-4390-8288-fac2af3fc7bb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.443455 Oct 06 13:11:37.680486 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2330/4644] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:37 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:37.688033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:37.689175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:37.696654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.697550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.698217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.699186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.700552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.701321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.717019 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4658bf11-fd1a-407f-b93c-a3e453173f6e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 204 len: 0 microversion: 2.1 time: 0.327444 Oct 06 13:11:37.718322 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2315/4645] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:11:37 2022] DELETE /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:11:37.730994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:37.732626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:37.740563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:37.748307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.750078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.761817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:37.763016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:37.763693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:37.764349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.103396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.114889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.116699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69f97691-3983-4929-a297-c4da5fa6dada tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1510 microversion: 2.1 time: 0.434610 Oct 06 13:11:38.123988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c740ac12-0c3e-469e-a05d-bd05d0ace070 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.404015 Oct 06 13:11:38.124481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2331/4646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:37 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:38.141231 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2316/4647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:37 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:38.143858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "name": "network-vif-plugged", "status": "completed", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:38.146749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:38.147613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:38.157571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.158340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.158776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.169257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.171189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.172461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.174864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.175630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.176292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.181394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] Creating event network-vif-plugged:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:11:38.192079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-807bfb3b-5717-465c-a1e5-c921e4d6e6ef req-b9a06f3f-b68b-46b8-ab43-9ae2e07d6321 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066159 Oct 06 13:11:38.193305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2332/4648] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:38.200468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:38.205522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.206589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:38.215875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.218359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.218977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.223068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.223719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.224342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.279264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:38.331848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.339799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.340279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.340764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.392008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.402098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25588433-2fb3-480f-a6e5-43ea2006f506 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1496 microversion: 2.1 time: 0.259198 Oct 06 13:11:38.403294 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2317/4649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:38 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1496 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:38.409305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:38.410113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:38.420680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.422423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.423118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.424063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.425041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.425857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.431723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:38.655997 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43776246-642d-44b1-a5d2-703ce731e7d1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.461193 Oct 06 13:11:38.659238 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2333/4650] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:11:38 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:38.663231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:38.664210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:38.671369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.672129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.673099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.674039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:38.674653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:38.675237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:38.739288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.747698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd5d438a-5176-4e0c-81da-ae2db1466973 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.343227 Oct 06 13:11:38.748273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2318/4651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:38 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:38.752749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:38.758071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:38.759050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:39.149374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.150820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.151363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.152173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.156908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.157795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.224531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.253876 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2801bc0-db98-4891-a7e1-e0220daf4c4c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.595445 Oct 06 13:11:39.263334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2334/4652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:38 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:39.286258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:39.286855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:39.302486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.303010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.303449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.309491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.310036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.310475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.373415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:39.459459 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd897ab0-7aff-4a1c-913e-55ea5040facb tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.709899 Oct 06 13:11:39.467465 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2319/4653] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Oct 6 13:11:38 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:39.478228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:39.478960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:39.488871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.489593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.490162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.491020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.492203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.493031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.677665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.696855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.704329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.712590 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-58c79789-acbc-4771-bd13-321cf28df063 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.447436 Oct 06 13:11:39.720525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2335/4654] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:39 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:39.741904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:39.742837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:39.757496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.771126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.772872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.777902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.779537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.780235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.843828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.854231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1d074b3f-778a-4ece-a8e9-c511fab61aa9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.385540 Oct 06 13:11:39.856214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2320/4655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:39 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:39.867084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:39.883098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:39.886907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:39.900894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.901802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.902575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:39.914909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:39.915851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:39.916755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.181553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:40.357705 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa7187e4-5e21-4911-9bba-b29daef23c1e tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.498971 Oct 06 13:11:40.366273 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2321/4656] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Oct 6 13:11:39 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:40.371508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:40.378653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:40.391206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:40.393982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.394660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.395289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.396943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.397811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.398642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.407200 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9cac0e60-e818-478b-9248-2e1781ba9950 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1496 microversion: 2.1 time: 0.684080 Oct 06 13:11:40.411922 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2336/4657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:39 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1496 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:40.421146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:40.424411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:40.454775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.459319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.460097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.461159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.461947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.463235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.783717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:40.798584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7964a3b-df10-4ce1-91df-05944d1b6614 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.430688 Oct 06 13:11:40.806640 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2322/4658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:40 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:40.811560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:40.827698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:40.829154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:40.839515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.842330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.842948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:40.850805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:40.851565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:40.852420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.019121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:41.034345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5afad018-217b-431d-a241-69beb9a2d03f tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.621487 Oct 06 13:11:41.045401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2337/4659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:40 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:41.051686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:41.070880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:41.088273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.088680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.089118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.089881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.090396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.090824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.435539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:41.444828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:41.450571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:41.455763 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab2fa892-1bc4-4c12-917e-74f6b7f6abef tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.408638 Oct 06 13:11:41.458807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2338/4660] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:41 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:41.469352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:41.470604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:41.485836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.486916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.489835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.491007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.491713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.492382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.878709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:41.879933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:41.888214 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d89d5eef-dc82-4acc-8d73-49fd5f223314 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1369 microversion: 2.1 time: 0.427422 Oct 06 13:11:41.890976 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2339/4661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:41 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1369 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:41.896273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:41.897330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:41.904702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.905485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.906301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:41.907270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:41.907934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:41.908792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.028839 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd28a503-02ef-4ad8-ac4f-a5c96f265d31 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 1.216338 Oct 06 13:11:42.032385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2323/4662] 10.222.0.26 () {58 vars in 1196 bytes} [Thu Oct 6 13:11:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:42.052045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:42.053876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:42.084953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.085497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.085986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.086750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.087216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.087655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.376528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:42.393009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15b74e83-4340-44a9-a29a-e28981456b24 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1496 microversion: 2.1 time: 0.500712 Oct 06 13:11:42.396608 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2340/4663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:41 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1496 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:42.407751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:42.414139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:42.415289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': '1221483330', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:42.422014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.422944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.423608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.425055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.425691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.426328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.531317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:42.548629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4915e287-1972-4c95-8235-c4d774f2dea3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.515399 Oct 06 13:11:42.551254 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2324/4664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:42 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:42.551436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:42.587626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:42.589709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:42.606998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.608277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.608927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.612850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.613628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.614959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.662858 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47a32ecd-e9ff-455c-b86a-6d057ef8f548 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=1221483330" status: 200 len: 346 microversion: 2.1 time: 0.263468 Oct 06 13:11:42.663751 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2341/4665] 10.222.0.26 () {58 vars in 1156 bytes} [Thu Oct 6 13:11:42 2022] GET /compute/v2.1/servers?name=1221483330 => generated 346 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:42.681021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:42.685126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:42.702153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.703048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.703658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:42.706552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:42.707436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:42.708035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:43.423347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:43.457263 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a09baf7-88ee-4cf8-8edd-37099175b258 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.904359 Oct 06 13:11:43.461937 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2325/4666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:42 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:43.491540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:43.504378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:43.518134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:43.540713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:43.541282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:43.541803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:43.542617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:43.543089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:43.544093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:43.635238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:43.652153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:43.656107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:43.661472 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5a29e47-324b-4854-a64b-ac6232f25632 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.994950 Oct 06 13:11:43.677767 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2342/4667] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:42 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:43.686726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:43.690208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:43.731610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:43.733764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:43.734231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:43.739421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:43.741312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:43.744977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:43.888322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:44.207535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a7f75090-61d1-4b17-8e5e-15ca69b6ab25 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.725375 Oct 06 13:11:44.209543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2326/4668] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Oct 6 13:11:43 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:44.221775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:44.223256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3f7f79-d045-4458-b548-bf0b530bbc3d", "name": "network-vif-deleted", "tag": "070e77d4-a27e-4cd8-98f8-d64143b4ff2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:44.244345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7650ad94-1919-4249-b2b6-940e0a38e4b0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1564 microversion: 2.1 time: 0.578005 Oct 06 13:11:44.253466 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2343/4669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:43 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1564 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:44.262940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.264531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:44.265663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:44.271149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.271792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.280139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.281989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.283981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.284960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.287223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.287899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.313077 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] Creating event network-vif-deleted:070e77d4-a27e-4cd8-98f8-d64143b4ff2d for instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d on n-h1-860556-1 Oct 06 13:11:44.323704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f78043a5-ea03-46ee-b7df-9fdfadf0e781 req-e43a18d5-8f8e-4f33-a315-0a8d0d0e4d7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111274 Oct 06 13:11:44.332255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2327/4670] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:44.345627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:44.346410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:44.364854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.365779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.368967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.377986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.379051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.380220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.380952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lazy-loading 'fault' on Instance uuid 6f3f7f79-d045-4458-b548-bf0b530bbc3d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:11:44.383639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.383901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.386403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.504041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:44.523641 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c0623fa-aa13-40f9-8a90-1682a3b03ce5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 200 len: 1305 microversion: 2.1 time: 0.268292 Oct 06 13:11:44.542023 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2344/4671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:44 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:44.550729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:44.563389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:44.564183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-122148333', 'deleted': False, 'project_id': 'f542e391c37440a0901558ec9c88eb29'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:11:44.575783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.576450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.576956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.578006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.578565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.579662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.766124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:11:44.821689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:44.839393 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcccb358-5a10-4a0f-a3dc-5b188cea4de6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 0.505536 Oct 06 13:11:44.846977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2328/4672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:44 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:44.856402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:44.858383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:44.869370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.871372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.873326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:44.874451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:44.875361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:44.875973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:45.057384 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28560155-30fc-4d75-8894-af81dfea60ff tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209005 Oct 06 13:11:45.058079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2329/4673] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:11:44 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:45.066121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:45.066121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:45.083434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:45.083954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:45.084415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:45.085125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:45.094367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:45.095498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:45.657950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b581c99d-7fe3-48f1-9408-8cfede63d4f8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-122148333" status: 200 len: 346 microversion: 2.1 time: 1.112279 Oct 06 13:11:45.681897 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2345/4674] 10.222.0.26 () {58 vars in 1228 bytes} [Thu Oct 6 13:11:44 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-122148333 => generated 346 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:45.697091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:45.701538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:45.712443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:45.713137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:45.713646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:45.714498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:45.715061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:45.716157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:45.971680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:45.990858 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84672dec-faa1-4ccb-8bfd-b02fe6f0db41 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.931677 Oct 06 13:11:45.993960 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2330/4675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:45 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:45.999916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0206ff63-f48c-4f6c-a7f2-24359b70d5ec", "name": "network-vif-plugged", "status": "completed", "tag": "70e098cb-4607-40bd-9654-c5d405325dba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:46.017004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.018285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.019130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.052871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] Creating event network-vif-plugged:70e098cb-4607-40bd-9654-c5d405325dba for instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec on n-h2-860556-1 Oct 06 13:11:46.063717 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-087958cc-7078-49e0-ad2c-7728d6adec1a req-3d67ecd2-ba4c-4e95-8bce-799c6670e743 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067735 Oct 06 13:11:46.065556 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2331/4676] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:46.072593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:46.073565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:46.082137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.083006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.083668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.084784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.085464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.086142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.122713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d HTTP/1.1 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6f3f7f79-d045-4458-b548-bf0b530bbc3d'} Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:46.125690 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:11:46.130263 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:46.135800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:11:46.137022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04ca1c23-a68f-4cce-a2ef-86bfd4e13d1f tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 404 len: 111 microversion: 2.1 time: 0.069960 Oct 06 13:11:46.141668 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2332/4677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:46 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:11:46.162056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:46.162861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:46.188343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.189030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.189495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.193771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.202619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.203236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.273646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:11:46.470539 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5638db93-000c-4107-9878-7f94dab345ba tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 204 len: 0 microversion: 2.1 time: 0.326704 Oct 06 13:11:46.471675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2333/4678] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:11:46 2022] DELETE /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:11:46.479236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:46.480073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:46.490797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.491709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.492366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.493839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:46.494526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:46.495128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:46.528551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:46.670336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:46.690268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:46.692988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:46.698289 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d85446ad-f5ce-446e-b0eb-8a2308938a47 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 1.011502 Oct 06 13:11:46.699103 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2346/4679] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:45 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:46.712519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-636954672", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9f23e231-093e-4e79-afe3-6aad8d694967"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:46.822605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] validate_networks() for [('9f23e231-093e-4e79-afe3-6aad8d694967', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:11:47.479800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:47.491615 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d94418c4-4ec4-4288-a63b-77f0bc3244a5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1363 microversion: 2.1 time: 1.018209 Oct 06 13:11:47.492202 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2334/4680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:46 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1363 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:47.508709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:47.516348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:47.525424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:47.526759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:47.529701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:47.530501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:47.531312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:47.531711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:48.064688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:48.081124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a29c1b3-f699-4ef5-913d-1f0fb80f1f56 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1516 microversion: 2.1 time: 0.576608 Oct 06 13:11:48.086534 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2335/4681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:47 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1516 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:48.112240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:48.116538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:48.128281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:48.128785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:48.129240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:48.132819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:48.135874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:48.136917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:48.330084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:49.350316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:49.367137 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-568d36a5-24ca-4ad4-bffb-10dfda562c87 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 1.261981 Oct 06 13:11:49.370109 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2336/4682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:48 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:49.387759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:49.388992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:49.406416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.407462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.408437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.410649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.411482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.414917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.760008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:49.774915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:49.790809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:49.799423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b87a3a12-0383-4eb3-bf32-955855170f58 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.420712 Oct 06 13:11:49.800577 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2337/4683] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:49 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:49.814989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:11:49.814989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:11:49.815920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:11:49.817121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:11:49.817121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:11:49.822589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:49.823601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:49.841204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.842017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.842718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.843699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.844353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.844968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.861536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.863304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.865034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.868113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:49.871913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=13 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:49.872178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:49.873152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:49.874316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:49.901857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:11:49.916908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Getting quotas for user 8dbe307ff89d4f289e47cc26fa9931cb and project 978516c309c04112953811ccadf3059b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:11:49.946985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:11:49.953932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:11:50.062382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ad256e1-ddda-444c-947b-1a9c6fca8f0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.361180 Oct 06 13:11:50.063432 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2347/4684] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:11:50.068568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:50.069639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:50.076864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.077647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.078313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.079202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.080169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.080771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.303335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:50.322824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41557d9d-40a8-4c78-bcb7-f1e158795372 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1549 microversion: 2.1 time: 0.516309 Oct 06 13:11:50.326184 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2338/4685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:49 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1549 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:50.337221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:50.363468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.368545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.369861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.398682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:50.407376 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5eaa761e-99f6-43d5-9ee1-947b0159577c tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1516 microversion: 2.1 time: 0.342694 Oct 06 13:11:50.411931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] Creating event network-changed:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:11:50.417912 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2348/4686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:50 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:50.423764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d7ab0dc-533b-4e63-8df6-93bc6cc39a52 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:50.424296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d7ab0dc-533b-4e63-8df6-93bc6cc39a52 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:50.425630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e36f456a-479b-428a-98f0-428a5e1e0a32 req-7ee14463-8fe5-4c18-8cc0-8d8f1d3ad2d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095958 Oct 06 13:11:50.429524 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2339/4687] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:50.440279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:50.441167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:50.449586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.450632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.451848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.452817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.453510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.454309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.537766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d7ab0dc-533b-4e63-8df6-93bc6cc39a52 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:50.550852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d7ab0dc-533b-4e63-8df6-93bc6cc39a52 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1214 microversion: 2.1 time: 0.126050 Oct 06 13:11:50.551789 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2349/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:50 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:50.562875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:50.563838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:50.580537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.581484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.591352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.592258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.592767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.593408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.638212 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c7838034-cb3c-4bf4-b764-3578dc12b1ec tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206677 Oct 06 13:11:50.639808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2340/4689] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:11:50 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:50.830070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:50.830702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:50.845255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.848173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.848828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:50.849781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:50.851738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:50.852392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.352826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.362100 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-519b54e2-7644-4ddd-9af8-fee22eae46ee tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.808822 Oct 06 13:11:51.362726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2350/4690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:50 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:51.374067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0347be9b-8cd0-4927-a4a1-9a450136b421", "name": "network-vif-deleted", "tag": "f2eba058-d524-45d7-9092-5a055d1a9909"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:51.391833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:51.394234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:51.394758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.419882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] Creating event network-vif-deleted:f2eba058-d524-45d7-9092-5a055d1a9909 for instance 0347be9b-8cd0-4927-a4a1-9a450136b421 on n-h1-860556-1 Oct 06 13:11:51.430532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-859ecab3-3137-448c-8ad3-aaf296430c1c req-1b307d02-08be-43fb-a692-ad1e4fd01d3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062145 Oct 06 13:11:51.431164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2351/4691] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:51.445237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:51.446283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:51.459739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:51.461535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:51.462175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.463075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:51.464773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:51.466196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.632702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.652173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.656830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.658125 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b2df45e-dcde-4216-bcf7-936a5da2f1dc tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.833262 Oct 06 13:11:51.658963 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2341/4692] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:50 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:11:51.688366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:51.689004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:51.699931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:51.700766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:51.701402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.702470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:51.703112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:51.703775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:51.725195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.743407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d44a4e6c-148a-4156-86ac-f0a115c84d71 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 200 len: 1474 microversion: 2.1 time: 0.310724 Oct 06 13:11:51.744781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2352/4693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:51 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:51.867415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:51.891083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d845a6eb-af35-40b4-9ad9-99cdcf1e7078 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1218 microversion: 2.1 time: 0.215726 Oct 06 13:11:51.895144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2342/4694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:51 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:52.389266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:52.390845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:52.399536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.400418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.401097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.402385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.403439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.408832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.688821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:52.689417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:52.707273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.707784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.708249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.708962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.709429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.709894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.788339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:52.805943 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c0e9de9-e830-4718-a45d-22d94664a183 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.421981 Oct 06 13:11:52.817890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2353/4695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:52 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:52.831695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:52.832536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 0347be9b-8cd0-4927-a4a1-9a450136b421] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:52.843060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.843565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.844192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.845020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.845669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.846392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.863510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] HTTP exception thrown: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Request method failure captured: Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 HTTP/1.1 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtOwbom99rXYK_hgVpNcQEuDm-GLfqfvlkkPASydzVdnSM70y1SiXQt0blJYi6JbYST_-eb1WCU71L-GLzk5OJFBYMKbFLiwzJMPdKIGIhZx_O9SLgNVlJt1F_fKqroUtADcbjKR1unwj7PLjnv8kNG7g5mHF0KVracLMmy6Nc6JKxM Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f542e391c37440a0901558ec9c88eb29", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}] Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: dda013ee00f241fe86330565456fc678 Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0347be9b-8cd0-4927-a4a1-9a450136b421'} Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:52.865536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. Oct 06 13:11:52.872234 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:11:52.873698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Returning 404 to user: Instance 0347be9b-8cd0-4927-a4a1-9a450136b421 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:11:52.874839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ed84c2f-a4b3-400c-b6cd-312e78cc8b2d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421" status: 404 len: 111 microversion: 2.1 time: 0.055585 Oct 06 13:11:52.876465 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2354/4696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:52 2022] GET /compute/v2.1/servers/0347be9b-8cd0-4927-a4a1-9a450136b421 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:11:52.887708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:52.888540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:52.899072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.899456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.900253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.901149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:52.901812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:52.902409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:52.943024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:11:53.067054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba9ebaf3-9657-4a09-892e-2bec3646f4f1 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 204 len: 0 microversion: 2.1 time: 0.185057 Oct 06 13:11:53.068203 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2355/4697] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:11:52 2022] DELETE /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:11:53.074467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:53.075404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:53.082960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.083931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.084545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.085418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.086224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.087024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.193913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:53.202627 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0e37f06-f71d-4263-b193-55b22b143aa5 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1266 microversion: 2.1 time: 0.132884 Oct 06 13:11:53.203224 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2356/4698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:53 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:53.208063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:53.208682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:53.220965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.221567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.222122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.223053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.223587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.224149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.246253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:53.255991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:53.258553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:53.260300 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a21567a-75b4-4488-8272-feb7ead21898 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.576168 Oct 06 13:11:53.262171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2343/4699] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:52 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:11:53.519069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:53.531623 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-743c51c8-ee3f-4fdd-9e8f-4cef35430d89 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1518 microversion: 2.1 time: 0.327118 Oct 06 13:11:53.534650 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2357/4700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:53 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:53.555676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0206ff63-f48c-4f6c-a7f2-24359b70d5ec", "tag": "70e098cb-4607-40bd-9654-c5d405325dba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:53.567598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.568706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.569364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.584121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] Creating event network-changed:70e098cb-4607-40bd-9654-c5d405325dba for instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec on n-h2-860556-1 Oct 06 13:11:53.590551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0e3da2e3-8710-4780-ad33-99220551880c req-38b86061-66e7-40b5-ad6a-b4e0de1f79c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038416 Oct 06 13:11:53.591841 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2344/4701] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:53.843124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:53.846964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:53.868896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.870235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.870940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:53.872607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:53.873357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:53.874094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.195181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:54.206652 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-355ddaa8-a720-42f7-8269-fdae354f820c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.373742 Oct 06 13:11:54.207538 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2358/4702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:53 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:54.225945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:54.234451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:54.235337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:54.256067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.258037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.260294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.263244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.265397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.266437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.291105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:54.292578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:54.304498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:54.312026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.315289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.315988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.316955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.319209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.323459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.478580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:54.486934 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7ad45e5c-71e3-47eb-8da1-dd6f2a7990d6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1272 microversion: 2.1 time: 0.262884 Oct 06 13:11:54.487547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2345/4703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:54 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:54.560587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:54.562026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:54.576109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.580860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.587380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:54.588454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:54.589249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:54.590022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:55.050042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:55.063473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:55.064932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:55.070274 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31daab2d-5375-4175-b38d-b838edd076ae tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.781308 Oct 06 13:11:55.077988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2359/4704] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:54 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:11:55.190137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:55.208050 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d36f7517-eb98-4eda-9570-c38c5328eca8 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1518 microversion: 2.1 time: 0.650102 Oct 06 13:11:55.213937 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2346/4705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:54 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1518 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:55.233860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:55.234737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:55.244142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:55.244643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:55.245084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:55.245819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:55.252472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:55.253039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:55.516280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:55.516922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:55.529305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:55.530174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:55.530810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:55.531713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:55.532344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:55.532963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.116293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.126393 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8bcedf24-ebcc-48a7-90a7-c6b760c8d739 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.614254 Oct 06 13:11:56.138100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.142344 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2347/4706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:55 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:56.151711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcb91fb-b246-4d1f-a8bb-9ab62ed84363", "tag": "036ea749-194f-4def-8d97-2d7e6e7ee347"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:56.154797 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd84e057-33b8-4000-a7c0-ce131e7fdedc tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.925506 Oct 06 13:11:56.155853 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2360/4707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:55 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:56.168957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:56.173996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:56.191970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:56.192482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:56.192936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.193666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:56.194165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:56.194595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.203824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:56.204537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:56.205147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.222989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] Creating event network-changed:036ea749-194f-4def-8d97-2d7e6e7ee347 for instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 on n-h1-860556-1 Oct 06 13:11:56.234352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-608e2fb3-5255-4631-9176-0bcb6d7e3bba req-c04c103a-b099-4ecb-90cf-2b3b0bda5a27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089200 Oct 06 13:11:56.235587 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2348/4708] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:56.244055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:56.246102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:56.257834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:56.258647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:56.259752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.260646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:56.263301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:56.264160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:56.756241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.765764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.768196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.769965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c7fd446-2034-4fec-875f-e4a0cbebe40c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.612927 Oct 06 13:11:56.771099 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2361/4709] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:56 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:56.794248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:56.822258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b4f4d9e-181c-4a5b-9c5d-41ea52fa6a20 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1518 microversion: 2.1 time: 0.584141 Oct 06 13:11:56.823448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2349/4710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:56 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1518 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:57.020108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4361a7-1f89-41f0-bce2-0fd7d9911017", "name": "network-vif-deleted", "tag": "7b35f39a-39a2-4f7b-997d-8d34c586440f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:57.034635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.042782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.044304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.062345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] Creating event network-vif-deleted:7b35f39a-39a2-4f7b-997d-8d34c586440f for instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 on n-h2-860556-1 Oct 06 13:11:57.068385 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-74111504-12b0-48bb-8e72-72aad1c692d2 req-0f7a0a4d-2067-49af-abed-15ae42aa4d55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052828 Oct 06 13:11:57.069707 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2362/4711] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:57.140863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "name": "network-vif-plugged", "status": "completed", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:57.156705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:57.157528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:57.179420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.179667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.180170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.181326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.181915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.182468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.184475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.190554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.191636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.214457 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] Creating event network-vif-plugged:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h1-860556-1 Oct 06 13:11:57.231874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1d79b7bc-701f-41be-9b00-e7cb0851fca9 req-b4b2fe4d-db9e-4b3f-b60d-8809c2bf3386 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096460 Oct 06 13:11:57.232797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2350/4712] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:11:57.251602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:57.252472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:57.269235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.271270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.273210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.275483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.283694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.286465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.583468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:57.600921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f12fffee-5e0e-48fa-bcb1-762d9b4a06b6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.365565 Oct 06 13:11:57.608509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:57.613934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2351/4713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:57 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:57.622804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a79748c-c75e-4a53-a031-52fbb4556560 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.471824 Oct 06 13:11:57.670664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2363/4714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:57 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:57.800602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:57.801899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:57.805447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:57.816786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.817336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.817791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.818854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.819332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.819776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.846868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:57.847492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:57.859785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.860690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.861725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.862645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.863277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.864611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.919985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:57.920478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:57.921668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:57.925469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lazy-loading 'fault' on Instance uuid 9d4361a7-1f89-41f0-bce2-0fd7d9911017 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:11:58.130019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:58.138243 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-500c722b-42c2-4131-94d2-6ca15e80403b tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 200 len: 1311 microversion: 2.1 time: 0.295863 Oct 06 13:11:58.156358 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2364/4715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:57 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 1311 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:11:58.219941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:58.232834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:58.235055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:58.236960 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2881594b-20fe-4e69-b607-b528fa2eb697 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.440426 Oct 06 13:11:58.253112 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2352/4716] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:57 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:58.630685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:58.632000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:58.641885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:58.642676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:58.643291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:58.644169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:58.644771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:58.652301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:58.653904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:58.660066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:58.673813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:58.677424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:58.678340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:58.680921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:58.682146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:58.684391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:58.735347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:59.551032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:59.559638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8312aa43-2cf2-4023-b05d-b5bbdcc47ecd tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1484 microversion: 2.1 time: 0.936211 Oct 06 13:11:59.564347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2365/4717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:58 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1484 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:11:59.577940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:59.577940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:59.577940 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-24ffc77c-1d31-4c9b-aa4a-700490f5354d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.927146 Oct 06 13:11:59.577940 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2353/4718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:58 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:11:59.581700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:59.582559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: 9d4361a7-1f89-41f0-bce2-0fd7d9911017] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:59.589628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.590580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.591195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.592074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.592587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:59.592759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.593123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.594220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:59.602847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.603656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.604318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.606239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.606908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.607580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.610482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] HTTP exception thrown: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Request method failure captured: Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 HTTP/1.1 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtOwbom99rXYK_hgVpNcQEuDm-GLfqfvlkkPASydzVdnSM70y1SiXQt0blJYi6JbYST_-eb1WCU71L-GLzk5OJFBYMKbFLiwzJMPdKIGIhZx_O9SLgNVlJt1F_fKqroUtADcbjKR1unwj7PLjnv8kNG7g5mHF0KVracLMmy6Nc6JKxM Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f542e391c37440a0901558ec9c88eb29", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}] Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: dda013ee00f241fe86330565456fc678 Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '9d4361a7-1f89-41f0-bce2-0fd7d9911017'} Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:11:59.612179 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Returning 404 to user: Instance 9d4361a7-1f89-41f0-bce2-0fd7d9911017 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:11:59.617675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18b5d9da-ada6-4604-8595-666442fdf6da tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017" status: 404 len: 111 microversion: 2.1 time: 0.037018 Oct 06 13:11:59.618386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2354/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:59 2022] GET /compute/v2.1/servers/9d4361a7-1f89-41f0-bce2-0fd7d9911017 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:11:59.626376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:11:59.627085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:59.633804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.634458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.635118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.635864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.636333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.636768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.761313 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d1c3f74-ad0e-47c4-acec-e597040c334a tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "POST /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236/action" status: 202 len: 0 microversion: 2.1 time: 0.139829 Oct 06 13:11:59.764700 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2355/4720] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:11:59 2022] POST /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:11:59.772426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:59.773043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:59.794396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.795020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.796426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.799481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.800550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.802763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.854825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:11:59.881494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:11:59.914140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:59.926087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:59.927946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:11:59.929176 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7f52e32-7aea-45f8-a59b-51f17f0425f3 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.349280 Oct 06 13:11:59.950368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2366/4721] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:11:59 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:11:59.959111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:11:59.960118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:11:59.968766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.969259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.971093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.971824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:11:59.972288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:11:59.972864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:11:59.993515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0fd8b44-a214-4810-ba69-90caaa78c33d tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 204 len: 0 microversion: 2.1 time: 0.226152 Oct 06 13:11:59.994512 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2356/4722] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:11:59 2022] DELETE /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:12:00.004161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:00.004883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:00.023673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.024192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.026831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:00.027768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.030355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.030893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:00.390305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:00.407337 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3660df53-b62a-4a62-a9f4-7f9d8189c555 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1492 microversion: 2.1 time: 0.455434 Oct 06 13:12:00.409714 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2367/4723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:59 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1492 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:00.440714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:00.451122 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-75468575-e9ee-4415-ad44-f998ab0ea9db tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1517 microversion: 2.1 time: 0.451512 Oct 06 13:12:00.452287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2357/4724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:11:59 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1517 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:00.600834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:00.603674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:00.615889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:00.619222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.626107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.627030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:00.627813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.628289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.628720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:00.874806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:00.890277 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae1c62ca-119c-4d2c-b7c0-c2b9afec5c9b tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.293462 Oct 06 13:12:00.905773 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2368/4725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:00 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:00.961469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:00.962805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:00.971785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.972526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.973172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:00.974140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:00.975522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:00.976295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.183794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:01.194254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:01.196013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:01.197630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0cff3e94-a433-4dce-8f06-d22e90f87cbf tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1730 microversion: 2.20 time: 0.239987 Oct 06 13:12:01.210339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2358/4726] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:00 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:12:01.435659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:01.436614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:01.443935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.444878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.445511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.446339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.446808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.447324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.475146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:01.475871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:01.483114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.483949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.484462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.485242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.485794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.486295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.757569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:01.770660 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02fff3bc-01ae-403a-8e95-2c664c169d89 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1492 microversion: 2.1 time: 0.342012 Oct 06 13:12:01.772065 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2369/4727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:01 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1492 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:01.794683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:01.804318 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad8fe7f9-6ce6-4af9-994f-09de0b075d39 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1517 microversion: 2.1 time: 0.333010 Oct 06 13:12:01.805886 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2359/4728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:01 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:01.914343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:01.915623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:01.922636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.923424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.924054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:01.925684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:01.926351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:01.926957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.088937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:02.102859 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d8864b7-b869-40f6-adff-0ceff4df9bdf tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.191839 Oct 06 13:12:02.103998 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2370/4729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:01 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:02.224859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:02.226045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:02.234031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.234774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.235425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.236321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.236953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.237553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.399740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:02.415972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:02.418824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:02.420741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1b7768a-d6d6-438c-88f3-3d4b195a97a8 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1717 microversion: 2.20 time: 0.199869 Oct 06 13:12:02.429019 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2360/4730] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:02 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1717 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:12:02.540160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5486573-4894-43fb-b47d-8a8f3a54ce3f", "name": "network-vif-deleted", "tag": "4b7df47e-0c0f-4f66-8099-1346fc8dee39"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:02.565003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.565529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.567126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.616046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] Creating event network-vif-deleted:4b7df47e-0c0f-4f66-8099-1346fc8dee39 for instance a5486573-4894-43fb-b47d-8a8f3a54ce3f on n-h1-860556-1 Oct 06 13:12:02.639950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bc8b9a73-66b8-4acb-8b77-92932337eb0c req-d312f077-e2e2-4ae3-9257-dcb12ab6e120 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103587 Oct 06 13:12:02.650574 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2371/4731] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:02.795480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:02.796995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:02.815538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.815538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.822928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.825350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.827137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.827721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.831821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:02.832695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:02.850805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.852735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.854498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.857378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.858358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.859168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.906929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:02.907554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:02.908753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:02.911534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lazy-loading 'fault' on Instance uuid a5486573-4894-43fb-b47d-8a8f3a54ce3f {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:03.035023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda013ee00f241fe86330565456fc678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f542e391c37440a0901558ec9c88eb29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:03.044475 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6814b5ef-7064-4e46-99b0-2bfa9c0dafe0 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 200 len: 1311 microversion: 2.1 time: 0.217363 Oct 06 13:12:03.061789 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2372/4732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:02 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 1311 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:03.067432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcb91fb-b246-4d1f-a8bb-9ab62ed84363", "name": "network-vif-plugged", "status": "completed", "tag": "036ea749-194f-4def-8d97-2d7e6e7ee347"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:03.079330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:03.080033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:03.080825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:03.094170 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] Creating event network-vif-plugged:036ea749-194f-4def-8d97-2d7e6e7ee347 for instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 on n-h1-860556-1 Oct 06 13:12:03.099358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5806db41-7dad-4e94-b583-e10fcb148be7 req-2a104c93-b0ca-46ea-ae67-4b4aa9eb285f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036076 Oct 06 13:12:03.100328 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2373/4733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:03.128299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:03.129306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:03.136269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:03.137303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:03.137793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:03.138507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:03.138974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:03.139465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:03.245587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:03.255643 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52d6d3cb-0e51-49ae-9104-1c004155014c tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1492 microversion: 2.1 time: 0.464556 Oct 06 13:12:03.256244 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2361/4734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:02 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1492 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:03.362536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:03.372391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab73de53-f2eb-461f-86b9-1325c21e8314 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.248409 Oct 06 13:12:03.377929 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2374/4735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:03 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:04.069763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:04.070312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] [instance: a5486573-4894-43fb-b47d-8a8f3a54ce3f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:04.076934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.077308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.077776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.078491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.078953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.079589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.095333 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] HTTP exception thrown: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Request method failure captured: Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f HTTP/1.1 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtOwbom99rXYK_hgVpNcQEuDm-GLfqfvlkkPASydzVdnSM70y1SiXQt0blJYi6JbYST_-eb1WCU71L-GLzk5OJFBYMKbFLiwzJMPdKIGIhZx_O9SLgNVlJt1F_fKqroUtADcbjKR1unwj7PLjnv8kNG7g5mHF0KVracLMmy6Nc6JKxM Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f542e391c37440a0901558ec9c88eb29", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f542e391c37440a0901558ec9c88eb29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f542e391c37440a0901558ec9c88eb29"}]}] Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f542e391c37440a0901558ec9c88eb29 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-210090706 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: dda013ee00f241fe86330565456fc678 Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ListServerFiltersTestJSON-210090706-project Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a5486573-4894-43fb-b47d-8a8f3a54ce3f'} Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:04.097026 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] Returning 404 to user: Instance a5486573-4894-43fb-b47d-8a8f3a54ce3f could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a10e4e82-ec32-4454-ac4d-342aae873ff6 tempest-ListServerFiltersTestJSON-210090706 tempest-ListServerFiltersTestJSON-210090706-project] 10.222.0.26 "GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f" status: 404 len: 111 microversion: 2.1 time: 0.033836 Oct 06 13:12:04.103636 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2362/4736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:04 2022] GET /compute/v2.1/servers/a5486573-4894-43fb-b47d-8a8f3a54ce3f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:04.285333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:04.287041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:04.294793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.295695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.296421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.297354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.298099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.298733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.413503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:04.415004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:04.426783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.427288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.427738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.428453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.428916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.430344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.665697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:04.675279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c4157ff-49d8-46ae-8862-83a23ffdb0e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1498 microversion: 2.1 time: 0.394843 Oct 06 13:12:04.676566 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2375/4737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:04 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:04.710344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:04.711631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:04.723694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.724617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.725964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.727152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.728346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.729045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.775313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:04.801340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:12:04.806713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-702b8dea-963c-4145-ac99-bebf6cbbbb0d tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1314 microversion: 2.1 time: 0.405551 Oct 06 13:12:04.833920 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2363/4738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:04 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:04.970810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b74a1e3f-75ac-4da9-ba41-bd5453080d02 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 204 len: 0 microversion: 2.1 time: 0.272767 Oct 06 13:12:04.971723 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2376/4739] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:04 2022] DELETE /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:12:04.983963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:04.985032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:04.994000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:04.995139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:04.996003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:04.997877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:05.001094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:05.002253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:05.392741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:05.400588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9be7bdc-a000-481f-986e-c0bb466eb0ec tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.423756 Oct 06 13:12:05.401213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2364/4740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:04 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:05.846486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:05.847227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:05.858256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:05.858758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:05.859210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:05.859938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:05.860476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:05.860820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.327204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:06.352193 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ce0dd56-a428-4c13-ab9d-574664029f47 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1501 microversion: 2.1 time: 0.517373 Oct 06 13:12:06.363097 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2377/4741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:05 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1501 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:06.392347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:06.393644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:06.415666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.419559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.420084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.420932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.421528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.426206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.430550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:06.431245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:06.447187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.466696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.467177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.471633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.472442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.482426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.511466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lazy-loading 'flavor' on Instance uuid bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:06.633785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4d75ed8-b88c-45da-8217-a94421938afd tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "POST /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363/action" status: 202 len: 0 microversion: 2.1 time: 0.256251 Oct 06 13:12:06.640040 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2365/4742] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:12:06 2022] POST /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:12:06.648325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:06.649586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:06.660962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.664485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.665399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:06.666731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:06.667459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:06.669359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:07.150759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:07.161955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7331343-a003-4b64-a1bf-18ef21c495e6 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.736786 Oct 06 13:12:07.162553 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2378/4743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:06 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:07.170309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:07.181646 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52cbb378-4d5a-488b-9293-80d374ba6e54 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1509 microversion: 2.1 time: 0.539014 Oct 06 13:12:07.182684 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2366/4744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:06 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:08.185640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:08.186479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:08.208015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:08.208614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:08.219105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.219621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.221183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.222158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.223132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.225510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.226241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.227032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.230237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.231707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.232207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.234864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.294998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:08.730703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:08.735882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:08.749275 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6563f70f-00d3-4564-861e-f50abb446b00 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1492 microversion: 2.1 time: 0.545701 Oct 06 13:12:08.749898 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2367/4745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:08 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1492 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:08.759150 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6d8dc2e-b5c5-4f43-b809-f3f4a61a6bf5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.577685 Oct 06 13:12:08.779097 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2379/4746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:08 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:08.784772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:08.788812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:08.802527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.803572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.803572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.804395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:08.804946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:08.805334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:08.846846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:12:09.032653 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dcb1815-fc7a-47d6-b774-4350560d2a14 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 204 len: 0 microversion: 2.1 time: 0.256366 Oct 06 13:12:09.035876 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2368/4747] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:08 2022] DELETE /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:12:09.045772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:09.046702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:09.072451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:09.073334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:09.074072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:09.075589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:09.076279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:09.076931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:09.700698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:09.711762 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ae4ec4e-fed0-480f-a4f7-815cfb344724 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1498 microversion: 2.1 time: 0.671265 Oct 06 13:12:09.712551 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2380/4748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:09 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1498 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:09.799829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:09.801703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:09.827927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:09.828915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:09.829534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:09.830545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:09.831175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:09.833153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:10.195624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:10.217107 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42fb5287-a7af-4b55-b49c-7a9fc2d5348e tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 200 len: 1504 microversion: 2.1 time: 0.422640 Oct 06 13:12:10.217714 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2369/4749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:09 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:10.237528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d78768-ccdc-460a-a0ab-2e2c2575a236", "name": "network-vif-deleted", "tag": "f013e0a1-3a00-4ef2-b041-6a4091503a75"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:10.257691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:10.258283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:10.258727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:10.292308 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] Creating event network-vif-deleted:f013e0a1-3a00-4ef2-b041-6a4091503a75 for instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 on n-h2-860556-1 Oct 06 13:12:10.306580 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a04dcf75-c46c-41d1-8c10-c5663f2d466e req-a9e7e45f-1eba-44be-8115-84b2eaf7ec65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075079 Oct 06 13:12:10.307209 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2381/4750] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:10.737665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:10.738570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:10.745076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:10.745565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:10.746066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:10.747479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:10.748106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:10.748764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:10.971765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:10.986600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a45a76c0-654c-433e-9f8f-349e2720abc7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1498 microversion: 2.1 time: 0.251957 Oct 06 13:12:10.987460 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2370/4751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:10 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:11.244702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:11.245764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: a2d78768-ccdc-460a-a0ab-2e2c2575a236] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:11.252757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.253475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.253948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.254984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.256018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.256623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.263587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:11.274598 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] HTTP exception thrown: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Request method failure captured: Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 HTTP/1.1 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtOlUIhFznA6p7oQyZExRldNg5modvm17F5yJqibnjQKcCGpJVSB6NTPdlBE7VJt-JV4cTS6rwjk-N9g3K0Nc8SgxlSqq98WzXMPZ8Mae9jMFfLSPSdvomsWCuw3FbQaOd5BZ-AswLwSItHjnPSv-0mtWHJWI1fjOlrxBLJDH33qi3s Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 494f0709ae414368a797dd058a1d69bf Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_494f0709ae414368a797dd058a1d69bf", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/494f0709ae414368a797dd058a1d69bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/494f0709ae414368a797dd058a1d69bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/494f0709ae414368a797dd058a1d69bf"}]}] Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 494f0709ae414368a797dd058a1d69bf Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueTestJSON-1924680552-project Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7f6a370d0e6a41efac924ac5c7e62ab3 Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueTestJSON-1924680552-project Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a2d78768-ccdc-460a-a0ab-2e2c2575a236'} Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:11.276606 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Returning 404 to user: Instance a2d78768-ccdc-460a-a0ab-2e2c2575a236 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b14a4c3a-cebd-4d80-94b3-cff6f4baeb1b tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236" status: 404 len: 111 microversion: 2.1 time: 0.037868 Oct 06 13:12:11.280877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2382/4752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:11 2022] GET /compute/v2.1/servers/a2d78768-ccdc-460a-a0ab-2e2c2575a236 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:11.289700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:11.290478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:11.296808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.297299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.297806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.298475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.298934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.299365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.327020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:12:11.416960 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47be7ad7-b8b2-4348-8c44-c6e251165565 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "DELETE /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 204 len: 0 microversion: 2.1 time: 0.130169 Oct 06 13:12:11.417608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2371/4753] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:11 2022] DELETE /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:12:11.427671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:11.430703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:11.440227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.440758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.441398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.442499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.442995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.443444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.669352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:11.684813 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90e988f8-ddee-4c76-9c2d-ae8a38ad20f5 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1490 microversion: 2.1 time: 0.260911 Oct 06 13:12:11.705364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2383/4754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:11 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1490 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:11.733656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcb91fb-b246-4d1f-a8bb-9ab62ed84363", "name": "network-vif-deleted", "tag": "036ea749-194f-4def-8d97-2d7e6e7ee347"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:11.771082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:11.771577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:11.772212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:11.797787 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] Creating event network-vif-deleted:036ea749-194f-4def-8d97-2d7e6e7ee347 for instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 on n-h1-860556-1 Oct 06 13:12:11.816921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bc9eadd7-d11c-4937-b49e-94ace921d7db req-333d7aee-c4cb-44d9-87a7-9cdf7ae4176d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091865 Oct 06 13:12:11.821475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2372/4755] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:12.016913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:12.018049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:12.070215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:12.071865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:12.072601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:12.073639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:12.074071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:12.075091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:12.144096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:12.145588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:12.148885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:12.149553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lazy-loading 'fault' on Instance uuid bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:12.208088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbe307ff89d4f289e47cc26fa9931cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978516c309c04112953811ccadf3059b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:12.218316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bebba4d2-d36d-4433-ad96-f6713933d78a tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 200 len: 1304 microversion: 2.1 time: 0.209559 Oct 06 13:12:12.222006 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2384/4756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:12 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 1304 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:12.714009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:12.716158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:12.733225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:12.734182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:12.735952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:12.740124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:12.740892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:12.746057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.127690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:13.146723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2dd7ce72-5486-48b1-bda9-42724cc46a76 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1490 microversion: 2.1 time: 0.437890 Oct 06 13:12:13.151688 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2373/4757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:12 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1490 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:13.608497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.609119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.615896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.616517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.617135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.618294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.618831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.619320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.635497 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 HTTP/1.1 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'bbcb91fb-b246-4d1f-a8bb-9ab62ed84363'} Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.638076 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.643552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-329eb7bf-665c-464c-a23c-6154f0fbb8f7 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 404 len: 111 microversion: 2.1 time: 0.396149 Oct 06 13:12:13.648567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2385/4758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:13 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 111 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:13.674806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.675576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.702576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.703260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.703814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.704678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.705246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.705950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.721790 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 HTTP/1.1 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'bbcb91fb-b246-4d1f-a8bb-9ab62ed84363'} Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.723622 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dc1ed467-a3f2-4a75-841d-19755fc83fe6 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 404 len: 111 microversion: 2.1 time: 0.076032 Oct 06 13:12:13.730090 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2374/4759] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:13 2022] DELETE /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:13.735971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.736603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: bbcb91fb-b246-4d1f-a8bb-9ab62ed84363] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.743193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.744701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.745542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.747070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.747742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.748640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.764355 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 HTTP/1.1 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'bbcb91fb-b246-4d1f-a8bb-9ab62ed84363'} Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.766309 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. Oct 06 13:12:13.770407 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.772310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.773396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a0f3054-c65a-459b-90d9-1fd7e3d528ed tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363" status: 404 len: 111 microversion: 2.1 time: 0.041582 Oct 06 13:12:13.774518 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2386/4760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:13 2022] GET /compute/v2.1/servers/bbcb91fb-b246-4d1f-a8bb-9ab62ed84363 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:13.784007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.784843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.793441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.794421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.795817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.798799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.799647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.801277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.827430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d HTTP/1.1 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6f3f7f79-d045-4458-b548-bf0b530bbc3d'} Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.829431 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.834146 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6847e078-9873-4bbc-8de4-1124f4c544b4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 404 len: 111 microversion: 2.1 time: 0.054023 Oct 06 13:12:13.835093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2375/4761] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:13 2022] DELETE /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:12:13.847945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.849658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 6f3f7f79-d045-4458-b548-bf0b530bbc3d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.857343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.858107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.858748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.859627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.860251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.860834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.878526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d HTTP/1.1 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '6f3f7f79-d045-4458-b548-bf0b530bbc3d'} Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.880519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 6f3f7f79-d045-4458-b548-bf0b530bbc3d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-913b3afa-75fd-49ed-bebc-ac6914108cd4 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d" status: 404 len: 111 microversion: 2.1 time: 0.044077 Oct 06 13:12:13.888113 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2387/4762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:13 2022] GET /compute/v2.1/servers/6f3f7f79-d045-4458-b548-bf0b530bbc3d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:13.895442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.896161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.906104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.908122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.909670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.911511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.912287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.912894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.951532 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 HTTP/1.1 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'ed120aa5-ed81-4986-a4b7-3de3be7f8603'} Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:13.955108 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:13.959366 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:13.962537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:13.969216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f60f3d02-c854-4445-809f-5b43ed081624 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 404 len: 111 microversion: 2.1 time: 0.079125 Oct 06 13:12:13.970086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2376/4763] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:13 2022] DELETE /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:13.978438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:13.979080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: ed120aa5-ed81-4986-a4b7-3de3be7f8603] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:13.986447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.986845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.987283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:13.987972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:13.988618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:13.989193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.007175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 HTTP/1.1 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ed120aa5-ed81-4986-a4b7-3de3be7f8603'} Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.012173 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. Oct 06 13:12:14.017909 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.019694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance ed120aa5-ed81-4986-a4b7-3de3be7f8603 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:14.020618 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ebd14d6e-82eb-40e7-9d2b-fa96b704bc84 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603" status: 404 len: 111 microversion: 2.1 time: 0.046316 Oct 06 13:12:14.022145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2388/4764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:13 2022] GET /compute/v2.1/servers/ed120aa5-ed81-4986-a4b7-3de3be7f8603 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:12:14.033220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:14.033220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:14.039638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.040444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.040945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.041887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.042611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.043854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.059935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee HTTP/1.1 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '8c7966dd-0d16-42ca-b53c-c517770759ee'} Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:14.061578 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.067506 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.069866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:14.070975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0bd97547-e63e-4c78-9ffa-b271dd523a80 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 404 len: 111 microversion: 2.1 time: 0.045138 Oct 06 13:12:14.071757 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2377/4765] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:14 2022] DELETE /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:14.081147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:14.081970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 8c7966dd-0d16-42ca-b53c-c517770759ee] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:14.090998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.092369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.093065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.094704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.095598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.096117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.121850 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee HTTP/1.1 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8c7966dd-0d16-42ca-b53c-c517770759ee'} Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.123921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. Oct 06 13:12:14.128220 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.131130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 8c7966dd-0d16-42ca-b53c-c517770759ee could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:14.132484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f951da1d-74bb-4d3e-8ab5-d5c9786e4a05 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee" status: 404 len: 111 microversion: 2.1 time: 0.055127 Oct 06 13:12:14.144256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:14.145285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:14.147983 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2389/4766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:14 2022] GET /compute/v2.1/servers/8c7966dd-0d16-42ca-b53c-c517770759ee => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:14.151683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a HTTP/1.1 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a'} Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.154439 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.160244 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.169910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:14.169910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-876d549e-c4e9-425d-a964-1c72e8a8ac15 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a" status: 404 len: 111 microversion: 2.1 time: 0.025996 Oct 06 13:12:14.176114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:14.177081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:14.182203 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2378/4767] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:14 2022] DELETE /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:14.185526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.189511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a HTTP/1.1 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a'} Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:14.191417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:14.197832 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:14.197832 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:14.197832 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:14.197832 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. Oct 06 13:12:14.197832 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:14.204890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:14.204890 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3b202965-80d7-48ad-a217-8d8e15e51e13 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a" status: 404 len: 111 microversion: 2.1 time: 0.028835 Oct 06 13:12:14.204890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2390/4768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:14 2022] GET /compute/v2.1/servers/5e1e38ec-720d-4a00-9c6f-ae78ad9b6e7a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:14.206618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:14.238492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.239563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.240196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:14.244321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:14.250204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:14.254050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:15.011196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:15.022562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a851ec4a-067e-4bd8-aef6-7f59a782e6f9 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1490 microversion: 2.1 time: 0.838682 Oct 06 13:12:15.029630 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2379/4769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:14 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1490 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:15.378262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-660008293", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:15.473721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] validate_networks() for [('c18b8972-2678-4657-ac0b-6a6dfbc8324f', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:12:15.843150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942f79f4-09a8-444c-9600-c253b7610519", "name": "network-vif-deleted", "tag": "add9419a-564d-4ded-8730-dc4f25d55735"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:15.888786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:15.892786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:15.893567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:15.944773 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] Creating event network-vif-deleted:add9419a-564d-4ded-8730-dc4f25d55735 for instance 942f79f4-09a8-444c-9600-c253b7610519 on n-h2-860556-1 Oct 06 13:12:15.956070 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9f02dfa1-036b-403f-9b45-2e369b520424 req-d1327fcb-0600-475b-bb23-8bd154ecea40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132393 Oct 06 13:12:15.956703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2380/4770] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:16.054993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:16.057078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:16.082550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:16.083698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:16.088606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:16.089929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:16.094081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:16.095483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:16.282956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:16.283463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:16.293310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:16.299409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lazy-loading 'fault' on Instance uuid 942f79f4-09a8-444c-9600-c253b7610519 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:16.507262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6a370d0e6a41efac924ac5c7e62ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494f0709ae414368a797dd058a1d69bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:16.534584 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2951e36d-252e-4452-8879-0323b0e099d7 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 200 len: 1303 microversion: 2.1 time: 0.485127 Oct 06 13:12:16.541948 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2381/4771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:16 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 1303 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:16.635733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:12:16.638092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:12:16.639235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:12:16.639664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:12:16.643382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:12:16.711251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:16.713474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:16.714123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:16.715895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:16.716535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:16.717144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:16.749273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Getting quotas for project f005dab7accd45749e9ea551c14a43bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:12:16.775163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Getting quotas for user 84cbafbe701345d5b90ee54cc615d875 and project f005dab7accd45749e9ea551c14a43bf. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:12:16.832169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:12:16.835039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:12:16.956844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d53304d-8ccb-4cff-b00e-0142652d4a5a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.679398 Oct 06 13:12:16.960080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2391/4772] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:12:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:12:16.974212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1144d88f-0018-4b1b-be49-25b32da5c485 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:16.974583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1144d88f-0018-4b1b-be49-25b32da5c485 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:17.060592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1144d88f-0018-4b1b-be49-25b32da5c485 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:17.077481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1144d88f-0018-4b1b-be49-25b32da5c485 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1222 microversion: 2.1 time: 0.108707 Oct 06 13:12:17.110536 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2382/4773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:16 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:17.576713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:17.578318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] [instance: 942f79f4-09a8-444c-9600-c253b7610519] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:17.601794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:17.602308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:17.602748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:17.603469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:17.603937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:17.604360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:17.645186 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] HTTP exception thrown: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Request method failure captured: Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 HTTP/1.1 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtOlUIhFznA6p7oQyZExRldNg5modvm17F5yJqibnjQKcCGpJVSB6NTPdlBE7VJt-JV4cTS6rwjk-N9g3K0Nc8SgxlSqq98WzXMPZ8Mae9jMFfLSPSdvomsWCuw3FbQaOd5BZ-AswLwSItHjnPSv-0mtWHJWI1fjOlrxBLJDH33qi3s Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 494f0709ae414368a797dd058a1d69bf Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_494f0709ae414368a797dd058a1d69bf", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/494f0709ae414368a797dd058a1d69bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/494f0709ae414368a797dd058a1d69bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/494f0709ae414368a797dd058a1d69bf"}]}] Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 494f0709ae414368a797dd058a1d69bf Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueTestJSON-1924680552 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueTestJSON-1924680552-project Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7f6a370d0e6a41efac924ac5c7e62ab3 Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueTestJSON-1924680552-project Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '942f79f4-09a8-444c-9600-c253b7610519'} Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:17.649111 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. Oct 06 13:12:17.654141 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:17.661874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] Returning 404 to user: Instance 942f79f4-09a8-444c-9600-c253b7610519 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:17.664595 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-097e8d11-364f-44b2-85ce-b19230d2ad21 tempest-ServerRescueTestJSON-1924680552 tempest-ServerRescueTestJSON-1924680552-project] 10.222.0.26 "GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519" status: 404 len: 111 microversion: 2.1 time: 0.095198 Oct 06 13:12:17.669305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2392/4774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:17 2022] GET /compute/v2.1/servers/942f79f4-09a8-444c-9600-c253b7610519 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:18.106691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ecc86596-0002-40d6-8273-a695ebeedaf9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:18.108064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ecc86596-0002-40d6-8273-a695ebeedaf9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:19.231320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ecc86596-0002-40d6-8273-a695ebeedaf9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:19.241311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ecc86596-0002-40d6-8273-a695ebeedaf9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1222 microversion: 2.1 time: 1.142045 Oct 06 13:12:19.244299 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2383/4775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:18 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1222 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:20.096865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:20.098183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:20.108238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.113647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.117266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.118715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.120256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.123910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.161288 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 HTTP/1.1 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '74390366-e72c-43da-8620-2b7ea6da61e4'} Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:20.163441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.168555 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.170949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:20.172111 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-023e233e-8d08-43fe-9987-90992c99463e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 404 len: 111 microversion: 2.1 time: 0.080287 Oct 06 13:12:20.173280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2393/4776] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:20 2022] DELETE /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:20.182763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:20.184257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 74390366-e72c-43da-8620-2b7ea6da61e4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:20.197170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.197953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.198629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.200632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.202077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.202770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.221759 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 HTTP/1.1 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '74390366-e72c-43da-8620-2b7ea6da61e4'} Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.223992 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. Oct 06 13:12:20.228199 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.241649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 74390366-e72c-43da-8620-2b7ea6da61e4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:20.245353 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2998f327-c037-411f-8379-5a20c698f95e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4" status: 404 len: 111 microversion: 2.1 time: 0.068104 Oct 06 13:12:20.246755 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2384/4777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:20 2022] GET /compute/v2.1/servers/74390366-e72c-43da-8620-2b7ea6da61e4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:20.257711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:20.264377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:20.279688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:20.280323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:20.311324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.314765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.318131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.320205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.320726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.321169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.324977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.327413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.331485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.334547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.335051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.339456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.394249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf HTTP/1.1 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2a82044e-4db0-4c80-88d9-d0adfe01a0bf'} Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:20.396157 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.401384 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.408296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:20.410824 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b35ee4f8-c85c-4978-9e62-91dfdd6e7275 tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 404 len: 111 microversion: 2.1 time: 0.157024 Oct 06 13:12:20.412206 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2394/4778] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:12:20 2022] DELETE /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:20.422429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:20.423423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] [instance: 2a82044e-4db0-4c80-88d9-d0adfe01a0bf] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:20.432315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.436054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.436875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.438022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:20.438866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:20.440151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:20.444338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:20.454172 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa0bbdca-8606-4d72-9ae0-b05cc5a60634 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1280 microversion: 2.1 time: 0.186302 Oct 06 13:12:20.454765 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2385/4779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:20 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:20.475344 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] HTTP exception thrown: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Request method failure captured: Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf HTTP/1.1 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtL5oRFl6B1Nv3tlmh8P1XwiGL8g2Tuegcx6HDS3ORnafm8guZMRcvT1RXE23L-0ZvVhRCBDl38zAFalvulsZ9ZqfItLDuzAaT1RDMKXk_Ukma1KseVGrs6zYiZc64nRGwuymTYYB7dFgRxPZo3K_QuV3tx0MNM3nsMUO9mvtq7yZTE Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_978516c309c04112953811ccadf3059b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/978516c309c04112953811ccadf3059b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/978516c309c04112953811ccadf3059b"}]}] Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 978516c309c04112953811ccadf3059b Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1466585871 Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 8dbe307ff89d4f289e47cc26fa9931cb Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1466585871-project Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '2a82044e-4db0-4c80-88d9-d0adfe01a0bf'} Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:20.476920 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. Oct 06 13:12:20.481622 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:20.483702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] Returning 404 to user: Instance 2a82044e-4db0-4c80-88d9-d0adfe01a0bf could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:20.484757 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b8074f6e-b9f0-4a57-99a1-d35364e0227e tempest-DeleteServersTestJSON-1466585871 tempest-DeleteServersTestJSON-1466585871-project] 10.222.0.26 "GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf" status: 404 len: 111 microversion: 2.1 time: 0.067196 Oct 06 13:12:20.485846 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2395/4780] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:20 2022] GET /compute/v2.1/servers/2a82044e-4db0-4c80-88d9-d0adfe01a0bf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:12:21.478262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:21.478973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:21.494200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:21.495331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:21.498166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:21.499140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:21.499876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:21.502355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:21.939389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:21.975336 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c32d876e-c5de-4577-a4a8-b0f97c2598a6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1280 microversion: 2.1 time: 0.495761 Oct 06 13:12:22.006951 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2386/4781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:21 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1280 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:23.005926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:23.006553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:23.010702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:23.032629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:23.033217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:23.034006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:23.034813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:23.035179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:23.035665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:23.760897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9fde6e7-d530-4028-af5b-535cfffff9ad"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:23.769583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:23.800360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:23.810606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:23.813251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:23.816810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:23.817493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:23.818473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:24.100590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:24.108355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:24.120080 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15af7030-9461-4fe0-ade8-042450d51107 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 1.118096 Oct 06 13:12:24.127686 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2396/4782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:23 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:24.496394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e8721a4-9316-4347-a971-531a3842190f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738691 Oct 06 13:12:24.496961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2387/4783] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:12:23 2022] POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 194 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:25.155530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:25.157769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:25.179906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:25.183864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:25.186377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:25.187421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:25.189387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:25.190139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:26.005117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:26.028916 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84b62afc-2e92-4bdb-a68d-aa357ad866c6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.885406 Oct 06 13:12:26.030296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2397/4784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:25 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:27.060820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:27.063266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:27.083235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:27.086131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:27.087449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:27.089398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:27.091984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:27.093421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:27.118534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:27.149830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:27.154258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:27.162574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:27.168771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:27.169527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:27.201157 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] Creating event network-changed:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:12:27.220495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e7d0eab4-5312-4c8e-902b-a165ab6ee563 req-43fcf997-7eb4-4265-a925-289d20bdc65f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106547 Oct 06 13:12:27.221911 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2398/4785] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:28.281636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:28.301132 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ae4dccc-9e50-4fe6-8c55-b22da7ec1d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 1.239113 Oct 06 13:12:28.302060 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2388/4786] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:27 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:29.329621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:29.330284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:29.340142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:29.340650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:29.343122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:29.343867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:29.344345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:29.344781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:29.595186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:29.606969 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c8e1035c-f005-474f-98ed-42b887f48f66 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.283820 Oct 06 13:12:29.608158 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2399/4787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:29 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:30.630696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:30.631525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:30.635087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:30.635779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:30.651314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:30.653284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:30.653971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:30.654908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:30.657319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:30.658019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:31.419642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:31.434058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba078c27-714d-44d9-82cb-a6f71be62da3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.807519 Oct 06 13:12:31.437490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2389/4788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:30 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:32.465574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:32.466512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:32.488416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:32.488980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:32.489358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:32.501848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:32.503184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:32.509140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:33.054695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:33.063493 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c72d4a1d-88e7-425d-8bb8-3e33afa89038 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.602136 Oct 06 13:12:33.101577 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2400/4789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:32 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:34.096413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:34.097041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:34.119735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:34.121465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:34.122167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:34.124353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:34.125029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:34.127765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:34.724092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:34.751827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0da76409-fb06-4236-b757-afccb96a0e22 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.658777 Oct 06 13:12:34.752513 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2390/4790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:34 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:35.770632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:35.773059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:35.780962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:35.782302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:35.790292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:35.794424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:35.807141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:35.813982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:35.814237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:35.814331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:35.816028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:35.818495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:35.819149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:35.823041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:35.826714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:35.829137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:35.974073 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e6c3a2f-3805-4ede-8cb0-a387518abc63 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.209373 Oct 06 13:12:35.975715 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2401/4791] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Oct 6 13:12:35 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907/os-volume_attachments => generated 25 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:36.182999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:36.184473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:36.218526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.224123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.224843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:36.233917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.234841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.235856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:36.357365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:12:36.362295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:36.377039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d43f69dc-8d60-4b1e-a5cc-cfabba621c2e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.601361 Oct 06 13:12:36.381998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2391/4792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:35 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:36.406996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:36.415273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:36.443659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.444267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.458301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:36.460532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.465460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.469607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:36.556390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lazy-loading 'flavor' on Instance uuid a70be547-3608-4d32-afdc-5f0186b5b6a3 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:36.618999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-805804f6-f914-4b08-8e08-2f554ba962fb tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 204 len: 0 microversion: 2.20 time: 0.441027 Oct 06 13:12:36.620168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2402/4793] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:12:36 2022] DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:12:36.642917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:36.643049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:36.658118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.659395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.659848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:36.660574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:36.661038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:36.664724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:37.027574 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33d91217-c1d9-48b7-9f4d-8ce2687982d0 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/action" status: 200 len: 32 microversion: 2.1 time: 0.643135 Oct 06 13:12:37.036549 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2392/4794] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:12:36 2022] POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/action => generated 32 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:12:37.055079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:37.055799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:37.087907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:37.093788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:37.095840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:37.098042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:37.098849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:37.100160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:37.172720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:37.192596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:37.197186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:37.201324 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e7b9aca-26bb-4206-80f0-e45d95d2ccbe tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.569621 Oct 06 13:12:37.202629 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2403/4795] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:36 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:12:37.418214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:37.418837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:37.435863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:37.436190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:37.443823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:37.445933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:37.454995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:37.455658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:37.906484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:37.938856 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a35508e-4127-4a8a-be73-679e624f0cd2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.897990 Oct 06 13:12:37.942129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2393/4796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:37 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:37.958926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "name": "network-vif-plugged", "status": "completed", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:38.006022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:38.008979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:38.015659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:38.094504 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] Creating event network-vif-plugged:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:12:38.123127 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-98a234b9-09e7-471e-8695-56729f6b9426 req-95f5eb47-5e7a-4728-9008-e55ff17bedbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178647 Oct 06 13:12:38.134441 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2394/4797] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:38.195919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:38.206724 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc556798-c10a-42a2-aa1a-f0ce85fcf2d0 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 0.793616 Oct 06 13:12:38.215900 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2404/4798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:37 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:38.233984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:38.235090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:38.246086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:38.250026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:38.252524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:38.253595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:38.255539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:38.258362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:38.930200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:38.949616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:38.956797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:38.963874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d14871ed-c2e2-44de-a877-af1f610061e7 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1723 microversion: 2.20 time: 0.734831 Oct 06 13:12:38.965408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:38.966280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:38.967303 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2395/4799] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:38 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1723 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:12:38.991934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:39.000259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:39.001447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:39.003193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:39.013627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:39.014798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:39.231534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:39.232156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:39.241993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:39.243913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:39.245109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:39.247234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:39.248440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:39.249445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:40.478937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:40.484804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:40.488779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:40.505111 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e495960d-b787-44c8-9bb9-261698992807 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 1.544414 Oct 06 13:12:40.508841 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2405/4800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:38 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:40.512897 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a705e95-75c5-4242-a151-1c8922940bbc tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1322 microversion: 2.1 time: 1.285951 Oct 06 13:12:40.514241 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2396/4801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:39 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1322 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:40.515129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:40.515762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:40.543924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:40.544432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:40.544883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:40.545637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:40.546133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:40.546566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:40.778986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:40.804025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:40.816532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:40.822850 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ff116a8-6c1c-4a3e-a484-e416dd0445f6 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1656 microversion: 2.20 time: 0.307108 Oct 06 13:12:40.823539 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2406/4802] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:40 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1656 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:12:41.534588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:41.535219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:41.537283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:41.538022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:41.551950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:41.552185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:41.552468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:41.552920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:41.553641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:41.554142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:41.554582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:41.555100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:41.555761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:41.559215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:41.562074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:41.562842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.422276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:42.435826 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23e9f371-eb7e-488d-93e1-520fec66c8cb tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1518 microversion: 2.1 time: 0.902897 Oct 06 13:12:42.438601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2407/4803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:41 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1518 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:42.454251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37b88cd-d04c-425d-931d-855840f39907", "name": "network-vif-deleted", "tag": "e318da7d-d67c-4b2c-afed-4be87cd35f19"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:42.489321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.491659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.492494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.533067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:42.536165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] Creating event network-vif-deleted:e318da7d-d67c-4b2c-afed-4be87cd35f19 for instance f37b88cd-d04c-425d-931d-855840f39907 on n-h1-860556-1 Oct 06 13:12:42.542013 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3710b583-cbb2-4038-b533-37aff5e9e518 req-3e3d959c-fa19-4ecd-8891-f15737293e72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102095 Oct 06 13:12:42.544227 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2408/4804] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:12:42.548671 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac116bdc-a032-4482-a9b0-4da911121ac4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 1.020042 Oct 06 13:12:42.551657 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2397/4805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:41 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:42.553341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:42.554221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:42.563198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:42.568942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:42.576253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.576850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.577368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.581429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.582251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.582773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.592523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.600000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.601037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.602065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.603279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.603929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.658685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.662718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lazy-loading 'flavor' on Instance uuid 75d6d94d-7986-4bd3-aa8d-ae41a1909098 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:42.663282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.663815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.664360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lazy-loading 'fault' on Instance uuid f37b88cd-d04c-425d-931d-855840f39907 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:12:42.766059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:42.774484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:42.787174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1adca22b5c8a44fcbe1e6ef0f39ba69b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844e3815b5a545ab8fc1821d284f9504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:42.793032 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77fd8c7b-206f-4082-ac06-a2c8cc93f710 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 200 len: 1371 microversion: 2.20 time: 0.245238 Oct 06 13:12:42.793974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2409/4806] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:42 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:12:42.864741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44d2d709-245b-4246-ac0d-f7ad67b41285 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action" status: 200 len: 32 microversion: 2.1 time: 0.311574 Oct 06 13:12:42.878139 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2398/4807] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:12:42 2022] POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:12:42.881713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:42.882123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:42.903121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.905068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.906915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:42.909311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:42.912448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:42.915671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:43.583893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:43.584729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:43.598282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:43.601128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:43.601662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:43.604722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:43.605831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:43.608748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:43.957993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:43.972166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-241f9fa6-a590-49e2-9b1a-3841b93b3644 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 1.100536 Oct 06 13:12:43.998708 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2410/4808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:42 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:44.003295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:44.004725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:44.022317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:44.026433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:44.027083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:44.027963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:44.028536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:44.029247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:44.066843 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 HTTP/1.1 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f37b88cd-d04c-425d-931d-855840f39907'} Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:44.073054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:44.079004 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:12:44.081178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:44.082449 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d7e6424-802f-4509-ba5d-44b1b39e879e tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 404 len: 111 microversion: 2.20 time: 0.083180 Oct 06 13:12:44.083217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2411/4809] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:43 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:12:44.092508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6a6b37a-0811-4746-899a-474a182e8bb1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '.version_select at 0x7f7d476c2820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:44.147405 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6a6b37a-0811-4746-899a-474a182e8bb1 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403137545" status: 204 len: 0 microversion: 2.20 time: 0.059489 Oct 06 13:12:44.148286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2412/4810] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Oct 6 13:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403137545 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:12:44.425540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:44.438833 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b8e98213-d293-4a90-b95d-bb1383cfb317 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.863502 Oct 06 13:12:44.440816 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2399/4811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:43 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:45.006389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:45.007521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:45.060994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:45.065047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:45.066450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:45.094301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:45.096923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:45.097923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:45.463956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:45.465252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:45.487019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:45.489840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:45.491179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:45.493505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:45.497338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:45.501051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:45.523471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:46.342656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:46.352825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-542291db-dd04-4c33-a41a-50758d4d9be6 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 1.352081 Oct 06 13:12:46.358874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2413/4812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:44 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:47.037246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:47.059433 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00210cd3-b6af-4379-b9a4-e175aac4f296 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 1.597994 Oct 06 13:12:47.061364 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2400/4813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:45 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:47.393086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:47.394383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:47.423713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:47.424525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:47.426679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:47.429308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:47.432238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:47.432934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:48.087170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:48.093317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:48.095112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:48.115015 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed3e06f6-8734-4496-845a-47b37ad2e08c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.726096 Oct 06 13:12:48.129441 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2414/4814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:47 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:48.139178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:48.142291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:48.142291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:48.144306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:48.144970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:48.146829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:49.143961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:49.156585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:49.157221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:49.174491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:49.176807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-979c3ab5-f9d1-4bd1-a817-56ec7e9b3572 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 1.092126 Oct 06 13:12:49.178417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:49.179896 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2401/4815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:48 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:49.180553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:49.184018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:49.186101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:49.186861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:49.676117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:49.705238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c32a0907-4d58-4753-8bfa-76547f3f6161 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.553431 Oct 06 13:12:49.713805 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2415/4816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:49 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:50.211881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:50.213476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:50.237610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:50.241159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:50.241916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:50.246261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:50.249259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:50.253022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:50.767116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:50.792978 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-399dd75a-0941-4bb7-8bb9-cef662c32da3 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.581592 Oct 06 13:12:50.826027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2402/4817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:50 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:50.856764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:50.861893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:50.892333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:50.895593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:50.898768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:50.903077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:50.906897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:50.908335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:51.232914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-47452328", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "aa83b2d3-c223-414a-b52f-d228a47e4697"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:12:51.342124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] validate_networks() for [('aa83b2d3-c223-414a-b52f-d228a47e4697', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:12:51.541051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:51.556736 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a61e708e-7e27-46ef-bdbc-20d22b64c03c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.727239 Oct 06 13:12:51.567200 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2403/4818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:50 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:51.833772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:51.834827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:51.850324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:51.854853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:51.858081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:51.863579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:51.864267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:51.865232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:52.616820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:52.644229 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-209a9919-357a-4512-9e67-3cec0d502d8b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.815577 Oct 06 13:12:52.695662 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2404/4819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:51 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:52.704275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:52.710832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:52.729196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:52.731040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:52.732414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:52.734505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:52.736730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:52.738517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.304043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:53.314842 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee69d651-cd19-4212-a949-cc0a151060be tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.617232 Oct 06 13:12:53.315913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2405/4820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:52 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:53.322609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:53.323508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:53.330867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.331606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.332502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.333415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.334583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.335194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.355954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 HTTP/1.1 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f37b88cd-d04c-425d-931d-855840f39907'} Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:53.358003 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.363074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.366556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:53.367460 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0bade8e4-3555-4a3e-aebc-801cc38a436c tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 404 len: 111 microversion: 2.20 time: 0.050302 Oct 06 13:12:53.371817 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2406/4821] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:12:53 2022] DELETE /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:12:53.392603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:53.400888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f37b88cd-d04c-425d-931d-855840f39907] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:53.401075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:12:53.402021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:12:53.402628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:12:53.403308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:12:53.403684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:12:53.406458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:12:53.413672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.414208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.414961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.415691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.416147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.420189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.437718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.441128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.442742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.447007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.447755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.448444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.462792 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 HTTP/1.1 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f37b88cd-d04c-425d-931d-855840f39907'} Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.469061 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f37b88cd-d04c-425d-931d-855840f39907 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:12:53.473576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e9b2258-2786-4327-bf6e-a0d195d5cc64 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907" status: 404 len: 111 microversion: 2.20 time: 0.090321 Oct 06 13:12:53.477312 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2407/4822] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:12:53 2022] GET /compute/v2.1/servers/f37b88cd-d04c-425d-931d-855840f39907 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:12:53.531158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Getting quotas for project f3932ad7da01478781804a648a1e835c. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:12:53.544812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Getting quotas for user 59237920f5a141eb9e07a1b3f69efb51 and project f3932ad7da01478781804a648a1e835c. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:12:53.599767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:12:53.602555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:12:53.695196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:53.696415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:53.710651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.711263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.711728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.722257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:53.722771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:53.723503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:53.809455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d57f6d6-473f-4b53-b3c8-7e80b36fbe99 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.203293 Oct 06 13:12:53.811346 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2416/4823] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:12:53.835870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78e68945-abdc-460c-bc33-20b44dea78b3 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:53.838726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-78e68945-abdc-460c-bc33-20b44dea78b3 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:53.994948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78e68945-abdc-460c-bc33-20b44dea78b3 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:54.015933 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78e68945-abdc-460c-bc33-20b44dea78b3 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1223 microversion: 2.1 time: 0.195814 Oct 06 13:12:54.017135 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2417/4824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:53 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:54.343500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:54.344139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:54.372096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:54.372600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:54.373042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:54.373832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:54.383704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:54.390706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:54.412226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:54.442689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad7ef22a-3720-4028-9663-91778c3ae288 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.751212 Oct 06 13:12:54.466117 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2408/4825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:53 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:54.761747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:54.770561 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a7441ee7-b2ad-490d-916e-92c8effbf836 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.431766 Oct 06 13:12:54.795465 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2418/4826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:54 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:55.044570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50cf1122-1e0e-430b-b568-fa5af13fe922 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:55.049052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50cf1122-1e0e-430b-b568-fa5af13fe922 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:55.263997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50cf1122-1e0e-430b-b568-fa5af13fe922 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:55.278068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50cf1122-1e0e-430b-b568-fa5af13fe922 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1223 microversion: 2.1 time: 0.234789 Oct 06 13:12:55.301439 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2409/4827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:55 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1223 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:55.470860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:55.471486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:55.481624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:55.506276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:55.507153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:55.508093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:55.517217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:55.517870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:55.800171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:55.801270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:55.833431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:55.834018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:55.834472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:55.841618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:55.843463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:55.846545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:55.934574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:55.947729 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-17490d4f-ab48-4782-a928-d54c46eb6530 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.480707 Oct 06 13:12:55.954145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2419/4828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:55 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:56.204234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:56.239434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01b0061b-ddc7-4d76-bec7-3ba795a84e69 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.444528 Oct 06 13:12:56.241343 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2410/4829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:55 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:56.306090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:56.307248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:56.321546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:56.322227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:56.322674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:56.325952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:56.329021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:56.330699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:56.459991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:56.472911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25999c6e-9079-41cf-a6bb-fcb317473a58 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1275 microversion: 2.1 time: 0.172106 Oct 06 13:12:56.474419 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2420/4830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:56 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:56.975297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:56.977200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:56.988340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:56.989485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:56.990531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:56.993456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:56.996175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:56.997781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:57.266965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:57.268242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:57.286711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:57.299041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7529ddaa-9fc8-411d-bd8a-472968a20922 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.327848 Oct 06 13:12:57.299827 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2411/4831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:56 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:57.315987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:57.316503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:57.316934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:57.317657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:57.318226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:57.318660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:57.503147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:57.504255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:57.517417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:57.518306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:57.520172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:57.520172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:57.520172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:57.520873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:57.692090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:57.701629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:57.704360 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4df73357-a65d-4eaf-ba20-b52a30bc9567 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1281 microversion: 2.1 time: 0.205864 Oct 06 13:12:57.705453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2412/4832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:57 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:57.718776 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a26a9473-4a9f-4858-b43b-32523a1686b9 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.452804 Oct 06 13:12:57.719713 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2421/4833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:57 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:12:58.324895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:58.326233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:58.343360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.344196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.349540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:58.350580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.351226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.351811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:58.667265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:58.676475 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6856df75-f8d7-4401-9028-54d20791efbd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1734 microversion: 2.1 time: 0.356751 Oct 06 13:12:58.677080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2413/4834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:58 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1734 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:58.728867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:58.729508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:58.745028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:58.746553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:58.757124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.758055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.758697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:58.758889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.759397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.759846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:58.760573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.761597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.762058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:58.764812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:58.765578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:58.766770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:59.016861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:59.029751 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8b543d0-dde2-4d4c-9774-289e297f0a25 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1281 microversion: 2.1 time: 0.304999 Oct 06 13:12:59.030368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2422/4835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:58 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:59.214935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:59.233713 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fb86f8f3-11bd-472a-b919-40c336a57886 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.491450 Oct 06 13:12:59.252940 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2414/4836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:58 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:12:59.701668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:12:59.702226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:12:59.714111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:59.714641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:59.715090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:59.716291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:12:59.716828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:12:59.717344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:12:59.967453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:12:59.994264 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d176cb3-1c29-4577-baf1-0100baa3b7cb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1714 microversion: 2.1 time: 0.297312 Oct 06 13:12:59.994904 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2423/4837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:12:59 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1714 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:00.056148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:00.057404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:00.066412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.067168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.067802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.068726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.069364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.070200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.271388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:00.273445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:00.290367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.332680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.334270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.342911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.348885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.350703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.609934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:00.622314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d21cdc32-d373-4353-b569-00b5f741c381 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.571534 Oct 06 13:13:00.622934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2415/4838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:00 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:00.643625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:00.644144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:00.673132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.675435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.677155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.683313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.702641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.703319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.767363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:00.793998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a13194d8-890b-4195-bea3-a33ed0d1bcc7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.520226 Oct 06 13:13:00.796067 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2424/4839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:00 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:00.951783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Cannot 'detach_volume' instance a70be547-3608-4d32-afdc-5f0186b5b6a3 while it is in vm_state rescued Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments/f9fde6e7-d530-4028-af5b-535cfffff9ad HTTP/1.1 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: exception: Cannot 'detach_volume' instance a70be547-3608-4d32-afdc-5f0186b5b6a3 while it is in vm_state rescued Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': 'a70be547-3608-4d32-afdc-5f0186b5b6a3', 'id': 'f9fde6e7-d530-4028-af5b-535cfffff9ad'} Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a70be547-3608-4d32-afdc-5f0186b5b6a3 while it is in vm_state rescued Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:00.957177 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a70be547-3608-4d32-afdc-5f0186b5b6a3 while it is in vm_state rescued Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:00.963167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 409 to user: Cannot 'detach_volume' instance a70be547-3608-4d32-afdc-5f0186b5b6a3 while it is in vm_state rescued {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:00.964365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94fa3183-7aa9-4ce7-8d85-26fefaf02bb4 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments/f9fde6e7-d530-4028-af5b-535cfffff9ad" status: 409 len: 152 microversion: 2.1 time: 0.335262 Oct 06 13:13:00.970345 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2416/4840] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:13:00 2022] DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments/f9fde6e7-d530-4028-af5b-535cfffff9ad => generated 152 bytes in 343 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:13:00.977337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:00.978748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:00.992673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.994658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:00.997183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:00.998777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:00.999617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.000306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.078162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:01.144372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8370f500-21ef-4450-b6da-76f8a2a42f16 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/action" status: 202 len: 0 microversion: 2.1 time: 0.174917 Oct 06 13:13:01.145200 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2425/4841] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:00 2022] POST /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:01.153527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:01.154280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:01.167787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=58 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:01.169641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.173590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.174552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.175565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.180606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.181667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.399495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:01.414471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65e15710-37c1-4ef2-95c2-d4eb3db74016 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1722 microversion: 2.1 time: 0.264424 Oct 06 13:13:01.415739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2417/4842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:01 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:01.606195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:01.606808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:01.630698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.631211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.631669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.636962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.645704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:01.646541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:01.649720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.653357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.667878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.673448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.673976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.674736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.675218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.675662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.705461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c HTTP/1.1 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f947c19c-0ca6-46d8-a257-45e62a15a37c'} Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:13:01.707459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.712339 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.714024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:01.715548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23609d17-ac30-4f34-803f-4b50087c7c07 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 404 len: 111 microversion: 2.20 time: 0.115103 Oct 06 13:13:01.716779 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2426/4843] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:13:01 2022] DELETE /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:13:01.724663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:01.726513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] [instance: f947c19c-0ca6-46d8-a257-45e62a15a37c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:01.740221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.742558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.743220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.744155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.749250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.749979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.792275 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] HTTP exception thrown: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Request method failure captured: Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c HTTP/1.1 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtJI7iEE9wXdaZW_1yjAs8Jf33TYPyzfeNGcwPVe9a4BNtrdX8AQ5co8aEifQrWG5Nz9HB6g9UG1jyin6k7vBrB3ZP2BCkEZvJi3R47Kj9KZ7KVJdNPtQUBe9U-rZTqNexfBhIbmlJPF2cs-m6mqCY59eyStlyMWOZrSqyGCq2mTLGQ Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_844e3815b5a545ab8fc1821d284f9504", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/844e3815b5a545ab8fc1821d284f9504"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/844e3815b5a545ab8fc1821d284f9504"}]}] Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 844e3815b5a545ab8fc1821d284f9504 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135473259 Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1adca22b5c8a44fcbe1e6ef0f39ba69b Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135473259-project Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f947c19c-0ca6-46d8-a257-45e62a15a37c'} Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.794513 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. Oct 06 13:13:01.798759 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:01.801238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] Returning 404 to user: Instance f947c19c-0ca6-46d8-a257-45e62a15a37c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:01.802342 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef22bb5a-dcff-4fb0-b638-c9cc3dd16bf2 tempest-AttachVolumeShelveTestJSON-135473259 tempest-AttachVolumeShelveTestJSON-135473259-project] 10.222.0.26 "GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c" status: 404 len: 111 microversion: 2.20 time: 0.081510 Oct 06 13:13:01.803433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2427/4844] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:13:01 2022] GET /compute/v2.1/servers/f947c19c-0ca6-46d8-a257-45e62a15a37c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 06 13:13:01.823061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:01.824223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:01.847619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.848117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.848561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:01.849283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:01.849756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:01.850436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:02.181481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:02.199516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c47032c-8a95-4789-894d-86168db03ad7 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.557522 Oct 06 13:13:02.202821 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2418/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:01 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:02.257668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:02.272927 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3750b813-49ef-41cd-bfee-d21436660f2f tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.452496 Oct 06 13:13:02.276969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2428/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:01 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:02.440373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:02.441267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:02.457387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:02.460045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:02.460919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:02.463337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:02.464064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:02.464973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:02.470336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:02.962784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:02.982734 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e38f1b76-53a9-46b3-8c56-d5f5b77a393b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1722 microversion: 2.1 time: 0.546964 Oct 06 13:13:02.984104 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2419/4847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:02 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1722 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:03.241413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:03.242087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:03.274506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:03.275830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:03.279813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:03.286851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:03.286851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:03.286851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:03.301672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:03.302393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:03.314660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:03.315170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:03.315614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:03.335341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:03.335851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:03.336308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:03.498933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:04.000535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:04.166238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:04.183028 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b74c1409-3a58-49ef-accf-08adca3950ce tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.886288 Oct 06 13:13:04.192267 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2420/4848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:03 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:04.205364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:04.206232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:04.213571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:04.219160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:04.219847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:04.221859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:04.223807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:04.224476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:04.771747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:04.781594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9566591a-9cc8-48e1-b6d9-df0fce930f85 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 1.556227 Oct 06 13:13:04.782569 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2429/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:03 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:04.790682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4344502b-8f5e-4218-aeb9-c8c33a205171", "tag": "834de65b-6fa1-4049-b13c-ba4d33fb930e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:04.801626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:04.802479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:04.803152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:04.825720 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] Creating event network-changed:834de65b-6fa1-4049-b13c-ba4d33fb930e for instance 4344502b-8f5e-4218-aeb9-c8c33a205171 on n-h1-860556-1 Oct 06 13:13:04.839970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e85a2e04-b3c3-496e-94f4-2ec3e313423f req-0c134631-f97c-46c7-b642-cb670860c8a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053700 Oct 06 13:13:04.841576 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2430/4850] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:05.016922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:05.027601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-352d46ac-fbcd-4c34-ad03-ae7d3e97d83a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1722 microversion: 2.1 time: 0.835768 Oct 06 13:13:05.028793 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2421/4851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:04 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1722 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:05.220329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:05.222515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:05.243617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:05.246378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:05.247249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:05.248918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:05.251143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:05.253629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:05.788678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:05.802645 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-abe524a5-bc24-41f2-9da3-23b4103bd286 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.592348 Oct 06 13:13:05.818601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2431/4852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:05 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:05.827744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:05.828611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:05.846722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:05.859305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:05.860364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:05.861000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:05.862161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:05.863461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:05.864140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.055587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:06.056273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:06.065955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.075250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.075685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.076448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.089828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.090977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.423495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:06.433380 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45edc69a-5594-4373-a844-9ff18002b943 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.612711 Oct 06 13:13:06.457581 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2422/4853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:05 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:06.631720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:06.646573 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48d8e656-7971-4b5a-b526-a8872b21fd7a tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1728 microversion: 2.1 time: 0.593423 Oct 06 13:13:06.649988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2432/4854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:06 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1728 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:06.677200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:06.677714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:06.694757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.695624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.696255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.699747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.704840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.705808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.844838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:06.846154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:06.854454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.855829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.856451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.857382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:06.858056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:06.858662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:06.963226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d0070ed-d177-4279-87bb-c8953b1b2ed7 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.290478 Oct 06 13:13:06.964971 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2423/4855] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:13:06 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:07.301546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:07.314538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c42b7fed-db67-479e-979d-a543ad69cb57 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.488261 Oct 06 13:13:07.332569 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2433/4856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:06 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:07.470578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:07.471952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:07.486025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:07.489350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:07.490646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:07.493914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:07.496353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:07.498230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:08.142010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:08.163333 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0473a8d8-b56f-471a-aec8-9780f9f121c5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.695349 Oct 06 13:13:08.179303 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2424/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:07 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:08.351886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:08.352944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:08.368292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:08.369361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:08.370942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:08.372505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:08.374633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:08.376767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.194149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:09.194781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:09.209323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:09.210609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:09.211279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.214601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:09.215262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:09.215868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.343253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:09.351709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2488b54d-5bea-4c52-81b5-3542d812a91a tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 1.012905 Oct 06 13:13:09.352722 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2434/4858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:08 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:09.359028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:09.370412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:09.371304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:09.372014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.385223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] Creating event network-changed:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:13:09.391741 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2f71e771-e511-44c5-8fee-857fb270e200 req-b4d4b08c-d680-47e9-aed6-b7544ed7c83c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037037 Oct 06 13:13:09.393222 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2435/4859] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:09.428550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:09.429531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:09.455795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:09.457457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:09.459693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.460792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:09.463210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:09.468894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:09.526922 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0a37a07-bdec-48d0-8dd6-b6883dbee2de tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/ips" status: 200 len: 145 microversion: 2.1 time: 0.101859 Oct 06 13:13:09.539711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2436/4860] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:13:09 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/ips => generated 145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:09.839433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:09.850191 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6fa0faaf-1fab-47d7-8f48-ce16c9fa2ed9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.660012 Oct 06 13:13:09.851729 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2425/4861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:09 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:10.403720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:10.404348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:10.424073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:10.424783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:10.425351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:10.426507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:10.427205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:10.428003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:10.877409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:10.877962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:10.898397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:10.898583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:10.900020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:10.903430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:10.904569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:10.906364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:10.994623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:11.010014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-14f6a32c-3aa9-4f4a-91b9-3f862c3245ff tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.628617 Oct 06 13:13:11.016246 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2437/4862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:10 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:11.483784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:11.498486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:11.500487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:11.501198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:11.538266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] Creating event network-changed:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:13:11.551620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5a3ecc3e-7e7e-44b9-93a0-63c03829ad58 req-0dae735d-183f-4769-bea3-ebc3016a76dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084022 Oct 06 13:13:11.553623 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2438/4863] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:11.629524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:11.638841 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa25480a-406f-40ca-abbc-0322d2a264d5 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.766032 Oct 06 13:13:11.639522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2426/4864] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:10 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:11.653956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4344502b-8f5e-4218-aeb9-c8c33a205171", "name": "network-vif-plugged", "status": "completed", "tag": "834de65b-6fa1-4049-b13c-ba4d33fb930e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:11.670587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:11.671313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:11.671938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:11.760604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] Creating event network-vif-plugged:834de65b-6fa1-4049-b13c-ba4d33fb930e for instance 4344502b-8f5e-4218-aeb9-c8c33a205171 on n-h1-860556-1 Oct 06 13:13:11.777506 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b17bcc6b-7a0b-4ad9-b5c2-404adbf974d4 req-bd27dfab-0cde-47d9-9daf-a6aad3274521 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134940 Oct 06 13:13:11.811684 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2439/4865] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:12.033575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:12.034495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:12.059770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:12.060281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:12.060726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:12.061501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:12.062018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:12.062527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:12.586990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:12.613122 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e42b3757-9555-4633-a676-e1265a6d6b40 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.583445 Oct 06 13:13:12.635546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2427/4866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:12 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:12.670745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:12.671970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:12.687117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:12.688041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:12.688714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:12.689916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:12.690639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:12.691930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:12.984159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:12.992557 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e753f565-96fa-4e7f-b691-5d9c7545c179 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.329432 Oct 06 13:13:13.011551 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2440/4867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:12 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:13.161373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63afb19d-6151-4768-a4ce-ec658a615295"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:13.164308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:13.173397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:13.174071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:13.174719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:13.175815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:13.176850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:13.178879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:13.641083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:13.641714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:13.655558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:13.656022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:13.656474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:13.657214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:13.657784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:13.663516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:13.700291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b46bd53-2df7-4d72-8655-eec03ff924da tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535200 Oct 06 13:13:13.708480 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2428/4868] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:13:13 2022] POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:14.008508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:14.018775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-866ff8ee-a69d-4b2d-a9f9-cc72a30c9e0c tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1524 microversion: 2.1 time: 0.381578 Oct 06 13:13:14.027510 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2441/4869] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:13 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:14.032857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:14.032857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:14.060095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:14.062858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:14.064774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:14.065859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:14.067356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:14.068395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:14.453178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:14.473553 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc429ec7-7a41-4733-8ff9-553782f89f10 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1323 microversion: 2.1 time: 0.449754 Oct 06 13:13:14.474472 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2429/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:14 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:15.053055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:15.053697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:15.073878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:15.075891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:15.083541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:15.085875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:15.087608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:15.090313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:15.502714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:15.503342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:15.515323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:15.516074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:15.517884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:15.518812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:15.521908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:15.522640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:15.545454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:15.558700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b29081e4-c1f0-4ea1-89f0-64d06d9072d3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1504 microversion: 2.1 time: 0.510514 Oct 06 13:13:15.561212 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2442/4871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:15 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:15.586146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47b7f4f9-707c-4579-b036-7b8144fbc5e3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'create', calling method: .version_select at 0x7f7d3e3cb5e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-328681002", "description": "tempest-description-187928050"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:16.078877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:16.091161 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f7b8d8a-db4e-475f-bfb5-aedb52777b24 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1520 microversion: 2.1 time: 0.592643 Oct 06 13:13:16.092050 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2430/4872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:15 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:16.116323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:16.117138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:16.129894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.131387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.131387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.133810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.134400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.135035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.220960 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] HTTP exception thrown: Action 999 not found Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Request method failure captured: Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171/os-instance-actions/999 HTTP/1.1 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtRSnAUeCEMUtUohjorlBPaXJy73amAaTRjik2frFwTfNTKwLWwcKHdZDYxhmAPPyuY_VBNsal3iya256uRk3B6IsPFklhWQStuXoGkDsdZG6EcImFsgaXhI9KTxLPWwXICS2995IU-b6Ur4UPUGrvR4waHvlTy_on4abocFyqEKZXk Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f3932ad7da01478781804a648a1e835c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f3932ad7da01478781804a648a1e835c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}] Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 59237920f5a141eb9e07a1b3f69efb51 Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: exception: Action 999 not found Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '4344502b-8f5e-4218-aeb9-c8c33a205171', 'id': '999'} Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 06 13:13:16.229851 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.234288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Returning 404 to user: Action 999 not found {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:16.235773 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-674bd966-31b3-41a7-af7a-d65ecbcffa5d tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.123515 Oct 06 13:13:16.243279 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2431/4873] 10.222.0.26 () {58 vars in 1308 bytes} [Thu Oct 6 13:13:16 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171/os-instance-actions/999 => generated 66 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:13:16.257639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '.version_select at 0x7f7d3fd8fc10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:16.259671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: f599ba15-13de-4812-a799-8f98d1ab9bf5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:16.264287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47b7f4f9-707c-4579-b036-7b8144fbc5e3 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.682226 Oct 06 13:13:16.265287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2443/4874] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Oct 6 13:13:15 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:13:16.272752 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] HTTP exception thrown: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. Oct 06 13:13:16.290187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-328681002"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Request method failure captured: Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/f599ba15-13de-4812-a799-8f98d1ab9bf5/os-instance-actions HTTP/1.1 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtRSnAUeCEMUtUohjorlBPaXJy73amAaTRjik2frFwTfNTKwLWwcKHdZDYxhmAPPyuY_VBNsal3iya256uRk3B6IsPFklhWQStuXoGkDsdZG6EcImFsgaXhI9KTxLPWwXICS2995IU-b6Ur4UPUGrvR4waHvlTy_on4abocFyqEKZXk Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f3932ad7da01478781804a648a1e835c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f3932ad7da01478781804a648a1e835c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}] Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 59237920f5a141eb9e07a1b3f69efb51 Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': 'f599ba15-13de-4812-a799-8f98d1ab9bf5'} Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:13:16.291132 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Returning 404 to user: Instance f599ba15-13de-4812-a799-8f98d1ab9bf5 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:16.296070 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c8eeae7-1445-4ea3-b28c-545f5b3c40b9 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/f599ba15-13de-4812-a799-8f98d1ab9bf5/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.048440 Oct 06 13:13:16.301883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2432/4875] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Oct 6 13:13:16 2022] GET /compute/v2.1/servers/f599ba15-13de-4812-a799-8f98d1ab9bf5/os-instance-actions => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:13:16.304071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:16.310603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:16.311116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:16.324302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.330640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.332945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.336197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.338304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.340542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.343581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.344197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.344666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.347205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.347205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.348579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.419151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:13:16.577305 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-62543841-e762-4275-9598-f9e1622db751 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 204 len: 0 microversion: 2.1 time: 0.273885 Oct 06 13:13:16.578966 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2433/4876] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:13:16 2022] DELETE /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:13:16.595054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:16.596626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:16.614526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.615026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.617627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.618450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:16.620308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:16.621798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:16.636158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:16.732270 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Adding security group 508f2319-0780-46dd-b84e-2b1011ae2446 to port 324f52d1-854f-4133-9874-d2639d9a376a Oct 06 13:13:17.106401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:17.115479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79a2b8b9-8c22-4386-986d-92610c44c819 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1526 microversion: 2.1 time: 0.532365 Oct 06 13:13:17.134592 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2434/4877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:16 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1526 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:18.141439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:18.142268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:18.152704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:18.165086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:18.166093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:18.167693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:18.168420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:18.169170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:18.414717 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53e86ee0-3224-41e1-9afe-80445ff5c80e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action" status: 202 len: 0 microversion: 2.1 time: 2.136974 Oct 06 13:13:18.419567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2444/4878] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:16 2022] POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action => generated 0 bytes in 2143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:18.424918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-328681002"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:18.426022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:18.440045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:18.440797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:18.442290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:18.444593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:18.446505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:18.447235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:19.054322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59237920f5a141eb9e07a1b3f69efb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3932ad7da01478781804a648a1e835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:19.067779 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38b0256a-7709-4861-99b5-79bfb1907efe tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 200 len: 1526 microversion: 2.1 time: 0.930142 Oct 06 13:13:19.074619 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2435/4879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:18 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 1526 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:19.093072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:19.142954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:19.144203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:19.144813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:19.213610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] Creating event network-changed:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:13:19.245940 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f441ce13-bf60-4f41-b65b-b1a2b7a6450f req-a689895f-d2e8-41d0-acc4-66415127db56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168925 Oct 06 13:13:19.249210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2436/4880] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:19.254764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4344502b-8f5e-4218-aeb9-c8c33a205171", "name": "network-vif-deleted", "tag": "834de65b-6fa1-4049-b13c-ba4d33fb930e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:19.318114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:19.322252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:19.322972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:19.400034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] Creating event network-vif-deleted:834de65b-6fa1-4049-b13c-ba4d33fb930e for instance 4344502b-8f5e-4218-aeb9-c8c33a205171 on n-h1-860556-1 Oct 06 13:13:19.408338 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7fb2b797-66a8-4af6-a464-d8ff1f081b54 req-31322adf-4f93-4f5a-83d0-e01e07acda3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156426 Oct 06 13:13:19.410528 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2437/4881] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:19.770665 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Removing security group 508f2319-0780-46dd-b84e-2b1011ae2446 from port 324f52d1-854f-4133-9874-d2639d9a376a Oct 06 13:13:20.108849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:20.110082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] [instance: 4344502b-8f5e-4218-aeb9-c8c33a205171] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:20.127285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:20.127999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:20.128248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:20.128976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:20.132004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:20.133573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:20.195533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] HTTP exception thrown: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Request method failure captured: Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 HTTP/1.1 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtRSnAUeCEMUtUohjorlBPaXJy73amAaTRjik2frFwTfNTKwLWwcKHdZDYxhmAPPyuY_VBNsal3iya256uRk3B6IsPFklhWQStuXoGkDsdZG6EcImFsgaXhI9KTxLPWwXICS2995IU-b6Ur4UPUGrvR4waHvlTy_on4abocFyqEKZXk Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f3932ad7da01478781804a648a1e835c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f3932ad7da01478781804a648a1e835c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f3932ad7da01478781804a648a1e835c"}]}] Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f3932ad7da01478781804a648a1e835c Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-360940880 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 59237920f5a141eb9e07a1b3f69efb51 Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-360940880-project Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4344502b-8f5e-4218-aeb9-c8c33a205171'} Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:20.197453 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. Oct 06 13:13:20.204796 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:20.207738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] Returning 404 to user: Instance 4344502b-8f5e-4218-aeb9-c8c33a205171 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:20.208829 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dadcce9b-919c-4102-9655-70f210ba8995 tempest-InstanceActionsNegativeTestJSON-360940880 tempest-InstanceActionsNegativeTestJSON-360940880-project] 10.222.0.26 "GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171" status: 404 len: 111 microversion: 2.1 time: 0.106081 Oct 06 13:13:20.214098 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2438/4882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:20 2022] GET /compute/v2.1/servers/4344502b-8f5e-4218-aeb9-c8c33a205171 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:13:20.817588 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff2645fa-bad0-4cd6-893c-af4e99a934ca tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action" status: 202 len: 0 microversion: 2.1 time: 2.396583 Oct 06 13:13:20.818413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2445/4883] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:18 2022] POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action => generated 0 bytes in 2398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:20.829579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4d0d3b3-0bf2-4e7a-bc8b-c2e5fad58f24 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'create', calling method: .version_select at 0x7f7d3ea18820>, body: {"pool": null} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:21.327222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:21.368611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:21.369667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:21.370812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:21.402688 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] Creating event network-changed:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:13:21.417131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6994d494-5a44-4012-a031-77213c6642c5 req-7d7ac252-f152-4292-86c9-b7c7948f3cd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093472 Oct 06 13:13:21.418636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2446/4884] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:13:24.390375 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:13:24.391106 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:13:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.26) !!! Oct 06 13:13:25.434251 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:13:25.434956 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:13:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.26) !!! Oct 06 13:13:26.732979 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4d0d3b3-0bf2-4e7a-bc8b-c2e5fad58f24 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.908172 Oct 06 13:13:26.736182 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2439/4885] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Oct 6 13:13:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:26.759351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.87"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:26.764181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:26.774265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:26.799488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:26.800367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:26.801155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:26.818290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:26.819257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:26.820322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:26.861945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:13:26.865569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquired lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:13:30.740017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:30.744402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:30.744402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=16 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:30.758191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:30.759321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:30.761207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:30.946620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Going to try to stop instance {{(pid=129614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:13:31.053111 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc56e9bc-fad1-40de-bb64-3f2c94e8101d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.315566 Oct 06 13:13:31.054232 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2440/4886] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:30 2022] POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:13:31.096146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:31.097278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:31.115979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:31.117905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:31.118741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:31.120030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:31.122338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:31.123354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:31.136471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Building network info cache for instance {{(pid=129615) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:13:31.147074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:31.515617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:31.531259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc97bd24-af47-4744-9238-d6df01ed0100 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.455095 Oct 06 13:13:31.531897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2441/4887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:31 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:31.536888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:31.560887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:31.561395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:31.562901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:31.594957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] Creating event network-changed:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:13:31.604094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-94c8f6cc-b898-436a-a2f1-6a4e9c849792 req-d2ffc81a-138b-4349-906d-f3a57f712d71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070441 Oct 06 13:13:31.605440 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2442/4888] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:32.392087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Updating instance_info_cache with network_info: [{"id": "324f52d1-854f-4133-9874-d2639d9a376a", "address": "fa:16:3e:22:f1:b7", "network": {"id": "c18b8972-2678-4657-ac0b-6a6dfbc8324f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2032770159-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f005dab7accd45749e9ea551c14a43bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap324f52d1-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:13:32.412782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Releasing lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:13:32.413771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15ec73f8-a831-4531-91dd-2edd6a4eb124 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action" status: 202 len: 0 microversion: 2.1 time: 5.660673 Oct 06 13:13:32.414682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2447/4889] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:26 2022] POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action => generated 0 bytes in 5663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:13:32.424575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.87"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:32.558326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:32.559030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:32.570513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:32.571684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:32.574804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:32.575996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:32.579888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:32.580857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:32.873903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:32.882776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:32.885190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:32.888631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:32.889952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:32.892331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:32.895989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:33.227086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 13:13:33.227530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquired lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 13:13:33.476291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:33.486896 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1838e01-cfc9-411f-8532-b1c4d55257b1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.932100 Oct 06 13:13:33.487816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2448/4890] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:32 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:34.137195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Building network info cache for instance {{(pid=129614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 06 13:13:34.177820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:34.202562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:34.214204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:34.214772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:34.240105 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] Creating event network-changed:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:13:34.250358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9af73f60-6025-4984-b1fc-79a40bba33da req-2e197ca4-90a8-4953-b911-5f43a8d624d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075007 Oct 06 13:13:34.263239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2449/4891] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:34.513000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:34.514492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:34.527493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:34.528019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:34.528482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:34.529237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:34.529779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:34.530178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:34.961511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:34.974661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85ec63f3-fc3c-4a82-a1b6-12cd02eb6337 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.466483 Oct 06 13:13:34.979831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2450/4892] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:34 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:35.597197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Updating instance_info_cache with network_info: [{"id": "324f52d1-854f-4133-9874-d2639d9a376a", "address": "fa:16:3e:22:f1:b7", "network": {"id": "c18b8972-2678-4657-ac0b-6a6dfbc8324f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2032770159-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f005dab7accd45749e9ea551c14a43bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap324f52d1-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:13:35.614784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Releasing lock "refresh_cache-75d6d94d-7986-4bd3-aa8d-ae41a1909098" {{(pid=129614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 13:13:35.616360 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-136c000e-89d8-4d3b-83bd-17e9fe306e90 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action" status: 202 len: 0 microversion: 2.1 time: 3.196012 Oct 06 13:13:35.617458 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2443/4893] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:32 2022] POST /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098/action => generated 0 bytes in 3198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 06 13:13:35.627104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5aa8eeda-ddad-4961-a84b-16544d544f9e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '.version_select at 0x7f7d476af3a0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:36.002485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:36.003231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:36.013345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:36.013971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:36.014585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:36.015767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:36.016368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:36.016870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:36.454029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:36.468323 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-12831939-3de6-4934-b82d-ab026ec9de32 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.468837 Oct 06 13:13:36.484855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2444/4894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:35 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:36.924786 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5aa8eeda-ddad-4961-a84b-16544d544f9e tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/b5d7e358-ff34-41b1-8128-e109f1ee1d54" status: 202 len: 0 microversion: 2.1 time: 1.302144 Oct 06 13:13:36.926769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2451/4895] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Oct 6 13:13:35 2022] DELETE /compute/v2.1/os-floating-ips/b5d7e358-ff34-41b1-8128-e109f1ee1d54 => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:36.938903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8981928-59a6-432e-98b5-0c958cc9b8d7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '.version_select at 0x7f7d3e78b790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:37.453483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8981928-59a6-432e-98b5-0c958cc9b8d7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/508f2319-0780-46dd-b84e-2b1011ae2446" status: 202 len: 0 microversion: 2.1 time: 0.520651 Oct 06 13:13:37.457102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2445/4896] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Oct 6 13:13:36 2022] DELETE /compute/v2.1/os-security-groups/508f2319-0780-46dd-b84e-2b1011ae2446 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:37.471968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:37.472505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:37.507446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.512122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:37.512867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.513299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:37.513877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:37.515066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.515642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.516180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:37.531117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.534181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.537922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:37.539127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.541500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.543604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:37.595053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:13:37.834215 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-302a4cc0-967a-4710-a495-62c3362e0d6d tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 204 len: 0 microversion: 2.1 time: 0.373774 Oct 06 13:13:37.837310 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2452/4897] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:13:37 2022] DELETE /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:13:37.847105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:37.847820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:37.864553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.865063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.865528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:37.874374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:37.874789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:37.875242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:38.186218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:38.201975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2b02e9a2-5cc2-45ef-aeb0-aacb6b58cc52 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.695537 Oct 06 13:13:38.204910 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2446/4898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:37 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:38.304622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:38.313906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9bc3864-1cd9-4b81-8494-6e97ace796e7 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1510 microversion: 2.1 time: 0.471561 Oct 06 13:13:38.334677 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2453/4899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:37 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:39.250587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:39.254879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:39.289675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:39.292299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:39.294110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:39.295599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:39.298938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:39.300748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:39.349655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:39.351391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:39.361997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:39.368560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:39.369435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:39.370838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:39.371560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:39.372275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:39.707953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:39.723013 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d786241-be99-4bd5-8bd7-3a928b19cee5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.497039 Oct 06 13:13:39.725814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2447/4900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:39 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:39.821001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:39.836121 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cb4171d-fef7-44ee-960b-522f38554dab tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1510 microversion: 2.1 time: 0.490205 Oct 06 13:13:39.839262 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2454/4901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:39 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:40.184285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1736094561", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:40.287023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] validate_networks() for None {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:13:40.751071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:40.752369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:40.766159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:40.767124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:40.769630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:40.770577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:40.771626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:40.773033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.180200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:41.197460 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3147893-2699-4c8e-8c26-d226328c696c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1723 microversion: 2.1 time: 0.450112 Oct 06 13:13:41.204327 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2455/4902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:40 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:41.216407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:41.217437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:41.232660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:41.234601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:41.237992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.239812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:41.240421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:41.240996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.305038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:13:41.305637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:13:41.306478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:13:41.307793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:13:41.308509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:13:41.344286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:41.346778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:41.347484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.350061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:41.350996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:41.352894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.423702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Getting quotas for project ecbacf2106f54f359d5e129c63437657. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:13:41.439922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Getting quotas for user 11d29c00085047cb9a50cc16492b665f and project ecbacf2106f54f359d5e129c63437657. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:13:41.475308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:13:41.485602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:13:41.560867 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f2b27def-f701-47c1-890b-bbabc3fe94e2 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382087 Oct 06 13:13:41.563332 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2448/4903] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:13:41.574786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d2956dc-5441-45b2-8e7f-53b47cd42dc6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:41.577067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d2956dc-5441-45b2-8e7f-53b47cd42dc6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:41.866203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d2956dc-5441-45b2-8e7f-53b47cd42dc6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:41.881022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d2956dc-5441-45b2-8e7f-53b47cd42dc6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1215 microversion: 2.1 time: 0.310461 Oct 06 13:13:41.894127 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2449/4904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:41 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:41.915373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d6d94d-7986-4bd3-aa8d-ae41a1909098", "name": "network-vif-deleted", "tag": "324f52d1-854f-4133-9874-d2639d9a376a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:41.925813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:41.929133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:41.929813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:41.952389 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] Creating event network-vif-deleted:324f52d1-854f-4133-9874-d2639d9a376a for instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 on n-h2-860556-1 Oct 06 13:13:41.968869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84cbafbe701345d5b90ee54cc615d875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f005dab7accd45749e9ea551c14a43bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:41.973569 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d2cd7791-c0c8-4c64-be20-40a4b09d5174 req-a4a139f7-a037-4c49-ac13-e047884d9b67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077915 Oct 06 13:13:41.974593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2450/4905] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:41.991853 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c6539b0-6ac6-4738-a4c1-dd27b5277d44 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 200 len: 1510 microversion: 2.1 time: 0.783336 Oct 06 13:13:41.996603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:41.997514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2456/4906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:41 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 1510 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:41.998429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:42.018618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.019124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.019568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.020326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.020732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.021179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.137727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lazy-loading 'services' on Instance uuid a70be547-3608-4d32-afdc-5f0186b5b6a3 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:13:42.231574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:42.232720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:42.239834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.242135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.242848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.244532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.245999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.246797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.335275 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c13b927c-6777-4781-953c-737ba33ee83f tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments/f9fde6e7-d530-4028-af5b-535cfffff9ad" status: 202 len: 0 microversion: 2.1 time: 0.343917 Oct 06 13:13:42.336218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2451/4907] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:13:41 2022] DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments/f9fde6e7-d530-4028-af5b-535cfffff9ad => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:42.352020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:42.358007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:42.391626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.395108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.396770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.398351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.399307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.400199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.455475 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ceee99c2-8ee4-4aa1-b37c-be9b6da4c4d8 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113796 Oct 06 13:13:42.457199 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2452/4908] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:42 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:42.848811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:42.858232 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d6ab697-759e-45f4-b4c3-0f6277e9807f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1700 microversion: 2.1 time: 0.632049 Oct 06 13:13:42.866058 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2457/4909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:42 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1700 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:42.883399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:42.901015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.901544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.903140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.911254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:42.913406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:42.927049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.927565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.928826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.929577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:42.933339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:42.933832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:42.981353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Going to try to start instance {{(pid=129614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:13:43.082598 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-073ee4ae-871d-4a2b-958b-3c985d5672f1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.203108 Oct 06 13:13:43.086907 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2453/4910] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:42 2022] POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:13:43.095518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:43.097233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] [instance: 75d6d94d-7986-4bd3-aa8d-ae41a1909098] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:43.106357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:43.123113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.125323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.126574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.128328 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6c34c2a-8731-41a5-96d3-f08dc33e2a22 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1219 microversion: 2.1 time: 0.223057 Oct 06 13:13:43.130189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.130896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.131682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.146168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2458/4911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:42 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1219 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:43.153061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:43.153783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:43.163652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.164171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.164733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.165631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.167576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.168031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.172641 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] HTTP exception thrown: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Request method failure captured: Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 HTTP/1.1 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtQvdASdbQm2qwygjj8Ioa0e7udMxLHiFSNpNsekvfaGXbId4c4EfLCbKFrXMkCeD571NGKGSukIxAsF7cvtHKfrmKAB4WNVV9t_ErHR5-KtRjExTuJGvrXfbP2vM-uaDZTvKRWj1En7XpMudxibzRLFfqTBaYhaXh7eP7rUgrW5ve0 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: f005dab7accd45749e9ea551c14a43bf Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2008536455 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f005dab7accd45749e9ea551c14a43bf", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f005dab7accd45749e9ea551c14a43bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f005dab7accd45749e9ea551c14a43bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f005dab7accd45749e9ea551c14a43bf"}]}] Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2008536455 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: f005dab7accd45749e9ea551c14a43bf Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2008536455 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerRescueTestJSONUnderV235-2008536455-project Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 84cbafbe701345d5b90ee54cc615d875 Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2008536455-project Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '75d6d94d-7986-4bd3-aa8d-ae41a1909098'} Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:43.178720 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. Oct 06 13:13:43.184463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:13:43.203931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] Returning 404 to user: Instance 75d6d94d-7986-4bd3-aa8d-ae41a1909098 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:43.207551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92ce1928-9825-4659-8c1b-3c29f438def2 tempest-ServerRescueTestJSONUnderV235-2008536455 tempest-ServerRescueTestJSONUnderV235-2008536455-project] 10.222.0.26 "GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098" status: 404 len: 111 microversion: 2.1 time: 0.117908 Oct 06 13:13:43.208363 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2454/4912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:43 2022] GET /compute/v2.1/servers/75d6d94d-7986-4bd3-aa8d-ae41a1909098 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:13:43.469853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:43.472678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:43.495767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.496767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.500554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.502267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:43.505064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:43.506719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:43.609273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8b76e1f8-43b3-45d9-b9e1-d80feb616c50 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142774 Oct 06 13:13:43.617064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2455/4913] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:43 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:44.152097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:44.152719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:44.169414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:44.170575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:44.171047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:44.171791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:44.172258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:44.172881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:44.439026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:44.454794 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78f1a54b-856b-45df-b94b-d2238540fad4 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1285 microversion: 2.1 time: 0.306949 Oct 06 13:13:44.455927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2456/4914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:44 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:44.585657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:44.597381 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7100aadf-9029-470e-af23-13233d67cc5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1709 microversion: 2.1 time: 1.449937 Oct 06 13:13:44.605075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2459/4915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:43 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1709 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:44.627653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:44.630375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:44.644777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:44.652098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:44.652702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:44.670152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:44.672687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:44.693273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:44.786824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:44.795099 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52c0e2ef-9141-4399-b88b-7826a3c419d9 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175548 Oct 06 13:13:44.798117 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2457/4916] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:44 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:45.481297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:45.482068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:45.491627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.497700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.498305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.503953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.504569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.505096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.639600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:45.641310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:45.678042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.679008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.679935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.680906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.682293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.682954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.795101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:45.816852 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53a1b567-b11b-457d-8ebd-ff9a524dbd6e tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1273 microversion: 2.1 time: 0.340148 Oct 06 13:13:45.818502 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2460/4917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:45 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:45.828578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:45.834432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:45.875901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.876525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.877153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.878316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:45.882237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:45.882904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:45.964604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5acae081-686d-4d27-95ea-57a9fc7f89f6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142632 Oct 06 13:13:45.966103 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2461/4918] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:45 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:46.273475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:46.288216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4582f71d-0b67-42b5-ba24-d07647ff48a1 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1709 microversion: 2.1 time: 0.658690 Oct 06 13:13:46.288995 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2458/4919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:45 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1709 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:46.845289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:46.846052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:46.867577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:46.868090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:46.870271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:46.873305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:46.873849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:46.874348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:46.977263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:46.986734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:47.006028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:47.010480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:47.016782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:47.023317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:47.024062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:47.026629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:47.137444 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fade5ea6-e683-4854-a975-0223e4dfe2f2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164258 Oct 06 13:13:47.146539 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2459/4920] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:46 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:47.154450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:47.171460 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7dcca05-b118-478c-9b9b-4456e183c879 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1273 microversion: 2.1 time: 0.334450 Oct 06 13:13:47.172082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2462/4921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:46 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:47.316399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:47.317342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:47.331052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:47.332002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:47.332819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:47.333985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:47.335015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:47.335751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:47.767924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:47.783604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8616210b-27c0-4975-bcdf-da29ec82cde2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1713 microversion: 2.1 time: 0.471845 Oct 06 13:13:47.788597 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2460/4922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:47 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1713 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:48.159496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:48.162204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:48.179647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:48.183464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:48.184208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:48.190344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:48.192254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:48.195558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:48.196050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:48.197111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:48.214528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:48.215462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:48.216640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:48.220345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:48.221201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:48.221947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:48.240108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:48.270210 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-692a6bb2-d8a9-40c7-b781-c1e4326f6d8c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115337 Oct 06 13:13:48.271839 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2463/4923] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:48 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:49.270092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:49.280148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-deba450c-addd-4b94-af6b-ce348999a8fa tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 1.086526 Oct 06 13:13:49.282529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2461/4924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:48 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:49.286997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:49.295188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:49.321165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:49.324795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:49.327421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:49.329188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:49.330440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:49.331684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:49.446788 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25ffe541-5e6e-40f2-b115-bdc3eebce820 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166831 Oct 06 13:13:49.450894 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2464/4925] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:49 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:50.094332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694ce2e4-63ec-4721-91c5-1d9f8a663642", "tag": "d8b71593-853c-49cc-88e3-88dd52136ffb"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:50.132788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.133945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.135266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.154229 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] Creating event network-changed:d8b71593-853c-49cc-88e3-88dd52136ffb for instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 on n-h1-860556-1 Oct 06 13:13:50.174993 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2cae735e-a3fb-475c-a231-43ba23da2824 req-4f4ea37a-f922-400c-9060-c5d40f7299f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086192 Oct 06 13:13:50.176084 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2462/4926] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:50.309230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:50.312700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:50.343359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.344125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.349500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.352216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.355542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.357433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.464856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:50.469439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:50.489345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.491455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.492189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.495535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.496259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.498075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.588186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3da2a3e-2ec8-4143-abb5-5c614205b9bd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125751 Oct 06 13:13:50.593592 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2463/4927] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:13:50 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:13:50.931681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:50.942737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c3fba2d-4342-401c-bb12-ea126b9e350f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.641256 Oct 06 13:13:50.946244 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2465/4928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:50 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:50.965262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:50.974553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:50.982696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.984936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.989128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:50.990435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:50.991366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:50.992416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.049240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5ea9068-5664-4d17-85bf-ce74f6a821be tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: .version_select at 0x7f7d3f901d30>, body: {"keypair": {"name": "tempest-keypair-102683087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL2svsP0m+E85mPOjCoiB6II+pI8rrrtPdwYS606B1/EIOgv25FpZhVoM7PTel2alEhMkA15OyXqIZmnlnVS4q6j/g/A7G+K0GPfU0rgZGl4X60Mp6JfjcffzdJRXlIpg=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:51.076629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c5ea9068-5664-4d17-85bf-ce74f6a821be tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:13:51.082227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Cannot 'reboot' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.085194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c5ea9068-5664-4d17-85bf-ce74f6a821be tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action HTTP/1.1 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 28 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: {"reboot": {"type": "HARD"}} Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'reboot' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1c762195-c17a-4a39-88ad-1d1df05bff2d', 'body': {'reboot': {'type': 'HARD'}}} Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:13:51.090743 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.095266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.101001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 409 to user: Cannot 'reboot' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:51.102461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02345ab2-38a1-4e03-86a7-0df3c6443433 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action" status: 409 len: 145 microversion: 2.1 time: 0.151407 Oct 06 13:13:51.117068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2466/4929] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:50 2022] POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action => generated 145 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:13:51.145590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:51.157638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:51.183985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.189314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.191995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.196811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.202745 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5ea9068-5664-4d17-85bf-ce74f6a821be tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.607470 Oct 06 13:13:51.206168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.207435 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2464/4930] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:13:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:13:51.214760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.318699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Cannot 'rebuild' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action HTTP/1.1 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 65 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: exception: Cannot 'rebuild' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1c762195-c17a-4a39-88ad-1d1df05bff2d', 'body': {'rebuild': {'imageRef': '9c012702-c0af-44bb-9be6-c3831386ffe2'}}} Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:13:51.320470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 409 to user: Cannot 'rebuild' instance 1c762195-c17a-4a39-88ad-1d1df05bff2d while it is in vm_state rescued {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:13:51.325788 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-695e8e8b-1671-4e7a-b362-1cbafbaf9b1b tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action" status: 409 len: 146 microversion: 2.1 time: 0.198503 Oct 06 13:13:51.327381 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2467/4931] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:13:51 2022] POST /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d/action => generated 146 bytes in 204 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:13:51.346597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:51.347536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:51.370492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.388635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.389115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.394823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.395352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.397189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.398700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:51.458011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:13:51.579042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00949ce2-f878-4321-9d41-fb4bba1bf2b6 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 204 len: 0 microversion: 2.1 time: 0.243226 Oct 06 13:13:51.579750 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2465/4932] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:13:51 2022] DELETE /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:13:51.588793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:51.590032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:51.608932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.611607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.615235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.616996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.618642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.620506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:51.976475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:51.977288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:51.994936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:51.995448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:51.995904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:52.003138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:52.003273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:52.004132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:52.164888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:52.176649 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0dc28670-d39c-4c48-9034-efabf2858c48 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1688 microversion: 2.1 time: 0.592253 Oct 06 13:13:52.180732 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2468/4933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:51 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1688 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:52.507406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:52.518130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd13fcd7-99ad-4053-b08a-50d52926252b tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.547035 Oct 06 13:13:52.525029 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2466/4934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:51 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:53.199985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:53.204639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:53.217287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:53.221412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:53.221902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:53.228048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:53.229300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:53.230162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:53.550490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:53.551753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:53.564481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:53.568515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:53.569219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:53.570188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:53.576628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:53.577321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:53.599091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:53.610313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-afc06fc8-a05d-4cd2-8c58-4e7780ce0a64 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1688 microversion: 2.1 time: 0.414999 Oct 06 13:13:53.615955 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2469/4935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:53 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1688 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:54.319017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:54.336885 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3d41768-3db5-4cb6-89db-031b76cc89e8 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.787753 Oct 06 13:13:54.340720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2467/4936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:53 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:54.638665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:54.639283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:54.657163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:54.658819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:54.662662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:54.666119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:54.667681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:54.669436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:55.240439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:55.254067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31cdff75-5fad-4cbf-ab07-4a3efe076d52 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1688 microversion: 2.1 time: 0.619926 Oct 06 13:13:55.254603 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2470/4937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:54 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1688 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:55.363488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:55.364109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:55.372402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:55.382855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:55.388309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:55.391375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:55.400301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:55.401360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:55.891241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:55.904403 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-13f48356-824d-496b-9890-785838ad238d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.544698 Oct 06 13:13:55.905006 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2468/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:55 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:56.149024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-616281851", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78"}], "security_groups": [{"name": "tempest-securitygroup--1034474604"}], "key_name": "tempest-keypair-102683087", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:56.282046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:56.283802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:56.297231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:56.299170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:56.300546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:56.305524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:56.306366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:56.307593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:56.511430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] validate_networks() for [('3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:13:56.787382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:56.798521 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1688 microversion: 2.1 time: 0.521616 Oct 06 13:13:56.799918 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2469/4939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:56 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1688 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:56.880146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:56.881213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3004db43-ce28-4abd-8027-9343ca496602 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002832 Oct 06 13:13:56.889349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2470/4940] 10.222.0.26 () {56 vars in 886 bytes} [Thu Oct 6 13:13:56 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 06 13:13:56.914622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:56.933188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:56.933851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:56.945662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:56.946815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:56.947707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:56.954409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:56.955246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:56.956752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:57.734513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:13:57.735081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:13:57.735543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:13:57.735961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:13:57.736371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:13:57.746558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:57.747914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:57.748368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:57.749322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:57.749945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:57.750386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:57.771032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:13:57.771471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:57.777247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:13:57.782321 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1de4adc6-56d1-4317-a6c5-d2ec4c170e6f tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.853857 Oct 06 13:13:57.783982 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2471/4941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:56 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:13:57.816380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:13:57.822266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:13:57.826734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:57.841884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:57.861445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:57.863132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:57.865305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:57.867310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:57.870212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:57.870919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:57.894034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff2f0e11-3cc9-493e-9ee1-6ff5dcc9d8f3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.749346 Oct 06 13:13:57.902835 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2471/4942] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:13:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:13:57.908461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a442430-7f05-4d8f-8bd9-08d534d8c6af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:57.909405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2a442430-7f05-4d8f-8bd9-08d534d8c6af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:58.021102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2a442430-7f05-4d8f-8bd9-08d534d8c6af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:58.030571 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a442430-7f05-4d8f-8bd9-08d534d8c6af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1237 microversion: 2.1 time: 0.126173 Oct 06 13:13:58.031168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2472/4943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:57 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:58.139603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:58.155592 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81ab6368-d0fa-4ddf-9a1c-8278103cc697 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1688 microversion: 2.1 time: 0.331009 Oct 06 13:13:58.160335 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2472/4944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:57 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1688 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:58.818868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:58.820058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:58.829116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:58.830680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:58.831396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:58.832860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:58.833564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:58.834413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.060840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:59.061770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:59.076839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:59.079833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:59.081609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.082789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:59.083531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:59.084197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.374669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:59.392761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7cd17a2-9900-4ee5-a4cf-39f80e438031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1289 microversion: 2.1 time: 0.336368 Oct 06 13:13:59.395957 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2473/4945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:59 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1289 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:59.403154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:13:59.404081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:13:59.413462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:59.418013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:59.418755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.419680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:59.420908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:59.422379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.576967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:59.579777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:13:59.593466 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a2dfe06-0a1f-45f7-bb0f-762f4a929647 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 200 len: 1329 microversion: 2.1 time: 0.194104 Oct 06 13:13:59.594151 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2474/4946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:59 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 1329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:59.597167 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e11ee4e8-cf6a-4425-a3d2-66d909bf7c2d tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.791878 Oct 06 13:13:59.598928 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2473/4947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:13:58 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:13:59.609264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70be547-3608-4d32-afdc-5f0186b5b6a3", "name": "network-vif-deleted", "tag": "cdf6d857-a7e2-4324-b0e8-77062a153e5f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:13:59.630571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:13:59.645680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:13:59.648879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:13:59.651456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:13:59.725002 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] Creating event network-vif-deleted:cdf6d857-a7e2-4324-b0e8-77062a153e5f for instance a70be547-3608-4d32-afdc-5f0186b5b6a3 on n-h1-860556-1 Oct 06 13:13:59.772409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7be593d2-c8dd-4a4b-9608-a95bc4d696cc req-fa7552cc-7193-46a1-850e-e8d085c6c2ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165287 Oct 06 13:13:59.775129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2475/4948] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:00.050870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694ce2e4-63ec-4721-91c5-1d9f8a663642", "name": "network-vif-plugged", "status": "completed", "tag": "d8b71593-853c-49cc-88e3-88dd52136ffb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:00.080694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.082943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.083637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.119794 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] Creating event network-vif-plugged:d8b71593-853c-49cc-88e3-88dd52136ffb for instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 on n-h1-860556-1 Oct 06 13:14:00.136492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4fe78398-836b-437f-9720-7f87cb52140a req-70b80376-7d81-4679-a67e-2a15b661a78c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090253 Oct 06 13:14:00.144673 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2474/4949] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:00.424048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:00.425456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:00.439169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.440412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.441051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.441984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.442651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.444513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.451096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:00.563321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:00.575666 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6da06a51-3964-4cb7-8813-2a7da14dff01 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1295 microversion: 2.1 time: 0.156824 Oct 06 13:14:00.578726 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2476/4950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1295 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:00.618388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:00.620282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: a70be547-3608-4d32-afdc-5f0186b5b6a3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:00.626747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:00.627900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:00.637610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.638160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.638616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.639350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.640015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.641287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.642713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.643369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.643846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.644402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:00.645104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:00.645866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:00.677667 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 HTTP/1.1 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'a70be547-3608-4d32-afdc-5f0186b5b6a3'} Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:00.679779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 404 to user: Instance a70be547-3608-4d32-afdc-5f0186b5b6a3 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:14:00.686056 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64e6d4ce-f3ca-4eac-bc74-0d897bd1db01 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3" status: 404 len: 111 microversion: 2.1 time: 0.067693 Oct 06 13:14:00.689770 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2475/4951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:00 2022] GET /compute/v2.1/servers/a70be547-3608-4d32-afdc-5f0186b5b6a3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:14:00.695227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6e310dd-083d-47c0-949d-6929181d2713 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '.version_select at 0x7f7d3f222160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:00.748175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6e310dd-083d-47c0-949d-6929181d2713 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112984061" status: 202 len: 0 microversion: 2.1 time: 0.058089 Oct 06 13:14:00.754277 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2476/4952] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112984061 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:14:01.108428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:01.117434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9a65702-aca7-48ba-b63f-05d18616d6bb tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1315 microversion: 2.1 time: 0.495669 Oct 06 13:14:01.125349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2477/4953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:00 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:14:01.605193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:01.606123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:01.622466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:01.623500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:01.624146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:01.626248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:01.626976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:01.628047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.048849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:02.058237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8d14247-cb88-4cc1-a58e-b8623ee318e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1295 microversion: 2.1 time: 0.457516 Oct 06 13:14:02.059012 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2477/4954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:01 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1295 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:02.150296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:02.152865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:02.155454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:02.173186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.176302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.177878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.180869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.183603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.184782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.588490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:02.598686 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f073d8d-b7ab-4fdf-9825-e96ffee7fad6 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1465 microversion: 2.1 time: 0.454071 Oct 06 13:14:02.604411 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2478/4955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:02 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:02.688338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:02.689002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:02.709472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.710474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.712824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.714960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.717665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.717665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.763734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:14:02.940079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a18eea8-6cde-4de8-8a16-6439547b2065 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 204 len: 0 microversion: 2.1 time: 0.255326 Oct 06 13:14:02.945160 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2478/4956] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:14:02 2022] DELETE /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:14:02.954953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:02.956312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:02.966025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.967007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.967915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:02.968875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:02.969867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:02.970510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:03.083044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:03.084020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:03.094297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:03.096177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:03.097277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:03.099156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:03.101039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:03.102631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:03.583657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:03.603859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87082ce6-24c1-4fb7-8935-6bad476e4f19 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1471 microversion: 2.1 time: 0.649784 Oct 06 13:14:03.606386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2479/4957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:02 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:03.689094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:03.710095 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d2c6542-c34a-450c-bf2e-bcce85cbd0af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.631398 Oct 06 13:14:03.721147 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2479/4958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:03 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:04.629873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:04.630438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:04.643320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:04.643824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:04.644272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:04.644996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:04.645462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:04.645933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:04.740857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:04.742560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:04.751392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:04.752166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:04.752819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:04.753754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:04.754459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:04.755402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:05.630758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11d29c00085047cb9a50cc16492b665f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbacf2106f54f359d5e129c63437657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:05.640409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-840c70b9-0aad-4832-a763-6b52b968e9b0 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 200 len: 1471 microversion: 2.1 time: 1.015623 Oct 06 13:14:05.646529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2480/4959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:04 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 1471 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:05.662458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694ce2e4-63ec-4721-91c5-1d9f8a663642", "name": "network-vif-deleted", "tag": "d8b71593-853c-49cc-88e3-88dd52136ffb"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:05.681497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:05.684835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:05.685330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:05.718854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] Creating event network-vif-deleted:d8b71593-853c-49cc-88e3-88dd52136ffb for instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 on n-h1-860556-1 Oct 06 13:14:05.737664 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-30800852-f62d-42db-9469-525deec06f9f req-4a7b70a7-f135-4b96-af3b-0b4962b41a82 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089635 Oct 06 13:14:05.739388 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2481/4960] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:05.904319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:05.916096 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a34eaee-ffbf-4316-8f41-a348a05d051e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 1.179208 Oct 06 13:14:05.930537 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2480/4961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:04 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:06.675527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:06.676248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] [instance: 694ce2e4-63ec-4721-91c5-1d9f8a663642] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:06.699002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:06.699531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:06.699995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:06.707603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:06.708207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:06.708678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:06.755227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:06.777803 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] HTTP exception thrown: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Request method failure captured: Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 HTTP/1.1 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSAJj5uPxkCBG9FQC77fLxyhMWc0Crs_xEn5MV5ZAkeSlwYiOWUf8oNKQy6J1ifMh3mGUYHi0LV49jUkx2ZUWGMEZ8PWSqbmPp_aP9P7V01mFOIRMl31Vjn0x0uK2eM5LE7_jsCcDsoL549mSRWH2QNcsejFmPabDIZYXthJvJ4dr0 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: ecbacf2106f54f359d5e129c63437657 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesNegativeTest-873425504 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecbacf2106f54f359d5e129c63437657", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecbacf2106f54f359d5e129c63437657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecbacf2106f54f359d5e129c63437657"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecbacf2106f54f359d5e129c63437657"}]}] Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesNegativeTest-873425504 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: ecbacf2106f54f359d5e129c63437657 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesNegativeTest-873425504 Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesNegativeTest-873425504-project Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11d29c00085047cb9a50cc16492b665f Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesNegativeTest-873425504-project Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '694ce2e4-63ec-4721-91c5-1d9f8a663642'} Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:06.783134 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. Oct 06 13:14:06.788933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:14:06.792280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] Returning 404 to user: Instance 694ce2e4-63ec-4721-91c5-1d9f8a663642 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:14:06.792437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:06.792437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:06.792653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:06.804767 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7f81d82-c212-4292-ac99-e553c8479874 tempest-VolumesNegativeTest-873425504 tempest-VolumesNegativeTest-873425504-project] 10.222.0.26 "GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642" status: 404 len: 111 microversion: 2.1 time: 0.120571 Oct 06 13:14:06.808474 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2482/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:06 2022] GET /compute/v2.1/servers/694ce2e4-63ec-4721-91c5-1d9f8a663642 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:14:06.866579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] Creating event network-changed:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:14:06.893578 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-168e1f82-170c-45d2-a33a-95b7a0674dfb req-3278d7ac-cf7c-41d6-a5ae-0b78348ea35d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135686 Oct 06 13:14:06.894423 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2481/4963] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:14:06.943523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:06.944493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:06.960836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:06.966888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:06.966888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:06.966888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:06.966888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:06.967286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:07.571790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:07.581871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-718cd2f2-f686-4258-b643-6cc5e8444f3f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.642490 Oct 06 13:14:07.595342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2483/4964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:06 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:08.604729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:08.606569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:08.612389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:08.615016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:08.631474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:08.632248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:08.633983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:08.643260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:08.644026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:08.644642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:09.014949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:09.025884 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c7a03742-3d2f-443d-8244-b052a590973f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.422754 Oct 06 13:14:09.026473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2482/4965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:08 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:10.055190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:10.056305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:10.065354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:10.065937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:10.066637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:10.067348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:10.068200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:10.068642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:10.322804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:10.335976 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-82fd97a4-d870-434a-8ecf-b2b3b2670bd7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.284390 Oct 06 13:14:10.339075 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2484/4966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:10 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:11.363380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:11.363986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:11.372988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.373508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.373977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.374683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.375136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.375555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.438024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:11.438551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:11.452033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.452528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.453193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.454101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.454768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.455638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.501454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:14:11.594776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:11.598625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:11.607169 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-08456369-6d06-4aed-a2a2-a9581b45bbc3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.247494 Oct 06 13:14:11.623699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2483/4967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:11 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:11.707493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-12120a6c-767e-461f-a967-5b3b1977db4d tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 204 len: 0 microversion: 2.1 time: 0.273088 Oct 06 13:14:11.708408 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2485/4968] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:14:11 2022] DELETE /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:14:11.720084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:11.720715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:11.741607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.743803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.744858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.747795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:11.751062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:11.751891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:11.939774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:11.958344 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3345995c-b1e6-48df-bb6b-cbb9af1dbfbc tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1507 microversion: 2.1 time: 0.244168 Oct 06 13:14:11.959333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2484/4969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:11 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:12.632679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:12.633394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:12.648592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:12.650100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:12.652565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:12.653521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:12.655494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:12.656207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:12.988730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:12.997966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:12.997966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:13.011008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c7e15a3-3f7f-419f-a7c6-bb3cb18f694d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.383193 Oct 06 13:14:13.018718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2486/4970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:12 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:13.026749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:13.028345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:13.029034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:13.030338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:13.031210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:13.032238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:13.032596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-plugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:13.073570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:13.082615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:13.082972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:13.108966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] Creating event network-vif-plugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:14:13.123214 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-23647502-5386-4820-a2ce-d2841ea0f58f req-448028c3-ead0-4f1a-8ebb-5ffe41229677 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096471 Oct 06 13:14:13.127052 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2487/4971] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:13.388725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:13.401562 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a61b731-8b56-4099-88f9-dc247107a4cd tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1507 microversion: 2.1 time: 0.421150 Oct 06 13:14:13.402186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2485/4972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:12 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:14.050837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:14.052286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:14.077664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:14.078433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:14.079083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:14.079809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:14.080327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:14.080961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:14.353139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:14.365685 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1683c28a-8827-4605-906c-1d20db060a49 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1363 microversion: 2.1 time: 0.321681 Oct 06 13:14:14.370752 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2488/4973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:14 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:14.433526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:14.434713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:14.448823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:14.449333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:14.449805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:14.450535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:14.457288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:14.460445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:14.990671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c762195-c17a-4a39-88ad-1d1df05bff2d", "name": "network-vif-deleted", "tag": "aa49d155-9939-4704-af13-8cd4cda416cc"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:15.034586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:15.035032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:15.038469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:15.097705 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] Creating event network-vif-deleted:aa49d155-9939-4704-af13-8cd4cda416cc for instance 1c762195-c17a-4a39-88ad-1d1df05bff2d on n-h1-860556-1 Oct 06 13:14:15.114611 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fe0aa9d7-643e-4d5c-ae29-da7f804cf8fa req-3fed89a8-b9c3-4cfe-bbfb-cc8d8a89a2f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138536 Oct 06 13:14:15.118268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:15.126138 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2489/4974] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:14:15.133153 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e8e31b7-0672-41c2-861f-fab8b17342eb tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 200 len: 1507 microversion: 2.1 time: 0.707043 Oct 06 13:14:15.136228 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2486/4975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:14 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:15.392096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:15.392812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:15.408605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:15.409395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:15.410662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:15.411581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:15.412227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:15.412844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.157719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:16.158358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: 1c762195-c17a-4a39-88ad-1d1df05bff2d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:16.170676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.173009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.175148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.175905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.176439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.184542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.207149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d HTTP/1.1 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1c762195-c17a-4a39-88ad-1d1df05bff2d'} Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:16.209136 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. Oct 06 13:14:16.214613 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:16.216508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 404 to user: Instance 1c762195-c17a-4a39-88ad-1d1df05bff2d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:14:16.217613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6fbcfa7-ac87-4144-b317-0233861215ef tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d" status: 404 len: 111 microversion: 2.1 time: 0.064428 Oct 06 13:14:16.218806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2487/4976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:16 2022] GET /compute/v2.1/servers/1c762195-c17a-4a39-88ad-1d1df05bff2d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:14:16.226150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:16.226973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:16.235915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.237208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.238341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.239503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.240216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.240884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.273969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:14:16.374881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:16.390128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5fac1475-f047-48e9-9538-d9eb1cd59e78 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1549 microversion: 2.1 time: 1.002557 Oct 06 13:14:16.392921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2490/4977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:15 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1549 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:16.419403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:16.420281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:16.431261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.432596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.433236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.434200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.435128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.435773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.456871 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0522fc00-8df6-4bad-b8a9-1da00baf1947 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 204 len: 0 microversion: 2.1 time: 0.229014 Oct 06 13:14:16.461247 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2488/4978] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:14:16 2022] DELETE /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:14:16.483751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:16.485265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:16.500350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.503669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.504147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.507631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:16.507631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:16.508916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:16.930362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1666cc10-7c45-4dcd-9720-85f6182f400a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.515935 Oct 06 13:14:16.931476 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2491/4979] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:14:16 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/os-interface => generated 285 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:17.109105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:17.118860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef57c9ec-0517-440d-a941-f8caa95374d2 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.653201 Oct 06 13:14:17.122058 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2489/4980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:16 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:18.143559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:18.144721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:18.158083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:18.161214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:18.163821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:18.166810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:18.167512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:18.168181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:18.518855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:18.537023 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6a7cfe7-14f8-4e44-9ab2-c9bce21ea72e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.397040 Oct 06 13:14:18.538769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2492/4981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:18 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:14:19.308608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:19.326327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:19.328066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:19.328686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:19.343765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] Creating event network-changed:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:14:19.350496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b30197fd-a966-4e88-9ee7-3b83a01a9026 req-8016ee7e-fcc0-4901-bf30-508c189b4730 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046100 Oct 06 13:14:19.351525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2490/4982] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:14:19.564381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:19.565671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:19.579350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:19.579893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:19.585281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:19.586154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:19.587134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:19.587134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:19.873116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:19.886787 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a25fad9d-97e6-4155-81ff-6714d3e80494 tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1521 microversion: 2.1 time: 0.325359 Oct 06 13:14:19.888076 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2493/4983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:19 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:20.919598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:20.920316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:20.927289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:20.927781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:20.928224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:20.929197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:20.929655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:20.930116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:21.060458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db39e3800b574bb7abd3922b5ad8e282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ed3c9630104e48abc5fc6770a610b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:21.071518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67ac197f-d90c-4d48-9f78-f539ae31ee4c tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 200 len: 1479 microversion: 2.1 time: 0.159116 Oct 06 13:14:21.073082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2491/4984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:20 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 1479 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:21.388335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0fa67-05ab-4aa9-8b83-bbac6933a041", "name": "network-vif-deleted", "tag": "e3e1cb25-f848-4c4c-997f-00d612055274"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:21.412790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:21.414708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:21.415209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:21.452598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:21.461121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] Creating event network-vif-deleted:e3e1cb25-f848-4c4c-997f-00d612055274 for instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 on n-h2-860556-1 Oct 06 13:14:21.472608 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-16ba98e6-aa72-40ba-a963-197a1fc09d86 req-5bef5330-6c77-4c36-94cc-cd75bfdebaa8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089554 Oct 06 13:14:21.475699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2494/4985] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:22.095041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:22.095931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] [instance: dfd0fa67-05ab-4aa9-8b83-bbac6933a041] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:22.104183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:22.105034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:22.105928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:22.107004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:22.108428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:22.108742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:22.132455 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] HTTP exception thrown: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Request method failure captured: Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 HTTP/1.1 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtONfkCzkCoOk0PkHklnMOVxQUArFKyKifui_kqju0T3GPprQgjzyA5M4Zw3G4tYGjU7nYEBqgpfRR8fMjC3PG6BxQ9xkHB8I14gQiwaCwgA6uYrv0N_vKzLJBNwlOTqTDyWGlInfUaI1mQaK7_kEtIIhBuLp9c_plYT06raJ34_HVI Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74ed3c9630104e48abc5fc6770a610b0", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74ed3c9630104e48abc5fc6770a610b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74ed3c9630104e48abc5fc6770a610b0"}]}] Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 74ed3c9630104e48abc5fc6770a610b0 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84175981 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: db39e3800b574bb7abd3922b5ad8e282 Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84175981-project Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dfd0fa67-05ab-4aa9-8b83-bbac6933a041'} Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:22.138526 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] Returning 404 to user: Instance dfd0fa67-05ab-4aa9-8b83-bbac6933a041 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0f85867-79e9-4bff-b577-dee3573c109e tempest-ServerRescueNegativeTestJSON-84175981 tempest-ServerRescueNegativeTestJSON-84175981-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041" status: 404 len: 111 microversion: 2.1 time: 0.049109 Oct 06 13:14:22.143188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2492/4986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:22 2022] GET /compute/v2.1/servers/dfd0fa67-05ab-4aa9-8b83-bbac6933a041 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:14:26.195546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88987117-d5c1-4c26-b6ad-574cf10797a2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Action: 'create', calling method: .version_select at 0x7f7d3f5a2f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-784722117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhG3/LyZPV0AehSsVwHRTdp3ofIBEozDptSS1BvpeluJdrSlZKqXK29gtg5+Li6DCbUYmgy85wiuYY0tAJvb/CmaU35RKmehvb7w9uBj+oQ3G+UjdC9K3x6leawuPqqUQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:26.232301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-88987117-d5c1-4c26-b6ad-574cf10797a2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:14:26.247615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-88987117-d5c1-4c26-b6ad-574cf10797a2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for user b3edacb9b63c4fbebd4cb4dd80d98fba and project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:14:26.306717 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88987117-d5c1-4c26-b6ad-574cf10797a2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.535180 Oct 06 13:14:26.308047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2495/4987] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:14:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:30.933868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1559862880", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:30.981038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:31.118522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:14:31.119184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:14:31.123443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:14:31.124002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:14:31.128109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:14:31.146916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:31.147409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:31.147853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:31.151867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:31.153571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:31.154245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:31.204209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Getting quotas for project 719fe15bd9ce4cd0bd237934c8f3257a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:14:31.214617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Getting quotas for user 74370737fbb94b6e87eba729bbddd397 and project 719fe15bd9ce4cd0bd237934c8f3257a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:14:31.248276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:14:31.252010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:14:31.334925 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1bf879b6-d364-48c9-8bd7-8e2a226e7bee tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.829981 Oct 06 13:14:31.338712 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2493/4988] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:14:31.351141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:31.352158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:31.363474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:32.000098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:32.016781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:32.027991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:32.033320 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b464ec70-a1b5-4dc5-9c7f-2ddcc19f23d2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 200 len: 1278 microversion: 2.47 time: 0.687100 Oct 06 13:14:32.036815 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2496/4989] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:31 2022] GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 1278 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:32.309010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-183693325", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:32.426485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:14:32.426975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:14:32.427455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:14:32.427926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:14:32.429113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:14:32.462230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:32.463476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:32.463926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:32.468802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:32.469300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:32.469794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:32.520512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Getting quotas for project 719fe15bd9ce4cd0bd237934c8f3257a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:14:32.528512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Getting quotas for user 74370737fbb94b6e87eba729bbddd397 and project 719fe15bd9ce4cd0bd237934c8f3257a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:14:32.552128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:14:32.554530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:14:32.648025 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe6ff6c6-ea65-4bcb-836c-c7e2fe226be5 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.344714 Oct 06 13:14:32.662781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2494/4990] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 13:14:32.666536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-701f52e8-3f5a-4bc8-b937-dc3b8f58831b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:32.669219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-701f52e8-3f5a-4bc8-b937-dc3b8f58831b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:32.831515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-701f52e8-3f5a-4bc8-b937-dc3b8f58831b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "PUT /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 991 microversion: 2.47 time: 0.170808 Oct 06 13:14:32.833041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2497/4991] 10.222.0.26 () {62 vars in 1297 bytes} [Thu Oct 6 13:14:32 2022] PUT /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 991 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:14:32.863739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:32.866094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:33.318185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:33.372682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:33.375474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:33.382862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0b38de3-9e19-447a-9e4d-5a3c29513f5c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1277 microversion: 2.47 time: 0.524147 Oct 06 13:14:33.395046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2495/4992] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:32 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1277 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:34.415902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:34.418364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:34.435743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:34.436301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:34.437587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:34.440354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:34.440843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:34.441293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:34.605655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:34.618006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:34.622364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:34.626439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fccbaf17-d4b3-4b33-bf6d-dd1e5dd3ae21 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1329 microversion: 2.47 time: 0.216524 Oct 06 13:14:34.628461 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2498/4993] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:34 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:35.657052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:35.657664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:35.698046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:35.698738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:35.699195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:35.699949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:35.700409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:35.700840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:36.001381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:36.027949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:36.036934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:36.049454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6630d74b-e3b1-4f17-9e0f-35837a56e4ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1329 microversion: 2.47 time: 0.394426 Oct 06 13:14:36.050755 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2496/4994] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:35 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1329 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:37.083450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:37.084088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:37.112893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:37.115066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:37.115724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:37.119167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:37.120349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:37.124711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:37.384997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:37.398064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:37.404173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:37.408279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15f99757-c23f-468b-9aa0-962a2104b397 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1335 microversion: 2.47 time: 0.332069 Oct 06 13:14:37.410735 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2499/4995] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:37 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1335 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:38.438139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:38.440056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:38.469148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:38.472299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:38.472767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:38.473512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:38.479767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:38.481369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:38.813105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:38.856653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:38.859779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:38.861840 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bedf3792-3fbe-4035-945e-c0b9661983ad tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1335 microversion: 2.47 time: 0.428594 Oct 06 13:14:38.863845 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2497/4996] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:38 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1335 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:39.890369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:39.891538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:39.904217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:39.909977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:39.909977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:39.909977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:39.910634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:39.911088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:40.300212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:40.313393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:40.314781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:40.325424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dc77a9d-7ef4-4370-94fd-5a03b11f15ea tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1356 microversion: 2.47 time: 0.429627 Oct 06 13:14:40.328224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2500/4997] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:39 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1356 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:40.359024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:40.362403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:40.406570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:40.412010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:40.412545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:40.413317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:40.426543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:40.428165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:40.672103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:14:40.672728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:14:40.673255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:14:40.673674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:14:40.674129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:14:40.870154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:40.889527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:40.890555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:40.897211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:40.901172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:40.901928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:40.902889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:41.032656 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8661b446-1ceb-4087-9f1e-de9c939b4f16 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "POST /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8/action" status: 202 len: 1078 microversion: 2.47 time: 0.674840 Oct 06 13:14:41.037479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2498/4998] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Oct 6 13:14:40 2022] POST /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8/action => generated 1078 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 06 13:14:41.060656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:41.061953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:41.079872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:41.084474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:41.085535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:41.090256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:41.099617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:41.100481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:41.463714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:41.472473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:41.488833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:41.491094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c68c65af-9551-4c62-a987-2bba467978fe tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.435270 Oct 06 13:14:41.498073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2501/4999] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:41 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:42.519890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:42.521118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:42.534737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:42.537329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:42.539149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:42.539955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:42.543285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:42.544091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:42.544981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:42.554273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:42.705044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:42.716044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:42.717813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:42.719589 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c458a41-d9a3-4559-bdff-f4775732725b tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.203533 Oct 06 13:14:42.720696 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2499/5000] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:42 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:14:42.773847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-10458404-access_point-1313195573", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "479ae90b-e0b7-4f69-b4c7-dc02a48bf843"}], "key_name": "tempest-TestSecurityGroupsBasicOps-784722117", "security_groups": [{"name": "tempest-secgroup_access--429053884"}, {"name": "tempest-secgroup_general--447154704"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:42.797063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:43.026661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:43.027178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:43.039894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:43.046349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:43.046910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:43.047685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:43.048175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:43.048617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:43.271745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] validate_networks() for [('479ae90b-e0b7-4f69-b4c7-dc02a48bf843', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:14:43.299166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lazy-loading 'services' on Instance uuid 0206ff63-f48c-4f6c-a7f2-24359b70d5ec {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:14:43.386579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:43.505712 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6ace4d8-af1c-4634-a121-da7361958c56 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments/63afb19d-6151-4768-a4ce-ec658a615295" status: 202 len: 0 microversion: 2.1 time: 0.483676 Oct 06 13:14:43.506287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2500/5001] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:14:43 2022] DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments/63afb19d-6151-4768-a4ce-ec658a615295 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:14:43.749642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:43.752100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:43.774526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:43.783043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:43.783748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:43.784709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:43.789487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:43.794544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:43.991325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:44.007828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:44.010016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:44.011800 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cbd9770a-47b3-4a78-a814-735939edf779 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.268381 Oct 06 13:14:44.027806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2501/5002] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:43 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:14:44.134631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:14:44.135972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:14:44.136685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:14:44.137562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:14:44.139132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:14:44.157045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:44.157974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:44.158671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:44.160287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:44.161288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:44.162061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:44.184281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:14:44.192624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for user b3edacb9b63c4fbebd4cb4dd80d98fba and project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:14:44.223588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:14:44.230545 n-d-860556-1 devstack@n-api.service[129614]: WARNING nova.utils [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-10458404-access_point-1313195573 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-10458404-acce Oct 06 13:14:44.231684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:14:44.345970 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a24c92b-c44f-4199-bfb9-b2ffa2869e1c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.570867 Oct 06 13:14:44.348045 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2502/5003] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:14:42 2022] POST /compute/v2.1/servers => generated 456 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:14:44.359185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89b27e30-e7f7-4f8f-b842-0abdbf922592 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:44.359811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89b27e30-e7f7-4f8f-b842-0abdbf922592 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:44.534146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89b27e30-e7f7-4f8f-b842-0abdbf922592 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:44.547444 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89b27e30-e7f7-4f8f-b842-0abdbf922592 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1292 microversion: 2.1 time: 0.189252 Oct 06 13:14:44.558138 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2502/5004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:44 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1292 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:45.046569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:45.047218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:45.069583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:45.078016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:45.079332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:45.080492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:45.081179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:45.081818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:45.497782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:45.515203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:45.516657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:45.522826 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-594308d3-bc01-4a86-a4ea-34d8d890697d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.478718 Oct 06 13:14:45.523662 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2503/5005] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:45 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:45.573327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:45.574896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:45.617153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:45.620270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:45.624237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:45.625603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:45.632171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:45.636427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:45.864647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:45.880360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-330d632e-e2bc-4252-9b7d-45ac085ec612 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1288 microversion: 2.1 time: 0.311452 Oct 06 13:14:45.903439 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2503/5006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:45 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1288 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:46.556230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:46.558099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:46.582096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:46.585569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:46.591146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:46.596443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:46.597120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:46.597978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:46.810614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:46.840364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:46.849893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:46.851286 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1841602-eac3-4803-80a5-f52c63b4f95e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.300910 Oct 06 13:14:46.864852 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2504/5007] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:46 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:46.911571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:46.912815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:46.924187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:46.924681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:46.931037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:46.936295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:46.941457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:46.942255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:47.111602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:47.146751 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5940db88-2ceb-4e92-ac47-81b1d9b5b358 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1350 microversion: 2.1 time: 0.239675 Oct 06 13:14:47.149406 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2504/5008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:46 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:47.894607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:47.895210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:47.908438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:47.908947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:47.909408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:47.910188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:47.910939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:47.911366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:48.084041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:48.101222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:48.109406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:48.114383 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c402c334-0173-4c09-bd4c-9f7fb988d74d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.221977 Oct 06 13:14:48.121780 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2505/5009] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:47 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:48.174452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:48.175185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:48.185513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:48.186045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:48.186498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:48.187225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:48.203734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:48.204444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:48.518611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:48.534545 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5968859f-b391-42e1-956b-655182abcfcf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1350 microversion: 2.1 time: 0.363756 Oct 06 13:14:48.538063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2505/5010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:48 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1350 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:49.143107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:49.143725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:49.161372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:49.162308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:49.164788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:49.170537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:49.171088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:49.171567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:49.332247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:49.346113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:49.353800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:49.355242 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9454f442-ffdf-4dd8-8343-fe9a38d9aaf2 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.215921 Oct 06 13:14:49.356267 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2506/5011] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:49 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:49.561535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:49.562187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:49.577515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:49.578795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:49.579869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:49.582490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:49.584628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:49.588008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:49.859157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:49.867810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a95545d-c36d-4133-ad98-cfce3510fff1 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.310076 Oct 06 13:14:49.871102 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2506/5012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:49 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:50.392527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:50.393921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:50.409479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:50.411161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:50.412031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:50.412972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:50.413609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:50.414370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:50.599730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:50.612218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:50.616190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:50.618370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2afb492-3495-4d8a-838e-96c7acf16f61 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.237167 Oct 06 13:14:50.620014 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2507/5013] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:50 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:50.892481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:50.893716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:50.907101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:50.908332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:50.910301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:50.913304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:50.914016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:50.917676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:51.228573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:51.240519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8173fe7a-c9c7-4658-81fc-9604cc6abf5c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.353029 Oct 06 13:14:51.241794 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2507/5014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:50 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:51.657639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:51.658969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:51.672564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:51.673592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:51.685844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:51.688465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:51.691459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:51.692251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:52.006772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:52.021549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:52.024500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:52.029336 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8c883e5b-b8ea-4403-a54e-c5faddcbc003 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.385659 Oct 06 13:14:52.032674 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2508/5015] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:51 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:52.269059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:52.269700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:52.282156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:52.282669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:52.283124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:52.283952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:52.284457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:52.284765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950a4692-d31d-4a3e-bc67-e70294a41cfc", "tag": "4523483d-d1fb-4dca-9f2c-72a5aab53243"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:52.285235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:52.304312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:52.307404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:52.309886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:52.332695 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] Creating event network-changed:4523483d-d1fb-4dca-9f2c-72a5aab53243 for instance 950a4692-d31d-4a3e-bc67-e70294a41cfc on n-h2-860556-1 Oct 06 13:14:52.338706 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ba15548d-171d-4c17-80db-9755105e4bd5 req-be3dbb29-b36a-4e3a-b097-04a7e04a001a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514908 Oct 06 13:14:52.339848 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2508/5016] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:14:52.550057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:52.569282 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ac6dcfe-de02-4f34-b5b4-4218a7d40708 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.305652 Oct 06 13:14:52.570710 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2509/5017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:52 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:14:53.067260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:53.073575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:53.078595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:53.094695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.097906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.098384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.104391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.104902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.107759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.109919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.110612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.113955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.186224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Going to try to stop instance {{(pid=129614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:14:53.282026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:53.286522 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f70313bc-40ed-4019-a4fc-9e76f9c00dd8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.223549 Oct 06 13:14:53.288946 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2510/5018] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:14:53 2022] POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:14:53.295697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:53.297663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:53.298445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:53.300409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:53.302168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd603987-fcdd-40b8-b1fc-61a4ce72e4ff tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.248660 Oct 06 13:14:53.303282 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2509/5019] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:53 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:53.306830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.307678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.308828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.310609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.311536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.312838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.387720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1953965868", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:53.464000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:14:53.577274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:53.585654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3fffaccb-bb29-46da-abfe-7faa47424073 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.292810 Oct 06 13:14:53.591191 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2511/5020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:53 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:53.598012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:53.599234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:53.610608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.611598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.612537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.613555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.614223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.614999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.946626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:14:53.947544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:14:53.948185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:14:53.949057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:14:53.949461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:14:53.968307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.968819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.969272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:53.973386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:53.973921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:53.974372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:54.019736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.027734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Getting quotas for project 429e8bcc1d1f4050badc0fe17a79261b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:14:54.033045 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2a4473a7-fbce-48ef-97a5-71be52a1104b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.440315 Oct 06 13:14:54.034326 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2512/5021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:53 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:54.034466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Getting quotas for user af36b93b3fe94b1888006c1bcd57976c and project 429e8bcc1d1f4050badc0fe17a79261b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:14:54.062415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:14:54.066182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:14:54.171493 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be028c4a-48e9-4efc-8561-453d45a08d0f tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787055 Oct 06 13:14:54.172786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2510/5022] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:14:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:14:54.185241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-852f3baf-e9cf-47ff-97f1-d4f9a1c9d6b8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:54.186026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-852f3baf-e9cf-47ff-97f1-d4f9a1c9d6b8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:54.189646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:54.203151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:54.320930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-852f3baf-e9cf-47ff-97f1-d4f9a1c9d6b8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.329236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:54.330359 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-852f3baf-e9cf-47ff-97f1-d4f9a1c9d6b8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1214 microversion: 2.1 time: 0.150416 Oct 06 13:14:54.331120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:54.333032 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2513/5023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:54 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:54.341889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:54.345580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:54.346344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:54.349708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:54.350412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:54.351067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:54.543699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.555389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.556826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.558057 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9bd777ab-b82b-41de-a825-280248929659 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.233412 Oct 06 13:14:54.564102 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2511/5024] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:54 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:54.626194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:54.627194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:54.638891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:54.643626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:54.644238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:54.645136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:54.648351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:54.648922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:54.862867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:54.872235 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a73afa7-4dd2-4cea-9b63-c56e2c5bd3bb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.251867 Oct 06 13:14:54.875080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2514/5025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:54 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:55.058470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:55.059505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:55.066631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.067176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.067690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.068409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.068871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.069517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.247390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:55.255416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eea1659e-3880-4886-a820-437732ff98c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.200682 Oct 06 13:14:55.274341 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2512/5026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:55 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:55.355600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:55.356378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:55.368851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.369447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.370511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.371240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.371835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.372273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.380583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:55.474859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:55.486410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0428edbf-df9a-4894-aeb2-3978a459d724 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1218 microversion: 2.1 time: 0.134923 Oct 06 13:14:55.487521 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2515/5027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:55 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:55.594594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:55.595860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:55.615524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.619817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.620380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.623182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.623788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.624349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.717284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:55.733525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:55.738936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:55.744339 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fad37c1f-a245-4729-8ad9-f36ba24a4c5d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.156031 Oct 06 13:14:55.754221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2513/5028] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:55 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:55.903787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:55.904475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:55.918959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.922837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.923670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:55.924579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:55.925207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:55.926759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.218028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:56.227303 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32727808-a828-4ede-aee8-b4db629af8b8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.326658 Oct 06 13:14:56.228407 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2516/5029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:55 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:56.283283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:56.284020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:56.298146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.299568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.301072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.303223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.303877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.306661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.694747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Calling method '.version_select at 0x7f7d4766fdc0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:56.698098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:56.698602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.698827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.699455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.712034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5db6347a-fef1-4883-8287-256a41244942 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.432100 Oct 06 13:14:56.713721 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2514/5030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:56 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:56.724219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:56.724847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:56.740706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.742495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.743022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.743993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.746604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.747596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.748751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.749331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.749662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.772341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.773208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.773663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.796798 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42b1ba89-d68a-49c3-a4b2-36b03b31f5f4 tempest-PortsAdminExtendedAttrsTestJSON-1884554637 tempest-PortsAdminExtendedAttrsTestJSON-1884554637-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.461450 Oct 06 13:14:56.810772 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2517/5031] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:14:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:14:56.824336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:56.827724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:56.843165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.843968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.845324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.847284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:56.854715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:56.860020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:56.866002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:56.887502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2dae79e2-3acc-4550-8517-516ea8a8d72c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1284 microversion: 2.1 time: 0.170351 Oct 06 13:14:56.913084 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2515/5032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:56 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:57.015861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:57.027554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:57.033134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:57.039644 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45799007-023a-41a3-a017-42f7bb341b7d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.228357 Oct 06 13:14:57.040890 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2518/5033] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:56 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:57.254271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:57.255705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:57.268931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.269460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.270185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.276668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.277685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.278888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.636407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:57.654441 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe336ef2-06b6-4991-9d1c-bf617db70809 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.405693 Oct 06 13:14:57.655686 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2516/5034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:57 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:57.736624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:57.738727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:57.755554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.756323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.757185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.758184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.762033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.762690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.920712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:57.922142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:57.929324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.938430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.939458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.940891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:57.941593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:57.942453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:57.967975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:58.243095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:58.266117 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-80622a58-9336-472f-b9ab-2bf0d7a6f9e2 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.533274 Oct 06 13:14:58.267409 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2519/5035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:57 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:58.274539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:58.275898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:58.283661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:58.284433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:58.285050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:58.286213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:58.286858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:58.287568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:58.470620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:58.480164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:58.482832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:58.484386 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da0605a2-d86e-46ca-8d65-eed5cf5e090a tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.215797 Oct 06 13:14:58.484929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2520/5036] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:58 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:58.545110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:58.554409 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6fd28f4-5020-4c69-bbff-1370daf2ea20 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.637522 Oct 06 13:14:58.554994 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2517/5037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:57 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:58.681157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:58.681980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:58.690495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:58.691147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:58.691754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:58.692780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:58.693343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:58.695202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.036386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:59.045823 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1866cc00-f8ed-4ccc-9318-2bb918a6eb7c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.368703 Oct 06 13:14:59.046425 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2521/5038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:58 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:59.298120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:59.298899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:59.302686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:14:59.311212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.314064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.314544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.316286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.318311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.318800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.587956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950a4692-d31d-4a3e-bc67-e70294a41cfc", "name": "network-vif-plugged", "status": "completed", "tag": "4523483d-d1fb-4dca-9f2c-72a5aab53243"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:14:59.606192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.606192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.606192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.624142 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] Creating event network-vif-plugged:4523483d-d1fb-4dca-9f2c-72a5aab53243 for instance 950a4692-d31d-4a3e-bc67-e70294a41cfc on n-h2-860556-1 Oct 06 13:14:59.629262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e20cf09a-5938-4438-890f-125fce86fe9c req-0bb5e1fb-55ed-4c94-b909-66bb71d5b415 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301380 Oct 06 13:14:59.630249 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2522/5039] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:14:59.635859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:59.636576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:59.643039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.643546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.643997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.644713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.645180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.645617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.813569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:59.826486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:59.839868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-74c4e100-7e70-48e4-b1df-5f0b32dbbb4b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.546702 Oct 06 13:14:59.842898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2518/5040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:59 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:14:59.844434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:59.846730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:14:59.850634 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e6a8e53-ec2a-4e8c-81a9-407b6e93f599 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.219285 Oct 06 13:14:59.858210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2523/5041] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:14:59 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:14:59.859548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:14:59.860526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:14:59.868667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.869460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.870264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:14:59.871351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:14:59.872049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:14:59.872695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.074101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:00.074805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:00.091449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.092871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.094780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.095793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.096709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.097616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.208431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:00.217568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4493fbb7-244c-4581-8ffd-8958f1e31dbb tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.373288 Oct 06 13:15:00.218611 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2519/5042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:14:59 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:00.838221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:00.856449 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-690439a3-105f-4867-b566-8ce1de974bcc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.786319 Oct 06 13:15:00.860298 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2524/5043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:00 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:00.880048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:00.881300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:00.893610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:00.894561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:00.897372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.901259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.903621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.904577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.905208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.907050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.907699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.913006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.913686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:00.914624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:00.915910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:00.916533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:01.067173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:01.082275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:01.085074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:01.086454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2c4645e-02e9-4442-84c1-3598c2fa0828 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.203885 Oct 06 13:15:01.087738 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2525/5044] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:00 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:01.324006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:01.333432 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-db536320-1cc3-4125-bcec-d722402f864e tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1468 microversion: 2.1 time: 0.458379 Oct 06 13:15:01.333661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5baf36c0-2402-4f11-baf9-e7b6c3e756f7", "tag": "525e90f9-f89a-4fe2-9616-1f52a8532a15"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:01.345893 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2520/5045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:00 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1468 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:01.349239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:01.349942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:01.350914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:01.351640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:01.352284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:01.372810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:01.373299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:01.376192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] Creating event network-changed:525e90f9-f89a-4fe2-9616-1f52a8532a15 for instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 on n-h2-860556-1 Oct 06 13:15:01.382348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:01.383137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:01.383844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:01.384971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:01.386875 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1da1c37e-fe36-4268-8c5b-5b8739d46b17 req-3edef0e2-5919-4c6d-891d-2566e1069655 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297328 Oct 06 13:15:01.393451 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2526/5046] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:01.826084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:01.834258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3590ff43-58cf-4155-9a62-6901d12a866c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.486985 Oct 06 13:15:01.835447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2521/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:01 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:01.889769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:01.891195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:01.907566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:01.910260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:01.911261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:01.912368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:01.913273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:01.913993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:01.914612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.116756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:02.118008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:02.125279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.126563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.127207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.128113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.128748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.129352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.143381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:02.155430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f15e6c7e-d0d6-456b-90a6-77a3962cfe06 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.272395 Oct 06 13:15:02.156309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2527/5048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:01 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:02.201075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:02.214341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:02.217294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:02.219049 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a539d73-e141-44e1-adf5-826f6d877d65 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.107678 Oct 06 13:15:02.219897 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2522/5049] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:02 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:15:02.363326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:02.364526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:02.371232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.371973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.372615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.373512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.374379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.375281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.693086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:02.705294 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-435485fd-a26a-4a0a-a08c-5e2721cc9e04 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1640 microversion: 2.1 time: 0.345528 Oct 06 13:15:02.707949 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2528/5050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:02 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1640 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:02.729070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:02.729701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:02.736719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.737483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.739978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.740936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.742150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.742763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.861946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:02.863830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:02.875474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.877096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.878160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.879200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:02.880509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:02.883455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:02.992952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.002097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0601f720-d0cd-4475-9861-c460547557b6 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1640 microversion: 2.1 time: 0.276875 Oct 06 13:15:03.019651 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2523/5051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:02 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1640 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:03.024874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:03.025837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:03.032325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.033074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.033712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.034646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.035268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.036141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.348246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.365150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-879bd1dc-132d-4744-88c5-3ccc11bff568 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.508848 Oct 06 13:15:03.366002 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2529/5052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:02 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:03.370996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:03.371671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:03.381614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.382286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.382591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.383310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.384344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.384781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.686867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.696332 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8343508c-c438-41dc-82f7-c1b546ff3350 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.329007 Oct 06 13:15:03.697463 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2530/5053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:03 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:03.719503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:03.721244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:03.729142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.729506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.730385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.731391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:03.731963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:03.732542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:03.809045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1cb7ef2-2fac-4a45-a4be-b235dc0f2415 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1791 microversion: 2.1 time: 0.785786 Oct 06 13:15:03.811250 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2524/5054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:03 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1791 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:03.840349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.851264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.853314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:03.854859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6237f5b-5fb4-4528-9e44-45da14453e68 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.142593 Oct 06 13:15:03.856162 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2531/5055] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:03 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:04.398393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:04.399037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:04.409886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:04.414364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:04.420895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:04.421402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:04.422035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:04.422964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:04.423595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:04.424195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:04.724282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:04.724913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:04.731764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:04.734796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:04.735508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:04.736156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:04.737059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:04.737697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:04.738326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:04.969026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:04.984639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9defaefa-2279-4078-9386-46bb71529ed9 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.595267 Oct 06 13:15:04.985521 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2525/5056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:04 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:04.992449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:04.999512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:05.012058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:05.017195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:05.018581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:05.019581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:05.023094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:05.023837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:05.253811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:05.265250 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-90e64d77-a27b-4c8a-a0a3-b92a08db227c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1677 microversion: 2.1 time: 0.544685 Oct 06 13:15:05.278163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2532/5057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:04 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1677 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:05.308225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:05.317494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:05.323166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:05.333726 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23f1f0f4-862c-4a48-9004-a55d2cd9de90 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.346787 Oct 06 13:15:05.334420 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2526/5058] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:04 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:06.016395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:06.018382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:06.032901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.033689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.034433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.038803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.040308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.040944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.054161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:06.300613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:06.301570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:06.310222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.310731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.311541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.312274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.312950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.313397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.740478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:06.756288 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-977acc50-4be8-4cd8-ac8a-7e9484cac946 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.743062 Oct 06 13:15:06.770058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2533/5059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:06 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:06.799853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:06.803370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:06.823697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.824982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.825835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.826610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.833357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.833934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.911659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:06.930633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79d8b907-8059-4da0-a75a-45ccbca1a582 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1654 microversion: 2.1 time: 0.633855 Oct 06 13:15:06.936747 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2527/5060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:06 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1654 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:06.954634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950a4692-d31d-4a3e-bc67-e70294a41cfc", "tag": "4523483d-d1fb-4dca-9f2c-72a5aab53243"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:06.976020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:06.976959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:06.978859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:06.992768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] Creating event network-changed:4523483d-d1fb-4dca-9f2c-72a5aab53243 for instance 950a4692-d31d-4a3e-bc67-e70294a41cfc on n-h2-860556-1 Oct 06 13:15:07.000471 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bb3eff72-e03e-4991-a77e-9c4892baf893 req-bfe4c39b-ebc2-45eb-8c6b-a04de48ef46e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058201 Oct 06 13:15:07.001974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2528/5061] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:07.010304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:07.018734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.019431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.020610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:07.070338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Going to try to start instance {{(pid=129615) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:15:07.147766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:07.159514 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7c47d2e5-04e8-4414-8c8b-61200345b290 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.155074 Oct 06 13:15:07.159892 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2529/5062] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:15:07 2022] POST /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:15:07.161497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:07.169946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:07.172129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:07.185968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:07.188476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.188618 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b44d795-c4ec-4437-833e-c986b6ba9a7e tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1365 microversion: 2.47 time: 0.417216 Oct 06 13:15:07.191441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.193001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:07.193794 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2534/5063] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:06 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:07.198741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.199442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.200109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:07.565989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baf36c0-2402-4f11-baf9-e7b6c3e756f7", "name": "network-vif-plugged", "status": "completed", "tag": "525e90f9-f89a-4fe2-9616-1f52a8532a15"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:07.581421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.590010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.591952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:07.622583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] Creating event network-vif-plugged:525e90f9-f89a-4fe2-9616-1f52a8532a15 for instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 on n-h2-860556-1 Oct 06 13:15:07.628617 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e124f829-b250-49f4-bbfb-3bbe4172a604 req-fd40c496-047c-4f66-8fbe-2a08bd099427 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066055 Oct 06 13:15:07.630490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2535/5064] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:07.690696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:07.701596 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8830dd03-84e5-4875-ae4e-95f3c8ec034c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1663 microversion: 2.1 time: 0.536637 Oct 06 13:15:07.702548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2530/5065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:07 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1663 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:07.792429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:07.793433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:07.806395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.808408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.809363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:07.812547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:07.813476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:07.815155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:08.223885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:08.224575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:08.237325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:08.237867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:08.241024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:08.241832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:08.242612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:08.243774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:08.342626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:08.355347 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-126c4072-9b01-4351-9cab-642061dcc509 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.566105 Oct 06 13:15:08.374465 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2536/5066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:07 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:08.463756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:08.475098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:08.476565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:08.478353 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d122ffd1-0b96-46c2-9458-4458bb8091d9 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1371 microversion: 2.47 time: 0.260499 Oct 06 13:15:08.480951 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2531/5067] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:08 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:08.727076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:08.728716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:08.736143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:08.737139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:08.737831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:08.739131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:08.739813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:08.740452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:09.062659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:09.082124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fef7160f-6d19-47de-a98e-ef653f0a8448 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1663 microversion: 2.1 time: 0.361027 Oct 06 13:15:09.083758 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2537/5068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:08 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1663 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:09.380795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:09.381411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:09.390026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:09.390510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:09.391164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:09.391900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:09.392347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:09.392781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:09.512367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:09.514678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:09.527074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:09.528186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:09.529037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:09.530200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:09.531431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:09.533218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:09.720318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:09.723599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:09.732440 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4356ef3c-a28c-4589-944e-948d5947899c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1314 microversion: 2.1 time: 0.355311 Oct 06 13:15:09.743757 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2532/5069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:09 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:09.751560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:09.753221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:09.755277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41cacdab-048f-4216-a9fa-6b9c4f97cc3d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1371 microversion: 2.47 time: 0.252096 Oct 06 13:15:09.758206 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2538/5070] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:09 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:15:10.115664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:10.116579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:10.128899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.132403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.134977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:10.135969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.137650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.139246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:10.577064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:10.581095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:10.595576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0ef2c1f-f6d5-4622-8d4d-597525a1245d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1667 microversion: 2.1 time: 0.483066 Oct 06 13:15:10.599195 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2533/5071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:10 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1667 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:10.768970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:10.785267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:10.792207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:10.792738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:10.818484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.818983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.822119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:10.822779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.824512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.824976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.825413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:10.826120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.827488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:10.828850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:10.830243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:10.831969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.011800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.020745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.022254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.025012 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30044eea-1d75-4e01-b8b8-50d1c552d957 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1356 microversion: 2.47 time: 0.243114 Oct 06 13:15:11.025808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2534/5072] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:10 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1356 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:15:11.051109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:11.056933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.059138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Searching by: {'deleted': False, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:15:11.065288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.066152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.066771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.067915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.068533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.069145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.145413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.177524 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33b8a61d-762d-4c35-905c-21d5773582b1 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1464 microversion: 2.1 time: 0.420686 Oct 06 13:15:11.179145 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2539/5073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:10 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1464 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:11.195596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:15:11.208982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eac5d6a-973d-4a05-bc8b-c444d36c5442", "device": "/dev/sdb"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:11.216013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:11.226297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.228017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.228811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.230315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.230967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.233528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.314776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.322181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.322752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.323393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.344115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.347158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:11.396860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3d90acc-51fd-4d68-a5ed-73e614801d1c tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.348489 Oct 06 13:15:11.399790 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2535/5074] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Oct 6 13:15:11 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:15:11.439860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:11.443045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:11.463158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.463928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.464571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.465668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.466420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.467619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.516347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:15:11.682693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-227cbbd7-b820-4de1-9ec3-7b21045bc964 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 204 len: 0 microversion: 2.47 time: 0.247926 Oct 06 13:15:11.683436 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2536/5075] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:15:11 2022] DELETE /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:15:11.702887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:11.705483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:11.721251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.723572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.724511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.725312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:11.726318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:11.730452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:11.750622 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2095bc4f-73b8-4d6e-be72-49bf0775180c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "POST /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552155 Oct 06 13:15:11.752149 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2540/5076] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:15:11 2022] POST /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:12.031973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:12.045543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:12.052568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:12.057094 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b063e133-88c5-4266-88e8-61156fefb710 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1362 microversion: 2.47 time: 0.368133 Oct 06 13:15:12.058991 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2537/5077] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:11 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:13.086178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:13.087654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:13.106740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:13.109316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:13.112317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:13.113354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:13.114135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:13.114777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:13.278002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:13.295728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:13.299386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:13.301262 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8c20732-ea6c-46d4-94cc-cae5dda56224 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 200 len: 1362 microversion: 2.47 time: 0.220606 Oct 06 13:15:13.303525 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2541/5078] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:13 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:14.330140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:14.330893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:14.345767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.346884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.348626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.350377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.352188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.353567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.397568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] HTTP exception thrown: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Request method failure captured: Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 HTTP/1.1 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtS2E5CSjbC4kLTORymyM8MMe5D3aI6CmbBreoZhtkqm7e_h_2A_o7ONriiCIaRljuTGwz_DgidzANE1V8CdwLsJpxJ8JTNTsNSBsx4I9Acct36xw5oGQftLn70hpWRebuHBQFUQTf9keQEN4fUHO9ahoJIiZbIRndY1VXaeAuKin1Q Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.47 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 719fe15bd9ce4cd0bd237934c8f3257a Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerShowV247Test-382321185 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_719fe15bd9ce4cd0bd237934c8f3257a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/719fe15bd9ce4cd0bd237934c8f3257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/719fe15bd9ce4cd0bd237934c8f3257a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/719fe15bd9ce4cd0bd237934c8f3257a"}]}] Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerShowV247Test-382321185 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 719fe15bd9ce4cd0bd237934c8f3257a Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerShowV247Test-382321185 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerShowV247Test-382321185-project Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 74370737fbb94b6e87eba729bbddd397 Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerShowV247Test-382321185-project Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8'} Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:14.402868 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. Oct 06 13:15:14.408609 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:14.410827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Returning 404 to user: Instance 3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:14.412794 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb485512-f1ad-4137-8934-684d819d007d tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8" status: 404 len: 111 microversion: 2.47 time: 0.088118 Oct 06 13:15:14.416232 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2538/5079] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:14 2022] GET /compute/v2.1/servers/3d71cd86-6d2e-4c6c-b5f6-aa9fd6a963e8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:15:14.425457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:14.426577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:14.442880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.443858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.444474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.445386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.446089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.446712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.487843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:15:14.597427 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-597d1b6c-67ef-486c-9de4-3921360abb26 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 204 len: 0 microversion: 2.47 time: 0.175649 Oct 06 13:15:14.600998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2542/5080] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:15:14 2022] DELETE /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 13:15:14.612555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:14.616572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:14.630138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.630654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.631109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.644173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:14.647084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:14.653974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:14.907824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:14.923950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:14.925628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:14.933528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3318e42-733d-4a9b-a709-1b7b9cd47588 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 200 len: 1363 microversion: 2.47 time: 0.324697 Oct 06 13:15:14.934259 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2539/5081] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:14 2022] GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:15.962058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:15.962794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:15.980135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:15.980638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:15.981079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:15.981841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:15.982306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:15.982744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:16.312876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:16.325469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:16.330854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:16.332117 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bbc5c5fe-3d34-48cb-aadf-ed10192f0939 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 200 len: 1363 microversion: 2.47 time: 0.375147 Oct 06 13:15:16.332687 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2543/5082] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:15 2022] GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:17.358336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:17.358964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:17.372429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:17.378507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:17.379293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:17.380063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:17.380546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:17.380982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:17.523899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:17.526436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:17.527508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:17.529402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lazy-loading 'fault' on Instance uuid 1360086d-3f08-4dd9-b5e2-761f7d416ca6 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:15:17.989297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:18.002995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:18.008287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74370737fbb94b6e87eba729bbddd397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719fe15bd9ce4cd0bd237934c8f3257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:18.012620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ad6af14-a09d-4918-88ee-59a3128c3373 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 200 len: 1368 microversion: 2.47 time: 0.658057 Oct 06 13:15:18.015518 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2540/5083] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:17 2022] GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 1368 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:15:19.042765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:19.044364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] [instance: 1360086d-3f08-4dd9-b5e2-761f7d416ca6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:19.064842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:19.070619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:19.071295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:19.074476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:19.075243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:19.075797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:19.136823 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] HTTP exception thrown: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Request method failure captured: Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 HTTP/1.1 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtS2E5CSjbC4kLTORymyM8MMe5D3aI6CmbBreoZhtkqm7e_h_2A_o7ONriiCIaRljuTGwz_DgidzANE1V8CdwLsJpxJ8JTNTsNSBsx4I9Acct36xw5oGQftLn70hpWRebuHBQFUQTf9keQEN4fUHO9ahoJIiZbIRndY1VXaeAuKin1Q Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Openstack-Nova-Api-Version: 2.47 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 719fe15bd9ce4cd0bd237934c8f3257a Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerShowV247Test-382321185 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_719fe15bd9ce4cd0bd237934c8f3257a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/719fe15bd9ce4cd0bd237934c8f3257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/719fe15bd9ce4cd0bd237934c8f3257a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/719fe15bd9ce4cd0bd237934c8f3257a"}]}] Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerShowV247Test-382321185 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 719fe15bd9ce4cd0bd237934c8f3257a Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerShowV247Test-382321185 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerShowV247Test-382321185-project Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 74370737fbb94b6e87eba729bbddd397 Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerShowV247Test-382321185-project Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '1360086d-3f08-4dd9-b5e2-761f7d416ca6'} Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:19.141313 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. Oct 06 13:15:19.147128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:19.149101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] Returning 404 to user: Instance 1360086d-3f08-4dd9-b5e2-761f7d416ca6 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:19.151416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d1002d5-3aea-4fde-b0d7-7c866f2aad99 tempest-ServerShowV247Test-382321185 tempest-ServerShowV247Test-382321185-project] 10.222.0.26 "GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6" status: 404 len: 111 microversion: 2.47 time: 0.113245 Oct 06 13:15:19.158736 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2544/5084] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:15:19 2022] GET /compute/v2.1/servers/1360086d-3f08-4dd9-b5e2-761f7d416ca6 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:15:21.710644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:21.712621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:21.862862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e866e36-db98-451b-bc76-b73466c97c79 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Action: 'create', calling method: .version_select at 0x7f7d3ecca790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-36777306"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:22.283236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e866e36-db98-451b-bc76-b73466c97c79 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.578381 Oct 06 13:15:22.284075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2541/5085] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Oct 6 13:15:21 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 580 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 13:15:22.299054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00f39390-e85d-4ba2-a0b1-a2c451fa6045 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d47608c10>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:22.426463 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00f39390-e85d-4ba2-a0b1-a2c451fa6045 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 200 len: 343 microversion: 2.1 time: 0.131886 Oct 06 13:15:22.427320 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2545/5086] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:22 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 343 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:23.443250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-331e4793-dccd-45c4-b143-ed044208e438 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3eda8c10>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:23.498545 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-331e4793-dccd-45c4-b143-ed044208e438 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 200 len: 344 microversion: 2.1 time: 0.060517 Oct 06 13:15:23.499143 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2542/5087] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:23 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:23.514204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-854208d0-5a33-402e-8dac-95b9e811a27d tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Action: 'create', calling method: .version_select at 0x7f7d3f26b3a0>, body: {"snapshot": {"volume_id": "6fb9e72a-89b3-4bb9-8299-cf6e336a08ba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-175432131"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:23.777487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-854208d0-5a33-402e-8dac-95b9e811a27d tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.268706 Oct 06 13:15:23.784947 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2546/5088] 10.222.0.26 () {60 vars in 1162 bytes} [Thu Oct 6 13:15:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:23.792552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa010ad8-dec7-4f7a-a502-49058393dd61 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3ef4c820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:23.840031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa010ad8-dec7-4f7a-a502-49058393dd61 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.053472 Oct 06 13:15:23.841254 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2543/5089] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:23 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:23.855777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6220d051-f323-4502-801e-217f73a55559 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d47608430>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:23.916734 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6220d051-f323-4502-801e-217f73a55559 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.066890 Oct 06 13:15:23.917308 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2547/5090] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Oct 6 13:15:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:23.929695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef4e576e-4477-407f-8a3f-5763b642dc80 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3ee014c0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:23.966276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef4e576e-4477-407f-8a3f-5763b642dc80 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.040879 Oct 06 13:15:23.972455 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2544/5091] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:23 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:24.980803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77017415-a8db-419c-9f83-9ebf4e2ee9fd tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e748ee0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:25.002357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:25.006024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:25.018097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:25.018811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:25.021227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:25.022150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:25.022931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:25.024671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:25.067136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77017415-a8db-419c-9f83-9ebf4e2ee9fd tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.091491 Oct 06 13:15:25.074512 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2548/5092] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:24 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:25.393032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:25.414027 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2227edcd-6c5d-4cae-a76a-01f639d4d796 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.417737 Oct 06 13:15:25.418412 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2545/5093] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:24 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:25.445347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:25.446925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:25.457773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:25.466459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:25.467128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:25.468068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:25.468700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:25.469313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:26.006466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:26.020696 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a6029ed-0965-428c-bdb3-5aebe002be15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.580891 Oct 06 13:15:26.023897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2549/5094] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:25 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:26.049181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:26.049988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:26.058925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:26.059480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:26.060190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:26.061005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:26.061710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:26.062180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:26.261970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7e54360a-70b0-41a7-ac00-157816b43e75 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: .version_select at 0x7f7d3eccaa60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-256870886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrn2MCcEax4h2LIcfVgLEd58KAdG36W2wnU6zLxTJa9aCBwd4Pi3QoSTybtY29dkrrW9GAhOBHiYCBFfJSQw3X1LlZnbvDOTHBUz70ry4bBqODT4DSQYbGHf9gpSStATg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:26.280058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7e54360a-70b0-41a7-ac00-157816b43e75 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:15:26.288253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7e54360a-70b0-41a7-ac00-157816b43e75 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:15:26.311891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:26.322898 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e65ab076-0b5a-40ff-8cbb-6620a4758333 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.277923 Oct 06 13:15:26.327269 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2550/5095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:26 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:26.330833 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7e54360a-70b0-41a7-ac00-157816b43e75 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.351941 Oct 06 13:15:26.332372 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2546/5096] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:15:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:26.335220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52114759-a520-4225-9f29-ce339acb583d tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e2ceca0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:26.351190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2110059865"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:26.355213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:26.363660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:26.364386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:26.365629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:26.366313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:26.367075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:26.367707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:26.409626 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52114759-a520-4225-9f29-ce339acb583d tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 287 microversion: 2.1 time: 0.080868 Oct 06 13:15:26.410537 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2551/5097] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:26 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:26.423857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a354d1a0-8c3a-4491-88c1-db6fc0f34a81 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e777f70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:26.519929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a354d1a0-8c3a-4491-88c1-db6fc0f34a81 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 202 len: 0 microversion: 2.1 time: 0.101261 Oct 06 13:15:26.520504 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2552/5098] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Oct 6 13:15:26 2022] DELETE /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:15:26.529303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f73c96fa-dce0-4b22-b359-a3737fb1c510 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d477ca550>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:26.601932 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f73c96fa-dce0-4b22-b359-a3737fb1c510 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.077006 Oct 06 13:15:26.603340 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2553/5099] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:26 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:26.763190 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7072a564-fa0e-4e7e-a0a5-a50a58b5b34b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.415475 Oct 06 13:15:26.768193 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2547/5100] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:15:26 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 06 13:15:27.623661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-047c5087-b55e-4b00-b8d9-76ba024c07c2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e2ce940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:27.685148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-047c5087-b55e-4b00-b8d9-76ba024c07c2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.072907 Oct 06 13:15:27.685949 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2554/5101] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:27 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:28.700974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2da569a-3d39-4bae-84d1-b08cdd0daf3c tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e714310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:28.762253 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2da569a-3d39-4bae-84d1-b08cdd0daf3c tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 200 len: 286 microversion: 2.1 time: 0.066886 Oct 06 13:15:28.764018 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2548/5102] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:28 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:29.780424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e22ea0f8-e88f-4f1f-b718-b4eef115796a tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3f26bf70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:29.822407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-e22ea0f8-e88f-4f1f-b718-b4eef115796a tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] HTTP exception thrown: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e22ea0f8-e88f-4f1f-b718-b4eef115796a tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Request method failure captured: Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 HTTP/1.1 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTpmTawEhRJOKzpR7ND8K2hcDZSAkyipiXg-PYZFl_eOl5gEcef6IVIUSoUy7utmdaxg5Fzs4nguR6AbaNIcumPaKESwMp1PFHcmxTAi20iSXxe9YT6ZQ3pgMCcyDcQuwOSFUtxy0ZOfJD4SQg-19sIoQqaGw7vMceahmMEYt_uRgU Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_50d7fee05cfc4f56aa0e7872b726ecb8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}] Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b57a594fce4c4eb9bfd2c9e249455d75 Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: exception: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'b0f2e599-1cd6-4c61-a307-f7fba02b4dc6'} Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. (HTTP 404) (Request-ID: req-5b914471-a73b-4161-8e6b-52f695d30252) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:15:29.833629 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e22ea0f8-e88f-4f1f-b718-b4eef115796a tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Returning 404 to user: Snapshot b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e22ea0f8-e88f-4f1f-b718-b4eef115796a tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6" status: 404 len: 111 microversion: 2.1 time: 0.064090 Oct 06 13:15:29.840036 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2555/5103] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:15:29 2022] GET /compute/v2.1/os-snapshots/b0f2e599-1cd6-4c61-a307-f7fba02b4dc6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:15:29.846747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91d1c695-bcd2-4ce9-80b8-dc8070c32394 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3ed05f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:29.975364 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91d1c695-bcd2-4ce9-80b8-dc8070c32394 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 202 len: 0 microversion: 2.1 time: 0.134001 Oct 06 13:15:29.975951 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2549/5104] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:15:29 2022] DELETE /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:15:29.985084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15cc0f32-b3a6-4639-9894-7777ef658649 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e2ce790>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:30.098880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15cc0f32-b3a6-4639-9894-7777ef658649 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 200 len: 343 microversion: 2.1 time: 0.117933 Oct 06 13:15:30.099773 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2556/5105] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:29 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 343 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:31.116232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ef0d418-5b71-460d-b58f-1e54093acc71 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e7145e0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:31.214686 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ef0d418-5b71-460d-b58f-1e54093acc71 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 200 len: 343 microversion: 2.1 time: 0.104056 Oct 06 13:15:31.217349 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2550/5106] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:31 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 343 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:32.234207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-492d4f21-fca5-4141-b842-c6387f6a518c tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e536d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:32.335570 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-492d4f21-fca5-4141-b842-c6387f6a518c tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 200 len: 343 microversion: 2.1 time: 0.108825 Oct 06 13:15:32.345801 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2557/5107] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:32 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 343 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:33.379511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5003f9bb-6e60-46f0-8b72-7c4343f4b7a4 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3ed05040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:33.455534 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5003f9bb-6e60-46f0-8b72-7c4343f4b7a4 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] HTTP exception thrown: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5003f9bb-6e60-46f0-8b72-7c4343f4b7a4 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Request method failure captured: Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba HTTP/1.1 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtTpmTawEhRJOKzpR7ND8K2hcDZSAkyipiXg-PYZFl_eOl5gEcef6IVIUSoUy7utmdaxg5Fzs4nguR6AbaNIcumPaKESwMp1PFHcmxTAi20iSXxe9YT6ZQ3pgMCcyDcQuwOSFUtxy0ZOfJD4SQg-19sIoQqaGw7vMceahmMEYt_uRgU Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_50d7fee05cfc4f56aa0e7872b726ecb8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}] Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: b57a594fce4c4eb9bfd2c9e249455d75 Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: exception: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '6fb9e72a-89b3-4bb9-8299-cf6e336a08ba'} Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. (HTTP 404) (Request-ID: req-2dea488d-7824-402e-8e43-c668db4da708) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:15:33.464069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.472450 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.488001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5003f9bb-6e60-46f0-8b72-7c4343f4b7a4 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Returning 404 to user: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:33.488001 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5003f9bb-6e60-46f0-8b72-7c4343f4b7a4 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 404 len: 109 microversion: 2.1 time: 0.123114 Oct 06 13:15:33.498325 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2551/5108] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:33 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:15:33.501181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bc1be4f-7a2a-4fd3-84b7-0ccf894e01d2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e536d30>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:33.565084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-plugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:33.583569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:33.589475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:33.592687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:33.593384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:33.606772 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-1bc1be4f-7a2a-4fd3-84b7-0ccf894e01d2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] HTTP exception thrown: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bc1be4f-7a2a-4fd3-84b7-0ccf894e01d2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Request method failure captured: Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba HTTP/1.1 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTpmTawEhRJOKzpR7ND8K2hcDZSAkyipiXg-PYZFl_eOl5gEcef6IVIUSoUy7utmdaxg5Fzs4nguR6AbaNIcumPaKESwMp1PFHcmxTAi20iSXxe9YT6ZQ3pgMCcyDcQuwOSFUtxy0ZOfJD4SQg-19sIoQqaGw7vMceahmMEYt_uRgU Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_50d7fee05cfc4f56aa0e7872b726ecb8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}] Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b57a594fce4c4eb9bfd2c9e249455d75 Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: exception: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6fb9e72a-89b3-4bb9-8299-cf6e336a08ba'} Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. (HTTP 404) (Request-ID: req-4812bbf5-3815-4dfa-bc04-ece29780dbff) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:15:33.608946 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bc1be4f-7a2a-4fd3-84b7-0ccf894e01d2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Returning 404 to user: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1bc1be4f-7a2a-4fd3-84b7-0ccf894e01d2 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 404 len: 109 microversion: 2.1 time: 0.121458 Oct 06 13:15:33.619174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2558/5109] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:15:33 2022] DELETE /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:15:33.636944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22f18cc7-68c4-460e-a4db-5fc21a0ac5d8 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Calling method '.version_select at 0x7f7d3e2ce9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:33.670874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] Creating event network-vif-plugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:15:33.691704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0bac8cc3-d1cf-40ce-894a-c8d9539aa033 req-9d292b43-a06e-4f7b-a377-c0fabab54b70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131501 Oct 06 13:15:33.695058 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2552/5110] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:33.719808 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-22f18cc7-68c4-460e-a4db-5fc21a0ac5d8 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] HTTP exception thrown: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22f18cc7-68c4-460e-a4db-5fc21a0ac5d8 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Request method failure captured: Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba HTTP/1.1 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTpmTawEhRJOKzpR7ND8K2hcDZSAkyipiXg-PYZFl_eOl5gEcef6IVIUSoUy7utmdaxg5Fzs4nguR6AbaNIcumPaKESwMp1PFHcmxTAi20iSXxe9YT6ZQ3pgMCcyDcQuwOSFUtxy0ZOfJD4SQg-19sIoQqaGw7vMceahmMEYt_uRgU Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_50d7fee05cfc4f56aa0e7872b726ecb8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/50d7fee05cfc4f56aa0e7872b726ecb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/50d7fee05cfc4f56aa0e7872b726ecb8"}]}] Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 50d7fee05cfc4f56aa0e7872b726ecb8 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-573562308 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b57a594fce4c4eb9bfd2c9e249455d75 Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-573562308-project Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: exception: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6fb9e72a-89b3-4bb9-8299-cf6e336a08ba'} Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. (HTTP 404) (Request-ID: req-39bd0196-b30d-4277-bc5e-0be6bfa56277) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:15:33.722103 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. Oct 06 13:15:33.727046 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:15:33.736467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22f18cc7-68c4-460e-a4db-5fc21a0ac5d8 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] Returning 404 to user: Volume 6fb9e72a-89b3-4bb9-8299-cf6e336a08ba could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:15:33.737354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22f18cc7-68c4-460e-a4db-5fc21a0ac5d8 tempest-VolumesSnapshotsTestJSON-573562308 tempest-VolumesSnapshotsTestJSON-573562308-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba" status: 404 len: 109 microversion: 2.1 time: 0.120053 Oct 06 13:15:33.744493 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2559/5111] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:33 2022] GET /compute/v2.1/os-volumes/6fb9e72a-89b3-4bb9-8299-cf6e336a08ba => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:15:42.794725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0176279-26e6-4c96-8123-56a4224c7a4d tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3f1fcd30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:42.816738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:42.906322 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0176279-26e6-4c96-8123-56a4224c7a4d tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9ee2de86-3fc6-4b75-b169-828619260ecb" status: 200 len: 350 microversion: 2.1 time: 0.125175 Oct 06 13:15:42.907602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2553/5112] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:42 2022] GET /compute/v2.1/os-volumes/9ee2de86-3fc6-4b75-b169-828619260ecb => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:45.691956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-555db51a-8d65-4fee-b914-3cde21615846 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e2ce040>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:45.708478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:45.709278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:45.776638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:45.779136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:45.799963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-937511385", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "c891936a-904d-4a85-81ed-ec7174fbd6cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-256870886", "security_groups": [{"name": "tempest-secgroup-smoke-1555496520"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:45.844687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-555db51a-8d65-4fee-b914-3cde21615846 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07550db5-a718-46a0-9c26-e9bbef3428d8" status: 200 len: 349 microversion: 2.1 time: 0.156370 Oct 06 13:15:45.854456 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2560/5113] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:45 2022] GET /compute/v2.1/os-volumes/07550db5-a718-46a0-9c26-e9bbef3428d8 => generated 349 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:46.209576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] validate_networks() for [('c891936a-904d-4a85-81ed-ec7174fbd6cc', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:15:47.511276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:15:47.514541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:15:47.515240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:15:47.515906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:15:47.516736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:15:47.544049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:47.545239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:47.547525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:47.548644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:47.564407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:47.565094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:47.662800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:15:47.691625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:15:47.732187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:15:47.736032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:15:47.888538 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6edf75d-b4fd-444b-bab9-9b9a1f1912a5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.112636 Oct 06 13:15:47.892047 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2554/5114] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:15:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:15:47.904867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21291a2d-27d1-49b0-b9ac-43b097e0bb46 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:47.905495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-21291a2d-27d1-49b0-b9ac-43b097e0bb46 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:48.186229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21291a2d-27d1-49b0-b9ac-43b097e0bb46 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:48.202709 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21291a2d-27d1-49b0-b9ac-43b097e0bb46 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1265 microversion: 2.1 time: 0.302651 Oct 06 13:15:48.203315 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2561/5115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:47 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:48.975492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60e38616-b04a-473e-a309-cf6182c3e1c1 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e714790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:49.116158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60e38616-b04a-473e-a309-cf6182c3e1c1 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e2c9c4b4-81db-49f2-8b00-aadf21e1266a" status: 200 len: 350 microversion: 2.1 time: 0.152782 Oct 06 13:15:49.117014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2555/5116] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:15:48 2022] GET /compute/v2.1/os-volumes/e2c9c4b4-81db-49f2-8b00-aadf21e1266a => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:49.165879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d68e6163-49f0-497a-b9a1-8ec7f659ad22 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e6ce0d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:49.231245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:49.233413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:49.253544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:49.254521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:49.257280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:49.266006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:49.275467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:49.277574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:49.504571 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d68e6163-49f0-497a-b9a1-8ec7f659ad22 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.377794 Oct 06 13:15:49.505441 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2562/5117] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Oct 6 13:15:49 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:49.521479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a178d2c5-2615-4b5a-9e18-6b8c01e4e86a tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e736550>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:49.743915 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a178d2c5-2615-4b5a-9e18-6b8c01e4e86a tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.227665 Oct 06 13:15:49.745692 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2563/5118] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Oct 6 13:15:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:15:49.760415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1902216a-b01d-4273-b13a-24a0672ae266 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e777820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:49.775740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:49.814142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3e70b36-fcf9-47a5-b723-d9670dcbd6ac tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1269 microversion: 2.1 time: 0.588819 Oct 06 13:15:49.815281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2556/5119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:49 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1269 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:49.963603 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1902216a-b01d-4273-b13a-24a0672ae266 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.207127 Oct 06 13:15:49.964473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2564/5120] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Oct 6 13:15:49 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:49.981375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27eb6763-ec5a-41d8-9072-51a27695c976 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3edaa8b0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:50.225909 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27eb6763-ec5a-41d8-9072-51a27695c976 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.248127 Oct 06 13:15:50.226498 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2557/5121] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Oct 6 13:15:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:50.240658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f05ef5c1-9e1a-4dc6-8df1-9784dc96a854 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3e564e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:50.487291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f05ef5c1-9e1a-4dc6-8df1-9784dc96a854 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.250249 Oct 06 13:15:50.498434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2565/5122] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Oct 6 13:15:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:50.503806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6c1d80fd-c0bf-48eb-acf5-25de3f77cca4 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3ecca040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:50.842702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:50.843764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:50.855534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:50.858424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:50.862504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:50.863691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:50.864438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:50.866336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:50.941181 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6c1d80fd-c0bf-48eb-acf5-25de3f77cca4 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.441506 Oct 06 13:15:50.949977 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2558/5123] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 13:15:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:50.955902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66f3c9df-f580-4077-91f3-a217ccea21c2 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d3f01daf0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:51.184910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-66f3c9df-f580-4077-91f3-a217ccea21c2 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.233121 Oct 06 13:15:51.185504 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2559/5124] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Oct 6 13:15:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:15:51.207395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aac1140f-ba62-47b6-b108-cf5de5025441 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] Calling method '.version_select at 0x7f7d47677550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:51.435496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aac1140f-ba62-47b6-b108-cf5de5025441 tempest-VolumesTestJSON-1849564303 tempest-VolumesTestJSON-1849564303-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.232921 Oct 06 13:15:51.445865 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2560/5125] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 13:15:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:51.726080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:51.735468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3fa4df73-81ab-4fa5-b3cb-c64d3eec7718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1335 microversion: 2.1 time: 0.896547 Oct 06 13:15:51.735954 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2566/5126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:50 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1335 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:52.763759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:52.764991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:52.778941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:52.801103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:52.803281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:52.807243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:52.817407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:52.819120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:53.108797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:53.136828 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-884fd939-3ab8-4a8b-9279-30618dcfa93c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1323 microversion: 2.1 time: 0.378915 Oct 06 13:15:53.151287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2561/5127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:52 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:54.173365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:54.174758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:54.195001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:54.196092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:54.196722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:54.197633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:54.200137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:54.200837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:54.663850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:54.674687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f59abcf1-2593-40fa-8a32-ce708960f240 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.506069 Oct 06 13:15:54.680568 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2567/5128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:54 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:55.702700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:55.703330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:55.723705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:55.724492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:55.725138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:55.726161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:55.726941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:55.728161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:56.312548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:56.328690 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-524bb4a3-c4bd-4d96-bad5-dfc92b2591d3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.621941 Oct 06 13:15:56.345027 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2562/5129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:55 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:15:57.355042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:57.357561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:57.385294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:57.393652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:57.396337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:57.411256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:57.426781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:57.435045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:57.473141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:15:57.504013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:57.505606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:57.506281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:57.524922 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] Creating event network-changed:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h1-860556-1 Oct 06 13:15:57.534354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e707d4fd-aedc-44d1-a933-919e2c21eb86 req-dfe0ea38-cac2-410f-9d9e-da13fca33145 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074182 Oct 06 13:15:57.535805 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2563/5130] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 06 13:15:58.200812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:58.317147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:15:58.337212 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-560aa4ee-e152-4449-be7d-f266e301b302 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.987819 Oct 06 13:15:58.350546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2568/5131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:57 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:15:59.366212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:15:59.369126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:15:59.386259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:59.387436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:15:59.390514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:59.391466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:59.392096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:15:59.393014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:15:59.393642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:15:59.394300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:00.102154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:00.141967 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48641f73-1f7b-4052-aaf8-2816166c7769 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.778063 Oct 06 13:16:00.143519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2564/5132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:15:59 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:01.175409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:01.176306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:01.208716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:01.215794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:01.217240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:01.226396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:01.229447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:01.230197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:01.663791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:01.701773 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47f078d4-a285-4f5c-bfcf-5a4442d377a7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.518159 Oct 06 13:16:01.703815 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2569/5133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:01 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:02.727481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:02.728934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:02.744934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:02.745916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:02.746615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:02.747579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:02.748285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:02.748982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:03.506955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:03.506955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-555cdcec-3add-4652-8794-16da73b032af tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.744955 Oct 06 13:16:03.506955 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2565/5134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:02 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:04.512685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:04.516111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:04.548970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:04.549644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:04.550119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:04.550871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:04.551344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:04.551800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:05.304804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:05.326974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22336f17-3905-44af-8626-9ae19e9be806 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 0.827146 Oct 06 13:16:05.328310 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2570/5135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:04 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:06.367802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:06.368408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:06.384763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:06.385264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:06.398855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:06.400199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:06.400829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:06.403532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:06.604769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "name": "network-vif-plugged", "status": "completed", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:06.646351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:06.646852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:06.653972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:06.698102 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] Creating event network-vif-plugged:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h1-860556-1 Oct 06 13:16:06.709180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9f32c7f3-1840-46a4-b46a-735ca84b92d8 req-36634eaa-4a28-4504-bc2d-c724166dda81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118961 Oct 06 13:16:06.721036 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2571/5136] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:07.904649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:07.928804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e118871-d8ce-49ea-bff7-c8dc3ba87d1b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1391 microversion: 2.1 time: 1.565120 Oct 06 13:16:07.929402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2566/5137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:06 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1391 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:08.957580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:08.959047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:09.012381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:09.018593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:09.026863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:09.030662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:09.031515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:09.038277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:09.852059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:09.871984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9cbd80ac-7ff9-41e4-98e4-01319cffbbdb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1564 microversion: 2.1 time: 0.917369 Oct 06 13:16:09.877675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2572/5138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:08 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1564 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:09.899693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:09.901508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:09.918851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:09.920063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:09.921010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:09.922207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:09.922903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:09.923545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:10.766468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:10.782723 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ec81a88-7c0d-4e33-a639-09a03280fd21 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1564 microversion: 2.1 time: 0.881747 Oct 06 13:16:10.800906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2567/5139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:09 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1564 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:13.403438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:13.404657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:13.455016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:13.456001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:13.456928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:13.457962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:13.458843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:13.459613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:14.095686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:14.107851 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8130dcb6-ea99-48d5-bc3e-48f52f4acce3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.711487 Oct 06 13:16:14.109119 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2573/5140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:13 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:14.139937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-24598824"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:14.145554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:14.162802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:14.165149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:14.166346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:14.173466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:14.174978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:14.176616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:14.486384 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc809e10-7437-4774-b6d3-cd6d5869f950 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.354871 Oct 06 13:16:14.487214 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2568/5141] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:16:14 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 06 13:16:17.284079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:17.296924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:17.297809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:17.315768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=21 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:17.317920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:17.341293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:17.344898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:17.348820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:17.350076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:17.350903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:17.358800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:17.358941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:17.358941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:17.358941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:17.369940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=45 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:17.398934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:17.405801 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] Creating event network-changed:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h1-860556-1 Oct 06 13:16:17.422975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9a2053fe-5297-44e3-a455-b2d6073c44b3 req-615fb03e-52cf-4166-8c25-a4f3c3d0de66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133975 Oct 06 13:16:17.424385 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2569/5142] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:17.431352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:17.453022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:17.453773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:17.454396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:17.469564 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] Creating event network-vif-unplugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:16:17.486300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c314ff1f-9c59-419c-94a3-7fbf2d18f736 req-39b2b136-1b40-4b31-9720-ac94fc3c6c36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060084 Oct 06 13:16:17.488236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2570/5143] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:18.361480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:18.380894 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9485f2fc-db07-4f81-a97b-8d78f1ad12a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1564 microversion: 2.1 time: 1.103914 Oct 06 13:16:18.381926 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2574/5144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:17 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1564 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:18.725310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:18.732518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:18.748794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:18.749545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:18.750264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:18.751259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:18.751948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:18.752595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:18.820749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3f307cdb-d1d2-4684-81e1-ae44687e3cb3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100116 Oct 06 13:16:18.822680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2571/5145] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:16:18 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:16:18.914178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:18.914690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:18.921507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:18.922058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:18.922515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:18.923256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:18.923808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:18.924255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:18.982113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:16:19.143914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea753d9c-b689-45cd-9385-3e2e24c583a6 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 204 len: 0 microversion: 2.1 time: 0.233648 Oct 06 13:16:19.153083 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2575/5146] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:16:18 2022] DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:16:19.164535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:19.165122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:19.189500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:19.190029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:19.190476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:19.191198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:19.191658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:19.192091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:19.551491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:19.565528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aea7ba28-0691-47ae-8ffa-92a0916e9c88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1673 microversion: 2.1 time: 0.406257 Oct 06 13:16:19.569617 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2572/5147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:19 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1673 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:20.610602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:20.611307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:20.626067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:20.626573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:20.627026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:20.627743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:20.631511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:20.634701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:20.902789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:20.919040 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e54631ea-5051-4f39-9313-5f44374bba00 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1673 microversion: 2.1 time: 0.312635 Oct 06 13:16:20.919783 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2576/5148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:20 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1673 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:21.457369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-plugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:21.484914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:21.485392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:21.485873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:21.512240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] Creating event network-vif-plugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:16:21.530127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-df8071c5-92b7-4749-a4a0-78aa356412a5 req-b1926082-05de-44c8-b51d-e3da0dd24931 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076291 Oct 06 13:16:21.532600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2573/5149] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:21.942851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:21.943486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:21.957012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:21.957509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:21.958033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:21.959071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:21.959683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:21.970880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:22.471005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:22.481362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1417341c-669f-43ab-917f-66fd9ccfa4df tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1673 microversion: 2.1 time: 0.542200 Oct 06 13:16:22.488961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2577/5150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:21 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1673 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:23.525164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:23.526061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:23.569413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:23.574091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:23.575988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:23.577124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:23.582655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:23.587507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:24.543775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:24.555390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80bbe3cb-51f1-4271-babf-43f2f3cdfff9 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1606 microversion: 2.1 time: 1.041769 Oct 06 13:16:24.562474 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2574/5151] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:23 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1606 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:25.533057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0206ff63-f48c-4f6c-a7f2-24359b70d5ec", "name": "network-vif-deleted", "tag": "70e098cb-4607-40bd-9654-c5d405325dba"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:25.578811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:25.580518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:25.581560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:25.584976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:25.588060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:25.621785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:25.622984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:25.626509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:25.627368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:25.630850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:25.634130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] Creating event network-vif-deleted:70e098cb-4607-40bd-9654-c5d405325dba for instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec on n-h2-860556-1 Oct 06 13:16:25.634537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:25.656925 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-385cbf3d-0aff-4220-ab9d-6f01c7022471 req-a6b11115-4481-4e92-b34d-b58a216cbc68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121629 Oct 06 13:16:25.661047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2578/5152] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:25.873087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:25.887548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e788957-19a6-48c5-bf9f-297cc3163e30 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 200 len: 1323 microversion: 2.1 time: 0.304368 Oct 06 13:16:25.901070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2575/5153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:25 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:26.917416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:26.918753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:26.942522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:26.946126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:26.948823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:26.950670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:26.954782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:26.959690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:27.030529 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec HTTP/1.1 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0206ff63-f48c-4f6c-a7f2-24359b70d5ec'} Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:16:27.033364 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:16:27.039087 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:16:27.041031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:16:27.050996 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-578284e6-ea86-48b9-bfe3-8e6b827733c5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 404 len: 111 microversion: 2.1 time: 0.139868 Oct 06 13:16:27.058681 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2579/5154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:26 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:16:27.068844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3406a01f-1fd7-4144-af44-bcb778aac384 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '.version_select at 0x7f7d3ee6f160>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:27.132101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3406a01f-1fd7-4144-af44-bcb778aac384 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184475204" status: 202 len: 0 microversion: 2.1 time: 0.068749 Oct 06 13:16:27.133766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2576/5155] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184475204 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:16:31.127472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce3fbcec-54c5-4744-90d0-fe11a51bfb2f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: .version_select at 0x7f7d3e736af0>, body: {"keypair": {"name": "tempest-keypair-465846181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1b8am5h0B7gFDCSsJD2URqidhXj0Z6+65yEy/DHU45L0NNsW6vJiOB1OWIhXXcBonjut55uZw7WU/ZcNPbXpgmNQZ+7nDtd0Wyw7FwuBEP8CdKsejmv1SzB+AnrFCEfQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:31.168088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ce3fbcec-54c5-4744-90d0-fe11a51bfb2f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:16:31.182335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-ce3fbcec-54c5-4744-90d0-fe11a51bfb2f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for user 5d1f3078e7b3489f962470c753bdf574 and project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:16:31.253419 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce3fbcec-54c5-4744-90d0-fe11a51bfb2f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129748 Oct 06 13:16:31.260220 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2580/5156] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:16:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:16:36.066421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:36.068641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:36.106577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=29 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:36.116887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:36.128641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:36.129387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:36.130908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:36.135440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:36.136769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:36.255299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9486b1d8-86af-46ca-9eb0-f036bcd4a436 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action" status: 200 len: 24567 microversion: 2.1 time: 0.192589 Oct 06 13:16:36.256604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2577/5157] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:16:36 2022] POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action => generated 24567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:16:39.638251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:39.644745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1919223951", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f6db9c2-b018-4d3e-ac2e-c3143e453914"}], "security_groups": [{"name": "tempest-securitygroup--901056031"}], "key_name": "tempest-keypair-465846181", "user_data": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:40.291042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] validate_networks() for [('9f6db9c2-b018-4d3e-ac2e-c3143e453914', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:16:41.209506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:45.650700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:16:45.651961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:16:45.652656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:16:45.654376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:16:45.655583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:16:45.698408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:45.704261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:45.707433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:45.708416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:45.708905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:45.709344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:45.797822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:16:45.825553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Getting quotas for user 5d1f3078e7b3489f962470c753bdf574 and project 1b41ce509e1f418cbd716872a7d0b734. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:16:45.867229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:16:45.870081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:16:46.103003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-53e6197d-88c6-4092-bb74-0c3d35ab59f4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.466308 Oct 06 13:16:46.138064 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2581/5158] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:16:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 6500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:16:46.144065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eaad1cbf-4485-41f4-ac3d-815ced0f003c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:46.144783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eaad1cbf-4485-41f4-ac3d-815ced0f003c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:46.149493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:46.181833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:46.653345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaad1cbf-4485-41f4-ac3d-815ced0f003c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:46.661788 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eaad1cbf-4485-41f4-ac3d-815ced0f003c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1237 microversion: 2.1 time: 0.522116 Oct 06 13:16:46.686445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2578/5159] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:46 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1237 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:47.128999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1004625472", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a588b329-ae1f-411d-8596-f0db988b26c0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-784722117", "security_groups": []}, "os:scheduler_hints": {"different_host": ["950a4692-d31d-4a3e-bc67-e70294a41cfc"]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:47.339481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:47.340200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:47.369871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:47.374069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:47.374786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:47.376972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:47.387647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:47.391543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:47.462988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] validate_networks() for [('a588b329-ae1f-411d-8596-f0db988b26c0', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:16:48.655273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:48.727283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7646e757-bc96-494e-a02f-236b97e847ce tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1834 microversion: 2.1 time: 1.390285 Oct 06 13:16:48.753562 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2579/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:47 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1834 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:48.824625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:48.834002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:48.938676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:48.942305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:48.943366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:48.945650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:48.948907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:48.950599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:49.077850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:16:49.093168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:16:49.094773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:16:49.098630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:16:49.099383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:16:49.168332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:49.184345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a19dff25-6648-4af3-bea8-343711753faf tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1289 microversion: 2.1 time: 0.403609 Oct 06 13:16:49.186954 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2580/5161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:48 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1289 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:49.221042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:49.221379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:49.221911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:49.222359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:49.223098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:49.223565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:49.223999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:49.236880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:49.268415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:49.270677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:49.278288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:49.283440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:49.286512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:49.287959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:49.325705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:16:49.345012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Getting quotas for user b3edacb9b63c4fbebd4cb4dd80d98fba and project e8400eff3a0f4badb4e232de82dbabd1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:16:49.388360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:16:49.393266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:16:49.517619 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-551b8eb9-c146-4e65-94e2-831b2e459f7c tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.393924 Oct 06 13:16:49.521667 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2582/5162] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:16:47 2022] POST /compute/v2.1/servers => generated 361 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:16:49.535001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0b1bb63-33aa-4221-a1cb-b98e569ae444 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:49.535919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0b1bb63-33aa-4221-a1cb-b98e569ae444 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:49.807082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c0b1bb63-33aa-4221-a1cb-b98e569ae444 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:49.824467 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0b1bb63-33aa-4221-a1cb-b98e569ae444 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1241 microversion: 2.1 time: 0.293584 Oct 06 13:16:49.827414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2583/5163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:49 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:50.044095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:50.058403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a19964b8-1fd5-472e-860e-94ef8b5d18a0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1683 microversion: 2.1 time: 0.866108 Oct 06 13:16:50.060382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2581/5164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:49 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1683 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:50.222341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:50.223190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:50.241494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.242041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.242494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.243231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.243698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.244138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.341372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:50.344936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:50.353154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.354052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.354709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.360181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.361385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.362087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.456974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-456a89df-46cc-4159-9fd0-40f5fd104339 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action" status: 200 len: 32639 microversion: 2.1 time: 0.119930 Oct 06 13:16:50.457669 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2582/5165] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:16:50 2022] POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action => generated 32639 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:16:50.489796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:50.540094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b213cb6e-dd5d-4a4a-84fa-ec0a1e296df3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1295 microversion: 2.1 time: 0.323522 Oct 06 13:16:50.551483 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2584/5166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:50 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1295 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:50.621343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:50.622166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:50.639351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.641597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.643421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.646900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:50.648696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:50.649813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:50.865851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-675d686b-81a6-4664-bdcd-7a04684734e3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:50.875814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-675d686b-81a6-4664-bdcd-7a04684734e3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:51.072974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-675d686b-81a6-4664-bdcd-7a04684734e3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:51.102527 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-675d686b-81a6-4664-bdcd-7a04684734e3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1241 microversion: 2.1 time: 0.248813 Oct 06 13:16:51.132241 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2585/5167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:50 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1241 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:51.177381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a15e4cd91774549958c839a63015eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a2546666c0434f9c6956fb48986f95', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:51.178912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] flavor_id is None. Assuming migration. {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 06 13:16:51.181384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:16:51.592232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:51.592546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:51.630884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:51.634625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:51.637618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:51.639233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:51.639895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:51.640600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:51.817986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:51.833675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55a54953-bc07-4d5c-bd29-01f78267fdeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1295 microversion: 2.1 time: 0.257673 Oct 06 13:16:51.838487 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2586/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:51 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1295 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:52.136564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:52.138479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:52.138911 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86f9182a-17ca-430f-b0a2-3979e0ce3482 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action" status: 202 len: 0 microversion: 2.1 time: 1.526181 Oct 06 13:16:52.144796 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2583/5169] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:16:50 2022] POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:16:52.152651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:52.155594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.156106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.157048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.159898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:52.177893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.179505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.180305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.182106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.182582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.183204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.184123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.185855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.187539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.449044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:52.487315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a524e97d-9cbf-43ac-8360-ea23f8a2a325 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1293 microversion: 2.1 time: 0.337303 Oct 06 13:16:52.498076 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2587/5170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:52 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:52.857982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:52.858685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:52.877115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.877958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.880878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.881666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:52.882769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:52.903672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:52.915224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:52.926152 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91922aa2-9624-4055-aaa4-e2070f94f365 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1692 microversion: 2.1 time: 0.779690 Oct 06 13:16:52.927174 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2584/5171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:52 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1692 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:53.039412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:53.088439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-90c8f68c-32b9-49be-8945-1aa32059c091 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1295 microversion: 2.1 time: 0.235092 Oct 06 13:16:53.089692 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2588/5172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:52 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:53.513138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:53.517131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:53.526897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:53.527822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:53.528492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:53.529684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:53.530564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:53.531217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:53.669965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:53.696709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7081791-a480-4dc7-8135-18c220b0c2ca tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.188507 Oct 06 13:16:53.697335 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2585/5173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:53 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:53.984314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:53.985695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:54.004603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.005119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.005542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.009678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.014834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.015530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.128071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:54.128694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:54.154957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.155943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.158223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.160560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.172474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.193409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.406780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:54.415483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-010a7dbb-d320-4ef4-97ca-39ab52505eb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1692 microversion: 2.1 time: 0.435297 Oct 06 13:16:54.422680 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2589/5174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:53 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1692 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:54.519052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:54.554734 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38e88bd9-e180-496b-b8de-80602c3a143f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1295 microversion: 2.1 time: 0.427380 Oct 06 13:16:54.561060 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2586/5175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:54 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1295 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:54.727271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:54.728203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:54.747200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.748181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.748788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.749716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:54.750358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:54.751509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:54.889545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:54.905194 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44295bb4-bccf-4324-920e-d5d165e16336 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.184035 Oct 06 13:16:54.906265 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2590/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:54 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:55.445871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:55.447659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:55.461246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:55.462465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:55.462465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:55.467587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:55.469847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:55.470451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:55.598005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:55.599203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:55.614658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:55.615417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:55.616012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:55.618288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:55.619068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:55.622872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:55.942191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:55.997050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9e2aa26-3afe-44d4-a35d-5631afe1aebd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1692 microversion: 2.1 time: 0.557487 Oct 06 13:16:56.000986 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2587/5177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:55 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1692 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:56.027283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:56.028773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:56.050960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:56.051472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:56.051927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:56.052718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:56.053118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:56.063531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:56.214188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:56.232520 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10896b31-c5c0-45ea-aed7-4dbdfd593f18 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.639262 Oct 06 13:16:56.233129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2591/5178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:55 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:56.237963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:56.258833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:56.277020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:56.277783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:56.278508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:56.279749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:56.280541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:56.294444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:56.513903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:56.524865 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f52fb2c-da1a-44d8-8146-0d9349c0070a tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.522707 Oct 06 13:16:56.525478 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2588/5179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:56 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:57.032140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:57.035327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:57.038592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:57.050747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.051975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.052680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.054045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.054795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.055442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.117452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:57.145910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1d78fb4-2b1d-476d-b3b5-4588db7b344d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.911301 Oct 06 13:16:57.147177 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2592/5180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:56 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:57.173110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2103791804"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:57.182364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:57.191369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.192411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.193206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.194436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.196171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.197945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.426432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:57.454286 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a989b391-e194-429d-b2df-3d37d69ed2fe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1692 microversion: 2.1 time: 0.426338 Oct 06 13:16:57.478205 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2589/5181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:57 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1692 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:57.516148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:57.519571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:57.558129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.559332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.561172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.566391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.570414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.571146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.774998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c3e5f404-c338-49dd-96ba-e62ae9c83667 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.607651 Oct 06 13:16:57.775833 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2593/5182] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:16:57 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 06 13:16:57.784030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:57.792114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:57.822995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.823247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.823579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:57.824302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:57.824874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:57.825317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:58.315747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:58.329536 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e1599e6a-9975-4084-9ff2-3749e6cee7ec tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.550701 Oct 06 13:16:58.330652 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2594/5183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:57 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:58.373215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:58.385210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:58.399364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:58.400733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:58.401817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:58.402980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:58.404459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:58.405106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:58.422170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:58.448124 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e0c6ef3-d366-4bfe-86f3-09059183ae8f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.966376 Oct 06 13:16:58.452528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2590/5184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:57 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:58.502863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:58.503655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:58.535189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:58.536074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:58.536537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:58.537541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:58.538554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:58.539027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:58.995617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:59.006740 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0425906-b7a3-40c5-b0b2-4587ee659aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.673387 Oct 06 13:16:59.010612 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2595/5185] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:58 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:16:59.052005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:59.075217 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-501b5ac8-6e9e-4163-94d3-296a75be7388 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1692 microversion: 2.1 time: 0.577478 Oct 06 13:16:59.099820 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2591/5186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:58 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1692 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:59.355710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:59.356342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:59.358435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:16:59.374030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:59.374531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:59.374976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:59.375702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:59.376163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:59.376598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:59.476898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:16:59.477723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:16:59.486801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:59.487387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:59.487914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:59.488712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:59.489250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:59.490562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:59.615951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:16:59.630274 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db3d62cc-f971-4683-ac83-76a0c13d2d9f tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.278589 Oct 06 13:16:59.638100 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2596/5187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:59 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:16:59.862468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:16:59.873274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:16:59.873767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:16:59.874255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:16:59.899889 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] Creating event network-vif-unplugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:16:59.905609 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-3f7b967b-0783-4cde-b9cc-abbd3524bd38 req-675448a1-3931-496d-b6d1-b3758122256e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046713 Oct 06 13:16:59.906817 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2597/5188] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:17:00.034649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:00.035624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:00.056288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:00.056796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:00.057237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:00.057984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:00.058447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:00.058878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:00.660328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:00.684694 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9a0f382-d9f5-46b0-93e0-dec6013d28fd tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 1.211291 Oct 06 13:17:00.687927 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2592/5189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:16:59 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:00.698676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:00.699669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:00.720940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:00.721696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:00.723202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:00.724976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:00.726622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:00.727446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.023058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:01.041229 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f01804f-acbc-4f6a-b926-8e3469164ccd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 1.010852 Oct 06 13:17:01.043099 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2598/5190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:01.048517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:01.049202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:01.065454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:01.066251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:01.067210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.070838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:01.071524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:01.072151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.080013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=16 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:01.278483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:01.286836 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9e9710f-3b23-4e02-ab74-984004fd35a4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.242475 Oct 06 13:17:01.290376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2599/5191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:01 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:01.293603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:01.300136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0", "tag": "01d5932a-04b0-45b4-b5cf-ffb008bf67c3"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:01.301763 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88ecdce6-72f0-49fc-b30b-9b5cf0af2574 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.611546 Oct 06 13:17:01.320980 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2593/5192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:00 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:01.334245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:01.335186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:01.336169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.344289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:01.359310 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] Creating event network-changed:01d5932a-04b0-45b4-b5cf-ffb008bf67c3 for instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 on n-h1-860556-1 Oct 06 13:17:01.367164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c1d69260-1b55-47d5-ae63-f0c3ca9e4d07 req-1ec582a4-6aad-43e2-8c2c-7c24d64e7652 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074174 Oct 06 13:17:01.368428 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2600/5193] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:01.719624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:01.720475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:01.769606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:01.770143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:01.771162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.774546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:01.775985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:01.779910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:01.837380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:02.070126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:02.071024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:02.092023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.096745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.097214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.098018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.098492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.098933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.140448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:02.154888 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47778b5d-c797-461d-b8e3-7d9719aae58b tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.444789 Oct 06 13:17:02.166465 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2594/5194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:01 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:02.311600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:02.312557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:02.324723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.325388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.326028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.329698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.330367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.330952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.405542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:02.436966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ead930f6-8393-4da2-a936-8fbe554e7b2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1686 microversion: 2.1 time: 0.367023 Oct 06 13:17:02.440868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2601/5195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:02 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1686 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:02.483539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:02.485362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:02.506626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.509802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.511960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.514430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:02.516295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:02.518059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:02.587604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:02.597189 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba2b8c98-b7df-4dba-93e1-925ef23905e0 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.289129 Oct 06 13:17:02.618848 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2595/5196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:02 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:02.779028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:02.789292 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-609682b2-f239-4784-af49-64b0ec3ea9b0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.347302 Oct 06 13:17:02.801760 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2602/5197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:02 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:03.184924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:03.185658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:03.199295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.201769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.202495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.203681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.205345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.208059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.392016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:03.403569 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31e82b3e-db63-4511-8c3f-a38a7b09a28d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.224307 Oct 06 13:17:03.404703 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2596/5198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:03 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:03.451895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaef6924-d5d4-43a1-878b-9dc57e0d5bd0", "tag": "90be6203-5a42-4305-b88b-8575a2eb3c69"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:03.468557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:03.469609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:03.487922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.491328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.491904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.496019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.498600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.499967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.501113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.501606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.502967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.533703 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] Creating event network-changed:90be6203-5a42-4305-b88b-8575a2eb3c69 for instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 on n-h1-860556-1 Oct 06 13:17:03.548715 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-17481f5c-6777-487f-b72a-6ef2f083e093 req-5307d3b0-119f-44ea-82c3-32562fc59b1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100921 Oct 06 13:17:03.552569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2603/5199] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:03.628707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:03.630590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:03.655407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.655911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.656359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.660177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.660892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.661492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.815079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:03.838136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0163113-ef2a-4a1d-baf9-d3da93ceaabd tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.205849 Oct 06 13:17:03.851626 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2604/5200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:03 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:03.861357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:03.862002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:03.884238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.884670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.885124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.893309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:03.893921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:03.894662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:03.960652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:03.978600 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad9f5535-e268-4ad5-a787-e0edb7923bf4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1686 microversion: 2.1 time: 0.516901 Oct 06 13:17:03.995092 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2597/5201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:03 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1686 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:04.243200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:04.251362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-934b309d-399f-4611-9c1d-1e4cbcd30276 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.404299 Oct 06 13:17:04.252436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2605/5202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:03 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:04.435660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:04.436285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:04.459359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:04.459522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:04.462861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:04.464765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:04.472052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:04.472517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:04.823233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-plugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:04.847550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:04.848224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:04.851230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:04.883869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] Creating event network-vif-plugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:17:04.894810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2770413b-eabb-4e44-937f-26b0ded3c368 req-9cbfe227-62dd-4f3f-81c9-a2e000e28f9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075219 Oct 06 13:17:04.895870 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2606/5203] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:17:04.910040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:04.911243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:04.927655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:04.929603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:04.930406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:04.931683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:04.932328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:04.936342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:05.446521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:05.456450 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f4d4456-0a05-477d-bac7-c325fe6e2541 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 1.028936 Oct 06 13:17:05.462174 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2598/5204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:04 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:05.492963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:05.494382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:05.525699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:05.526619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:05.528621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:05.541638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:05.542423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:05.544678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:05.736624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:05.756376 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14fd00ec-10c9-41ed-bfdc-beace392740b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.859219 Oct 06 13:17:05.757646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2607/5205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:04 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:05.763360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:05.764394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:05.798013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:05.799717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:05.802439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:05.805836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:05.807706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:05.808388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:05.929623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:05.940062 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90777724-1e39-4d0b-9e2e-56ac7bdb9332 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1686 microversion: 2.1 time: 0.474176 Oct 06 13:17:05.944020 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2599/5206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:05 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1686 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:06.351126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:06.369786 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3aacda32-c069-49a0-bb15-bb6e23a19430 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.610331 Oct 06 13:17:06.381845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2608/5207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:05 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:06.487484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:06.488111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:06.508366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:06.510098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:06.510634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:06.511401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:06.518726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:06.519301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:06.784379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:06.785008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:06.799114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:06.823770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:06.824516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:06.829048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:06.835410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:06.838891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:07.248756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:07.261924 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0efb87ba-d607-4b49-a32f-41094a3169e8 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.478385 Oct 06 13:17:07.262974 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2609/5208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:06 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:07.279489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:07.286159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:07.316238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:07.317569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:07.318192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:07.320376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:07.322920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:07.329173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:07.842296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:07.863007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8b95c52-3f36-44e9-9320-542adede7eeb tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 1.373834 Oct 06 13:17:07.864064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2600/5209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:06 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:07.887357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:07.888064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:07.910978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:07.912755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:07.916068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:07.916862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:07.917343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:07.917804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:08.219179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:08.235613 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-93d4f6aa-dbe0-4b9e-828b-666c9435b847 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 0.970753 Oct 06 13:17:08.236615 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2610/5210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:07 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:08.292721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:08.293514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:08.311946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:08.312701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:08.313942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:08.318310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:08.318875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:08.320509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:09.115268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:09.128265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9fd123de-5230-44fe-a1b1-1551a0ecb860 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 1.258845 Oct 06 13:17:09.129696 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2601/5211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:07 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:09.151783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:09.156054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:09.194961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:09.195885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:09.196471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:09.197329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:09.197981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:09.198554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:09.279611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:09.292219 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a9b25bb-55f6-41f8-a747-48cd9de7eb00 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 1.004980 Oct 06 13:17:09.309826 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2611/5212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:08 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:09.314751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:09.315400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:09.324639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:09.324944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:09.325588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:09.326489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:09.327104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:09.327689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:09.932480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:09.943053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e6bf455-ee59-4e82-90df-6afbd2b32c2c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.807911 Oct 06 13:17:09.943644 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2602/5213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:09 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:10.137072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:10.156621 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea9d550e-59bb-4f1b-9881-ebd8473ca81b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 0.848696 Oct 06 13:17:10.159430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:10.160473 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2612/5214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:09 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:10.160865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:10.173795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.174707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.175397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:10.176541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.177269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.181277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:10.322975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:10.325697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:10.340112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.340822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.342070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:10.347610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.348278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.351224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:10.679123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:10.724526 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-136261ac-e893-4e09-b5e8-eb1b5c13c909 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.408847 Oct 06 13:17:10.743041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2613/5215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:10 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:10.768526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:10.781029 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93d71bca-797a-4864-ba42-8d3fb27fdf91 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.626440 Oct 06 13:17:10.786455 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2603/5216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:10 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:10.967537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:10.968408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:10.985289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.987586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.989508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:10.990481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:10.992272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:10.993949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:11.190974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:11.191604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:11.208501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:11.209022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:11.209469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:11.210792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:11.218213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:11.218671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:12.400429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:12.410065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:12.436313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c1832d6b-9e74-4416-af76-bd97300506df tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 1.243582 Oct 06 13:17:12.438738 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae50f0e3-1c2f-4402-b31c-6ab94b6b204f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 1.470061 Oct 06 13:17:12.439790 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2604/5217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:11 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:12.441488 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2614/5218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:10 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:12.458325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:12.463920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:12.464716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:12.467457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:12.489635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:12.492056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:12.493574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:12.496239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:12.499192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:12.499344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:12.499753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:12.500374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:12.501275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:12.504456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:12.504798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:12.505323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:12.817238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:12.835645 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3b83d2e-5f2e-4589-947b-cde8855346fc tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.392216 Oct 06 13:17:12.842073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2605/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:12 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:12.973727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:12.983609 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e637e620-f28f-4b99-9e96-8b3b6a513aa0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.539713 Oct 06 13:17:12.984224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2615/5220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:12 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:13.400331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0", "name": "network-vif-plugged", "status": "completed", "tag": "01d5932a-04b0-45b4-b5cf-ffb008bf67c3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:13.419442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:13.425384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:13.426571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:13.461793 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] Creating event network-vif-plugged:01d5932a-04b0-45b4-b5cf-ffb008bf67c3 for instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 on n-h1-860556-1 Oct 06 13:17:13.473082 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ebe07585-6816-4b02-96dc-3c2ea5f317aa req-2071aad6-8885-4641-adf3-9526f2f07c46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073529 Oct 06 13:17:13.474089 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2606/5221] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:13.481665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:13.483160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:13.500230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:13.501338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:13.502374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:13.503102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:13.505085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:13.507126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:13.509239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:13.509955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:13.521526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:13.528771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:13.540271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:13.541404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:13.543615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:13.544311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:14.041022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:14.056675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6fc6ac26-3473-4d54-8d0b-ee72e0f593e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 0.579311 Oct 06 13:17:14.081551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2616/5222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:13 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:14.093612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:14.102439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:14.123573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:14.124419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:14.125091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:14.126646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:14.129563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:14.134974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:14.440524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:14.443797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:14.466497 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60b91bbe-3484-4cd3-9213-598fcf11f44f tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.978308 Oct 06 13:17:14.467735 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2607/5223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:13 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:14.482668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:14.484029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:14.491972 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-500509c6-203d-4b91-a1a6-67c8b8d9ae96 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.408285 Oct 06 13:17:14.496715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:14.498555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:14.501498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:14.502945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:14.504069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:14.505805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:14.512346 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2617/5224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:14 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:15.046135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:15.063173 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9980d4a-d6f2-4fe6-8436-80de638e5159 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 0.593674 Oct 06 13:17:15.064417 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2608/5225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:14 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:15.091475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:15.092425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:15.112313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.112818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.113272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:15.126544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.127050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.127505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:15.497494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:15.498243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:15.519896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.530231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.532170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:15.534236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.543237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.543866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:15.610113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:15.674686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:15.694572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51f53b5f-9dd4-4ab1-a198-b500f79fcbf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 0.608505 Oct 06 13:17:15.710531 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2618/5226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:15 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:15.710531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:15.723004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:15.765498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.766443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.766901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:15.767633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:15.768113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:15.768535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:16.031500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:16.052519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9c253c2-0eef-496b-9b74-3b4258643880 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1362 microversion: 2.1 time: 0.561986 Oct 06 13:17:16.074290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2609/5227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:15 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:16.080037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaef6924-d5d4-43a1-878b-9dc57e0d5bd0", "name": "network-vif-plugged", "status": "completed", "tag": "90be6203-5a42-4305-b88b-8575a2eb3c69"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:16.116297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:16.116790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:16.117244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:16.144435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:16.158674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] Creating event network-vif-plugged:90be6203-5a42-4305-b88b-8575a2eb3c69 for instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 on n-h1-860556-1 Oct 06 13:17:16.160413 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63432307-745d-4c15-bba1-f21638f4ba86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1299 microversion: 2.1 time: 0.456669 Oct 06 13:17:16.164049 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2619/5228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:15 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1299 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:16.181561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:16.182614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:16.203271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6b56837b-8297-4113-9341-fdd2e3e1e9f8 req-f74e189d-6999-4607-bcfe-4ef58c082460 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127131 Oct 06 13:17:16.203713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:16.204234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:16.204359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2610/5229] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:16.204688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:16.205425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:16.206125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:16.206569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:16.736714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:16.737587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:16.739813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=71 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:16.762495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:16.763199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:16.764810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:16.774145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:16.774819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:16.775586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:19.020073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:19.032750 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5324beef-fec4-48b1-b3c8-7f9b07387517 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 2.309662 Oct 06 13:17:19.033463 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2611/5230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:16 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:19.046902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:19.053100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:19.074004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:19.084455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:19.085187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:19.086842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:19.087546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:19.088215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:19.139719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:19.148075 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8641ede8-7281-4e37-bb1b-672834ea852b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1697 microversion: 2.1 time: 2.981297 Oct 06 13:17:19.148912 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2620/5231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:16 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1697 bytes in 2984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:19.153198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:19.175416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:19.176160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:19.192821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:19.203986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:19.204496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:19.204952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:19.206356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:19.207001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:19.207603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:20.182535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:20.198183 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7db2d3a3-6164-4697-b0d2-267a76ae93c3 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1472 microversion: 2.1 time: 1.048373 Oct 06 13:17:20.203697 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2621/5232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:19 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1472 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:20.218364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:20.218936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:20.242039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:20.246118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:20.247754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:20.250423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:20.251717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:20.255077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:20.649150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:20.665696 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b868a08-7576-4e83-8c07-07b4f7eb77d3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1549 microversion: 2.1 time: 1.630932 Oct 06 13:17:20.666620 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2612/5233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:19 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1549 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:20.686148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:20.687259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:20.707024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:20.707891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:20.708588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:20.710061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:20.710763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:20.711688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:22.450301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:22.461167 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fe16c850-e183-490e-89c9-44812ba1909b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 2.255277 Oct 06 13:17:22.463153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2622/5234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:20 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:22.475966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:22.482826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:22.521974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:22.522690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:22.531086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:22.533568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:22.542295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:22.543221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:22.681405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:22.689283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-682295c3-ae33-4ccd-ac00-84f44d672e20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1696 microversion: 2.1 time: 2.021393 Oct 06 13:17:22.689967 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2613/5235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:20 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1696 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:22.702241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:22.702511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:22.716698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:22.727971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:22.728453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:22.729227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:22.752620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:22.760562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:22.888748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:22.903349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0dc26036-39f2-4f0b-9e1e-09822b08ab86 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1472 microversion: 2.1 time: 0.438772 Oct 06 13:17:22.904566 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2623/5236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:22 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:22.916316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "name": "network-vif-unplugged", "status": "completed", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:22.961728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:22.966274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:22.967037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:23.014277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Creating event network-vif-unplugged:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h2-860556-1 Oct 06 13:17:23.036516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:17:23.064100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-30c5ec1f-1630-4e0f-a700-693f7a2efc74 req-f033593f-09eb-4059-9909-8c1709dd4660 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158050 Oct 06 13:17:23.066998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2624/5237] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:23.070754 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c455576b-340b-4ca2-b673-92deae73e0f3 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.379694 Oct 06 13:17:23.079663 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2614/5238] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:17:22 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:23.091324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:23.096183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:23.112994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:23.113831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:23.114486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:23.115499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:23.117016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:23.123074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:23.489973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:23.491479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:23.502984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:23.510059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:23.511550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:23.512530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:23.513114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:23.513648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:24.344874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d85c2ac5-9edd-4b7c-b4eb-bed1a91f0261 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1623 microversion: 2.1 time: 1.276379 Oct 06 13:17:24.372434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2625/5239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:23 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1623 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:24.408793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:24.411325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:24.434629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:24.435962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:24.437686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:24.440332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:24.440842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:24.441329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:25.933572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:25.953182 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d68d289-382a-40c1-8717-d14f31f63c59 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 2.463552 Oct 06 13:17:25.958112 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2615/5240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:23 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:25.974185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:25.976138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:25.983833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:25.984895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:25.985572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:25.986570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:25.987484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:25.988137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:26.495851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:26.513537 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c54fd84-3178-45ec-a740-ea7887a37289 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1696 microversion: 2.1 time: 2.130565 Oct 06 13:17:26.516709 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2626/5241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:24 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1696 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:26.531352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:26.565408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:26.566321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:26.567045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:26.605810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Creating event network-changed:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h2-860556-1 Oct 06 13:17:26.618100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:17:26.648827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-52686089-f1f3-429c-94bc-b65205faf394 req-3343e559-6610-41c6-a4ec-d823548ec6ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129794 Oct 06 13:17:26.655084 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2627/5242] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:26.663614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:26.670828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:26.688846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:26.690000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:26.690675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:26.691626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:26.695483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:26.696205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:26.891451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lazy-loading 'services' on Instance uuid 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:17:27.047876 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14824b3b-caf1-4829-8a53-ed3a7c463263 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7/os-volume_attachments/6eac5d6a-973d-4a05-bc8b-c444d36c5442" status: 202 len: 0 microversion: 2.1 time: 0.388925 Oct 06 13:17:27.048789 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2628/5243] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:17:26 2022] DELETE /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7/os-volume_attachments/6eac5d6a-973d-4a05-bc8b-c444d36c5442 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:17:27.063998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:27.065228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:27.077701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:27.080984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:27.081771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:27.085667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:27.089449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:27.090227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:27.618379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc5ac7b4-265d-4dc6-a2b8-091e2d532751 tempest-TestSecurityGroupsBasicOps-1767156276 tempest-TestSecurityGroupsBasicOps-1767156276-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1910 microversion: 2.1 time: 1.657121 Oct 06 13:17:27.621616 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2616/5244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:25 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1910 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:27.640620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:27.641260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:27.668913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:27.670930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:27.676647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:27.677993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:27.678659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:27.679252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:29.153356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:29.170823 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-419ab49c-9926-4c8c-94ff-b50fbcc4085e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1696 microversion: 2.1 time: 1.548021 Oct 06 13:17:29.171697 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2617/5245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:27 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1696 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:29.191968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:29.192700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:29.214998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:29.215797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:29.216759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:29.218420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:29.221047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:29.222536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:29.312737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:29.338978 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4c0cb5e-a3c3-4fb2-9fb8-c3184e4deab1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 2.271612 Oct 06 13:17:29.341008 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2629/5246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:27 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:29.360255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:17:29.690204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4fb5bf96-7276-4a1e-9ca4-c559dd59994d tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 204 len: 0 microversion: 2.1 time: 0.516639 Oct 06 13:17:29.690816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2618/5247] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:17:29 2022] DELETE /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:17:29.699064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:29.700152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:29.722460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:29.730372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:29.730877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:29.731653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:29.732132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:29.732567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:30.200231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:30.200949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:30.233367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:30.233948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:30.236478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:30.239802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:30.243119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:30.250239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:30.325774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:30.344417 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-69342488-772f-4cc9-bfde-e1b1a5c72075 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1478 microversion: 2.1 time: 0.649002 Oct 06 13:17:30.345040 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2630/5248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:29 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1478 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:30.374703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:30.375336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:30.400003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:30.400905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:30.414137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:30.417468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:30.424287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:30.425103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:31.684174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:31.696998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:31.714203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f561b81-9a89-4612-90fb-bbf360433010 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 1.343053 Oct 06 13:17:31.718989 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8a0a74a-84d0-48d5-8813-986a730bd2f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1696 microversion: 2.1 time: 1.521338 Oct 06 13:17:31.723160 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2631/5249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:30 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:31.730066 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2619/5250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:30 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1696 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:31.735220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:31.736131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:31.742265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0", "tag": "01d5932a-04b0-45b4-b5cf-ffb008bf67c3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:31.773748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:31.776339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:31.779053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:31.782821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:31.785566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:31.786349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:31.788312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:31.790922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:31.796250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:31.870808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] Creating event network-changed:01d5932a-04b0-45b4-b5cf-ffb008bf67c3 for instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 on n-h1-860556-1 Oct 06 13:17:31.886007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-be4d1ae6-756d-47b5-9b55-7bded8b3099d req-9a8dcb37-7818-4c5b-a7ff-30634a0f2587 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153117 Oct 06 13:17:31.888577 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2620/5251] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:32.181169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:32.195101 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b431b717-31e5-4137-8bea-5c82b6eea566 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1478 microversion: 2.1 time: 0.468006 Oct 06 13:17:32.195709 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2632/5252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:31 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1478 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:32.752712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:32.755474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:32.760230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:32.762673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:32.779514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:32.783560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:32.785854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:32.786628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:32.788251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:32.788928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:32.789565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:32.790297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:32.790904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:32.792710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:32.799334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:32.799990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:33.261568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:33.269929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5839ed2e-7e62-462a-866c-0b47f7b97292 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1694 microversion: 2.1 time: 0.523234 Oct 06 13:17:33.290883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2633/5253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:32 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1694 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:33.310076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:33.310697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:33.320940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:33.321559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:33.330428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:33.331379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:33.331878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:33.332503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:33.651783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:33.657654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:33.679314 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5639e7aa-93b2-4237-abbe-9803eeda7700 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 0.935704 Oct 06 13:17:33.684791 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-73c5e853-3fbc-4fed-aecf-7e74df2566cf tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 200 len: 1478 microversion: 2.1 time: 0.378732 Oct 06 13:17:33.700567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2621/5254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:32 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:33.700807 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2634/5255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:33 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 1478 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:33.820405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaef6924-d5d4-43a1-878b-9dc57e0d5bd0", "name": "network-vif-deleted", "tag": "90be6203-5a42-4305-b88b-8575a2eb3c69"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:33.848972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:33.849844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:33.850565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:33.889427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] Creating event network-vif-deleted:90be6203-5a42-4305-b88b-8575a2eb3c69 for instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 on n-h1-860556-1 Oct 06 13:17:33.897051 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a133c727-8b45-45d8-a10f-dcb490841c5c req-ff54886a-7165-41e5-af0d-9462c5bf724d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080553 Oct 06 13:17:33.902527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2622/5256] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:34.293712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:34.295674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:34.309009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:34.322214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:34.322938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:34.325819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:34.327371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:34.336915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:34.408198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:34.717948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:34.718686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:34.743466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:34.746605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:34.747165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:34.757095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:34.760572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:34.761268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:35.532968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:35.549452 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc8c3988-db79-4acf-8906-52e4d3c58cbf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1694 microversion: 2.1 time: 1.260113 Oct 06 13:17:35.571616 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2635/5257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:34 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1694 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:35.584065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:35.589874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: eaef6924-d5d4-43a1-878b-9dc57e0d5bd0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:35.603762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:35.605779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:35.607061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:35.609615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:35.610342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:35.612404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:35.644131 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] HTTP exception thrown: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Request method failure captured: Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 HTTP/1.1 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSulYe47XW4QUY2pUxDp0gpiSvBW3bqIMjezyfeE4J0v7uo3_fcFd7iMM2Geg8uBLelAWA0LbnG0ImWl0ny9CAoheGzgAZ4mz3qV4dhTpR6j6imCGCFZQrTJSxJdtwS3BLb_tIwr8BlmJegZWum8jObqDW1R_3bYg0Y1IqY_aDc6mo Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: e8400eff3a0f4badb4e232de82dbabd1 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8400eff3a0f4badb4e232de82dbabd1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8400eff3a0f4badb4e232de82dbabd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8400eff3a0f4badb4e232de82dbabd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8400eff3a0f4badb4e232de82dbabd1"}]}] Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: e8400eff3a0f4badb4e232de82dbabd1 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestSecurityGroupsBasicOps-10458404-project Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b3edacb9b63c4fbebd4cb4dd80d98fba Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestSecurityGroupsBasicOps-10458404-project Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'eaef6924-d5d4-43a1-878b-9dc57e0d5bd0'} Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:17:35.658941 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. Oct 06 13:17:35.663222 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:35.672303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Returning 404 to user: Instance eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:17:35.673588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9332bc7-8236-4eea-b257-5bf8a19b0204 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0" status: 404 len: 111 microversion: 2.1 time: 0.100484 Oct 06 13:17:35.679340 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2636/5258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:35 2022] GET /compute/v2.1/servers/eaef6924-d5d4-43a1-878b-9dc57e0d5bd0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:17:36.044772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:36.058526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e7f9c32-c596-4710-8671-b5bd6b768450 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 1.352930 Oct 06 13:17:36.072457 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2623/5259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:34 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:36.578453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:36.578998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:36.609102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:36.613213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:36.614095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:36.614880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:36.621071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:36.622796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.086181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:37.086774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:37.098114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.099357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.103529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.104576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.105279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.106297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.285356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:37.302270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-293df433-4e8a-4ce2-aada-ad83116aa167 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1691 microversion: 2.1 time: 0.728088 Oct 06 13:17:37.303799 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2637/5260] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:36 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1691 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:37.330511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:37.331315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:37.345687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.346501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.347142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.348051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.349508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.351054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.579645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7606444e-68c6-48d8-bf09-8e4c029a3d2c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action" status: 204 len: 0 microversion: 2.1 time: 0.253310 Oct 06 13:17:37.580333 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2638/5261] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:17:37 2022] POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:17:37.638550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:37.639591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:37.674596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.675164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.677602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:37.682678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:37.683379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:37.686042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:38.190335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:38.202372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-27273cc4-f493-4566-815f-2a9bb4f5e9a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1681 microversion: 2.1 time: 1.121639 Oct 06 13:17:38.204166 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2624/5262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:37 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1681 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:38.372713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:38.389243 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec21b2db-b190-4fb1-ae92-c57d649a5024 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1691 microversion: 2.1 time: 0.787347 Oct 06 13:17:38.389988 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2639/5263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:37 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1691 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:39.242764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:39.244622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:39.261261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:39.262287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:39.263249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:39.264756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:39.265630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:39.266780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:39.420673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:39.421876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:39.435706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:39.436202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:39.444974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:39.446034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:39.446724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:39.447179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:39.848193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:39.883641 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7391a39-a3b9-4282-baf9-d65db2c70a60 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.650618 Oct 06 13:17:39.886944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2625/5264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:39 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:39.911271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "name": "network-vif-plugged", "status": "completed", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:39.964041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:39.964802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:39.967084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:39.994030 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Creating event network-vif-plugged:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h2-860556-1 Oct 06 13:17:40.027782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:17:40.055572 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c9c4410e-6c05-4c6b-aef6-8db426b32de3 req-92c67cdf-ba02-4fe5-bef4-4d42844f6dd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163294 Oct 06 13:17:40.063817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2626/5265] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:40.069659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:40.073057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:40.083349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8460132-7973-4014-aa0f-297d677327c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1691 microversion: 2.1 time: 0.669944 Oct 06 13:17:40.089239 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2640/5266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:39 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1691 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:40.094538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:40.099229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:40.121182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:40.130400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.131146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.131756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:40.135338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.136061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.136665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:40.143885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.165210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.166362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:40.166851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.169258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.169857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:40.198814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:17:40.369208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:40.496318 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-05170eb6-09fa-49bd-96cc-3e3daa7803f8 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 204 len: 0 microversion: 2.1 time: 0.430608 Oct 06 13:17:40.497683 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2627/5267] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:17:40 2022] DELETE /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:17:40.508968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:40.510212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:40.517942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.518832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.519590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:40.520560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:40.521271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:40.522293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:41.566358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:41.574965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5f5a92e-b335-4f31-9dc0-b00d761709e3 tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1470 microversion: 2.1 time: 1.071632 Oct 06 13:17:41.586267 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2628/5268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:40 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1470 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:41.601929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:41.602600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:41.628405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:41.629031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:41.629471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:41.634360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:41.634940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:41.635392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:41.707719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:41.728623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c892575-bb4a-4dae-8bf8-915150f9f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 1.630862 Oct 06 13:17:41.729304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2641/5269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:40 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:42.242823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:42.264650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f79e032b-780e-47c8-9728-0c8c6c84b675 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1691 microversion: 2.1 time: 0.675761 Oct 06 13:17:42.266315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2629/5270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:41 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1691 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:42.602021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:42.602650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:42.627465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:42.627988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:42.637661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:42.638314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:42.638818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:42.649014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.121105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:43.137341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:43.137937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:43.138564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.151144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] Creating event network-vif-unplugged:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:17:43.156613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ff99ab9b-8aec-4e14-98c9-fa71d967972c req-b89561e0-3274-4741-b5bf-d81bb8f4db92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045178 Oct 06 13:17:43.157503 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2630/5271] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:43.295400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:43.296039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:43.315864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:43.316366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:43.319681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.320424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:43.320901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:43.321342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.541358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:43.561102 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c188a60d-f137-48ad-8c66-01e24b900b5c tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1470 microversion: 2.1 time: 0.954031 Oct 06 13:17:43.561731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2642/5272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:42 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1470 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:43.567401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:43.568033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:43.583324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:43.584036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:43.584534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.592130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:43.592810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:43.593274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:43.858969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:43.868503 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb6f43af-d4b3-43fc-89a9-e8e4629d719b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1683 microversion: 2.1 time: 0.578875 Oct 06 13:17:43.885785 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2631/5273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:43 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1683 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:44.183689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:44.201422 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f650163-2506-4d75-90df-bdcae076769b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.638400 Oct 06 13:17:44.202072 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2643/5274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:43 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:44.230983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:44.232280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:44.249661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.250219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.250676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.251419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.251887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.256783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.442793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baf36c0-2402-4f11-baf9-e7b6c3e756f7", "name": "network-vif-deleted", "tag": "525e90f9-f89a-4fe2-9616-1f52a8532a15"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:44.454002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.454795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.455451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.478615 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] Creating event network-vif-deleted:525e90f9-f89a-4fe2-9616-1f52a8532a15 for instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 on n-h2-860556-1 Oct 06 13:17:44.484464 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0a2f2020-15ae-4d5b-9a8c-e2bdc82c6dbb req-a2251f18-4bff-4889-9f2b-47b77746472e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046336 Oct 06 13:17:44.485179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2644/5275] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:44.589359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:44.590403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:44.601565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.606086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.606800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.607711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.608374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.608998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.681237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.685861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.686701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.687691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lazy-loading 'fault' on Instance uuid 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:17:44.879964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:44.906473 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e95bb0f1-140e-446c-b189-f73941a148e2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.673510 Oct 06 13:17:44.915746 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2632/5276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:44 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:44.940059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:44.943357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:44.952368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.953188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.953876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:44.955373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:44.956099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:44.957088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:45.481226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af36b93b3fe94b1888006c1bcd57976c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e8bcc1d1f4050badc0fe17a79261b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:45.496148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2a4de29-045c-496b-9d71-e9719460859e tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 200 len: 1304 microversion: 2.1 time: 0.911239 Oct 06 13:17:45.497213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2645/5277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:44 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 1304 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:45.909614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:45.925284 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cefcac7b-2912-4d63-bc80-88d500145827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.991412 Oct 06 13:17:45.946937 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2633/5278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:44 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:45.954710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:45.957063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:45.978962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:45.979895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:45.980671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:45.981562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:45.982376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:45.983132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:46.115010 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0818e85-a512-4bb5-a4bf-5b2c462f062d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.165406 Oct 06 13:17:46.116094 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2646/5279] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:17:45 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:17:46.124247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:46.125161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:46.136861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:46.137476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:46.138039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:46.138980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:46.145682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:46.146507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:46.527905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:46.529466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] [instance: 5baf36c0-2402-4f11-baf9-e7b6c3e756f7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:46.544149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:46.546831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:46.547701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:46.548913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:46.549394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:46.550433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:46.585608 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] HTTP exception thrown: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Request method failure captured: Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 HTTP/1.1 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTJwmKsqOsA8jYhscpM-jClT7MpeWjSUwss-ChSkRp5MSwY-ymL9DgSHHOgVsZkudT0mGL-LPD0zDMV2siEoa82qbOt9n43UXp3YlwSytNzgaq0Z3Sr1QZ9IlvzA-LQMApmhXDB_tS2jc9QunweiRmh3B3QrDKLGnfw0C_iuJC4OFw Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 429e8bcc1d1f4050badc0fe17a79261b Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesBackupsTest-1709894295 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_429e8bcc1d1f4050badc0fe17a79261b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/429e8bcc1d1f4050badc0fe17a79261b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/429e8bcc1d1f4050badc0fe17a79261b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/429e8bcc1d1f4050badc0fe17a79261b"}]}] Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesBackupsTest-1709894295 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 429e8bcc1d1f4050badc0fe17a79261b Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesBackupsTest-1709894295 Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesBackupsTest-1709894295-project Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: af36b93b3fe94b1888006c1bcd57976c Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesBackupsTest-1709894295-project Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5baf36c0-2402-4f11-baf9-e7b6c3e756f7'} Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:17:46.588577 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. Oct 06 13:17:46.593498 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:17:46.595490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] Returning 404 to user: Instance 5baf36c0-2402-4f11-baf9-e7b6c3e756f7 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:17:46.597023 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8fd6f86-25c0-40d8-a366-7c7299273b6b tempest-VolumesBackupsTest-1709894295 tempest-VolumesBackupsTest-1709894295-project] 10.222.0.26 "GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7" status: 404 len: 111 microversion: 2.1 time: 0.073262 Oct 06 13:17:46.602179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2647/5280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:46 2022] GET /compute/v2.1/servers/5baf36c0-2402-4f11-baf9-e7b6c3e756f7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:17:46.977047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:46.995835 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-926f7e6b-3734-420e-9fd5-dcc5d1b9e3c8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1670 microversion: 2.1 time: 0.875405 Oct 06 13:17:46.996817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2634/5281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:46 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1670 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:48.024055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:48.025255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:48.040204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:48.041017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:48.041627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:48.042573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:48.043340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:48.046316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:49.282605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:49.315709 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-de021b70-9e24-4527-a297-0f395f392b84 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1670 microversion: 2.1 time: 1.289855 Oct 06 13:17:49.316381 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2648/5282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:48 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1670 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:50.359062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:50.360400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:50.363832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:50.371023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.372916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:50.374455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:50.379105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.379909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:50.380518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:50.830018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:50.839757 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80567062-e449-4dce-960d-fb5f8b2a78ea tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.496818 Oct 06 13:17:50.855013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2635/5283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:50 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:50.866085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:50.869630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:50.878039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=58 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:50.880288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.881702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:50.882490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:50.883610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.884316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:50.885138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:50.959083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41b89a3f-4fb3-47fd-abc7-eebaf09b59ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 200 len: 324 microversion: 2.1 time: 0.097183 Oct 06 13:17:50.979808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:50.980545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:50.986676 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2649/5284] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:17:50 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 324 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:50.992508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.994639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:50.995346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:50.996754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:50.999342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:51.013717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:51.391278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:51.426028 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-58e849a9-2500-4b0f-baeb-d162676abd43 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.449179 Oct 06 13:17:51.429463 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2636/5285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:50 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:51.461206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:51.462311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:51.473112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:51.473944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:51.474669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:51.476298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:51.476997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:51.477655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:51.770931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:51.782198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1074b53-0bca-4915-b9b5-e34bdddc6c1e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.327515 Oct 06 13:17:51.794551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2650/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:51.806920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:51.810911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:51.822434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:51.822946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:51.823397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:51.824134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:51.826674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:51.827166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:52.280840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:52.310853 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c57ec7ee-453c-4dc5-9715-03bf6b02b63f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.494520 Oct 06 13:17:52.317054 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2637/5287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:52.345668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:52.346886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:52.368178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:52.368990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:52.369612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:52.380167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:52.380972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:52.381592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:52.824014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:52.837669 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9443a38f-4eaf-42a5-8f76-ec7f07b9d875 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.496369 Oct 06 13:17:52.838330 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2651/5288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:52 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:53.031870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-727371132", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:53.127238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] validate_networks() for [('3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:17:53.363726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:53.365036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:53.404526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:53.406136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:53.409768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:53.412047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:53.416775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:53.417606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:53.428919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:17:53.486598 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edc6be30-ee63-408a-bbac-c90c94c9c9c8 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/ips" status: 200 len: 147 microversion: 2.1 time: 0.128375 Oct 06 13:17:53.487777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2652/5289] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:17:53 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/ips => generated 147 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:17:54.439673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:54.440234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:54.452946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:54.454247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:54.455018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:54.455998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:54.456561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:54.457071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:54.538014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:17:54.748254 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c83ce733-bab0-456b-b908-891a5929a760 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 204 len: 0 microversion: 2.1 time: 0.311705 Oct 06 13:17:54.749372 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2653/5290] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:17:54 2022] DELETE /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:17:54.761721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950a4692-d31d-4a3e-bc67-e70294a41cfc", "tag": "4523483d-d1fb-4dca-9f2c-72a5aab53243"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:54.783948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:54.786295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:54.786943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:54.811454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] Creating event network-changed:4523483d-d1fb-4dca-9f2c-72a5aab53243 for instance 950a4692-d31d-4a3e-bc67-e70294a41cfc on n-h2-860556-1 Oct 06 13:17:54.835428 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e6f3e3dc-f0ef-4a7d-85e2-4bc2c50786b7 req-075f28ac-0667-40f7-bb00-4c1ebd71bc63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084234 Oct 06 13:17:54.836292 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2654/5291] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:54.844360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:54.846744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:54.864075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:54.864795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:54.868330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:54.870682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:54.872089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:54.874226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:55.429458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:17:55.430084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:17:55.430549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:17:55.431137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:17:55.431568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:17:55.456317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:55.456812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:55.457263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:55.458031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:55.458494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:55.458933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:55.530047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:17:55.540119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:17:55.558490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:17:55.561378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:17:55.685301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f7c6f3e-b02d-437b-912b-c1accdaf5d11 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.659131 Oct 06 13:17:55.692592 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2638/5292] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:17:55.706811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9b4004f-cb8f-4788-9c89-ba9bf7cf94c6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:55.710417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9b4004f-cb8f-4788-9c89-ba9bf7cf94c6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:55.737925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:55.752071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2692ec7-a13c-40f5-a959-9a910d937762 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1765 microversion: 2.1 time: 0.913884 Oct 06 13:17:55.761376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2655/5293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:54 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1765 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:55.980695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9b4004f-cb8f-4788-9c89-ba9bf7cf94c6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:56.002735 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9b4004f-cb8f-4788-9c89-ba9bf7cf94c6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1214 microversion: 2.1 time: 0.300896 Oct 06 13:17:56.008782 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2639/5294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:55 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:56.279835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf1d86bd-774d-45cd-a1bc-ad81f7fb600c"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:56.282516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:56.299712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:56.300556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:56.301220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:56.302195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:56.303565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:56.304210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:56.696112 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-637581cf-56b2-44da-a313-8bb9aa387fef tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419710 Oct 06 13:17:56.697500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2656/5295] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:17:56 2022] POST /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:17:56.791694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:56.791694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:56.822723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:56.823335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:56.827733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:56.828579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:56.830225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:56.833090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:57.034702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:57.035605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:57.051898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:57.052434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:57.052942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:57.053672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:57.054161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:57.055626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:57.258610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:57.279532 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4a3925d-6de1-4830-9457-852e07fec609 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1210 microversion: 2.1 time: 0.247245 Oct 06 13:17:57.280475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2657/5296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:57 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:17:57.519185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:57.531164 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc82c505-8fcc-4739-9581-e22c5082f3c4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1765 microversion: 2.1 time: 0.749213 Oct 06 13:17:57.533291 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2640/5297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:56 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1765 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:58.315853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:58.317288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:58.326690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:58.327664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:58.328307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:58.330025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:58.330668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:58.331280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:58.498117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:58.512252 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d870aba-c428-4af3-88df-e57794a97b0d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1272 microversion: 2.1 time: 0.201567 Oct 06 13:17:58.514868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2658/5298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:58 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:58.557001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:58.558631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:58.576201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:58.580287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:58.581212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:58.582215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:58.582913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:58.585313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:59.000076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:59.013621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15265485-334b-4e54-9874-f1c3d1cb3078 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1646 microversion: 2.1 time: 0.461767 Oct 06 13:17:59.014692 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2641/5299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:58 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1646 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:17:59.328709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950a4692-d31d-4a3e-bc67-e70294a41cfc", "name": "network-vif-deleted", "tag": "4523483d-d1fb-4dca-9f2c-72a5aab53243"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:17:59.344316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:59.344956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:59.345652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:59.359637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] Creating event network-vif-deleted:4523483d-d1fb-4dca-9f2c-72a5aab53243 for instance 950a4692-d31d-4a3e-bc67-e70294a41cfc on n-h2-860556-1 Oct 06 13:17:59.367515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-43709911-2a11-4e9c-869f-e178e287a3a2 req-7f9a3cc7-d92f-4047-9d4a-c2452e7e5fe1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041994 Oct 06 13:17:59.368565 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2659/5300] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:17:59.540818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:17:59.548343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:17:59.571925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:59.579314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:59.581955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:59.584987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:17:59.585557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:17:59.586166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:17:59.750576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:17:59.766116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-681470f1-6bf6-4d77-a37d-ffbbec29c387 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1272 microversion: 2.1 time: 0.230127 Oct 06 13:17:59.767413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2642/5301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:17:59 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:00.044025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:00.056215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:00.065233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:00.065670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:00.066155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:00.067098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:00.067742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:00.069204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:00.159815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:00.160683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:00.162944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:00.163865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lazy-loading 'fault' on Instance uuid 950a4692-d31d-4a3e-bc67-e70294a41cfc {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:18:00.456079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3edacb9b63c4fbebd4cb4dd80d98fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8400eff3a0f4badb4e232de82dbabd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:00.469905 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97bca0f3-7533-407b-be36-4495372f18b4 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 200 len: 1382 microversion: 2.1 time: 0.432760 Oct 06 13:18:00.471270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2660/5302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:00 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 1382 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:00.803162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:00.808270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:00.853487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:00.858552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:00.859316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:00.864356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:00.868863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:00.872542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:01.346712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:01.361907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65665f0c-6f56-4017-93f5-7fcf957bd929 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.573141 Oct 06 13:18:01.363402 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2643/5303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:00 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:01.494521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:01.495482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] [instance: 950a4692-d31d-4a3e-bc67-e70294a41cfc] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:01.510177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:01.510688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:01.511139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:01.511866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:01.512332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:01.512767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:01.558190 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] HTTP exception thrown: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Request method failure captured: Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc HTTP/1.1 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSulYe47XW4QUY2pUxDp0gpiSvBW3bqIMjezyfeE4J0v7uo3_fcFd7iMM2Geg8uBLelAWA0LbnG0ImWl0ny9CAoheGzgAZ4mz3qV4dhTpR6j6imCGCFZQrTJSxJdtwS3BLb_tIwr8BlmJegZWum8jObqDW1R_3bYg0Y1IqY_aDc6mo Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: e8400eff3a0f4badb4e232de82dbabd1 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8400eff3a0f4badb4e232de82dbabd1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8400eff3a0f4badb4e232de82dbabd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8400eff3a0f4badb4e232de82dbabd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8400eff3a0f4badb4e232de82dbabd1"}]}] Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: e8400eff3a0f4badb4e232de82dbabd1 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-10458404 Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestSecurityGroupsBasicOps-10458404-project Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: b3edacb9b63c4fbebd4cb4dd80d98fba Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestSecurityGroupsBasicOps-10458404-project Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '950a4692-d31d-4a3e-bc67-e70294a41cfc'} Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:18:01.559874 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Returning 404 to user: Instance 950a4692-d31d-4a3e-bc67-e70294a41cfc could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c05a0408-ec75-4dd0-9ec1-6b798718495b tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc" status: 404 len: 111 microversion: 2.1 time: 0.070723 Oct 06 13:18:01.563551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2661/5304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:01 2022] GET /compute/v2.1/servers/950a4692-d31d-4a3e-bc67-e70294a41cfc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:18:02.386690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:02.387947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:02.409683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:02.410240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:02.414262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:02.415024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:02.415502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:02.418455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:02.930677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:02.939194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2668d066-7e87-4df7-84fe-21652aeb6c74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.556561 Oct 06 13:18:02.953026 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2644/5305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:02 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:03.992152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:03.992901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:04.016749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:04.017332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:04.017858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:04.021265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:04.022261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:04.023323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:04.145998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a728a6dd-9eb6-4889-a237-3d5b45792dd7", "tag": "5fa31be8-7444-466d-9f40-075820337863"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:04.160404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:04.160892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:04.161323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:04.187326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] Creating event network-changed:5fa31be8-7444-466d-9f40-075820337863 for instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 on n-h1-860556-1 Oct 06 13:18:04.199153 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7d930c77-db56-41ea-82ba-975072511c66 req-e9f2c03d-4598-4929-b6f4-edbb88442a26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068688 Oct 06 13:18:04.206170 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2645/5306] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:04.692964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:04.706794 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1b849191-9c86-4a3a-9eee-2209b4cc793c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.723116 Oct 06 13:18:04.709499 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2662/5307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:03 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:05.734871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:05.739246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:05.740353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:05.752542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:05.754325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:05.755860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:05.758782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:05.762359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:05.762799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:05.992718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:06.270623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:06.286853 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bd008e49-d44e-4f19-b142-2a54137d235e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.552789 Oct 06 13:18:06.290148 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2646/5308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:05 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:07.319884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:07.320609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:07.329604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:07.330489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:07.331339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:07.332270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:07.332937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:07.333550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:07.692049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:07.696067 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f513fc46-6b45-4d37-a63f-cfff9b28eed1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.381411 Oct 06 13:18:07.697567 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2663/5309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:07 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:18:08.723739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:08.727451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:08.748554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:08.753483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:08.754924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:08.762510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:08.764891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:08.765703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:08.848286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:09.312549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:09.330156 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7f56c25-a973-4cfe-b433-81705f1f252d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.611468 Oct 06 13:18:09.334977 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2647/5310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:08 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:10.365711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:10.366532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:10.367664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:10.373480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:10.392423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:10.393320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:10.397179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:10.397876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:10.398808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:10.399437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:10.406435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:10.407321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:10.410243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:10.411244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:10.413846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:10.418363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:10.555753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe9f4400-3bb0-4c1a-9eaa-56e84abbe8f8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action" status: 200 len: 24565 microversion: 2.1 time: 0.194309 Oct 06 13:18:10.563296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2648/5311] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:18:10 2022] POST /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3/action => generated 24565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:18:11.500716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:11.511408 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a20b9981-c280-4755-9e46-fbd052b8951c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 1.157525 Oct 06 13:18:11.515593 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2664/5312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:10 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:12.470174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a728a6dd-9eb6-4889-a237-3d5b45792dd7", "name": "network-vif-plugged", "status": "completed", "tag": "5fa31be8-7444-466d-9f40-075820337863"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:12.529448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.530602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.553093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.555425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:12.557108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:12.574254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.575409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.576073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.580775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.581343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.581899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.600497 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] Creating event network-vif-plugged:5fa31be8-7444-466d-9f40-075820337863 for instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 on n-h1-860556-1 Oct 06 13:18:12.607619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-82c7d13e-af3a-403c-9796-f80747bcc508 req-d112cac8-a1b5-4eb7-928f-7062558302e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141756 Oct 06 13:18:12.609090 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2649/5313] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:12.837989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:12.840456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:12.852982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.859119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.860054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.860899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.861470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.863774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.948410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e927873-4a96-45e4-9f4d-4aa35b3444ae tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109455 Oct 06 13:18:12.950295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2650/5314] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:18:12 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:18:12.960568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:12.973535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:12.981058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.982036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.983014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:12.984571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:12.994462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:12.995616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:13.040820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13b479fa-9ba4-4804-bb21-0a265a5f1c74 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c" status: 200 len: 194 microversion: 2.1 time: 0.084331 Oct 06 13:18:13.048040 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2651/5315] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Oct 6 13:18:12 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:18:13.236150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:13.250662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8a1fef5-d8ad-49d4-8d61-e5bac97cc6b9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.713259 Oct 06 13:18:13.269370 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2665/5316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:12 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:13.510946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6068d2c-e34c-476b-9954-05688b036165 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] Calling method '.version_select at 0x7f7d3e3bd940>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:13.588427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6068d2c-e34c-476b-9954-05688b036165 tempest-TestSecurityGroupsBasicOps-10458404 tempest-TestSecurityGroupsBasicOps-10458404-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-784722117" status: 202 len: 0 microversion: 2.1 time: 0.082557 Oct 06 13:18:13.590702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2652/5317] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-784722117 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:18:14.278426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:14.279040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:14.290687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:14.295852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:14.296314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:14.297061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:14.297528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:14.297986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:14.759446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:14.786689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d9b080e-bc88-4a96-bf94-0a644c0ff0cd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1314 microversion: 2.1 time: 0.508794 Oct 06 13:18:14.802587 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2666/5318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:14 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:15.657647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae90eccd-8822-4619-9d10-a69ac76ef798"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:15.661433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:15.671411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:15.672261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:15.672944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:15.674073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:15.674958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:15.675622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:15.813817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:15.818576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:15.841163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:15.846510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:15.847294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:15.848185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:15.849113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:15.850097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:16.122676 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc4bbbf0-8020-4446-885d-220f5133d408 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "POST /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469138 Oct 06 13:18:16.137242 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2653/5319] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:18:15 2022] POST /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:16.311526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:16.316342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:16.331001 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e08438de-c8b2-42ab-85bb-6b706695a601 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1499 microversion: 2.1 time: 0.522446 Oct 06 13:18:16.332173 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2667/5320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:15 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1499 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:16.356061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:16.364224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:16.365032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:16.366230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:16.397292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:18:16.475757 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d38999b-415a-4da9-9b8d-dfc1dee861c7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.122772 Oct 06 13:18:16.480493 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2654/5321] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:18:16 2022] POST /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:18:16.485044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:16.485672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:16.502171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:16.503330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:16.504370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:16.505293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:16.506570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:16.507819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:16.953012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:16.973911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b8bbfc9-2102-4a51-8e1a-ad68acc6a2e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.492514 Oct 06 13:18:16.982691 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2668/5322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:16 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:18.004773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:18.015065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:18.057786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:18.062398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:18.062506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:18.063507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:18.069847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:18.070274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:18.626727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:18.638906 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dc7e8d3-71c4-4052-a272-ac9b6a939fd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.640360 Oct 06 13:18:18.647026 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2655/5323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:17 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:19.670688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:19.671517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:19.718364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:19.718364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:19.718364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:19.729272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:19.731609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:19.733773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:20.168790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:20.181470 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79754309-cf3e-4b4c-8cd6-4cbc891d3db1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.515965 Oct 06 13:18:20.185561 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2669/5324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:19 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:21.212789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:21.214635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:21.218437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:21.237443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:21.238166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:21.241434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:21.243708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:21.244366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:21.247122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:21.614677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:21.636952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-093397c0-0e6b-4a12-8f8d-77bbbd39dba2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.417917 Oct 06 13:18:21.637844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2656/5325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:21 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:22.660798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:22.661531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:22.671883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:22.679912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:22.683726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:22.685600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:22.686666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:22.689845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:22.690522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:23.386411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:23.404579 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07de98e3-00bc-461f-ae3d-a26a61e3c6ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.747900 Oct 06 13:18:23.405661 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2670/5326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:22 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:24.437012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:24.442654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:24.456918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:24.457700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:24.459092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:24.460134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:24.465607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:24.466435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:24.953342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:24.962929 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-578b7ecf-0720-4f80-a45b-f0421701c656 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.534052 Oct 06 13:18:24.984315 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2657/5327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:24 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:25.994412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:25.995149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:26.010605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:26.011108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:26.011656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:26.014369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:26.017446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:26.020196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:26.898776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:26.911061 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-896c78a2-f181-44d3-9797-ab3768b560e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.923452 Oct 06 13:18:26.912351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2671/5328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:25 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:27.940266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:27.940966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:27.963217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:27.963714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:27.964152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:27.964860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:27.965315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:27.965819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:28.248429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:28.257808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3caacdf9-d3ad-44da-8574-8fb5b9aa3a62 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.321514 Oct 06 13:18:28.259062 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2658/5329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:27 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:29.284820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:29.286756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:29.303873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:29.304577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:29.305451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:29.306868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:29.308487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:29.308951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:29.542048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:29.554500 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c131c538-f1cb-425d-9cb3-e7101d73eced tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.273759 Oct 06 13:18:29.555688 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2672/5330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:29 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:30.581708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:30.583087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:30.597791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:30.598579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:30.599224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:30.605039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:30.605868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:30.606474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:31.012791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:31.021693 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4dd00eba-1cd7-42b3-b05c-a6c6282374e4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.443568 Oct 06 13:18:31.022566 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2659/5331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:30 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:32.051829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:32.052680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:32.069137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.069800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.070262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.074213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.074847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.077343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.259371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:32.264043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:32.284889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.286751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.286751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.296397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.299309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.299918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.404651 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04c8dbd4-4e6e-4ab4-ba80-ed0dbde15a12 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.149659 Oct 06 13:18:32.411761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2660/5332] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:18:32 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:32.560396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:32.562220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:32.576925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.578190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.579426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.580385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.581185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.581842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.582713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:32.596200 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96264fb5-c3f1-4028-b271-abca9c7206af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.549679 Oct 06 13:18:32.598006 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2673/5333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:32 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:32.634535 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-581e3ec4-4cfc-4b28-8573-7101309b9a5c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c" status: 200 len: 194 microversion: 2.1 time: 0.084477 Oct 06 13:18:32.636938 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2661/5334] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Oct 6 13:18:32 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:18:32.653907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:32.654432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:32.663457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.664515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.665130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.667459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:32.668297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:32.669558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:32.829339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lazy-loading 'services' on Instance uuid b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:18:32.992575 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edb5cf57-8d3b-4780-ab62-31a519b1a2f5 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c" status: 202 len: 0 microversion: 2.1 time: 0.350032 Oct 06 13:18:32.993347 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2674/5335] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:18:32 2022] DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/cf1d86bd-774d-45cd-a1bc-ad81f7fb600c => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:18:33.417708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:33.418341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:33.425384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:33.426174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:33.426853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:33.428123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:33.428581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:33.429074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:33.628751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:33.629660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:33.642887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:33.643710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:33.644486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:33.645990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:33.647309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:33.652838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:34.189837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:34.200236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa08974a-fc80-4de7-b140-0355d6643d5c tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1834 microversion: 2.1 time: 0.786469 Oct 06 13:18:34.200859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e197587-939d-41e0-8c80-40817ca3e71c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.578495 Oct 06 13:18:34.201417 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2662/5337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:33 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1834 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:34.201562 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2675/5337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:33 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:35.225337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:35.226129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:35.244819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:35.245572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:35.246400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:35.247503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:35.248203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:35.248875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:35.575581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:35.589856 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e47e5a0-a7bb-49e4-853c-17d61fc87765 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.368065 Oct 06 13:18:35.591193 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2676/5338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:35 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:36.576595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:36.577148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:36.588545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.591992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.592896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:36.593425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.593946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.596751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.597464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.619680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.620621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.621994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.641508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] Creating event network-changed:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h2-860556-1 Oct 06 13:18:36.646606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:36.653424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c1bb58e2-0825-4e60-8b22-a3ee1527cebd req-71141146-bf4d-4020-b473-aa50b8839325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064910 Oct 06 13:18:36.655568 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2677/5339] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:18:36.668411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:18:36.668639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:36.669371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:36.684924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.702867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.703711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.705973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.707809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.710677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.931119 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d8568ac-f7cc-4dcf-b41e-9966c694020a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 204 len: 0 microversion: 2.1 time: 0.358963 Oct 06 13:18:36.932519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2663/5340] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:18:36 2022] DELETE /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:18:36.945980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:36.947267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:36.965150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.967284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.969841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:36.971083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:36.972513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:36.974359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:37.247635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:37.264345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78200ebb-7e5a-4593-9fd0-e1f2fdaa3232 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.602450 Oct 06 13:18:37.266125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2678/5341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:36 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:37.386030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:37.407037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7dd8674f-c4bb-4822-8103-35e9ca976290 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1689 microversion: 2.1 time: 0.465850 Oct 06 13:18:37.409973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2664/5342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:36 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1689 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:18:38.291851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:38.292731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:38.308965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:38.311883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:38.312511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:38.314350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:38.316234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:38.320078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:38.441704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:38.443644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:38.455801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:38.456297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:38.458899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:38.459641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:38.460101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:38.460532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:39.097012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:39.128031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9474faa-7429-40d1-9872-18b667ddbcd7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1689 microversion: 2.1 time: 0.686919 Oct 06 13:18:39.149393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2665/5343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:38 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1689 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:40.091548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:40.116213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67536583-6b37-445a-ad6e-e06d5697c09a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 1.829345 Oct 06 13:18:40.132195 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2679/5344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:38 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:40.173979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:40.173979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:40.191742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:40.192426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:40.200909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:40.202072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:40.202602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:40.203163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.126854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:41.145201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:41.147103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:41.159553 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3eb33841-b71b-4d62-8ccf-9cb9a2cd6231 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1502 microversion: 2.1 time: 0.970239 Oct 06 13:18:41.160243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2666/5345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:40 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1502 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:41.174188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.176128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.176128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.176812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.185054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:41.185610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.186084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:41.187730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.222517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.223030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.223520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.234068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.234735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.235198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.296238 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd0d3c75-afd1-40e2-ab75-a5345599db7d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/ae90eccd-8822-4619-9d10-a69ac76ef798" status: 200 len: 194 microversion: 2.1 time: 0.155063 Oct 06 13:18:41.303265 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2680/5346] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Oct 6 13:18:41 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/ae90eccd-8822-4619-9d10-a69ac76ef798 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:18:41.312414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:41.313662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:41.330439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.330970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.331424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.333632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.334187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.334636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.556154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lazy-loading 'services' on Instance uuid b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:18:41.744177 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e48f14a3-c373-412a-9e14-8597ff01124d tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/ae90eccd-8822-4619-9d10-a69ac76ef798" status: 202 len: 0 microversion: 2.1 time: 0.438976 Oct 06 13:18:41.744805 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2681/5347] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:18:41 2022] DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments/ae90eccd-8822-4619-9d10-a69ac76ef798 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:18:41.785778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf3e1cf-054f-4311-9f52-0f3002ddffd3", "name": "network-vif-deleted", "tag": "eaaff27e-2faa-4ac1-a306-dd5ae903d77e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:41.814200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:41.837515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:41.842773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:41.843246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:41.846731 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b62530e-cd41-4457-8a46-356ff2137c45 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.681033 Oct 06 13:18:41.852152 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2667/5348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:41 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:41.918710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] Creating event network-vif-deleted:eaaff27e-2faa-4ac1-a306-dd5ae903d77e for instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 on n-h2-860556-1 Oct 06 13:18:41.950394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7c041eed-ab28-445e-b139-41de161c25e8 req-8aef32d6-89a6-413f-a59c-b417ea84ec6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202334 Oct 06 13:18:41.951907 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2682/5349] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:42.190044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:42.191136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:42.204692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:42.222615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:42.223549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:42.224462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:42.224885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:42.225538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:42.307637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:42.310813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:42.312309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:42.314095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lazy-loading 'fault' on Instance uuid 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:18:42.403942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:42.421874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc74294a-3bf2-408e-bb0a-49bbe6b5f7fa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 200 len: 1355 microversion: 2.1 time: 0.237034 Oct 06 13:18:42.423456 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2668/5350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:42 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 1355 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:42.875466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:42.876291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:42.891349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:42.891940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:42.892393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:42.893278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:42.899529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:42.900349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:43.176564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:43.196214 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39fed8c7-2fb7-4493-98b8-9e4ad6816e41 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.322645 Oct 06 13:18:43.196925 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2683/5351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:42 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:43.455142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:43.456656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 6bf3e1cf-054f-4311-9f52-0f3002ddffd3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:43.467246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:43.467994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:43.468830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:43.471438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:43.472128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:43.472762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:43.527927 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] HTTP exception thrown: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Request method failure captured: Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 HTTP/1.1 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtTsmOb2IHtwihdePXyfADQfkW9MCVUqYnyuz55PDdEtUaJQHgtSHH1_d8Z95Vl8OkADR1orN1ChZVgXm5fYPEFANxDrcd2eU6OpZ3BhqaqbU1zbg54exJX19aCxF02OkzSa-vYBp6RoWERABvtnoIm_4o1tDTtzLFkehLLNw1Jr3_c Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ed3a75f24b140e5879c48dba0eda9cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}] Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4b277518fc7b4784ba547a15bdcf3d54 Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '6bf3e1cf-054f-4311-9f52-0f3002ddffd3'} Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:18:43.533166 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. Oct 06 13:18:43.539803 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:18:43.543911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Returning 404 to user: Instance 6bf3e1cf-054f-4311-9f52-0f3002ddffd3 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:18:43.549100 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28ba79e5-12a4-4572-904f-abdc4dd94804 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3" status: 404 len: 111 microversion: 2.1 time: 0.098157 Oct 06 13:18:43.551461 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2669/5352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:43 2022] GET /compute/v2.1/servers/6bf3e1cf-054f-4311-9f52-0f3002ddffd3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:18:44.226707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:44.228129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:44.237334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:44.239023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:44.239930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:44.240892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:44.241903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:44.242577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:44.280264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:45.141525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:45.159959 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c15cc482-b422-44f2-9d4a-4012d65e7ea8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.937576 Oct 06 13:18:45.162026 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2684/5353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:44 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:46.187086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:46.188474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:46.214704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:46.215579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:46.216644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:46.217919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:46.218594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:46.219251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:46.868138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:46.903304 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02b44943-2dd1-414c-bd56-4a5c2f0dec4a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1509 microversion: 2.1 time: 0.713268 Oct 06 13:18:46.906909 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2670/5354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:46 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:47.931165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:47.932553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:47.946016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:47.950282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:47.952951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:47.956746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:47.965483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:47.967013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:48.673080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:48.688578 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fae7877f-26a5-4958-a5d8-f31072dc41a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1486 microversion: 2.1 time: 0.763769 Oct 06 13:18:48.689774 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2685/5355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:47 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1486 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:48.715203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:48.717581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:48.731068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:48.734838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:48.736237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:48.742179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:48.745514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:48.746002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:48.893867 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9cc6904-aaa0-4dfe-8d25-e82f01b9a56a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 200 len: 165 microversion: 2.1 time: 0.182936 Oct 06 13:18:48.896348 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2671/5356] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:18:48 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 165 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:48.908930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:48.909560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:48.930477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:48.931097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:48.931565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:48.932322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:48.932802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:48.935514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:49.617943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:49.626205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ffe09be2-0c63-4902-91e4-1985c1868b69 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.721371 Oct 06 13:18:49.634322 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2686/5357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:48 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:49.667977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:49.670686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:49.698482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:49.703068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:49.706508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:49.708872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:49.714426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:49.717364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:50.296396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:50.309014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d22ec211-21d9-40d3-8175-a791acc5c980 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.646016 Oct 06 13:18:50.311893 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2672/5358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:49 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:50.339427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:50.340879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:50.357078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:50.358663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:50.361329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:50.364280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:50.367287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:50.368993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:51.082604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:51.095389 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9c5087e-fb68-4104-94e1-39b7700f7fc9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.760341 Oct 06 13:18:51.097453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2687/5359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:50 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:18:52.023713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:52.027439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:52.047882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:52.053707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:52.061206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:52.062167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:52.063761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:52.064810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:52.065852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:53.047508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:53.067245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b8145277-fc57-4ada-b740-b037c8972d21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 1.946004 Oct 06 13:18:53.072410 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2673/5360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:53.409800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-323250831", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:53.465850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=36 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:53.604891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] validate_networks() for [('3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:18:53.857393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:53.860795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:53.881623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:53.882244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:53.882711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:53.886267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:53.888420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:53.889556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:53.963749 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-04ff58a2-a0d7-4b92-b3e8-6a0c6527a816 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112427 Oct 06 13:18:53.976105 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2674/5361] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:18:53 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:18:54.234371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:54.234371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:54.245468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.245996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.246459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.254622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.255772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.256291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.345293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a14a7d4-0625-47ba-8d4d-35de1bb8be88 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122647 Oct 06 13:18:54.363966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2675/5362] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:18:54 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:18:54.477687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:54.478426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:54.489383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.492513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.493160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.494148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.494759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.496789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.593479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:18:54.764534 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e3792a27-c26e-4ef5-8ef3-e77c4ccb357c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 204 len: 0 microversion: 2.1 time: 0.290490 Oct 06 13:18:54.766168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2676/5363] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:18:54 2022] DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:18:54.783403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:54.784358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:54.808894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.808894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.808894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.808894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:54.809341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:54.810029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:54.845197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:18:55.217148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:55.227439 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24c13abb-707f-4022-bcec-7f703d784a53 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1674 microversion: 2.1 time: 0.447784 Oct 06 13:18:55.227740 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2677/5364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:54 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1674 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:55.273525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9145ab0b-afde-4b11-a5b6-ed28539f5143 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '.version_select at 0x7f7d3e54d550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:55.316649 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9145ab0b-afde-4b11-a5b6-ed28539f5143 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-256870886" status: 202 len: 0 microversion: 2.1 time: 0.079837 Oct 06 13:18:55.318133 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2678/5365] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 13:18:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-256870886 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:18:55.348097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b79089ad-75fc-43f6-a9ff-1b607daf4d73 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: .version_select at 0x7f7d3e0383a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1016677480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoheW6YFuNntrmTPQo48WAAS6wv90YaKyHCzY7omxb8zzmqHpax5bbaiGFbhxQEduWovEd7yTwhRbfia8BX26xoBs7fFePXpFQOSBUzazgSm3ZNvXeRF81VC6gB00TIVA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:18:55.370878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b79089ad-75fc-43f6-a9ff-1b607daf4d73 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:18:55.380504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b79089ad-75fc-43f6-a9ff-1b607daf4d73 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:18:55.441289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:18:55.442957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:18:55.443759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:18:55.444541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:18:55.445186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:18:55.448691 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b79089ad-75fc-43f6-a9ff-1b607daf4d73 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.104440 Oct 06 13:18:55.449985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2679/5366] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:18:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:18:55.477920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:55.481416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:55.481964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:55.482963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:55.483321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:55.483765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:55.576284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:18:55.601857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:18:55.637289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:18:55.640238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:18:55.777399 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1911ee05-71b1-44b9-8e58-e5508f672883 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397445 Oct 06 13:18:55.787980 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2688/5367] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:18:55.801186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81c76ced-2278-46a8-9d50-2f6917b8a9aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:55.802388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81c76ced-2278-46a8-9d50-2f6917b8a9aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:56.102217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81c76ced-2278-46a8-9d50-2f6917b8a9aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:56.113950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81c76ced-2278-46a8-9d50-2f6917b8a9aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1214 microversion: 2.1 time: 0.327776 Oct 06 13:18:56.118662 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2680/5368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:55 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:56.252876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:56.253717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:56.265428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:56.267410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:56.269267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:56.270201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:56.271789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:56.272337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:56.707276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:56.719410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd3f154b-c969-4087-be96-34bec9875e20 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1674 microversion: 2.1 time: 0.470525 Oct 06 13:18:56.725720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2689/5369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:56 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1674 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:57.139646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:57.146514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:57.159884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:57.162843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:57.163586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:57.166778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:57.167646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:57.169597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:57.437074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:57.449972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3b372018-1a05-4cc6-8c47-e40168ff2250 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1266 microversion: 2.1 time: 0.311041 Oct 06 13:18:57.467784 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2681/5370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:57 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:18:57.747587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:57.748209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:57.759165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:57.762411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:57.763064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:57.766851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:57.767602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:57.768260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:58.311655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:58.329039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f462d89-dbe7-4437-9dbe-3a725ed140bc tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1674 microversion: 2.1 time: 0.585503 Oct 06 13:18:58.349837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2690/5371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:57 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1674 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:58.476234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:58.477775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:58.500152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:58.500649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:58.501088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:58.501825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:58.502279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:58.502703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:58.601570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:58.610131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73fe60a8-a4f9-436c-906e-1ed0a6bc34c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1272 microversion: 2.1 time: 0.138174 Oct 06 13:18:58.622613 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2682/5372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:58 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:59.353277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:59.353915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:59.368772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:59.369700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:59.370337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:59.371213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:59.371825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:59.372408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:59.509450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:59.532498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6acb60a8-69f5-4bf0-80ce-6e1167bafed7 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1607 microversion: 2.1 time: 0.183654 Oct 06 13:18:59.538698 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2691/5373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:59 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1607 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:18:59.649870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:18:59.652864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:18:59.667512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:59.668175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:59.668722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:59.673724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:18:59.674508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:18:59.675065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:18:59.794607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:18:59.803624 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42464b26-94db-4123-bd5e-f9938ef74c6c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1272 microversion: 2.1 time: 0.162334 Oct 06 13:18:59.810610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2683/5374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:18:59 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:00.568518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:00.569760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:00.585151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:00.585668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:00.586862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:00.592189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:00.593097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:00.593719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:00.835871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:00.839146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:00.868792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:00.879116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:00.886128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:00.887950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:00.890246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:00.891209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:00.892940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:00.928538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7d03f6b-7aa4-4ad0-84ba-8209c824e820 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1607 microversion: 2.1 time: 0.362349 Oct 06 13:19:00.929276 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2692/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:00 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1607 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:01.376166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0", "name": "network-vif-deleted", "tag": "01d5932a-04b0-45b4-b5cf-ffb008bf67c3"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:01.397874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:01.398831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:01.399724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:01.437370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] Creating event network-vif-deleted:01d5932a-04b0-45b4-b5cf-ffb008bf67c3 for instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 on n-h1-860556-1 Oct 06 13:19:01.452743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ab0ba5c8-08a4-4ce5-a12a-76ebc582f522 req-66a4454a-38cf-4a65-bf3a-75ee29631e6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082320 Oct 06 13:19:01.454541 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2693/5376] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:19:01.781033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:01.796784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf8c1903-38d8-4cc1-ab80-2d765693d9a1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.968006 Oct 06 13:19:01.812857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2684/5377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:00 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:01.958915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:01.959850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:01.983345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:01.985360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:01.986177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:01.990087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:01.990689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:01.991764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:02.088888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:02.089830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:02.090755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:02.091749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lazy-loading 'fault' on Instance uuid b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:19:02.834962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:02.836557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:02.857435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:02.858249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:02.859623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:02.861616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:02.863017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:02.863773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:02.898787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1f3078e7b3489f962470c753bdf574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b41ce509e1f418cbd716872a7d0b734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:02.909199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a1146af-3295-4fbe-bf9c-d973f5357b9e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 200 len: 1327 microversion: 2.1 time: 0.954864 Oct 06 13:19:02.910872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2694/5378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:01 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 1327 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:03.424328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:03.437401 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4aae8555-3868-4ed9-ab18-3ecc9488822d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.616051 Oct 06 13:19:03.444236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2685/5379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:02 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:03.586828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3fecb33-58e6-48d2-81f4-c7e923a00f79", "tag": "1ce018de-e448-45cf-bf1b-9fc8128014c0"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:03.667798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:03.674035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:03.675768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:03.736874 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] Creating event network-changed:1ce018de-e448-45cf-bf1b-9fc8128014c0 for instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 on n-h2-860556-1 Oct 06 13:19:03.753783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b210cffa-6dfc-447b-8734-a97ce3d4c14f req-402e3760-3222-45bb-bb77-cbd636221854 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179516 Oct 06 13:19:03.760137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2695/5380] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:19:03.949073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:03.954058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:03.978321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:03.980603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:03.982062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:03.983479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:03.984463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:03.985321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:04.011109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 HTTP/1.1 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0'} Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:04.013948 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:04.018290 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:04.021571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:04.022984 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39e969c0-14c1-4c9f-a951-095c082684f2 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 404 len: 111 microversion: 2.1 time: 0.083888 Oct 06 13:19:04.023831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2686/5381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:03 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:04.033912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37a9a40f-cf5c-441c-89e5-7db4a6f1e20e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '.version_select at 0x7f7d3de8e9d0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:04.111653 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37a9a40f-cf5c-441c-89e5-7db4a6f1e20e tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465846181" status: 202 len: 0 microversion: 2.1 time: 0.082645 Oct 06 13:19:04.128955 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2696/5382] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465846181 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:04.472050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:04.472582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:04.487398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:04.487891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:04.488523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:04.490705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:04.491336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:04.492047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:04.963961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:04.977994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ee1d04a6-a4ee-4b65-9527-6c6665675b5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.506811 Oct 06 13:19:04.978925 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2687/5383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:04 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:06.011122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:06.012466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:06.035597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:06.043678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:06.092339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:06.093148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:06.093800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:06.102173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:06.103159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:06.108849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:06.748375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:06.762785 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9d77173-7b9a-4ba5-8b11-69bfca606db4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.750061 Oct 06 13:19:06.764163 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2697/5384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:06 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:07.803521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:07.815125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:07.859107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:07.874241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:07.874980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:07.879738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:07.889994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:07.891142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:07.894329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:08.699706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:08.747182 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22530488-bf4e-4a69-a162-ce6129e0b88c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.957160 Oct 06 13:19:08.750893 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2688/5385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:07 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:09.776319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:09.777781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:09.796509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:09.798141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:09.798933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:09.799892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:09.800595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:09.801253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:10.335727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:10.345034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8cfabc53-5b25-4072-a5f5-fbd5b9077269 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.573793 Oct 06 13:19:10.350906 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2698/5386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:09 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:11.386882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:11.388228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:11.421046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:11.422161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:11.422986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:11.434821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:11.435731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:11.436475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:11.508999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fecb33-58e6-48d2-81f4-c7e923a00f79", "name": "network-vif-plugged", "status": "completed", "tag": "1ce018de-e448-45cf-bf1b-9fc8128014c0"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:11.576765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:11.577637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:11.578469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:11.644650 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] Creating event network-vif-plugged:1ce018de-e448-45cf-bf1b-9fc8128014c0 for instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 on n-h2-860556-1 Oct 06 13:19:11.660982 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-76c5fda8-ca12-4c12-b672-4444d885a231 req-66f7c855-c5eb-47f3-8952-9677ac28a17c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162787 Oct 06 13:19:11.665349 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2699/5387] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:19:12.294564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:12.307278 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de1a918e-0d11-4ecc-92c3-1bc3a2a56aae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.932377 Oct 06 13:19:12.307884 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2689/5388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:11 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:13.340999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:13.346474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:13.374969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:13.378992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:13.379818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:13.380795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:13.381488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:13.384229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:14.159421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:14.188448 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e135111f-6243-4f6a-b2c6-94d1c56a15e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1314 microversion: 2.1 time: 0.856242 Oct 06 13:19:14.199351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2700/5389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:13 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:15.221244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:15.232611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:15.239972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:15.240898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:15.241495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:15.242508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:15.246484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:15.247135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:16.291165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:16.307339 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5113c160-ee16-4740-98d6-0bfc8d2cdc04 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1500 microversion: 2.1 time: 1.095822 Oct 06 13:19:16.313051 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2690/5390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:15 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1500 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:16.340809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:16.357070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:16.373328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:16.376790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:16.378637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:16.379760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:16.382384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:16.383271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:16.390886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=80 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:16.518233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43e39095-c9ea-4115-aac4-aa2096eb2ac7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.181210 Oct 06 13:19:16.523218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2701/5391] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:16 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:17.531367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:17.535113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:17.561952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:17.566303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:17.570758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:17.573608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:17.576670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:17.579955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:17.714479 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f95ab92a-b437-4e26-bffa-f5eb31b06a29 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.187467 Oct 06 13:19:17.715734 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2691/5392] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:17 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:18.727691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:18.733654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:18.762656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:18.763137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:18.763590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:18.764310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:18.764778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:18.775696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:18.928258 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fcb2b486-5b81-453a-8c75-3b6817bde972 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.205195 Oct 06 13:19:18.932475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2702/5393] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:18 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:19.971485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:19.997430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:20.021143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:20.021143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:20.021143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:20.022340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:20.023535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:20.024416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:20.139131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f782473-b402-468c-bfa4-3d5853003bce tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.199242 Oct 06 13:19:20.146832 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2692/5394] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:19 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:21.160435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:21.175899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:21.217263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:21.220132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:21.234030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:21.234030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:21.234030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:21.234030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:21.421917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37257546-b15c-4aa2-98c9-0bffb7472aa7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.270749 Oct 06 13:19:21.429471 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2703/5395] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:21 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:19:22.437622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:22.440969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:22.444673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:22.473758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:22.488444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:22.490193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:22.491080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:22.497956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:22.498483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:22.635197 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-979b47f5-dcd9-4726-a9c8-95410f4739af tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.201956 Oct 06 13:19:22.636338 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2693/5396] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:22 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:23.649140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:23.651979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:23.675423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:23.685437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:23.686000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:23.686448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:23.687175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:23.687782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:23.688242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:23.850538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-799627b2-d8c0-4633-af0d-d19f750dc0ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.205892 Oct 06 13:19:23.851910 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2704/5397] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:23 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:24.418464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1447513073", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a185e2f4-6d9f-4e16-b6cc-91a2f9e27582"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1016677480", "security_groups": [{"name": "tempest-secgroup-smoke-368236079"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:24.863586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:24.866216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:24.886932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:24.889362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:24.890012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:24.905295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:24.906611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:24.910379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:24.922117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] validate_networks() for [('a185e2f4-6d9f-4e16-b6cc-91a2f9e27582', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:19:25.049949 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c071aa54-e1bf-40d1-aac2-2cbab56658d4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.190521 Oct 06 13:19:25.055185 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2705/5398] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:24 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:19:25.745243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:19:25.747233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:19:25.749396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:19:25.750300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:19:25.751300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:19:25.782005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:25.783444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:25.787083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:25.789687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:25.791860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:25.793606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:25.816919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=71 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:25.836343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:19:25.875041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:19:25.952036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:19:25.954509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:19:25.968925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:25.969524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:25.984978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:25.995044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.002653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.004262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:26.005486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.006178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.063445 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 HTTP/1.1 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0'} Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:19:26.075010 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41f85e4f-a85b-4469-b5f9-86e96532afc4 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 404 len: 111 microversion: 2.1 time: 0.111790 Oct 06 13:19:26.078654 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2706/5399] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:19:25 2022] DELETE /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:26.086174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:26.088405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:26.124079 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ab0d75f-f3fd-4df0-9635-e659f04d16cd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.713190 Oct 06 13:19:26.124758 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2694/5400] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:19:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:19:26.127346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:26.128025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.130473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.131379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:26.132013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.135235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.139591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:26.143309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:26.161302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:26.162147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.165172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.166200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:26.170059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:26.171536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:26.224121 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 HTTP/1.1 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0'} Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:26.226044 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. Oct 06 13:19:26.232336 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:26.235262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:26.242524 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57dee261-eeb7-41cc-a398-640d31e19359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 14 microversion: 2.1 time: 0.163428 Oct 06 13:19:26.249865 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2707/5401] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:26 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:19:26.252212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42762def-10ed-4784-961c-f3815a3a279c tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0" status: 404 len: 111 microversion: 2.1 time: 0.122582 Oct 06 13:19:26.254959 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2695/5402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:26 2022] GET /compute/v2.1/servers/b84b7d00-ed90-47ea-91c9-3ac4b4c6acc0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:26.269730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6e7ba40-5300-4903-a7f1-25242a5d5c9b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:26.271380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6e7ba40-5300-4903-a7f1-25242a5d5c9b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:27.033699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a6e7ba40-5300-4903-a7f1-25242a5d5c9b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:27.069447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6e7ba40-5300-4903-a7f1-25242a5d5c9b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1267 microversion: 2.1 time: 0.798525 Oct 06 13:19:27.073689 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2708/5403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:26 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1267 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:27.257106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:27.267912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:27.313614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:27.314639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:27.315464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:27.316767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:27.326601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:27.327435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:27.504540 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a52eeb84-333e-4d36-b438-bdce3b7c4b4b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action" status: 200 len: 8207 microversion: 2.1 time: 0.251823 Oct 06 13:19:27.515305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:27.515935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:27.517610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2696/5404] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:27 2022] POST /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79/action => generated 8207 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:27.547351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:27.547858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:27.548307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:27.549051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:27.549515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:27.551605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.107331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:28.108222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:28.121479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.130530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.138491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.139817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.140512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.141193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.169546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:28.181568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba1e4fb8-09c2-44d0-b54e-89d5911de7e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.670289 Oct 06 13:19:28.187536 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2709/5405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:27 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:28.218270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:28.219287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:28.230755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.231768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.232384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.235414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.238602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.239824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.377223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:28.396809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-29dcdb33-e1c2-4896-90a2-d36cc1bec3ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1263 microversion: 2.1 time: 0.282834 Oct 06 13:19:28.399937 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2697/5406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:28 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1263 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:28.732345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:28.815476 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5778ec8-6e5c-45ee-b818-a136ecdcd624 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.601055 Oct 06 13:19:28.823594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2710/5407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:28 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:28.840640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:28.841418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:28.853419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.854363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.855056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:28.856006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:28.856700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:28.857517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:29.455132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:29.456327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:29.506293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:29.507253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:29.507716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:29.508480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:29.519303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:29.521490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:29.865339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:29.881085 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04729dcb-ba30-4be3-ac58-fcb3b74b87a1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1319 microversion: 2.1 time: 0.430091 Oct 06 13:19:29.881660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:29.895127 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2711/5408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:29 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:29.904581 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ef09963-b744-4843-b103-712ed2b38698 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 1.066922 Oct 06 13:19:29.935601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2698/5409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:28 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:29.955813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:29.956447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:30.000803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.001315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.003952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:30.007712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.012782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.014589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:30.746475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:30.781009 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d678009d-c913-44be-8cc7-a360560be94d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.832899 Oct 06 13:19:30.781916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2712/5410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:29 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:30.823369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:30.823974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:30.842721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.842972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.845926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:30.849049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.849787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.850400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:30.915466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:30.918566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:30.959637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Locking {{(pid=129615) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 06 13:19:30.970040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.970599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.971061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:30.971819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:30.976958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:30.979595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:31.078551 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c685e67-18bc-4308-9f05-178382caea50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.261299 Oct 06 13:19:31.081580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2699/5411] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:30 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:31.099999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:31.100874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:31.114479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:31.120776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:31.121538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:31.122731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:31.123369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:31.124016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:31.314794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:31.338887 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31bb8815-6e69-4e85-808a-b41115612001 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1325 microversion: 2.1 time: 0.429676 Oct 06 13:19:31.340211 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2713/5412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:30 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:31.896914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:31.908141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53247703-4a1d-4a66-b70f-2616bbe594a5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.820299 Oct 06 13:19:31.915389 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2700/5413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:31 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:31.955724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:31.988368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:31.989679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:31.990676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.078588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action HTTP/1.1 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 15 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: {"os-stop": {}} Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a05f8a56-ed27-431e-ac0a-48b0812b4ab5', 'body': {'os-stop': {}}} Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked Oct 06 13:19:32.088521 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:32.092630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 409 to user: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 is locked {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:32.092630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-328b2fec-3dca-4f63-be87-70892e872f8d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 409 len: 107 microversion: 2.1 time: 0.150537 Oct 06 13:19:32.095264 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2714/5414] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:31 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 107 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:19:32.110200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:32.110796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:32.132479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.134139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.135466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.148390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.149322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.150953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.253512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Unlocking {{(pid=129615) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 06 13:19:32.368893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:32.373505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:32.389511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.393214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.398238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.400215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.401457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.402400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.404394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83a15a04-2308-4b57-80e8-1af609075454 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.304360 Oct 06 13:19:32.405426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2701/5415] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:32 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:32.431165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:32.450227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.454129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.458270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.521543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:32.534882 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-581217be-ea8a-46e9-a38e-1e9dd5bc4873 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1325 microversion: 2.1 time: 0.169354 Oct 06 13:19:32.537304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2715/5416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:32 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:32.572837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:19:32.760277 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85f26c43-c8b3-4679-bb77-37a1ba607e52 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.346514 Oct 06 13:19:32.763105 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2702/5417] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:32 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:32.774335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:32.775462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:32.792097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.794046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.796912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:32.801968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:32.802889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:32.803671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:33.575053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:33.580426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:33.626088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:33.635120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:33.636715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:33.648848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:33.650550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:33.652654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:34.076810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:34.117136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec0300db-332d-4084-9017-ecf856eb2226 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 1.344210 Oct 06 13:19:34.118608 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2716/5418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:32 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:34.725406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:34.767644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1d445896-6a2a-4533-b1ea-de69305e26cc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 1.206896 Oct 06 13:19:34.779637 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2703/5419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:33 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:35.149225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:35.150962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:35.162932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:35.163816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:35.167795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:35.177657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:35.180455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:35.190672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:35.753065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:35.817881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:35.826786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:35.854253 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d8b8b50-2262-4c79-9155-aeb1092e03f5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.705499 Oct 06 13:19:35.860245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2717/5420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:35 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:35.905394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:35.913020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:35.914809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:35.915446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:35.916603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:35.919860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:35.920633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:35.921336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:36.062368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:36.064580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:36.146776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.147537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.148212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.149249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.166177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.167983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.246746 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec HTTP/1.1 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0206ff63-f48c-4f6c-a7f2-24359b70d5ec'} Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:19:36.248579 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.252541 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.257480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:36.260225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74c21a48-fadc-4205-b0cf-83e649d6dc16 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 404 len: 111 microversion: 2.1 time: 0.210454 Oct 06 13:19:36.270500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2718/5421] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:19:36 2022] DELETE /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:36.287121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:36.328135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.328630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.329078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.381333 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] Creating event network-changed:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:19:36.399315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-94283c44-6ee6-4424-be24-eedd357f011f req-2a9dae7c-dc1b-4700-885b-9655c6ca9c6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125271 Oct 06 13:19:36.407113 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2719/5422] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:19:36.427420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:36.431378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] [instance: 0206ff63-f48c-4f6c-a7f2-24359b70d5ec] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:36.467632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.479224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.487314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.489404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.493423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:36.498944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.499921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.507460 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87dc94c8-0fa0-4d3f-b745-19aace2c8d4b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 0.695712 Oct 06 13:19:36.508359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2704/5423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:35 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:36.596120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] HTTP exception thrown: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Request method failure captured: Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec HTTP/1.1 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtPzJHSvKqBSY3YdOoCpxH5uVUzI3P1RY6O1AT0wWuu6TTE-PVCVDZXJtfz5RCBi8E0krySankbmzaikCG9TpKkLXyyY5nXHUg69uA5rXpUcO39dsNWNTkjhL_jwziNGPUZijJWOCV1jcDJ3gyBwhuGJip1NRtpNvlW24lMeTMfVRb8 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b41ce509e1f418cbd716872a7d0b734", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b41ce509e1f418cbd716872a7d0b734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b41ce509e1f418cbd716872a7d0b734"}]}] Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 1b41ce509e1f418cbd716872a7d0b734 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694957968 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 5d1f3078e7b3489f962470c753bdf574 Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeTestJSON-694957968-project Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0206ff63-f48c-4f6c-a7f2-24359b70d5ec'} Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:36.597871 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. Oct 06 13:19:36.601771 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:36.605585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] Returning 404 to user: Instance 0206ff63-f48c-4f6c-a7f2-24359b70d5ec could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:36.608443 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e7ab81b-1fc3-4da4-b74e-06b75e541445 tempest-AttachVolumeTestJSON-694957968 tempest-AttachVolumeTestJSON-694957968-project] 10.222.0.26 "GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec" status: 404 len: 111 microversion: 2.1 time: 0.196326 Oct 06 13:19:36.619819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2720/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:36 2022] GET /compute/v2.1/servers/0206ff63-f48c-4f6c-a7f2-24359b70d5ec => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:36.896424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:36.900869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:36.945319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.946370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.946999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:36.954573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:36.954573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:36.955051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:37.549446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:37.550321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:37.556788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:37.577228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:37.586023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:37.586979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:37.591467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:37.592567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:37.596571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:38.126370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:38.140657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20804de5-fdd9-48de-9998-daf6af656891 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 1.253005 Oct 06 13:19:38.150447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2705/5425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:36 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:38.544650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:38.554847 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14a165cd-0e94-45e7-ba89-2b98d5dac152 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 1.010981 Oct 06 13:19:38.571718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2721/5426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:37 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:39.177806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:39.179077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:39.194285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:39.195076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:39.198340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:39.199360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:39.201253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:39.201921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:39.253707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:39.595848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:39.597936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:39.616679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:39.617728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:39.618433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:39.619678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:39.620551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:39.621523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:40.268909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:40.277829 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b998ebf3-ccd1-44cb-8c9e-f5422861667d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 1.104336 Oct 06 13:19:40.294670 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2706/5427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:39 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:40.366854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:40.394387 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb691ddf-98af-49b1-9447-ff4a664f49ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 0.799936 Oct 06 13:19:40.396107 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2722/5428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:39 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:41.315512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:41.319671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:41.336139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:41.341894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:41.343036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:41.353069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:41.354167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:41.354739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:41.436910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:41.436910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:41.463879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:41.485705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:41.486546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:41.494299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:41.494481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:41.494979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:41.724124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:41.739087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b986655c-88ba-43e5-a21a-ff42c51df1a8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.428797 Oct 06 13:19:41.739700 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2707/5429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:41 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:41.834215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:41.839392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:41.876247 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-445974b4-4923-4610-af13-2df56712f0b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 0.444156 Oct 06 13:19:41.879629 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2723/5430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:41 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:42.764440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:42.765110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:42.785640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:42.786032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:42.786481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:42.787252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:42.787727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:42.788208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:42.913218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:42.913218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:42.936070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:42.939336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:42.939336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:42.939336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:42.939336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:42.939336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:43.575348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:43.601309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:43.609618 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fab17ab2-c1dd-474b-82a8-8c27de41fff3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.849464 Oct 06 13:19:43.621781 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0a69bc4d-1816-4053-8b77-3be257f219ca tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 0.676943 Oct 06 13:19:43.621781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2724/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:42 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:43.633808 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2708/5432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:42 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:44.574369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-plugged", "status": "completed", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:44.592127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:44.594492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:44.596784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:44.647988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] Creating event network-vif-plugged:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:19:44.667979 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fda88ca8-2541-4f6f-92b3-f4f55d921e24 req-1674681a-4110-488c-91d8-fada6f6a3db8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097749 Oct 06 13:19:44.670639 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2725/5433] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:19:44.684325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:44.685854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:44.705017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:44.710645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:44.711584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:44.713477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:44.715336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:44.716465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:44.721186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:44.731906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:44.753771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:44.762824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:44.765878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:44.778844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:44.779699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:44.780262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:45.360137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:45.372173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f913cbe-7eed-4e0b-bd56-52329d18dedf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 0.681526 Oct 06 13:19:45.377710 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2726/5434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:44 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:45.398079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:45.407771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0b87c91-fd1f-4d91-be92-e0112332b044 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.727148 Oct 06 13:19:45.426789 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2709/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:44 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:46.409054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:46.410191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:46.434371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:46.435073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:46.454543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:46.456659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:46.458777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:46.460604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:46.461817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:46.463046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:46.464361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:46.464861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:46.465298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:46.466043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:46.466500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:46.467027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:48.090114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:48.115132 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a49e1c22-4133-4a85-b2cf-1c9e567fc8db tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 1.685307 Oct 06 13:19:48.120664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2710/5436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:46 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:48.399148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:48.448576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6e3b67c-f460-45a7-9a76-20eef1a6f35e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1392 microversion: 2.1 time: 2.034218 Oct 06 13:19:48.463340 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2727/5437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:46 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1392 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:49.151259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:49.152235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:49.169601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.170319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.171027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.172071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.172987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.173672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.487372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:49.490672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:49.520440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.521614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.524802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.530184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.537097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.538497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.612270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:49.642097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32fbff97-13bf-459d-8e7d-7b5f12f75e46 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1655 microversion: 2.1 time: 0.497574 Oct 06 13:19:49.652033 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2711/5438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:49 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1655 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:49.681163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:49.695562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.696175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.696625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.795134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Going to try to start instance {{(pid=129615) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:19:49.889637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d56b67a8-9914-4290-b1c8-4cea37505115 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.213741 Oct 06 13:19:49.890573 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2712/5439] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:49 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:49.905507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:49.906927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:49.907637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:49.916800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.917303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.917768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.918755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:49.919228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:49.919657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:49.941205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bbb56a11-e1c3-42f8-a371-e0520aad9f4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1564 microversion: 2.1 time: 0.454113 Oct 06 13:19:49.942906 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2728/5440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:49 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1564 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:49.982741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:49.983856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:50.000662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:50.016727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:50.017405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:50.020793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:50.021401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:50.022106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:50.228863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:50.245145 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba6adf2e-95fb-4f75-9e30-e2183a6fd9d8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1664 microversion: 2.1 time: 0.348483 Oct 06 13:19:50.249318 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2713/5441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:49 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1664 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:50.590252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:50.624011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05369ef0-63a6-415a-a70a-4bc5ccd7c8ee tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1564 microversion: 2.1 time: 0.651304 Oct 06 13:19:50.632850 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2729/5442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:49 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1564 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:51.276236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:51.278855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:51.298555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:51.302941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:51.305715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:51.306779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:51.307948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:51.312828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:51.775190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:51.795637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea10ece0-3557-4f43-b47f-172d142f2031 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1664 microversion: 2.1 time: 0.524863 Oct 06 13:19:51.804979 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2714/5443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1664 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:52.644444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3664862c-e136-4bfd-a756-95857ba97702 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Action: 'create', calling method: .version_select at 0x7f7d3deb0280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1900214573", "metadata": {"Type": "work"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3664862c-e136-4bfd-a756-95857ba97702 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 122 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1900214573", "metadata": {"Type": "work"}}} Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1900214573', 'metadata': {'Type': 'work'}}}} Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi '#$%' Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:19:52.653536 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 13:19:52.657594 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.664487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3664862c-e136-4bfd-a756-95857ba97702 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:52.668006 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3664862c-e136-4bfd-a756-95857ba97702 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.656368 Oct 06 13:19:52.672954 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2730/5444] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Oct 6 13:19:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 660 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:19:52.678920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ece486d5-4217-4987-b21c-fd121fa40c0f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Action: 'create', calling method: .version_select at 0x7f7d3dfda4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303769779", "metadata": {"Type": "work"}}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ece486d5-4217-4987-b21c-fd121fa40c0f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 119 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303769779", "metadata": {"Type": "work"}}} Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-303769779', 'metadata': {'Type': 'work'}}}} Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '0' Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:19:52.687080 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 13:19:52.691874 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.694448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ece486d5-4217-4987-b21c-fd121fa40c0f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:52.696972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ece486d5-4217-4987-b21c-fd121fa40c0f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020627 Oct 06 13:19:52.699285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2715/5445] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Oct 6 13:19:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:19:52.720780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e1e3f087-c665-4d58-b543-24e927ced37e tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Action: 'create', calling method: .version_select at 0x7f7d3e57a4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1451310560", "metadata": {"Type": "work"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e1e3f087-c665-4d58-b543-24e927ced37e tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 119 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1451310560", "metadata": {"Type": "work"}}} Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: method: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1451310560', 'metadata': {'Type': 'work'}}}} Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi '' Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:19:52.738171 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 13:19:52.743630 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.744480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e1e3f087-c665-4d58-b543-24e927ced37e tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:52.748414 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e1e3f087-c665-4d58-b543-24e927ced37e tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.042035 Oct 06 13:19:52.765215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-785e518e-4ca0-4b0b-bfaf-5b491e9ce772 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Calling method '.version_select at 0x7f7d3dfc1d30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:52.773985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2731/5446] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Oct 6 13:19:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:19:52.824495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-785e518e-4ca0-4b0b-bfaf-5b491e9ce772 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] HTTP exception thrown: Volume tempest-invalid-1496515939 could not be found. Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-785e518e-4ca0-4b0b-bfaf-5b491e9ce772 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1496515939 HTTP/1.1 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: exception: Volume tempest-invalid-1496515939 could not be found. Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'tempest-invalid-1496515939'} Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1496515939 could not be found. (HTTP 404) (Request-ID: req-01a7f32f-38d7-4d00-9063-b3f4835ddf2f) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:19:52.828113 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1496515939 could not be found. Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1496515939 could not be found. Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1496515939 could not be found. Oct 06 13:19:52.832123 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:52.843568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-785e518e-4ca0-4b0b-bfaf-5b491e9ce772 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 404 to user: Volume tempest-invalid-1496515939 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:52.843568 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-785e518e-4ca0-4b0b-bfaf-5b491e9ce772 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1496515939" status: 404 len: 99 microversion: 2.1 time: 0.079315 Oct 06 13:19:52.843568 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2716/5447] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:19:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1496515939 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 13:19:52.856926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:52.857532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-198baa7e-86dc-4971-b47f-c21b9ed3c8fd tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011880 Oct 06 13:19:52.858204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:52.858341 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2717/5448] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Oct 6 13:19:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 13:19:52.870426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:52.871224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:52.871905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:52.872867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:52.873565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:52.874260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:52.892241 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fbe74f9d-8b34-44d7-881e-a2a1830deca1 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024462 Oct 06 13:19:52.895528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2718/5449] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Oct 6 13:19:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 13:19:52.925094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-489b8716-d325-4b0b-843c-c84ae0fd6b7f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Calling method '.version_select at 0x7f7d3f01db80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:53.009123 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-489b8716-d325-4b0b-843c-c84ae0fd6b7f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] HTTP exception thrown: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-489b8716-d325-4b0b-843c-c84ae0fd6b7f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/os-volumes/cfe2c8e7-3c27-412b-9fed-d8976a840ce4 HTTP/1.1 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: exception: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'cfe2c8e7-3c27-412b-9fed-d8976a840ce4'} Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. (HTTP 404) (Request-ID: req-776de83e-94e1-4232-8ef5-475bffe43605) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:19:53.011497 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. Oct 06 13:19:53.015639 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.020261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-489b8716-d325-4b0b-843c-c84ae0fd6b7f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 404 to user: Volume cfe2c8e7-3c27-412b-9fed-d8976a840ce4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:53.021460 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-489b8716-d325-4b0b-843c-c84ae0fd6b7f tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/cfe2c8e7-3c27-412b-9fed-d8976a840ce4" status: 404 len: 109 microversion: 2.1 time: 0.119376 Oct 06 13:19:53.022831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2719/5450] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:19:52 2022] DELETE /compute/v2.1/os-volumes/cfe2c8e7-3c27-412b-9fed-d8976a840ce4 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:19:53.042034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a36bb3e4-6bae-497c-8c7f-1f84d755a591 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Calling method '.version_select at 0x7f7d3dfdab80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:53.107625 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a36bb3e4-6bae-497c-8c7f-1f84d755a591 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] HTTP exception thrown: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a36bb3e4-6bae-497c-8c7f-1f84d755a591 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Request method failure captured: Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/os-volumes/dfc71a61-ef85-4ac0-a254-ca1c31322b73 HTTP/1.1 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtX3sLIcxOoVg2pUoMGbaZSO1SNAN3qry7wyOV9XD4HP79-q1rrA4J7trVtZqbbff1Rf_JOM2wU1l9B6bh5vyqV5skwpPaHuXc-9XcxvApCFZbsPCBRNjcwoPZo8yFcRQB5xFvbjsXSHcFcAPC4gB67M3-3FSSHqUAetzodDTjb5TuU Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2a7cea84c454e59bae4f6df199c948a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2a7cea84c454e59bae4f6df199c948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2a7cea84c454e59bae4f6df199c948a"}]}] Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b2a7cea84c454e59bae4f6df199c948a Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesNegativeTest-1747549832 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1dabc7ef07404bdca215ce5c4384e678 Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesNegativeTest-1747549832-project Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: method: Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: exception: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dfc71a61-ef85-4ac0-a254-ca1c31322b73'} Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. (HTTP 404) (Request-ID: req-6e9e4eea-0713-4c85-8ff2-c863f8d3de2e) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 13:19:53.109589 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a36bb3e4-6bae-497c-8c7f-1f84d755a591 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] Returning 404 to user: Volume dfc71a61-ef85-4ac0-a254-ca1c31322b73 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a36bb3e4-6bae-497c-8c7f-1f84d755a591 tempest-VolumesNegativeTest-1747549832 tempest-VolumesNegativeTest-1747549832-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/dfc71a61-ef85-4ac0-a254-ca1c31322b73" status: 404 len: 109 microversion: 2.1 time: 0.082478 Oct 06 13:19:53.115050 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2720/5451] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Oct 6 13:19:53 2022] GET /compute/v2.1/os-volumes/dfc71a61-ef85-4ac0-a254-ca1c31322b73 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:19:53.293595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:53.318762 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38ab49c7-def0-4b05-9f42-8c9c38f46e17 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.467769 Oct 06 13:19:53.319377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2732/5452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:52 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:53.356018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:53.356864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:53.373377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:53.381647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:53.382643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:53.383300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:53.385380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:53.390654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:53.393579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.063148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:54.132035 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d7a6bcb-78cc-4c77-b9e6-10e70fcbfdc0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.780799 Oct 06 13:19:54.140426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2721/5453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:53 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:54.180797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:54.183076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:54.193376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=56 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:19:54.243551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.246223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.248810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.253312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.263217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.263786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.394665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Unlocking {{(pid=129614) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 06 13:19:54.502631 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a33017a-ca5c-4758-a283-f01ef30cdccc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.327110 Oct 06 13:19:54.504653 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2733/5454] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:54 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:54.532431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:54.533074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:54.556221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.557379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.557863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.559042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.559988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.560650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.916134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:54.934139 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2af908b3-0d03-4f0a-9d11-0042da7a7c93 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.417971 Oct 06 13:19:54.935773 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2722/5455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:54 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:54.961977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:54.964104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:54.984416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.985435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.990778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:54.991750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:54.992401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:54.993041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:55.340586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:55.351284 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c1d2a97-3098-471e-ab24-bb9db28baf6a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.393889 Oct 06 13:19:55.353681 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2734/5456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:54 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:55.383606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:55.384766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:55.399471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:55.400687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:55.404204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:55.406302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:55.407072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:55.409078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:55.710559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:55.731807 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-58e622b0-30ae-4ab1-a935-d63fe1080a5c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.357866 Oct 06 13:19:55.733404 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2723/5457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:55 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:55.760331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:55.760906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:55.788410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:55.788823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:55.789270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:55.794334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:55.794837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:55.800298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:56.087711 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d1bd5d7-fa2b-4efb-891d-208d257adab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.331896 Oct 06 13:19:56.097246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:56.099155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:56.107970 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2735/5458] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:55 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:56.122192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:56.123549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:56.125632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:56.126674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:56.130053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:56.130755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:56.434276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:56.446400 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b2489f9-bca2-4619-86e5-bd0082185b23 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1673 microversion: 2.1 time: 0.353083 Oct 06 13:19:56.447622 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2724/5459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:56 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:19:56.664675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:56.682879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:56.713798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:56.714698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:56.715468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:56.716648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:56.717432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:56.736512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:57.508690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:57.544866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:57.545357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:57.545812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:57.579794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:57.588409 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-76dcf8a1-64cd-453f-b052-a06dbd40ee70 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1564 microversion: 2.1 time: 0.931988 Oct 06 13:19:57.588991 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2736/5460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:56 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1564 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:57.599497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:57.601907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] Creating event network-changed:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:19:57.610902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:57.617239 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-be5b95e5-4173-4739-b092-152c98fc831d req-5d46727e-9f30-4fd3-a194-d061757177c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.948243 Oct 06 13:19:57.624720 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2725/5461] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:19:57.630751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:57.633585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:57.634321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:57.638473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:57.639240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:57.640785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:58.148334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:58.157538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-66791164-344f-4464-958b-c5268d2ddbef tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1653 microversion: 2.1 time: 0.561997 Oct 06 13:19:58.162736 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2737/5462] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:57 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1653 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:19:58.198090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:19:58.198456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:58.216433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:58.217044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:58.219240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:58.220237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:58.222492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:58.235386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:58.479098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-df03c455-65db-4161-942b-3503cb92fdd6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.287751 Oct 06 13:19:58.479857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2726/5463] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:19:58 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:19:58.489180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:19:58.490009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:19:58.500404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:58.511668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:58.513417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:58.523314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:19:58.524302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:19:58.525001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:19:59.315328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:19:59.333317 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-799c2d73-d164-4016-a665-de08457abab4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1660 microversion: 2.1 time: 0.841563 Oct 06 13:19:59.335532 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2738/5464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:19:58 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1660 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:00.376043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:00.379717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:00.396841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:00.397935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:00.398753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:00.400259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:00.401453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:00.402356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:00.780515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:00.785676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:00.795127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01bce4d8-0f99-41c8-9bc6-2e90a765b5d6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.430277 Oct 06 13:20:00.810752 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2727/5465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:00.837616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:00.838825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:00.876257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:00.877579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:00.878244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:00.883707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:00.885143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:00.887769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:00.939513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:01.214416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:01.234014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-047668fb-bdbc-4467-a591-8978eebabcc6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.407978 Oct 06 13:20:01.259934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2739/5466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:01.265201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:01.266245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:01.283832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:01.284444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:01.286000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:01.287240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:01.287978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:01.288573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:01.560692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:01.572687 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1a44166-70ed-4d12-8781-64155ba676e1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.311110 Oct 06 13:20:01.573592 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2728/5467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:01 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:20:01.632190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:01.633722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:01.678466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:01.679144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:01.679629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:01.682017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:01.685171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:01.686152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:02.241529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:02.265433 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-101ccf08-58a6-467f-8976-c3b0ab7f8ffb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.648903 Oct 06 13:20:02.267850 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2740/5468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:01 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:02.302613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:02.303440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:02.317372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:02.317913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:02.318436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:02.319265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:02.319800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:02.320561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:02.746813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:02.756421 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2b5768f8-a9a6-486a-9d84-43330c600e5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.458313 Oct 06 13:20:02.762118 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2729/5469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:02 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:02.800785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:02.801790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:02.819512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:02.823412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:02.824961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:02.828977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:02.831575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:02.832949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:03.311710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:03.351724 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-40e782b9-75c5-41db-b6c3-e0f312fab547 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.552790 Oct 06 13:20:03.352943 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2741/5470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:02 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:12.578283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:12.588457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:12.629656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=17 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:12.636249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:12.637564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:12.638219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:12.640465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:12.643435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:12.644044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:12.742981 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d253a35c-a2f0-4863-b6e5-0a7d55194547 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action" status: 200 len: 24560 microversion: 2.1 time: 0.171179 Oct 06 13:20:12.745190 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2730/5471] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:20:12 2022] POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action => generated 24560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:20:23.484495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:23.486331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:23.491515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=17 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:23.492924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=14 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:23.500551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:23.501442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:23.502504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:23.504603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:23.505257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:23.506055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:24.037289 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-564c1752-1e07-4588-840f-7c75db04b03d tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1834 microversion: 2.1 time: 0.556889 Oct 06 13:20:24.045890 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2742/5472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:23 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1834 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:24.064299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:24.065020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:24.077234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:24.078511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=17 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:24.085600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:24.086388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:24.087008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:24.097606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:24.098132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:24.098578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:24.394599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:24.402998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9eff697c-79b2-4aad-9c47-473ba3a7e29d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1683 microversion: 2.1 time: 0.342891 Oct 06 13:20:24.410539 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2731/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:24 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1683 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:24.817835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:24.820901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:24.839566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:24.840517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:24.841242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:24.846234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:24.847112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:24.848566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:24.943426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fa571a19-82c0-4bf4-b02e-918569d2f718 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action" status: 200 len: 32631 microversion: 2.1 time: 0.131397 Oct 06 13:20:24.945133 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2743/5474] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:20:24 2022] POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action => generated 32631 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:20:25.098941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:25.100410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:25.134468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:25.135441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:25.136300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:25.137967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:25.140555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:25.142441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:25.235931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a15e4cd91774549958c839a63015eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a2546666c0434f9c6956fb48986f95', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:25.252760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] flavor_id is None. Assuming migration. {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 06 13:20:25.261715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:20:25.648937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62bb1dca-dd75-440f-ae18-9ab458f125ef tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action" status: 202 len: 0 microversion: 2.1 time: 0.554715 Oct 06 13:20:25.653598 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2732/5475] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:20:25 2022] POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:20:26.584448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:26.585197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:26.603222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:26.609232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:26.610950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:26.614195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:26.616072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:26.617501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:27.243570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:27.252394 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16393fcc-5293-4817-8b18-e30ac358f937 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1692 microversion: 2.1 time: 1.597084 Oct 06 13:20:27.253009 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2744/5476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:25 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1692 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:20:28.298848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:28.300318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:28.318835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:28.319601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:28.320221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:28.321276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:28.322075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:28.322765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:28.645452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:28.660459 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-048c7393-22e5-41e0-837a-37d5ca72ef43 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1692 microversion: 2.1 time: 0.382167 Oct 06 13:20:28.668860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2733/5477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:28 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1692 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:29.684635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:29.685534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:29.700406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:29.700906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:29.701350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:29.702094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:29.702554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:29.702987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:30.383345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:30.398028 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52f2fc14-2b90-4117-9b51-897f88ad0afd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1692 microversion: 2.1 time: 0.711709 Oct 06 13:20:30.398986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2745/5478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:29 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1692 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:31.423864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:31.424722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:31.444279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:31.445412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:31.447603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:31.450055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:31.451039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:31.451486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:31.782056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:31.808042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-74b91333-f1ae-4fc4-8141-d476ab207173 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.387850 Oct 06 13:20:31.809659 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2734/5479] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:31 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:32.837021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:32.837629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:32.848455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:32.849228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:32.849874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:32.850817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:32.851459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:32.852089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:33.162359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:33.176426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e518a8f-220a-437b-a9df-f6d42dc80baa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.341564 Oct 06 13:20:33.177718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2746/5480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:32 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:34.218558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:34.219169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:34.239447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:34.239948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:34.240392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:34.241194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:34.250527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:34.251183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:34.647079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:34.664381 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23e1459f-73ad-4b82-b8b5-21d423143aa3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.447393 Oct 06 13:20:34.666014 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2735/5481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:34 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:35.692769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:35.693609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:35.704052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:35.714198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:35.714581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:35.715364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:35.715989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:35.716265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:35.996824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:36.010574 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ad07c46-03af-4271-bde7-29185f5ab98f tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.318494 Oct 06 13:20:36.016670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2747/5482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:35 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:37.048785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:37.049629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:37.076859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:37.077509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:37.093663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:37.099617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:37.100290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:37.100748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:37.733332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:37.743090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ee6daa5-b989-4c06-853f-5c84d4d961d1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.702200 Oct 06 13:20:37.750115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2736/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:37 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:20:38.772729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:38.773166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:38.797106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:38.806905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:38.811536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:38.822051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:38.827662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:38.832576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:39.223797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:39.261878 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c46bbdc8-1f0a-49b7-8abf-c9b920a9cd8e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.492724 Oct 06 13:20:39.265255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2748/5484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:38 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:40.290924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:40.292910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:40.330539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:40.332689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:40.336492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:40.340938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:40.342575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:40.351535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:40.678668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:40.704156 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40ced580-de45-4ba1-a996-62204be2fe67 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.416907 Oct 06 13:20:40.708047 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2737/5485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:40 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:41.736403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:41.740025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:41.751354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:41.752084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:41.752723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:41.754991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:41.755658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:41.756286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:42.235978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:42.245113 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-795acea4-f32e-4b96-aa51-15c6b460649b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1697 microversion: 2.1 time: 0.518890 Oct 06 13:20:42.246886 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2749/5486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:41 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1697 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:43.277298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:43.278788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:43.295131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:43.295983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:43.296762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:43.297703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:43.299051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:43.299645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:43.664774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:43.673415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-53e7ba79-7037-4f4c-b3f8-96c5a6a6645d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1696 microversion: 2.1 time: 0.406394 Oct 06 13:20:43.676603 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2738/5487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:43 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1696 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:44.704752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:44.705447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:44.723886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:44.726414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:44.726963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:44.730505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:44.731000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:44.735053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:45.199904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:45.230307 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f6fa3129-fc70-4d4a-b13d-7f8b9f821cb5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1696 microversion: 2.1 time: 0.516226 Oct 06 13:20:45.232301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2750/5488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:44 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1696 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:45.948136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-unplugged", "status": "completed", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:45.986157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:45.988979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:45.990990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:46.061073 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Creating event network-vif-unplugged:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h2-860556-1 Oct 06 13:20:46.083495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:20:46.133679 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d2df9607-4bcb-42aa-9b9f-b589a54c4dd5 req-0cadd50e-787c-4284-9d98-b701fb0111db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.828182 Oct 06 13:20:46.140445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2739/5489] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:20:46.261718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:46.262729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:46.275536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:46.288734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:46.289599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:46.294000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:46.295592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:46.297483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:46.685464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:46.700955 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-58004ee6-8863-4cda-b355-9f9347dc9851 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1696 microversion: 2.1 time: 0.440190 Oct 06 13:20:46.706701 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2751/5490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:46 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1696 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:47.747707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:47.748468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:47.795590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:47.795780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:47.796600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:47.798627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:47.799612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:47.800997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:48.204418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:48.272627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:48.273424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:48.278419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:48.365437 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Creating event network-changed:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h2-860556-1 Oct 06 13:20:48.402533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:20:48.424646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:48.452962 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1db8d571-893e-47ff-aad8-e210cdfe23b7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1696 microversion: 2.1 time: 0.712484 Oct 06 13:20:48.454285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2740/5491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:47 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1696 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:48.461753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-09cb1573-e8e6-42a2-8699-2b78194df845 req-af839e13-b64e-4623-8337-52a95ca3b2a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257642 Oct 06 13:20:48.463689 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2752/5492] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:20:48.594985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:48.613236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:48.669850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:48.674126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:48.678519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:48.683548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:48.686248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:48.688046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:48.859787 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b53ecee9-1197-49b9-b4dc-1c0511890b0a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.267910 Oct 06 13:20:48.865654 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2741/5493] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:20:48 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:20:48.873167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:48.875098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:48.899049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:48.902690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:48.903807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:48.909103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:48.910200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:48.912907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:49.502182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:49.503117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:49.541327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:49.542408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:49.544573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:49.549446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:49.550333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:49.551653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:50.027651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:50.044602 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e7e2008-db16-412b-a1c4-bebbc15675df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1696 microversion: 2.1 time: 0.561830 Oct 06 13:20:50.047669 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2742/5494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:49 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1696 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:50.065224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:50.075316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-31e0a7eb-220e-4468-8717-123f8e46a34e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1670 microversion: 2.1 time: 1.206830 Oct 06 13:20:50.076625 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2753/5495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:48 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1670 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:51.075254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:51.075885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:51.087837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:51.088350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:51.088833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:51.089561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:51.090077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:51.090516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:51.103884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:51.106283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:51.121272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:51.121840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:51.123131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:51.124261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:51.124970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:51.125629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:51.529044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:51.546926 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0413f318-b34a-461a-887d-9db9bb844d03 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1670 microversion: 2.1 time: 0.448299 Oct 06 13:20:51.548719 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2754/5496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:51.623943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:51.649093 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83d92437-2a12-42cc-89f4-ca6bd71c201a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1694 microversion: 2.1 time: 0.573510 Oct 06 13:20:51.666082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2743/5497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:51 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1694 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:52.574243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:52.575401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:52.605327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:52.605873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:52.606322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:52.607055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:52.607705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:52.608060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:52.680648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:52.681281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:52.701238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:52.706543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:52.708577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:52.710523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:52.714434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:52.716528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:53.932146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:53.964076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ec1a1ef8-97f7-4c34-9beb-e757957ee3e6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1694 microversion: 2.1 time: 1.285875 Oct 06 13:20:53.967523 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2744/5498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:52 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1694 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:20:54.317789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:54.321387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=79 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:54.334449 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00052362-113d-40e3-a633-1d2e6f30d8ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1670 microversion: 2.1 time: 1.762613 Oct 06 13:20:54.336928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2755/5499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:52 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1670 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:54.992615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:54.995145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:55.007806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=31 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:55.018088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.020098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.043410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.044582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.045396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.046136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.055756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:55.370977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:55.371621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:55.374861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=29 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:20:55.396833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.398152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.400915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.405134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.408684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.410764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.754049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:55.766055 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c6789fa-955a-4980-b338-fbb25287b07b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1691 microversion: 2.1 time: 0.778918 Oct 06 13:20:55.767733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2745/5500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:54 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1691 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:55.795358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:55.796061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:55.821692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.822214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.822782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.827673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:55.828803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:55.832323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:55.880043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:55.892541 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8adb06b2-e990-42cf-8691-93c1c9025ec9 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.530277 Oct 06 13:20:55.893144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2756/5501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:55 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:56.021130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12f9a96a-6a0c-487a-ac13-e3f6f4f3c85b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action" status: 202 len: 0 microversion: 2.1 time: 0.230984 Oct 06 13:20:56.025181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2746/5502] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:20:55 2022] POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:20:56.031656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:56.032679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:56.041876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:56.042899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:56.043591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:56.044535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:56.045206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:56.046180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:56.370848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:56.388059 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1fa71bf-6681-41b8-b291-c40734ae7c36 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.360492 Oct 06 13:20:56.391897 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2757/5503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:56 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:20:57.420933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:57.422524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:57.437291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:57.439527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:57.440218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:57.441875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:57.443788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:57.444892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:57.879694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:57.891603 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f214b6e-5a80-4b83-81c2-34b1ca013319 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.475285 Oct 06 13:20:57.892838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2747/5504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:57 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:20:58.917408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:20:58.918116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:20:58.932308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:58.932816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:58.933263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:58.934024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:58.934460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:58.936123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:59.043963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-plugged", "status": "completed", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:20:59.071769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:20:59.073529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:20:59.076376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:20:59.110734 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Creating event network-vif-plugged:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h2-860556-1 Oct 06 13:20:59.133200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:20:59.159761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ac8d4ed6-d7f8-4849-80ce-d43c523a2ea3 req-fdf11b41-3384-474b-bba2-7b8a62339dbb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.722758 Oct 06 13:20:59.162706 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2758/5505] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:20:59.724099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:20:59.735244 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21dbdb43-42e9-4b17-b65f-f5f9dd7878ba tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.822600 Oct 06 13:20:59.742120 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2748/5506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:20:58 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:21:00.766340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:00.771700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:00.825228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:00.827130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:00.827613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:00.828390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:00.828869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:00.829305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:01.235897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:01.253851 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59c454eb-98c9-4781-96dd-decf9ed88357 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.490193 Oct 06 13:21:01.271703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2759/5507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:00 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:02.289390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:02.291850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:02.305096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:02.308047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:02.310255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:02.313131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:02.316097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:02.317463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:02.400029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-unplugged", "status": "completed", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:02.427399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:02.428095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:02.429455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:02.469384 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Creating event network-vif-unplugged:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:21:02.516439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:21:02.587356 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4e0652cf-cba5-4e9b-97c5-fbb5dc8bb1ca req-e7fa2f5d-82ea-4a13-bb8e-6518b8600b87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191401 Oct 06 13:21:02.593277 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2760/5508] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:21:02.708050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:02.730252 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c7a87bf5-63a2-4df3-ba96-081fb305b5c0 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.443745 Oct 06 13:21:02.730898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2749/5509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:02 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:03.766814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:03.767460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:03.787437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:03.794412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:03.795177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:03.796700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:03.798302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:03.800073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:04.076848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:04.093897 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ede90756-fed6-427a-b99c-a7e2cf57226c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.338197 Oct 06 13:21:04.096170 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2761/5510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:03 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:05.048386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:05.100802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:05.104470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:05.110531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:05.125452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:05.126407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:05.148472 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Creating event network-changed:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:21:05.155212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:05.155733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:05.156184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:05.157773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:05.162033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:05.164801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:05.167620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:21:05.200574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-794e4ac8-22e6-49ed-bf5f-c4802e0d953b req-4ebebdf8-bc1d-4957-adf2-a5efabfd5890 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175928 Oct 06 13:21:05.219948 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2750/5511] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:21:05.689933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:05.699371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-558a68e8-44a5-4793-84a3-6d2ec057780a tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.582561 Oct 06 13:21:05.699969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2762/5512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:05 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:21:06.734667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:06.738611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:06.750220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:06.751116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:06.751753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:06.753409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:06.754777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:06.755384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:07.084072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:07.097935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9a76bc9-6cda-4579-84b2-8b9c871eb443 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.374691 Oct 06 13:21:07.101534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2751/5513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:06 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:08.125582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:08.126263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:08.144859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:08.145677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:08.146356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:08.147543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:08.148198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:08.148792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:08.468932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:08.477986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b792f61a-7eb3-4173-ab29-5a0042dc7114 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1690 microversion: 2.1 time: 0.356174 Oct 06 13:21:08.479197 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2763/5514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:08 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1690 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:09.502115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:09.502990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:09.521927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:09.522649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:09.523301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:09.524347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:09.524959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:09.527642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:09.780546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:09.816128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7ca7276-665d-4010-be30-2acdaaff9a7e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1683 microversion: 2.1 time: 0.317629 Oct 06 13:21:09.833334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2752/5515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:09 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1683 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:11.897517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-plugged", "status": "completed", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:11.922561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:11.923092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:11.924590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:11.961683 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] Creating event network-vif-plugged:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:21:11.979193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-304f3acb-b7f6-4480-bd2b-e087d6ba0236 req-805f4989-7c2e-4e99-9e65-000bb0d9fbae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086972 Oct 06 13:21:11.980362 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2764/5516] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:21:36.098502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:36.101462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:36.108533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=19 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:36.109440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:36.115615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:36.116748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:36.117591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:36.118667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:36.120565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:36.121190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:36.250863 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30b34aa0-97d3-493a-a7a4-c05a6b70d75d tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action" status: 200 len: 63154 microversion: 2.1 time: 0.159164 Oct 06 13:21:36.259948 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2753/5517] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:21:36 2022] POST /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65/action => generated 63154 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:21:42.473909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=17 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:42.478205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=47 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:43.063591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:43.064573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:43.092046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:43.092806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:43.093263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:43.098845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:43.099432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:43.099893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:43.739022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb887f3e-a37e-4366-a76d-e82bff838ae1 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1834 microversion: 2.1 time: 1.267388 Oct 06 13:21:43.740637 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2765/5518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:42 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1834 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:21:47.198839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:47.200095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:47.210040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:47.211855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:21:47.214670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:47.215456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:47.216104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:47.218072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:47.218748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:47.219407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:47.266324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:21:47.312142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:47.357005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:47.357501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:47.357981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:47.435206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] Creating event network-changed:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:21:47.468287 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-fa3723a6-719b-4131-9dff-e95500b698bb req-e8b52a5f-28a7-47b1-888b-c898d1c94eae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157246 Oct 06 13:21:47.468990 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2766/5519] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:21:47.619372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6694d26-a611-408f-bc55-535a0fdd1acc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 204 len: 0 microversion: 2.1 time: 0.435347 Oct 06 13:21:47.620040 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2754/5520] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:21:47 2022] DELETE /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:21:47.629554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:47.631212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:47.648235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:47.650135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:47.650780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:47.653833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:47.656086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:47.656699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:48.051857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:48.076929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f13a0de0-93ff-4b68-85a3-079888de8dbe tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1689 microversion: 2.1 time: 0.451933 Oct 06 13:21:48.077550 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2767/5521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:47 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1689 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:49.108485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:49.109201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:49.141093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:49.141620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:49.142065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:49.142817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:49.143277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:49.143705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:50.052993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:50.070388 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b55a33cd-801e-4452-be6b-37c7e979c6a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1689 microversion: 2.1 time: 0.972309 Oct 06 13:21:50.071668 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2755/5522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:49 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1689 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:21:51.040404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbda3ca-db08-4429-bb77-939fa35cde65", "name": "network-vif-deleted", "tag": "276aeec7-55b4-42a0-8868-f0850288fa12"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:21:51.076153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:51.082937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:51.084384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:51.104028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:51.105432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:51.123245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:51.134566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:51.135518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:51.139374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:51.140621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:51.148525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:51.155977 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] Creating event network-vif-deleted:276aeec7-55b4-42a0-8868-f0850288fa12 for instance 4cbda3ca-db08-4429-bb77-939fa35cde65 on n-h1-860556-1 Oct 06 13:21:51.179745 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-27bf10e0-23b8-4c1b-a513-4ccfc8c89247 req-1a7a87c3-e7a8-425e-b6b4-edd288e019e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144692 Oct 06 13:21:51.191480 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2768/5523] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:21:51.665289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:51.681168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d05cca9a-9193-4014-8a91-f09fde0440b5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 200 len: 1352 microversion: 2.1 time: 0.581883 Oct 06 13:21:51.684479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2756/5524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:51 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 1352 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:52.721426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:52.725011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 4cbda3ca-db08-4429-bb77-939fa35cde65] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:52.746187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:52.748397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:52.749133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:52.751929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:52.755291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:52.756943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:52.813791 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] HTTP exception thrown: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Request method failure captured: Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 HTTP/1.1 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTsmOb2IHtwihdePXyfADQfkW9MCVUqYnyuz55PDdEtUaJQHgtSHH1_d8Z95Vl8OkADR1orN1ChZVgXm5fYPEFANxDrcd2eU6OpZ3BhqaqbU1zbg54exJX19aCxF02OkzSa-vYBp6RoWERABvtnoIm_4o1tDTtzLFkehLLNw1Jr3_c Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ed3a75f24b140e5879c48dba0eda9cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}] Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 4b277518fc7b4784ba547a15bdcf3d54 Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4cbda3ca-db08-4429-bb77-939fa35cde65'} Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:21:52.824905 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. Oct 06 13:21:52.830967 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:21:52.833716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Returning 404 to user: Instance 4cbda3ca-db08-4429-bb77-939fa35cde65 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:21:52.848560 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b39b700f-c109-4442-b3d0-cddc962f3660 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65" status: 404 len: 111 microversion: 2.1 time: 0.122510 Oct 06 13:21:52.854390 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2769/5525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:52 2022] GET /compute/v2.1/servers/4cbda3ca-db08-4429-bb77-939fa35cde65 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:21:59.050387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:59.051424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:59.056142 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:21:59.056356 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 (ip 10.222.0.26) !!! Oct 06 13:21:59.114187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:59.114187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:59.114187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:59.114187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:59.118643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:59.127991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:59.767030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:21:59.781981 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-561299b5-2baf-48e4-af4b-c80081bda4aa tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.738788 Oct 06 13:21:59.800976 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2757/5526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:59 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:21:59.820927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:21:59.821553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:21:59.831649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:59.832448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:59.833196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:21:59.834119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:21:59.834803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:21:59.835536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:00.373010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:00.383652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dabdb2d-c36b-47d7-9f87-ca41d4aa1a15 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.566978 Oct 06 13:22:00.384246 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2770/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:21:59 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:00.429029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:00.429772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:00.437165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:00.437961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:00.438578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:00.439539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:00.440211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:00.440830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:01.609452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:01.623912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0862d6e4-7e3d-4c43-9d51-b4f03f0aeea2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 1.198693 Oct 06 13:22:01.638633 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2758/5528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:01.656796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:01.658987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:01.678138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:01.679008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:01.679788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:01.680728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:01.681416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:01.682161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:01.905224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddd7945a-6510-41ef-8b03-c21c18b414d6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '.version_select at 0x7f7d3dfdab80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:01.943620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddd7945a-6510-41ef-8b03-c21c18b414d6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1016677480" status: 202 len: 0 microversion: 2.1 time: 0.042331 Oct 06 13:22:01.944531 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2759/5529] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Oct 6 13:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1016677480 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:22:01.988633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1754ed48-53e2-4be8-a285-f99e1dea6f1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: .version_select at 0x7f7d3df90f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-40940457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIPQIdUaPyx6b1yepnFZuGfNvi91JqX+ZGiLEiXSHhHtCs/Bb6igSxXBtSVaLiSR45v3KHvg8ebIgg1hgUN54MCjDSeNtk/8qX5y+3SuH3LTnxi1l6awU9rMG5O4ObTqQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:02.029242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:02.050077 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91388a08-e882-415b-a7f4-f38c6db378da tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.398260 Oct 06 13:22:02.059723 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2771/5530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:01 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:02.061877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1754ed48-53e2-4be8-a285-f99e1dea6f1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:02.069908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1754ed48-53e2-4be8-a285-f99e1dea6f1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:02.107889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1754ed48-53e2-4be8-a285-f99e1dea6f1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.128895 Oct 06 13:22:02.116301 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2760/5531] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:22:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:22:02.275570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-424077028", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:02.426752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] validate_networks() for [('3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:22:03.498327 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:22:03.499011 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:22:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 06 13:22:03.501169 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:22:03.501363 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:22:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 06 13:22:04.491825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:22:04.494572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:22:04.497084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:22:04.497689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:22:04.500677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:22:04.534139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:04.534792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:04.535089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:04.536365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:04.536837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:04.537280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:04.596891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:04.604858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:04.633485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:22:04.635883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:22:04.731129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1627468-88a2-4dcf-b72b-19f42e552827 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.460589 Oct 06 13:22:04.731847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2772/5532] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:22:04.743930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73d70257-871b-4415-ad7b-ddfab7a704a6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:04.744968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73d70257-871b-4415-ad7b-ddfab7a704a6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:04.968952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73d70257-871b-4415-ad7b-ddfab7a704a6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:04.980817 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73d70257-871b-4415-ad7b-ddfab7a704a6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1214 microversion: 2.1 time: 0.239331 Oct 06 13:22:04.983473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2761/5533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:04 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:06.009769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:06.011201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:06.059154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:06.059671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:06.060115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:06.060859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:06.063616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:06.065214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:06.358508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:06.377311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e0202e0-1f62-4d00-bbf9-0fe8160afe99 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1210 microversion: 2.1 time: 0.378104 Oct 06 13:22:06.379623 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2773/5534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:05 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1210 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:07.402799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:07.404240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:07.432055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:07.433947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:07.437893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:07.445414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:07.446197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:07.454177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:07.752651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:07.765508 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4707d8c3-ac2e-471c-a604-14b6d8493b0e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1272 microversion: 2.1 time: 0.366016 Oct 06 13:22:07.769796 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2762/5535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:07 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:08.804533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:08.805222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:08.833493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:08.834695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:08.835527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:08.836824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:08.837765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:08.838680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:09.026529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:09.045759 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd33427b-1f83-4f2b-aec5-f50283cdc085 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1272 microversion: 2.1 time: 0.248392 Oct 06 13:22:09.046663 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2774/5536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:08 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:10.084850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:10.086270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:10.096191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:10.137866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:10.143896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:10.145121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:10.147642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:10.148212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:10.712460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:10.728963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23015ee6-6bde-4f59-bedb-849f769c69b6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.647603 Oct 06 13:22:10.755124 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2763/5537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:10 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:11.762941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:11.763863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:11.776870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:11.780344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:11.781011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:11.781918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:11.782655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:11.784762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:12.531176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:12.534254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=49 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:12.568866 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2ffe6d5-f958-42cf-803e-3fa52fd6884e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.801825 Oct 06 13:22:12.570358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2775/5538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:11 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:13.596052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:13.596698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:13.609406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:13.614303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:13.616262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:13.617977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:13.619795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:13.620450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:14.447005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:14.463796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-708b3b15-13b2-4ed4-8fff-d2ce39254997 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.866066 Oct 06 13:22:14.466152 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2764/5539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:13 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:14.583928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3ea6d9-0b99-4de2-8769-85de29c22f54", "tag": "dae05366-49fe-48e9-80ab-946c9b5c59be"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:14.594972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:14.600320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:14.620383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:14.623355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:14.624932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:14.636013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:14.679150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] Creating event network-changed:dae05366-49fe-48e9-80ab-946c9b5c59be for instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 on n-h1-860556-1 Oct 06 13:22:14.694715 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e6df02ea-0c26-4462-948b-6af6f6145692 req-2cf2a434-2272-4747-96a6-47af2149f701 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114592 Oct 06 13:22:14.705708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2776/5540] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:15.490079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:15.490840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:15.494453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:15.516768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:15.517567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:15.518209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:15.519101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:15.523087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:15.530445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:15.995560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:16.007754 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82192aff-70ba-460a-82fa-bad997473828 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.522182 Oct 06 13:22:16.015846 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2765/5541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:15 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:17.053252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:17.054533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:17.079458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:17.080684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:17.081150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:17.081935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:17.082440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:17.088071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:17.561938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:17.572352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dcbfeb39-fd7d-4971-b68c-2589696bd751 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.524838 Oct 06 13:22:17.572953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2777/5542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:17 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:18.599904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:18.600530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:18.604266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:18.628058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:18.628565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:18.629009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:18.629725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:18.630235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:18.638327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:18.712667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:19.174335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:19.190848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ecc2566-0175-49e7-84f0-8d7a7d0206b4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.594833 Oct 06 13:22:19.195719 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2766/5543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:18 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:20.222814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:20.223466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:20.238856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:20.243086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:20.247672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:20.249478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:20.252316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:20.253043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:21.218931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:21.232206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae187854-8c5a-4dd3-8938-5e1017b5d270 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 1.009518 Oct 06 13:22:21.236354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2778/5544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:20 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:22.270261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:22.270970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:22.289786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:22.290795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:22.292137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:22.294423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:22.299034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:22.299711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:23.186582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:23.203818 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-134079dd-2444-4dbf-b3c3-301ccd7acb8c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.938932 Oct 06 13:22:23.226025 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2767/5545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:22 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:23.899316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-188022145", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "41575074-bd82-47d3-9959-f92b3b1dc3b2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-40940457", "security_groups": [{"name": "tempest-secgroup-smoke-35446122"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:24.159548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] validate_networks() for [('41575074-bd82-47d3-9959-f92b3b1dc3b2', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:22:24.233517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:24.234959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:24.276812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:24.282650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:24.284164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:24.286468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:24.288967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:24.291188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:25.673577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:25.684669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f90cc949-fcac-4e46-b9ec-45067774b923 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 1.455633 Oct 06 13:22:25.706584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2768/5546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:24 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:25.723234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:22:25.724580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:22:25.725222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:22:25.725840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:22:25.726580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:22:25.744790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:25.745584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:25.746244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:25.749730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:25.750455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:25.753546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:25.820184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:25.838291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:25.879765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:22:25.886207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:22:26.024328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a0427cd-2503-4245-bb39-44f4e02b79f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.129543 Oct 06 13:22:26.026434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2779/5547] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:22:23 2022] POST /compute/v2.1/servers => generated 404 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:22:26.038679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-288c66a2-d3af-43a0-89b7-9ebc61ffdd89 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:26.040316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-288c66a2-d3af-43a0-89b7-9ebc61ffdd89 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:26.351779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-288c66a2-d3af-43a0-89b7-9ebc61ffdd89 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:26.372024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-288c66a2-d3af-43a0-89b7-9ebc61ffdd89 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1264 microversion: 2.1 time: 0.327601 Oct 06 13:22:26.374686 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2769/5548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:26 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:26.713056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:26.714229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:26.737826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:26.742734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:26.744255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:26.747886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:26.748735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:26.752344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:27.339058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fdce33f0-728c-4af5-86ea-035532959368 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: .version_select at 0x7f7d3df0d430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1768590005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfx3bgWoQ4A7Hkjk6m7l+s5Fe7kNQgzpnLwttls14E+yWslQ0sWRXOeGL9aadzXEUi24C99hMPAbTc37u7SfRcRt5R6Fl2enQ489l003+ERoqKDwtx4BZsPx98Ix7ve0g=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:27.375673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fdce33f0-728c-4af5-86ea-035532959368 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:27.396499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fdce33f0-728c-4af5-86ea-035532959368 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:27.461092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fdce33f0-728c-4af5-86ea-035532959368 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.127351 Oct 06 13:22:27.462446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2770/5549] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:22:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:27.480180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:27.481961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:27.504441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:27.506371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:27.513637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:27.515910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:27.518348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:27.518897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:27.614882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:27.623506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4a31f2d-3b28-4b74-81a8-85b4f3496529 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.914661 Oct 06 13:22:27.631590 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2780/5550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:26 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:27.947431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:27.995383 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd6bc8f6-9b31-4bac-a1e0-76e5bbaf3183 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1260 microversion: 2.1 time: 0.522295 Oct 06 13:22:28.002747 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2771/5551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:27 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1260 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:28.650761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:28.651400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:28.668898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:28.676214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:28.676964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:28.680764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:28.681572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:28.684228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:29.030154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:29.034081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:29.043916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:29.044893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:29.045634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:29.047037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:29.047664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:29.048406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:29.314938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:29.341074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3b84c010-8ad0-4706-9436-ef34acc3aff5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1334 microversion: 2.1 time: 0.311286 Oct 06 13:22:29.357773 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2772/5552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:29 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1334 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:29.471113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:29.482835 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ace20cb4-ac24-4dc0-8325-725f948be324 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.835953 Oct 06 13:22:29.486695 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2781/5553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:28 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:30.038231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3ea6d9-0b99-4de2-8769-85de29c22f54", "name": "network-vif-plugged", "status": "completed", "tag": "dae05366-49fe-48e9-80ab-946c9b5c59be"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:30.086033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:30.089687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:30.090712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:30.172158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] Creating event network-vif-plugged:dae05366-49fe-48e9-80ab-946c9b5c59be for instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 on n-h1-860556-1 Oct 06 13:22:30.195053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d56571c9-b037-4344-8fe0-93a8b8c376c1 req-c4fa6356-c539-489b-8c85-8010b2a746ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160717 Oct 06 13:22:30.200416 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2773/5554] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:30.372964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:30.373600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:30.396306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:30.396601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:30.408468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:30.427210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:30.427496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:30.430393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:30.574599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:30.575642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:30.592586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:30.597086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:30.597860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:30.598972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:30.602457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:30.603144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:30.795969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:30.823792 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ae73050-e46c-46b9-a9b6-bdf2e19cb335 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1322 microversion: 2.1 time: 0.454599 Oct 06 13:22:30.843773 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2782/5555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:30 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:31.194408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:31.208282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3fd4dd9f-45c7-40c0-9fa4-9542f1d4230f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1314 microversion: 2.1 time: 0.685608 Oct 06 13:22:31.229933 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2774/5556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:30 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:31.468542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1834137637", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "4875f54d-a70d-4adb-b3cf-e8987a7daf13"}], "key_name": "tempest-TestNetworkBasicOps-1768590005", "security_groups": [{"name": "tempest-secgroup-smoke-1728131076"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:31.857916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:31.858537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:31.866050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:31.866548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:31.866986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:31.878218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:31.879014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:31.880684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:32.739700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] validate_networks() for [('4875f54d-a70d-4adb-b3cf-e8987a7daf13', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:22:33.037839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:33.049648 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b5e19827-7837-470c-9682-e8a780a946ae tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 1.195496 Oct 06 13:22:33.050570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2775/5557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:31 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:33.071691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:33.082986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:33.104251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:33.104754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:33.105194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:33.105951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:33.106410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:33.106834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:33.944220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:33.958377 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b31474da-bd9d-4619-bd76-1c6d19da21a4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1500 microversion: 2.1 time: 0.906316 Oct 06 13:22:33.962614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2776/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:33 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1500 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:33.992405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:34.000351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:34.009851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.017349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.017875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:34.018672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.019137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.019736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:34.438517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:22:34.439619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:22:34.441667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:22:34.442405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:22:34.442952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:22:34.463939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.465180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.466772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:34.469581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.477122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.478365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:34.612963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:34.643209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:34.678645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:22:34.683272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:22:34.841895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc7bae23-83f6-43a2-a797-a73d1d804aa6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.377008 Oct 06 13:22:34.846506 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2783/5559] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:22:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:22:34.870169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:34.892923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:34.911094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.915297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.916009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:34.919704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:34.921263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:34.922239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:35.015555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Removing security group 13a837ea-68c7-4428-806c-d85c740a2b30 from port dae05366-49fe-48e9-80ab-946c9b5c59be Oct 06 13:22:35.608270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:35.621501 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64cd4f54-2f26-473e-96ad-d8074bb5d4c6 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.766644 Oct 06 13:22:35.627032 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2784/5560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:34 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:35.652741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:35.682275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:35.682672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:35.685783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:35.715794 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] Creating event network-changed:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h2-860556-1 Oct 06 13:22:35.750309 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-bc6219e8-e501-440d-9b56-ced166732438 req-3552019a-c27e-42f4-a11a-5985923dc926 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121604 Oct 06 13:22:35.755741 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2785/5561] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:35.774016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ad45909-050a-47cf-951c-e492db1d5b4b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:35.774752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ad45909-050a-47cf-951c-e492db1d5b4b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:36.365900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ad45909-050a-47cf-951c-e492db1d5b4b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:36.373695 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ad45909-050a-47cf-951c-e492db1d5b4b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1249 microversion: 2.1 time: 0.614083 Oct 06 13:22:36.374301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2786/5562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:35 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1249 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:36.653286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:36.654566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:36.674328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:36.683067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:36.683746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:36.684665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:36.685297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:36.685963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:36.782283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-77eb09c7-de5b-4fa2-b7ce-43f97180dbe0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54/action" status: 202 len: 0 microversion: 2.1 time: 2.794806 Oct 06 13:22:36.783641 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2777/5563] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:22:33 2022] POST /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54/action => generated 0 bytes in 2798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:22:36.798932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:36.799795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:36.827272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:36.827782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:36.828229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:36.828981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:36.829489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:36.829966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.245962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:37.261083 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f0fc081-1012-43dd-803c-ab33ac068cc8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1458 microversion: 2.1 time: 0.466671 Oct 06 13:22:37.270194 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2778/5564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:36 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1458 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:37.299204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:37.307284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:37.317617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.318444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.319092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.320206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.320830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.321435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.346341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:37.363377 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8eaa9da6-30cd-4365-9c0a-713bb5fe4fb3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.714310 Oct 06 13:22:37.367301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2787/5565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:36 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:37.399162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:37.400653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:37.409688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.410475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.411152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.412055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.412713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.413655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.417725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:37.647338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:37.664085 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15e09eab-928d-4bdb-842a-3e7c69128a75 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1309 microversion: 2.1 time: 0.269529 Oct 06 13:22:37.679710 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2788/5566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:37 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1309 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:37.702743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:37.719009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-542e5989-7718-44b1-9fcf-a7fbe03e2edb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.424923 Oct 06 13:22:37.720008 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2779/5567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:37 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:37.757393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:37.757984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:37.770052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.771238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.771909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:37.774759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:37.775785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:37.777298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.113170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:38.125325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2dd75e4a-8734-420f-ac3b-ac7c529d849c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.373885 Oct 06 13:22:38.143104 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2789/5568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:37 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:38.150575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:38.151865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:38.159650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.160630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.161361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.162395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.163258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.163929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.335762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3ea6d9-0b99-4de2-8769-85de29c22f54", "tag": "dae05366-49fe-48e9-80ab-946c9b5c59be"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:38.362239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.377330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.378821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.413014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] Creating event network-changed:dae05366-49fe-48e9-80ab-946c9b5c59be for instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 on n-h1-860556-1 Oct 06 13:22:38.421534 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d9135b4e-435c-4ad0-9924-8e530a3a0ed4 req-f81741f9-f01c-4c32-ae4e-127de38c8591 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089377 Oct 06 13:22:38.423227 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2790/5569] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:22:38.434105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:38.436671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:38.447085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.450554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.451569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.453666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.455088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.456401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.484038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:38.499292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7500aacb-6e47-4693-9247-e16569ac0a92 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.352637 Oct 06 13:22:38.520504 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2780/5570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:38 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:38.546114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:38.549651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:38.559265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.560178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.560815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.561835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:38.562472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:38.563115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:38.993649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:39.003403 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20a963ef-626c-48df-8a4f-96548e502917 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.577935 Oct 06 13:22:39.004878 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2791/5571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:38 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:39.010562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:39.011570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:39.018595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:39.020189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:39.020906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:39.021901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:39.022600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:39.023444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:39.186772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:39.198326 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e1a93b7-d6b3-4c40-bc10-1775c78b22d5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1307 microversion: 2.1 time: 0.188734 Oct 06 13:22:39.198326 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2792/5572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:39 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:39.296172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:39.309632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-204dcc49-aea8-4444-9adc-1c0f22d7d7e0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.779394 Oct 06 13:22:39.311199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2781/5573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:38 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:39.555974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1308709728", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:39.688614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] validate_networks() for [('3cc5a450-0a0a-4a34-9f7c-17aa96bf4c78', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:22:40.038198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:40.039895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:40.081459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:40.085381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:40.093050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:40.094013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:40.105905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:40.109082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:40.801334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:40.815212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-035f26a8-0567-4981-acf6-68982a6f64e3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.786031 Oct 06 13:22:40.816398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2782/5574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:40 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:40.826931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:40.831640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:40.845917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:40.849788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:40.850581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:40.851618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:40.852261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:40.852871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:41.165494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:22:41.166053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:22:41.166410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:22:41.167461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:22:41.168051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:22:41.207881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:41.208546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:41.210071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:41.211035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:41.214499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:41.215144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:41.268493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:41.285167 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e81df7e6-6b29-40d9-81f7-73e2260e28dc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.467177 Oct 06 13:22:41.286643 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2783/5575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:40 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:41.315163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:22:41.321373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Getting quotas for user 7490cf4b3ec842b291c38efdf91a37ae and project e2758cc0f71547f0a57642b4d91e62d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:22:41.335883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:22:41.339399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:22:41.410341 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23f3a753-e926-44ad-85c5-f9cfd7e37605 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858585 Oct 06 13:22:41.418524 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2793/5576] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:22:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:22:41.425397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6fdc73d2-d04c-4ffb-8aea-922cc2b597a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:41.426705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6fdc73d2-d04c-4ffb-8aea-922cc2b597a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:41.507650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6fdc73d2-d04c-4ffb-8aea-922cc2b597a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:41.515601 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6fdc73d2-d04c-4ffb-8aea-922cc2b597a0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1215 microversion: 2.1 time: 0.095841 Oct 06 13:22:41.518359 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2784/5577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:41 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:41.871302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:41.875696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:41.925292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:41.937552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:41.939457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:41.940974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:41.945209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:41.946040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:42.316629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:42.319077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:42.371063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:42.381948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:42.383946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:42.394122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:42.395285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:42.395942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:42.409449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:42.419769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8251c8ee-5828-4a55-b525-4cce56c3643e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.580879 Oct 06 13:22:42.439534 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2794/5578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:41 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:42.462926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7303b73-b5cb-4cd8-bae3-573f41b738e2", "tag": "bc01fecf-0ade-4059-9cc0-d671882e9a15"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:42.511779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:42.514360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:42.549922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:42.838625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:42.858971 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c19b723-35e4-465c-b2ac-87a68425f0f5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.550016 Oct 06 13:22:42.859815 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2785/5579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:42 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:42.865636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:42.890476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:42.903185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:42.907002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:42.907832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:42.909300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:42.917501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:42.918342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:43.085677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:43.103924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:43.138283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a2a5b183-dc4f-4db6-b47c-e66cd7d2f6bc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1219 microversion: 2.1 time: 0.276450 Oct 06 13:22:43.152681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2786/5580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:42 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1219 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:43.259472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=86 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:43.296664 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] Creating event network-changed:bc01fecf-0ade-4059-9cc0-d671882e9a15 for instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 on n-h1-860556-1 Oct 06 13:22:43.309660 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0607aae7-0fa0-4f23-a2d0-302504e32c83 req-5f8ef935-5a8c-4e4c-9f49-8808a1c816ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.868244 Oct 06 13:22:43.310838 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2795/5581] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:43.456759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:43.458762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:43.472158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:43.473074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:43.473583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:43.474397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:43.474960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:43.475405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:43.887212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:43.888173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:43.933058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:43.949601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:43.967820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:43.972747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:43.973595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:43.974278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:44.198967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:44.274421 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-211d9846-5ff4-49cb-b2fd-bd3e545a4150 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.808434 Oct 06 13:22:44.293943 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2787/5582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:43 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:44.307548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:44.308179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:44.336762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:44.338565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:44.343660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:44.348702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:44.353854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:44.355756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:44.503792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:44.517780 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01e6708e-5a22-4da8-a68f-7a76a79b1244 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1267 microversion: 2.1 time: 0.222316 Oct 06 13:22:44.551249 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2788/5583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:44 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:44.558251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "name": "network-vif-plugged", "status": "completed", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:44.612251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:44.613123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:44.614111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:44.673715 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] Creating event network-vif-plugged:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h2-860556-1 Oct 06 13:22:44.688472 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-47f25735-5720-4b78-be60-5d610a12cc35 req-11f76890-7207-42a1-aaf9-d5ee6ec828ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135676 Oct 06 13:22:44.690591 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2789/5584] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:44.707775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:44.738243 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f55cc581-7cd5-4c27-b76a-88ff6352c01d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.837864 Oct 06 13:22:44.757234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2796/5585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:43 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:45.299892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:45.300635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:45.309961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.321029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.322261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:45.323277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.324184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.324801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:45.547235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:45.549188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:45.551477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:45.568206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.574547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.578384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:45.578384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.578384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.578384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:45.870629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:45.879116 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-84a157b6-1a82-498b-8beb-656f685b676b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1285 microversion: 2.1 time: 0.337782 Oct 06 13:22:45.917797 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2797/5586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:45 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1285 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:45.930840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:45.933113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:45.950072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.950918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.951638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:45.953254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:45.953985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:45.955514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:46.026710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:46.036670 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a11f06b4-7653-498c-8c7c-7104e5ed9b61 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.740955 Oct 06 13:22:46.039268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2790/5587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:45 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:46.322872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:46.336192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c7823cf2-d6b6-4a00-ae5e-1e8528bda918 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.415169 Oct 06 13:22:46.341270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2798/5588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:45 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:46.909024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:46.909187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:46.929041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:46.929547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:46.930010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:46.930725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:46.932525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:46.932963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:47.067748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:47.068492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:47.079069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:47.083291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:47.085994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:47.087034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:47.089378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:47.090892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:47.096682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:47.106547 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3256cba0-665c-4b59-942f-ec457fa9f354 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1273 microversion: 2.1 time: 0.202629 Oct 06 13:22:47.107146 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2791/5589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:46 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:47.368447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:47.369465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:47.379705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:47.380460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:47.381413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:47.385943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:47.386789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:47.387428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:47.789173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:47.800370 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1ea5838-f86c-4dec-a17c-9dc6389c9260 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1388 microversion: 2.1 time: 0.738331 Oct 06 13:22:47.804204 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2799/5590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:47 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1388 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:47.919303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:47.932781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89e3b1be-87bc-4e82-af8f-d0f7a07699ad tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.563725 Oct 06 13:22:47.933624 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2792/5591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:47 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:48.136932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:48.138464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:48.171597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:48.173234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:48.173974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:48.175242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:48.175960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:48.176853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:48.418614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:48.430342 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbb818ce-17c2-4f5c-bef6-6b5b60de4931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.295763 Oct 06 13:22:48.432544 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2800/5592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:48 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:48.825267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:48.826799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:48.837609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:48.840362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:48.841300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:48.842750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:48.845270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:48.846057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:48.847284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:48.961917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:48.963075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:48.975782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:48.994993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:48.995741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:48.996805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.000368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.006201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.129038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:49.141636 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f674509-86f2-4460-bf2b-c67667fe2b4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1561 microversion: 2.1 time: 0.320100 Oct 06 13:22:49.143454 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2793/5593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:48 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1561 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:49.174054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:49.176418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:49.199127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.199898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.200523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.201451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.202101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.202858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.464457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:49.487473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81792435-9e95-46f7-96bd-058b970de027 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.532269 Oct 06 13:22:49.489877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2801/5594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:48 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:49.514245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:49.521721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:49.523097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:49.549484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e5145e2a-a4aa-45b3-a6f3-b7f2eb0a7622 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1561 microversion: 2.1 time: 0.375370 Oct 06 13:22:49.550752 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2794/5595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:49 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1561 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:49.561245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.574044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.582623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa06e296-aea6-4e20-b1aa-f0e7ac539527", "tag": "87dedffd-50be-441a-8a9a-3d5cd473683f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:49.591082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.599889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.602813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.607557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.619786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:49.620569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:49.627479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:49.650358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] Creating event network-changed:87dedffd-50be-441a-8a9a-3d5cd473683f for instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 on n-h2-860556-1 Oct 06 13:22:49.656931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-bd23f3d9-6f07-419a-86cf-4abfddfc5b28 req-a6b8fcd9-1b5d-428b-8a31-ecc32db52075 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079243 Oct 06 13:22:49.658232 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2795/5596] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:50.226544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7303b73-b5cb-4cd8-bae3-573f41b738e2", "name": "network-vif-plugged", "status": "completed", "tag": "bc01fecf-0ade-4059-9cc0-d671882e9a15"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:50.246146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:50.247715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:50.248295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:50.279582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] Creating event network-vif-plugged:bc01fecf-0ade-4059-9cc0-d671882e9a15 for instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 on n-h1-860556-1 Oct 06 13:22:50.294762 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-062b921b-99e0-4267-a936-0e0ad1b1f3be req-44352c2c-5e9f-49d6-b8f9-5b4168803282 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087423 Oct 06 13:22:50.296039 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2796/5597] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:22:50.381163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:50.391434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1f40c8ba-f9c2-4e45-9c3c-db7de359ecf1 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.899029 Oct 06 13:22:50.411202 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2802/5598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:49 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:50.516594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:50.517723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:50.529281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:50.531604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:50.532868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:50.535728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:50.538488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:50.540113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:50.840851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:50.864461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b25dddd0-4b37-47fe-bb94-85580cd43b86 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.353767 Oct 06 13:22:50.865070 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2797/5599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:50 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:51.423774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:51.425153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:51.436400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:51.439937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=20 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:51.444385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:51.449101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:51.449936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:51.450961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:51.453556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:51.454363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:51.888149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:51.889520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:51.889520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:51.898770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:22:51.901460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:51.901699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:51.902588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:51.903722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:51.904412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:51.905023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:51.921202 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf603a44-34da-4ab6-900c-ae22fd52605e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.501319 Oct 06 13:22:51.921909 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2803/5600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:51 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:52.329086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:52.341502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ff8e944-99df-4649-9758-72c58669c6a8 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1375 microversion: 2.1 time: 0.454784 Oct 06 13:22:52.343018 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2798/5601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:51 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1375 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:52.948164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:52.948812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:52.963930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:52.965385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:52.966080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:52.967131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:52.967966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:52.968716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:53.378286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:53.379194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:53.423843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:53.426457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:53.427632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:53.429405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:53.431255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:53.433008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:53.821572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:53.843010 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2dcd2fa4-dd61-436f-97da-5c37afbd198b tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.899355 Oct 06 13:22:53.845468 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2804/5602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:52 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:53.900881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:53.916010 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4b61ab08-b8ed-46ac-9c08-845f4ee27514 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1546 microversion: 2.1 time: 0.551704 Oct 06 13:22:53.918066 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2799/5603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:53 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1546 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:22:53.943296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:53.944226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:53.970541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:53.995820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:53.999936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:54.012267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:54.014326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:54.014959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:54.374239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:54.386871 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-68fb9321-2f7a-40b5-b946-9d875a3afa12 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1546 microversion: 2.1 time: 0.447498 Oct 06 13:22:54.393434 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2805/5604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:53 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1546 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:54.870063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:54.871437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:54.891377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:54.893428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:54.897913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:54.901177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:54.902100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:54.904752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:55.058503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:55.059451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:55.085006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:55.085557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:55.086030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:55.086787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:55.104049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:55.104542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:55.661242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:55.670627 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7126cfb7-848a-448d-9995-f5a884b1e275 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.805395 Oct 06 13:22:55.679394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2800/5605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:54 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:55.719510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:55.737082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:55.737831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:55.738603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:55.753887 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] Creating event network-changed:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h2-860556-1 Oct 06 13:22:55.760893 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2809c7a7-df95-4c49-84c1-51ebfc5d606f req-a5bc009e-384a-447a-af95-58e312b4f7f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080163 Oct 06 13:22:55.763213 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2801/5606] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:55.933362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:55.952877 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bda96eca-0b65-4c24-a1dd-704666ff09dd tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1561 microversion: 2.1 time: 0.898936 Oct 06 13:22:55.954814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2806/5607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:55 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1561 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:56.705775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:56.706625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:56.725416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:56.727078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:56.727710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:56.728622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:56.729409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:56.731007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:58.036441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:58.046955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bbc197fb-bff6-41f5-86b3-8ce2efd0e854 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 1.349646 Oct 06 13:22:58.056634 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2802/5608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:56 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:22:58.290143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06e296-aea6-4e20-b1aa-f0e7ac539527", "name": "network-vif-plugged", "status": "completed", "tag": "87dedffd-50be-441a-8a9a-3d5cd473683f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:22:58.306215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:58.307068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:58.308212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:58.326818 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] Creating event network-vif-plugged:87dedffd-50be-441a-8a9a-3d5cd473683f for instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 on n-h2-860556-1 Oct 06 13:22:58.332957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d735f440-7ac7-4961-885f-474c0242f1a7 req-bede3b9e-1760-4f6b-a2ae-7e3399123d0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047543 Oct 06 13:22:58.334725 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2807/5609] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:22:59.085372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:22:59.086767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:22:59.096642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:59.097138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:59.098519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:59.099417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:22:59.099881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:22:59.100585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:22:59.881765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:22:59.909652 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab622d54-2b0e-4c04-a7df-771f10e8d937 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1315 microversion: 2.1 time: 0.828498 Oct 06 13:22:59.918100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2803/5610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:22:59 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:00.947086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:00.948579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:00.963150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:00.964030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:00.964729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:00.965701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:00.966519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:00.967274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:01.279055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7303b73-b5cb-4cd8-bae3-573f41b738e2", "tag": "bc01fecf-0ade-4059-9cc0-d671882e9a15"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:01.298276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:01.303215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:01.304857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:01.344133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] Creating event network-changed:bc01fecf-0ade-4059-9cc0-d671882e9a15 for instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 on n-h1-860556-1 Oct 06 13:23:01.356115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-72c01048-15a5-426d-9433-0de73d5aa35e req-e412917a-0fb7-4ebc-a060-d8b7e72e0f93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080724 Oct 06 13:23:01.359203 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2804/5611] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:23:01.504104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:01.520491 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28ad4689-5475-4296-b24e-5a3af2144986 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1501 microversion: 2.1 time: 0.578883 Oct 06 13:23:01.530070 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2808/5612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:00 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1501 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:01.553340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:01.554151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:01.567166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:01.567692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:01.568150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:01.568877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:01.569349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:01.569807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:01.703279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:01.724512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e060400d-75c1-49f7-abbb-f2ab1dd7822a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527/action" status: 202 len: 0 microversion: 2.1 time: 0.178175 Oct 06 13:23:01.726489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2805/5613] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:01 2022] POST /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:23:01.737378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:01.739123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:01.749576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:01.750756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:01.752826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:01.754166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:01.755355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:01.756153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:02.307463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:02.320096 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba56bc72-077b-49d4-bf6b-aec64dc7cbc7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1506 microversion: 2.1 time: 0.588551 Oct 06 13:23:02.323338 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2809/5614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:01 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:03.355041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:03.356499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:03.385890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:03.386409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:03.390197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:03.393554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:03.395227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:03.396134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:03.819986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:03.830449 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8370848d-1f44-4f4e-8768-92677bb2817e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1486 microversion: 2.1 time: 0.482416 Oct 06 13:23:03.833583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2806/5615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:03 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1486 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:03.872467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:03.873202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:03.885704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:03.886469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:03.888027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:03.890639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:03.891124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:03.891608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:03.953025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lazy-loading 'flavor' on Instance uuid fa06e296-aea6-4e20-b1aa-f0e7ac539527 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:23:04.299699 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-080a0174-2239-4a59-b82a-4a9cb0a1cc9e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527/action" status: 202 len: 0 microversion: 2.1 time: 0.431224 Oct 06 13:23:04.300969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2810/5616] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:03 2022] POST /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:23:04.321970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:04.323295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:04.336554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:04.337510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:04.338505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:04.339881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:04.340556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:04.341385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:04.648665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:04.687899 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-12789177-3b88-4c29-a286-a4c5a0cd5334 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1492 microversion: 2.1 time: 0.379607 Oct 06 13:23:04.689617 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2807/5617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:04 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1492 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:05.716774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:05.718390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:05.726495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:05.727398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:05.728084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:05.729043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:05.729727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:05.730412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:05.757546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:06.124549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:06.135951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed5973a0-c4f5-40f0-bc4c-b0ba61e9e1ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1492 microversion: 2.1 time: 0.424512 Oct 06 13:23:06.153775 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2811/5618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:05 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1492 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:07.168943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:07.170572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:07.177817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:07.178545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:07.179151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:07.180043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:07.180663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:07.181312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:07.382864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:07.394142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6d90faf0-b337-4569-8500-f118add05af0 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1513 microversion: 2.1 time: 0.229443 Oct 06 13:23:07.395107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2808/5619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:07 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:08.113534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06e296-aea6-4e20-b1aa-f0e7ac539527", "name": "network-vif-plugged", "status": "completed", "tag": "87dedffd-50be-441a-8a9a-3d5cd473683f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:08.135639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:08.136568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:08.137228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:08.177611 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] Creating event network-vif-plugged:87dedffd-50be-441a-8a9a-3d5cd473683f for instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 on n-h2-860556-1 Oct 06 13:23:08.194426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-de01f297-6c09-4efd-9b03-6fd0865eaf8e req-91cba777-bd86-4051-85c6-4a073a39941b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087544 Oct 06 13:23:08.201763 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2812/5620] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:23:08.420657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:08.421651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:08.429267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:08.429784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:08.430413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:08.431218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:08.431689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:08.432117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:08.658428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:08.668414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be68bfcc-449a-41d2-a8f1-112d66968bd8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1513 microversion: 2.1 time: 0.252222 Oct 06 13:23:08.669550 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2809/5621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:08 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:09.698753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:09.700104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:09.708139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:09.708645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:09.709105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:09.709862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:09.710342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:09.710786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:09.874972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:09.884076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-767101f8-ec8e-4750-ad18-8957679fdb3e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1513 microversion: 2.1 time: 0.189831 Oct 06 13:23:09.884824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2813/5622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:09 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:10.907539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:10.909095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:10.922292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:10.924049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:10.926805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:10.929381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:10.929932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:10.930383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:11.133922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:11.143585 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dcc48b0-d53d-4a1b-8efc-fe89193f4a54 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.240471 Oct 06 13:23:11.144590 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2810/5623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:10 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:12.168915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:12.169552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:12.182562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:12.183141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:12.184700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:12.185527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:12.189301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:12.189828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:12.508049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:12.523553 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c56c60a9-0415-4652-adfe-23ed164830cb tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.359604 Oct 06 13:23:12.529375 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2814/5624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:12 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:13.560641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:13.561469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:13.581396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:13.588844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:13.589608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:13.594953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:13.598482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:13.600174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:14.009729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:14.039940 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed4b9b4b-fec3-4d30-85bb-d433909ca209 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.475769 Oct 06 13:23:14.041944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2811/5625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:13 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:15.066655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:15.068543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:15.095497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:15.096064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:15.097483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:15.101473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:15.102129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:15.102849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:15.558242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:15.568129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-675483ac-8a79-4a0c-8580-a11059cfe887 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.507356 Oct 06 13:23:15.569509 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2815/5626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:15 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:16.595035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:16.596836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:16.616343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:16.618357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:16.619298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:16.622121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:16.622802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:16.624660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:17.013516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:17.039332 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43d1fb54-8230-4b83-8ce1-d6af4990459e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.449869 Oct 06 13:23:17.054184 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2812/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:16 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:17.901628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:17.906272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:17.918216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=38 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:17.929100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:17.930344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:17.930997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:17.931954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:17.933896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:17.934524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:18.067943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:18.068569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:18.107796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:18.111428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:18.111937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:18.118046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:18.119841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:18.120307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:18.121173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-560e7c37-6861-48dc-a6a5-165772f6005a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2/action" status: 200 len: 24575 microversion: 2.1 time: 0.223831 Oct 06 13:23:18.123204 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2816/5628] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:17 2022] POST /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2/action => generated 24575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:23:18.491108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:18.502329 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7553cd01-505f-4a67-88ab-ca71bc8b09cc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.440162 Oct 06 13:23:18.506545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2813/5629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:18 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:19.530395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:19.532870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:19.576852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:19.578392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:19.580359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:19.581883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:19.592088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:19.594833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:20.398331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:20.414771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a7609aa6-07b1-4295-9cc6-4baea8536ef7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.889927 Oct 06 13:23:20.443805 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2817/5630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:19 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:21.440758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:21.442945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:21.453171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=42 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:21.469067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:21.479707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:21.480457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:21.481400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:21.482702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:21.486440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:22.713176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:22.737650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e70f977b-9ea9-4678-97cd-580af23c1918 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 1.300524 Oct 06 13:23:22.740667 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2814/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:21 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:23.781417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:23.783173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:23.814227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:23.815009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:23.820641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:23.823752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:23.829516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:23.833707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:24.133247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:24.153314 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9eb08d34-3bf1-4901-b578-73c09f2ccbe3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.375605 Oct 06 13:23:24.157223 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2818/5632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:23 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:25.184480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:25.185079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:25.198563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:25.199059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:25.199500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:25.200218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:25.200673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:25.201103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:25.515123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:25.531614 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52055da4-e172-4aa8-ac77-9b6df9577e7d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.350913 Oct 06 13:23:25.544729 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2815/5633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:25 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:26.570172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:26.571081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:26.578201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:26.579735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:26.580566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:26.581652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:26.582929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:26.583730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:26.600867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:26.608285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:26.629363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:26.630552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:26.632286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:26.634069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:26.645587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:26.646848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:26.793378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eb72cc03-d4ee-4695-b0ee-676f98a7b77c tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action" status: 200 len: 24563 microversion: 2.1 time: 0.197325 Oct 06 13:23:26.794651 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2816/5634] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:26 2022] POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action => generated 24563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:23:27.455133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:27.476442 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0597520b-6f3f-4e0a-936b-4a989d37ccbf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.923590 Oct 06 13:23:27.482580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2819/5635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:26 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:28.519408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:28.520880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:28.538579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:28.541578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:28.542372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:28.543592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:28.546197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:28.547029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:28.838417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:28.854043 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd8f8f92-bf1a-4cae-9206-1ee5d2898f0f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.339988 Oct 06 13:23:28.869990 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2817/5636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:28 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:29.882817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:29.883443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:29.891088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:29.891508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:29.891964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:29.892690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:29.893157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:29.893597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:30.316687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:30.330293 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a6ce73a-3409-4218-b2b2-85dfc4863931 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.453021 Oct 06 13:23:30.330895 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2820/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:29 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:31.352528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:31.353904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:31.371015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:31.371620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:31.372275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:31.373188 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:31.373847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:31.374609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:32.122759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:32.165312 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3156370-5e99-4f43-9da5-d99628fbcafe tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.816551 Oct 06 13:23:32.179058 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2818/5638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:31 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:33.189460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:33.190984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:33.212081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:33.215224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:33.218296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:33.222953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:33.224249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:33.226378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:33.668159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:33.678087 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6cfe19c-410f-4a29-998c-2356aebf71e3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1508 microversion: 2.1 time: 0.493335 Oct 06 13:23:33.678596 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2821/5639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:33 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1508 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:34.717459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:34.718134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:34.741363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:34.743379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:34.744074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:34.746834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:34.747924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:34.748995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:34.773329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=77 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:35.458291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:35.471588 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-58102cc0-d3d8-488c-8c0a-7fa5f2749c86 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1505 microversion: 2.1 time: 0.772550 Oct 06 13:23:35.474102 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2819/5640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:34 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:36.138689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-201598a8-359f-43ce-ac1a-12ec9c526b36 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: .version_select at 0x7f7d3dee5c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1635729459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPv2MAEfFSc3rUJ/eTwkPTHW6ciipFGKQljVtL3fXsquRi9WXwTQq+cuYuY35TErWK+DBLxjbKoRyOjAPFUBmI3VgBeXS4cYsGkkWlgXTKKkePLWFAOEr1kHAmv9WEbPw=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:36.177205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-201598a8-359f-43ce-ac1a-12ec9c526b36 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:23:36.199948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-201598a8-359f-43ce-ac1a-12ec9c526b36 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:23:36.287801 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-201598a8-359f-43ce-ac1a-12ec9c526b36 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.154716 Oct 06 13:23:36.288781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2822/5641] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:23:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:23:36.495826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:36.496496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:36.520904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:36.522237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:36.524298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:36.528996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:36.529841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:36.530513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:37.588819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:37.599158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-883eb514-7898-465a-a2e8-089f54cc7f08 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1505 microversion: 2.1 time: 1.107315 Oct 06 13:23:37.600823 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2820/5642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:36 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1505 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:38.473224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06e296-aea6-4e20-b1aa-f0e7ac539527", "name": "network-vif-unplugged", "status": "completed", "tag": "87dedffd-50be-441a-8a9a-3d5cd473683f"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:38.502310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:38.503173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:38.503861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:38.510920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=60 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:38.530425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.server_external_events [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] Unable to find a host for instance fa06e296-aea6-4e20-b1aa-f0e7ac539527. Dropping event network-vif-unplugged {{(pid=129614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 13:23:38.533534 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9c39ed2d-aad8-43e4-9e14-1a7f461e70a5 req-abdf3b86-115f-4689-9ffb-963591859e1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065951 Oct 06 13:23:38.537856 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2823/5643] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 13:23:38.628814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:38.629653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:38.646069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:38.646663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:38.647686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:38.648626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:38.649375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:38.650256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:38.960246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1246399334", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "63d4272f-556b-4de5-bba4-5a7209b0bbc8"}], "key_name": "tempest-TestNetworkBasicOps-1635729459", "security_groups": [{"name": "tempest-secgroup-smoke-118396852"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:39.019943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:39.029238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6065b5e3-8a3d-4f94-a311-0a25ab5c96ff tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 200 len: 1448 microversion: 2.1 time: 0.406511 Oct 06 13:23:39.051274 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2821/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:38 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 1448 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:39.064388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:39.070252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:39.076229 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:23:39.076623 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 (ip 10.222.0.26) !!! Oct 06 13:23:39.079693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:39.080395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:39.081002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:39.084058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:39.084736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:39.085454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:39.184520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] validate_networks() for [('63d4272f-556b-4de5-bba4-5a7209b0bbc8', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:23:39.501728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:39.541114 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ba91df3-a38f-40f4-9749-96e69f267f6d tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.476955 Oct 06 13:23:39.548572 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2822/5645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:39 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:39.599662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:39.611686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:39.674889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:39.675564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:39.675912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:39.676673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:39.677132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:39.677565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.114917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:40.128165 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2914cf3d-ab6e-4a92-af7e-eef73ffde42a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.536006 Oct 06 13:23:40.128822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2823/5646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:39 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:40.154630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:40.155266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:40.165166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.165864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.166734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.167762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.168844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.169484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.323642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:23:40.324146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:23:40.324559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:23:40.324986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:23:40.325418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:23:40.350850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.355838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.357506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.358391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.358874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.360380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.408382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:23:40.416260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:23:40.430642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:23:40.433447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:23:40.508963 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-beab5bb4-0460-4116-97cf-66168ad91439 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.551566 Oct 06 13:23:40.510005 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2824/5647] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:23:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:23:40.525933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-701dd18e-26f2-44c9-9803-41d16566b704 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:40.530276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-701dd18e-26f2-44c9-9803-41d16566b704 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:40.587489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:40.610302 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c0fe11b-ff7f-4f60-b89d-bdc1e5f37e74 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.461900 Oct 06 13:23:40.611119 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2824/5648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:40 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:40.634906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:40.635586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:40.644285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.645113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.646086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.646647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-701dd18e-26f2-44c9-9803-41d16566b704 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:40.647632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.648329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.648989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:40.667196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-701dd18e-26f2-44c9-9803-41d16566b704 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1249 microversion: 2.1 time: 0.149287 Oct 06 13:23:40.670251 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2825/5649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:40 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1249 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:40.931143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:40.947921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a42ec62-a4a0-4919-ad84-900f9e754359 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.316702 Oct 06 13:23:40.948675 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2825/5650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:40 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:40.973932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:40.984531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:40.998015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:40.998825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:41.052000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Going to try to stop instance {{(pid=129614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:23:41.139817 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6651f1bf-70bb-455d-9f21-73588207b95e tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.169711 Oct 06 13:23:41.141583 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2826/5651] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:40 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:23:41.149881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:41.150510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:41.167071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:41.168328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:41.169057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:41.170204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:41.170919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:41.171554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:41.608883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:41.617766 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3dafaa4-813c-47a1-9049-51b369589f20 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.471995 Oct 06 13:23:41.633774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2826/5652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:41 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:41.706112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:41.707031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:41.727275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:41.730203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:41.731494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:41.733087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:41.736033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:41.736662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:41.992047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:42.023805 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7ac8549-8bc3-40fa-a3b3-9fe16f41ea4a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1253 microversion: 2.1 time: 0.330774 Oct 06 13:23:42.040676 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2827/5653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:41 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1253 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:42.643528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:42.644146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:42.657295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:42.657847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:42.658293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:42.666093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:42.666584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:42.667203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:43.048419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:43.053570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:43.080629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:43.081524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:43.084355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:43.085387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:43.086660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:43.087335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:43.113184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:43.126265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6888fa13-56e9-4a42-b37d-feb9b38d47e5 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.486282 Oct 06 13:23:43.135415 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2827/5654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:42 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:43.246529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:43.258854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30fdce0d-4958-40e4-956a-654d26fe7ef0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1307 microversion: 2.1 time: 0.215586 Oct 06 13:23:43.274391 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2828/5655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:43 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:44.159647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:44.160287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:44.175418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:44.176147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:44.176606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:44.177338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:44.177843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:44.178369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:44.288247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:44.290067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:44.310395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:44.311104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:44.311674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:44.312653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:44.313925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:44.314483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:44.444151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:44.454842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:44.468168 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d991927e-2306-46b6-a197-acad6729fff6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.312767 Oct 06 13:23:44.470328 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2828/5656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:44 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:44.471610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-423b40e6-f901-45c6-9684-8250bc92ad72 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1307 microversion: 2.1 time: 0.188020 Oct 06 13:23:44.472571 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2829/5657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:44 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:45.499708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:45.501528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:45.501956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:45.505295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:45.515067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:45.515938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:45.517048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:45.517941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:45.518104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:45.518797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:45.519553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:45.519807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:45.520565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:45.521222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:45.523048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:45.523514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:45.986988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:46.001828 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bc3d1320-00c4-47ab-9c93-4bc4d553b263 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.500061 Oct 06 13:23:46.016509 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2830/5658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:45 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:46.090586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:46.113429 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4be3b5fe-dae9-434b-a24b-edd38b37b7bd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.617937 Oct 06 13:23:46.126268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2829/5659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:45 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:47.027262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:47.028475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:47.038353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:47.039123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:47.039684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:47.040718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:47.041466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:47.042441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:47.090577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c925ea6-685c-4c2c-841d-169d1a77b999", "tag": "afd2489e-dd2a-47a7-982c-6feb3d0f270c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:47.108438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:47.110756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:47.111483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:47.127593 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] Creating event network-changed:afd2489e-dd2a-47a7-982c-6feb3d0f270c for instance 0c925ea6-685c-4c2c-841d-169d1a77b999 on n-h2-860556-1 Oct 06 13:23:47.137510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f7aada7d-07a0-4e1f-88f7-4ea1f3926603 req-cb79193c-cc13-4ab6-b650-cd5d740ab583 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051220 Oct 06 13:23:47.141182 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2830/5660] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:23:47.152926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:47.153647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:47.171466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:47.173666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:47.174498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:47.175712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:47.176490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:47.177147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:47.398453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:47.410751 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a8896d4-9a56-4412-8c15-95a8c99c1e90 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.387940 Oct 06 13:23:47.432398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2831/5661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:47 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:47.456992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:47.466300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e35f7e4f-b765-4e06-9c22-9d58be1430cb tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.321288 Oct 06 13:23:47.467000 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2831/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:47 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:48.439672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:48.440863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:48.447656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:48.450131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:48.450897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:48.452064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:48.453014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:48.453864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:48.454471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:48.490085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:48.491312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:48.508119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:48.508630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:48.509084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:48.509842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:48.510308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:48.510744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:49.183202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:49.191741 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c1d99e96-ad22-48ab-870d-3a38d63452d6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.706845 Oct 06 13:23:49.192341 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2832/5663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:48 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:49.218995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:49.232749 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ac10e9a-4001-4372-9b3e-1644ede150dc tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.797758 Oct 06 13:23:49.234445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2832/5664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:48 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:50.219348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:50.220622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:50.232520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:50.233029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:50.246683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:50.247668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:50.248335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:50.248944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:50.264480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:50.270317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:50.290886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:50.291565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:50.292129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:50.292972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:50.294236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:50.299122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:50.385377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:50.563757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:50.572112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85f73b05-9f9e-4bdd-b33f-29ef26b19399 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.356742 Oct 06 13:23:50.575500 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2833/5665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:50 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:50.666106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:50.951443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:50.964723 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98744c4c-3694-4d3e-832e-66e36f9ca248 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1678 microversion: 2.1 time: 0.703442 Oct 06 13:23:50.967353 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2833/5666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:50 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1678 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:51.601231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:51.602067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:51.619754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:51.625609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:51.627705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:51.628576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:51.631129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:51.631826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:51.952430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:51.968084 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64f391d8-c57a-4ece-b912-73e2d9ebed8b tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.370795 Oct 06 13:23:51.969470 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2834/5667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:51 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:51.997716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:51.999100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:52.009945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.011149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.011814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.012910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.013716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.014335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.274976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:52.287778 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-961bf3f4-00eb-4ecd-9c2f-44c77e61f0ec tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1655 microversion: 2.1 time: 0.296530 Oct 06 13:23:52.291867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2834/5668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:51 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1655 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:52.320658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:52.332976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=42 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:52.334843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.335324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.336282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.384298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Going to try to start instance {{(pid=129615) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:23:52.452700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:52.507462 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0a81cc8-1238-4d01-b3ba-05a79eeb1da3 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.191472 Oct 06 13:23:52.508405 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2835/5669] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:52 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:23:52.520126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:52.520845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:52.544379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.544925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.546591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.548127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.550923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.551956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.663246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c925ea6-685c-4c2c-841d-169d1a77b999", "name": "network-vif-plugged", "status": "completed", "tag": "afd2489e-dd2a-47a7-982c-6feb3d0f270c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:52.704166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:52.719044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:52.722338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:52.751414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] Creating event network-vif-plugged:afd2489e-dd2a-47a7-982c-6feb3d0f270c for instance 0c925ea6-685c-4c2c-841d-169d1a77b999 on n-h2-860556-1 Oct 06 13:23:52.762483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c86fa785-d183-4ed4-a026-b961e4d1e879 req-6d01d0a8-81ca-4a7b-999c-cb94f8b821fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103767 Oct 06 13:23:52.766894 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2836/5670] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:23:52.843321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:52.854202 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67cc2aaa-359b-47bb-8743-4744fac322d2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1664 microversion: 2.1 time: 0.340449 Oct 06 13:23:52.855191 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2835/5671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:52 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1664 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:52.994322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:52.995055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:53.008603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:53.009364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:53.010036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:53.010978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:53.014914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:53.015614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:53.409392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:53.434781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d4b92b0-4296-4b38-a5c7-920e080988e1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.445233 Oct 06 13:23:53.436362 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2837/5672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:52 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:53.880325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:53.880951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:53.914309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:53.914818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:53.927425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:53.928610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:53.929434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:53.929878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:54.149216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:54.162046 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b4a131f5-d133-48d6-8072-820bc67f0f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1664 microversion: 2.1 time: 0.287201 Oct 06 13:23:54.165935 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2836/5673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:53 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1664 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:54.461152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:54.462936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:54.478583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:54.479300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:54.479965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:54.480698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:54.483134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:54.483593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:54.768901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:54.777970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5afae398-43ae-4c56-8f3f-2a1b3d17abd9 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1374 microversion: 2.1 time: 0.322050 Oct 06 13:23:54.788051 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2838/5674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:54 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1374 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:55.188289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:55.189532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:55.196980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:55.197523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:55.198010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:55.198745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:55.199218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:55.199659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:55.373271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:55.385239 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5a5d294-cbba-4003-89d7-fcd1cf7d0593 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1664 microversion: 2.1 time: 0.200898 Oct 06 13:23:55.398543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2837/5675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:55 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1664 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:55.804451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:55.805989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:55.814977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:55.815731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:55.816397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:55.817803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:55.818484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:55.819129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.046535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:56.072481 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92532de9-06a7-4d50-87e0-c81d41c5cbe2 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1545 microversion: 2.1 time: 0.271996 Oct 06 13:23:56.090376 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2839/5676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:55 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1545 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:56.100972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:56.102036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:56.110693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.111292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.111911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.113236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.113776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.114441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.370039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:56.380483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d2fe50e-c4d2-490d-a856-a2320f104702 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1545 microversion: 2.1 time: 0.284992 Oct 06 13:23:56.381354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2838/5677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:56 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1545 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:56.419839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:56.420324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:56.430231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.431454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.432096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.434145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.435027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.435735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.851399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:56.872734 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61f9fa7a-5ca5-4336-a38c-bef804a9c779 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.460790 Oct 06 13:23:56.876374 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2840/5678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:56 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:56.908651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:56.909546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:56.916932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.917464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.918490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:56.919411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:56.919878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:56.920357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.140446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:57.152680 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97cc79b6-84bc-40d3-91e0-8c024909f3a2 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.249274 Oct 06 13:23:57.155097 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2839/5679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:56 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:57.185622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:57.186605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:57.194523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.195259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.195935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.196953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.197419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.198366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.280168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:57.281662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:57.298417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.299850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.300885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.302805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.303325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.303762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.460721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:57.480615 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-877dccb7-526a-46db-98fe-8c7c59c60909 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.300568 Oct 06 13:23:57.497601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2841/5680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:57 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:57.508958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:57.509589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:57.523097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.523611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.524055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.524778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.525239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.529858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.531981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:57.540171 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20e70d28-026c-43e9-8907-184a1db429f9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1680 microversion: 2.1 time: 0.266783 Oct 06 13:23:57.545908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2840/5681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:57 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:23:57.745976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:57.751028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:57.761751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:57.770626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5d0ca7ea-1173-4885-8381-262015c703e8 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.265318 Oct 06 13:23:57.771856 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2842/5682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:57 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:57.783383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.783916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.789636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.791467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.791962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.792438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.799699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:23:57.802818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:57.808918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:57.820736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.821239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.821929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.823293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:57.824728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:57.826569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:57.880630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0fbfdd0d-13f0-4730-8412-2fa5454042b1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action" status: 200 len: 32634 microversion: 2.1 time: 0.138475 Oct 06 13:23:57.881977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2841/5683] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:57 2022] POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action => generated 32634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:23:58.084363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:58.085127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:58.094494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.095305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.095952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.096863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.097499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.098142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.151430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:58.159875 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ee02ae50-a67e-4007-b13a-750649ec5942 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.362949 Oct 06 13:23:58.163251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2843/5684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:57 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:58.191504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:58.193837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:58.205551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.208390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.209027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.209968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.212190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.214470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.275127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lazy-loading 'flavor' on Instance uuid a05f8a56-ed27-431e-ac0a-48b0812b4ab5 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:23:58.411730 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2fe8864e-ab66-4980-a9c6-90e1db663cdd tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1831 microversion: 2.1 time: 0.329965 Oct 06 13:23:58.412838 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2842/5685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:58 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1831 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:23:58.448435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e244c284-7ced-4d9a-87a8-12356c052eb4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.262914 Oct 06 13:23:58.451842 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2844/5686] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:58 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:23:58.452728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:23:58.456825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:58.466345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:23:58.468059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:23:58.479266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.479910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.480788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.481431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.482490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.483173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.484213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.484664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:23:58.485191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.485454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:23:58.486135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.488166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:23:58.590283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lazy-loading 'flavor' on Instance uuid c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:23:58.614490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Going to try to live migrate instance to another host {{(pid=129614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 06 13:23:58.969629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:23:58.986877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c9eec22-8fbd-4baa-a063-37b66a4f2d1a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1676 microversion: 2.1 time: 0.529766 Oct 06 13:23:58.989946 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2845/5687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:23:58 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1676 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:00.014162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:00.015513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:00.026769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:00.032330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:00.033338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:00.041726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:00.043698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:00.044393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:00.661581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:00.694995 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d69e12c-3b4e-4b2e-a298-b475fa43f165 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1659 microversion: 2.1 time: 0.682102 Oct 06 13:24:00.710378 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2846/5688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:00 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1659 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:00.757015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:00.759027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:00.782382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:00.785725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:00.786777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:00.791439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:00.792256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:00.793151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:01.024186 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eccbe3a7-c01f-4148-8f86-c8dca8947f2f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.295630 Oct 06 13:24:01.039584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2847/5689] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:24:00 2022] POST /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:24:01.055247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:01.056349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:01.081196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:01.085164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:01.087199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:01.088162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:01.101562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:01.102390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:01.366996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:01.386966 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0dee9b5a-1d15-4f9a-9961-4fc62f39cf24 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1665 microversion: 2.1 time: 0.345640 Oct 06 13:24:01.388289 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2848/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:01 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1665 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:02.425350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:02.426150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:02.451010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:02.451537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:02.451978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:02.452709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:02.455068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:02.455311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:02.849691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:02.860653 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f4ef1db-0bdd-4cf5-ab5a-236d8af732ba tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1665 microversion: 2.1 time: 0.447714 Oct 06 13:24:02.862484 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2849/5691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:02 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1665 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:03.667536 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c2f5e7cc-0df8-48de-981e-a141007c3560 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action" status: 202 len: 0 microversion: 2.1 time: 5.219835 Oct 06 13:24:03.669475 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2843/5692] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:23:58 2022] POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action => generated 0 bytes in 5223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:24:03.679818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:03.681121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:03.706564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:03.707841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:03.708491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:03.716497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:03.719404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:03.740452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:03.814596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:03.887610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:03.888406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:03.907790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:03.908317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:03.910844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:03.911623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:03.912109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:03.913626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:04.173421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:04.201404 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0482108-46cd-49e9-97bc-dd09bad2565e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.526687 Oct 06 13:24:04.204442 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2850/5693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:03 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:04.511487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:04.531474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4409201-0dd7-46d3-9707-9aa636784de6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1665 microversion: 2.1 time: 0.647733 Oct 06 13:24:04.538921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2844/5694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:03 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1665 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:24:05.231536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:05.232176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:05.246446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:05.246897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:05.247332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:05.248166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:05.248515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:05.248955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:05.558791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:05.559426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:05.576512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:05.577026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:05.577485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:05.578791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:05.579375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:05.579825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:05.704917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:05.722943 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1505ab93-a216-41cb-a3ed-1135b9ebe8f7 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.495873 Oct 06 13:24:05.732723 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2851/5695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:05 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:06.000626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:06.014294 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0c20cd87-75e8-4f1a-a4f6-603ab56a7ecf tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1665 microversion: 2.1 time: 0.459243 Oct 06 13:24:06.032250 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2845/5696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:05 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1665 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:06.748152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:06.749096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:06.778855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:06.779387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:06.779842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:06.780586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:06.781059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:06.801137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:07.066690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:07.067439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:07.088275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:07.088788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:07.101257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:07.102216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:07.103617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:07.106477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:07.267002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:07.286040 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2ea1ad1-23a0-4219-8132-d3586795469e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.542394 Oct 06 13:24:07.290049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2852/5697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:06 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:07.472804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:07.509774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:07.510287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:07.519028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:07.611477 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] Creating event network-vif-unplugged:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h2-860556-1 Oct 06 13:24:07.627725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4c7c6b27-4c9c-4d71-9dca-2b1292b33bb8 req-12d187c0-c2d9-4af4-8769-4d74777e2b6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155947 Oct 06 13:24:07.628658 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2853/5698] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:24:07.678564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:07.737387 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25b85c7b-60ba-4bfe-8860-80272a3bab5a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.696122 Oct 06 13:24:07.738275 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2846/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:07 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:07.766558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:07.767386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:07.790638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:07.794102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:07.796047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:07.805144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:07.810756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:07.813051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:08.188441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:08.239236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-083bef28-b1f0-46ba-86e0-4d81420356c4 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1668 microversion: 2.1 time: 0.478174 Oct 06 13:24:08.240115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2854/5700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:07 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1668 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:08.266199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:08.267629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:08.276179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:08.277525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:08.278312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:08.279332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:08.280078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:08.280765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:08.317156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:08.318088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:08.331640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:08.334237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:08.334757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:08.335189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:08.335925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:08.336394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:08.336831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:08.361497 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Working on deleting snapshot 1e44d9c6-716a-45e5-85e6-6d0c6302990c from shelved instance... Oct 06 13:24:08.698922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:08.712522 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9ff3f952-41f3-46c6-8e2e-7aa2a58b465e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.398146 Oct 06 13:24:08.715285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2855/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:08 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:09.737304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:09.764220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Doing local delete in cell ff6b8823-9a07-4510-8f08-d09c3334b0d8(cell1) {{(pid=129614) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 06 13:24:09.766484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:09.767187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:09.767844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:09.768488 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 06 13:24:09.773768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] deallocate_for_instance() {{(pid=129614) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 06 13:24:09.774893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:09.775734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:09.776197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:09.791012 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] Creating event network-changed:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h2-860556-1 Oct 06 13:24:09.800541 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ab54ce79-59a6-4f65-815b-aac8c4bccd79 req-58da4a7c-0a16-4b2f-845c-c09b860882e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077756 Oct 06 13:24:09.806479 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2856/5702] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:09.818113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:09.819044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:09.826544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:09.829319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:09.830254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:09.831252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:09.832600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:09.834283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:10.309019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:10.319804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a81b63bb-ecbb-4346-a71f-38d69c522a1e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.508994 Oct 06 13:24:10.320401 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2857/5703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:09 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:11.343252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:11.344654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:11.356397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:11.359023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:11.359725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:11.368151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:11.369769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:11.370271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:11.785770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Updating instance_info_cache with network_info: [] {{(pid=129614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 06 13:24:12.153671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:12.170050 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fccb9114-ef3e-47d3-bd47-b0bec1852d85 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.830518 Oct 06 13:24:12.170675 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2858/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:11 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:24:12.216574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06e296-aea6-4e20-b1aa-f0e7ac539527", "name": "network-vif-deleted", "tag": "87dedffd-50be-441a-8a9a-3d5cd473683f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:12.252903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.255500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.256148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.270277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.compute.server_external_events [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] Unable to find a host for instance fa06e296-aea6-4e20-b1aa-f0e7ac539527. Dropping event network-vif-deleted {{(pid=129615) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 13:24:12.271507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8be9a7b9-b3ef-458a-b6af-dc8b88468fe6 req-23fcc053-5a53-4e2b-b706-b2d8dae0f854 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.073896 Oct 06 13:24:12.273413 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2859/5705] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 13:24:12.305068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e5d0334-f064-4f13-9a46-8cb9bc153f50 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 204 len: 0 microversion: 2.1 time: 4.039761 Oct 06 13:24:12.308964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2847/5706] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:08 2022] DELETE /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 0 bytes in 4045 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:12.315913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:12.316493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: fa06e296-aea6-4e20-b1aa-f0e7ac539527] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:12.326181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.326969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.327643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.328887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.329566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.330178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.347349 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 HTTP/1.1 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'fa06e296-aea6-4e20-b1aa-f0e7ac539527'} Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:12.349986 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. Oct 06 13:24:12.353936 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:12.355724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 404 to user: Instance fa06e296-aea6-4e20-b1aa-f0e7ac539527 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:12.357054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0e785ce-b299-40cd-b691-bcf10d4c9646 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527" status: 404 len: 111 microversion: 2.1 time: 0.046641 Oct 06 13:24:12.358141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2860/5707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:12 2022] GET /compute/v2.1/servers/fa06e296-aea6-4e20-b1aa-f0e7ac539527 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:12.367226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:12.368178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:12.376887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.377833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.378998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.380134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.381281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.381946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.458395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:12.536257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=19,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:12.587041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1656096-9267-4c46-80d9-c2762cc96125 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 204 len: 0 microversion: 2.1 time: 0.222593 Oct 06 13:24:12.588087 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2848/5708] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:12 2022] DELETE /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:12.597637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:12.598532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:12.616489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.618059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.618888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.620413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:12.621378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:12.622493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:12.791436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:12.799889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c73adf3-a60a-43a0-8520-af94a2ddf215 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1464 microversion: 2.1 time: 0.207530 Oct 06 13:24:12.800464 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2861/5709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:12 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:13.204279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:13.205211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:13.221141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:13.221885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:13.223367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:13.224404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:13.226147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:13.227850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:13.571792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:13.581277 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9209c90d-914c-424f-ae3a-bef9a9644037 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.381901 Oct 06 13:24:13.582114 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2849/5710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:13 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:13.828356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:13.830284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:13.850184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:13.852838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:13.853468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:13.854393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:13.860694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:13.862440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:14.079480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:14.089049 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ac0f458-e18a-4d1b-b354-c4ebadccb977 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1464 microversion: 2.1 time: 0.265379 Oct 06 13:24:14.104485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2862/5711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:13 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1464 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:14.608406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:14.613085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:14.630478 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:14.631323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:14.647151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:14.648053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:14.659674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:14.660399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:14.998200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:15.020646 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd58cd93-8d80-4237-860a-49c16fc0ed01 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.409821 Oct 06 13:24:15.020646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2850/5712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:14 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:15.114228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:15.115000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:15.129405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:15.130964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:15.133045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:15.134972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:15.136180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:15.137835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:15.377989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:15.388179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81ac59af-caae-4b69-8468-ca203d02e00f tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1464 microversion: 2.1 time: 0.279798 Oct 06 13:24:15.389621 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2863/5713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:15 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:16.051654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:16.054633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:16.089209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.089719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.090200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.090935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.091402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.104236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.313703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3ea6d9-0b99-4de2-8769-85de29c22f54", "name": "network-vif-deleted", "tag": "dae05366-49fe-48e9-80ab-946c9b5c59be"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:16.371726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.374282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.377154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.424657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] Creating event network-vif-deleted:dae05366-49fe-48e9-80ab-946c9b5c59be for instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 on n-h1-860556-1 Oct 06 13:24:16.450042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fbeae57d-e8c6-4f1d-a5d9-ef221f95deb0 req-80be99e5-c501-4872-8b19-24ec8a11877e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142288 Oct 06 13:24:16.453164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2864/5714] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:16.475099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:16.478807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:16.505263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.510444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.511220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.512374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.518812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.519571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.676102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:16.680004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:16.680526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:16.681016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lazy-loading 'fault' on Instance uuid 0d3ea6d9-0b99-4de2-8769-85de29c22f54 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:24:16.712600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:16.733165 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b4c0366-013a-4374-8118-5fe4ef501a49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.687506 Oct 06 13:24:16.742654 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2851/5715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:16 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:16.906687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:16.920613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-551bf75a-70e4-45b2-a4f1-5d7d8280ec76 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 200 len: 1304 microversion: 2.1 time: 0.462271 Oct 06 13:24:16.922494 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2865/5716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:16 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 1304 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:17.768765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:17.769857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:17.780158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:17.780667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:17.781694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:17.787423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:17.788309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:17.789587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:17.950334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:17.950966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: 0d3ea6d9-0b99-4de2-8769-85de29c22f54] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:17.964443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:17.964970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:17.965560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:17.967985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:17.971466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:17.973309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:18.003175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 HTTP/1.1 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0d3ea6d9-0b99-4de2-8769-85de29c22f54'} Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:18.005147 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. Oct 06 13:24:18.008708 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:18.010857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 404 to user: Instance 0d3ea6d9-0b99-4de2-8769-85de29c22f54 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:18.012632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9d01e78-df60-420e-b87c-f900de8beebd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54" status: 404 len: 111 microversion: 2.1 time: 0.067972 Oct 06 13:24:18.013850 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2866/5717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:17 2022] GET /compute/v2.1/servers/0d3ea6d9-0b99-4de2-8769-85de29c22f54 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:18.042505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:18.044497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:18.064466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:18.065179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:18.065807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:18.067677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:18.068494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:18.072757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:18.146015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:18.264140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:18.283656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7bfe00ab-ad28-4f08-9258-d11609ed0156 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.519557 Oct 06 13:24:18.291516 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2852/5718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:17 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:18.346009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-03f01221-b5c3-46b1-9231-6ff9138b8095 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 204 len: 0 microversion: 2.1 time: 0.324662 Oct 06 13:24:18.359554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:18.361064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:18.365721 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2867/5719] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:18 2022] DELETE /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:18.370142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:18.371305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:18.372317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:18.373775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:18.377409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:18.378262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:18.745822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:18.760088 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-af0ad291-4790-44f0-b118-eb375c70d221 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1506 microversion: 2.1 time: 0.405491 Oct 06 13:24:18.761047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2853/5720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:18 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:19.313540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:19.321219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:19.343647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:19.344510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:19.345206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:19.346216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:19.347410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:19.348510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:19.791962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:19.792680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:19.799978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:19.802283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:19.803452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:19.804582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:19.808013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:19.810422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:19.811076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:19.879602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:19.889397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:19.893112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47d41515-26c7-4c2f-aede-ee8b3802f593 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1690 microversion: 2.1 time: 0.587844 Oct 06 13:24:19.894926 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2868/5721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:19 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1690 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:20.050557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:20.061250 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78e587a7-7fc3-48ae-9171-a504efec6762 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1506 microversion: 2.1 time: 0.276242 Oct 06 13:24:20.082234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2854/5722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:19 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:20.923915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:20.924764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:20.934939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:20.935503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:20.936201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:20.970909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:20.971735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:20.972364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.089035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:21.090527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:21.105177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.106148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.108169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.110095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.110957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.112271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.230596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:21.247405 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b31302f-3ba2-4592-8a53-536136473b14 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1464 microversion: 2.1 time: 0.162097 Oct 06 13:24:21.249100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:21.258526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3636193f-1be0-4a4e-9c82-de4cfccb8172 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1680 microversion: 2.1 time: 0.340113 Oct 06 13:24:21.259860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2869/5723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:20 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1680 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:21.282318 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2855/5724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:21 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:24:21.289172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:21.290214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:21.297506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.298104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.298619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.299393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.300087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.300594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.491607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fecb33-58e6-48d2-81f4-c7e923a00f79", "name": "network-vif-deleted", "tag": "1ce018de-e448-45cf-bf1b-9fc8128014c0"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:21.547006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.549557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.550134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.590312 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] Creating event network-vif-deleted:1ce018de-e448-45cf-bf1b-9fc8128014c0 for instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 on n-h2-860556-1 Oct 06 13:24:21.617062 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-19f64b21-2b0e-4a47-8ddd-f604609d93f4 req-18224e57-c407-4c57-976b-0c780d20a015 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130126 Oct 06 13:24:21.619354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2856/5725] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:21.698031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e317f753-300e-44f0-a2d8-13777fd13105 tempest-TestNetworkAdvancedServerOps-839720290 tempest-TestNetworkAdvancedServerOps-839720290-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1831 microversion: 2.1 time: 0.414619 Oct 06 13:24:21.699164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2870/5726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:21 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1831 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:21.726122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:21.726891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:21.782406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.796228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.797577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:21.801027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:21.803734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:21.804317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.163612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:22.185865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ee49c89-721b-4c05-8bdd-a06b0bc8daa2 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1680 microversion: 2.1 time: 0.465461 Oct 06 13:24:22.187238 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2857/5727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:21 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1680 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:22.300532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:22.303091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:22.328781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:22.329995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:22.331449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.341104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:22.344343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:22.345465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.423733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:22.427375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:22.456698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:22.459907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:22.460510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.461367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:22.462571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:22.463184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:22.463902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.465912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:22.466634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:22.467451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:22.468137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lazy-loading 'fault' on Instance uuid c3fecb33-58e6-48d2-81f4-c7e923a00f79 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:24:22.615015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:22.623306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2b5df36-90e5-4f2a-a145-71026f8d9bb7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 200 len: 1304 microversion: 2.1 time: 0.330881 Oct 06 13:24:22.635005 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2871/5728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:22 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:24:22.659935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae0656c5-bc00-4547-85a3-648dcddf4f68 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action" status: 200 len: 38719 microversion: 2.1 time: 0.237319 Oct 06 13:24:22.663427 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2858/5729] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:24:22 2022] POST /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4/action => generated 38719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:24:23.661601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:23.663074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: c3fecb33-58e6-48d2-81f4-c7e923a00f79] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:23.672569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:23.673602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:23.677572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:23.678722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:23.679365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:23.686573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:23.722379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 HTTP/1.1 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c3fecb33-58e6-48d2-81f4-c7e923a00f79'} Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:23.732185 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. Oct 06 13:24:23.737595 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:23.739893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 404 to user: Instance c3fecb33-58e6-48d2-81f4-c7e923a00f79 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:23.741288 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6a9bcba9-1ef5-4c2c-933e-541efea291ae tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79" status: 404 len: 111 microversion: 2.1 time: 0.084289 Oct 06 13:24:23.743160 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2872/5730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:23 2022] GET /compute/v2.1/servers/c3fecb33-58e6-48d2-81f4-c7e923a00f79 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:23.754444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:23.771217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:23.826782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:23.827474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:23.828627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:23.829529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:23.830195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:23.830959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:23.876856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:24.163844 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-383eb7e7-693f-48fd-8f53-1f15a2490bbd tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 204 len: 0 microversion: 2.1 time: 0.415862 Oct 06 13:24:24.165900 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2859/5731] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:23 2022] DELETE /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:24:24.185601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:24.186486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:24.200340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:24.201348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:24.202019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:24.203586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:24.204414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:24.205195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:24.491541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:24.504926 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c7bce5a5-b6b0-473a-9619-e9c024f7261a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1492 microversion: 2.1 time: 0.334054 Oct 06 13:24:24.510149 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2873/5732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:24 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1492 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:24.771877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:24.776858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:24.777848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:24.802656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:24.803390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:24.804964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:24.805455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:24.810355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:24.818492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:24.819702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:24.820413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:24.821949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:24.840897 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] Creating event network-changed:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h1-860556-1 Oct 06 13:24:24.855575 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fc2cbff5-38d0-485f-84e4-aec76c05beec req-149d7a59-fe1a-42f6-a22d-7cd88a8b8bfc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086153 Oct 06 13:24:24.862421 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2874/5733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:24.881632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:25.031185 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70f806a7-b823-46e3-8c9e-6d61819ebb49 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 204 len: 0 microversion: 2.1 time: 0.264166 Oct 06 13:24:25.032057 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2860/5734] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:24 2022] DELETE /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:25.044951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:25.046279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:25.061208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:25.061926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:25.070213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:25.071459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:25.072050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:25.072602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:25.358310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:25.370937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-252724e3-2ce8-45f6-b7f6-78ea7d6f8952 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1686 microversion: 2.1 time: 0.331588 Oct 06 13:24:25.371921 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2875/5735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:25 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1686 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:25.530050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:25.531331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:25.547455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:25.548667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:25.549227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:25.550843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:25.551554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:25.552225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:25.726421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:25.752460 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60369746-cc64-4f09-80a9-8fada48ade21 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1450 microversion: 2.1 time: 0.215303 Oct 06 13:24:25.782225 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2861/5736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:25 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1450 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:26.212966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a728a6dd-9eb6-4889-a237-3d5b45792dd7", "name": "network-vif-deleted", "tag": "5fa31be8-7444-466d-9f40-075820337863"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:26.264177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.269012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.270357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.357537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] Creating event network-vif-deleted:5fa31be8-7444-466d-9f40-075820337863 for instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 on n-h1-860556-1 Oct 06 13:24:26.373611 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-505f18f5-d299-45b1-ac87-610a405a97f6 req-b0816a92-edf2-4610-82a7-f11b1fafa841 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167851 Oct 06 13:24:26.374713 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2876/5737] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:26.399522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:26.400154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:26.410429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.411313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.411932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.413110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.413753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.414476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.780086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:26.781311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:26.820371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.824232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.825112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.826031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.827589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.828170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.962901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:26.963565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:26.967445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:26.968168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lazy-loading 'fault' on Instance uuid a728a6dd-9eb6-4889-a237-3d5b45792dd7 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:24:27.405681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:27.416825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-acfa9009-eff1-4c9b-9b3b-8d2033914769 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 200 len: 1304 microversion: 2.1 time: 0.639679 Oct 06 13:24:27.419534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2877/5738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:26 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 1304 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:27.741694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:27.744665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ad4f90-b708-4441-b8e5-7a1b9465d1f4", "name": "network-vif-deleted", "tag": "d004adcd-27ff-4d56-9d41-de1519e98a73"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:27.749393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:27.757687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c1fff70-0f12-4c66-8ac9-6f5e2d2cfb4e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 200 len: 1686 microversion: 2.1 time: 1.357530 Oct 06 13:24:27.759000 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2862/5739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:26 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 1686 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:27.789672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:27.790205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:27.790652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:27.837801 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] Creating event network-vif-deleted:d004adcd-27ff-4d56-9d41-de1519e98a73 for instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 on n-h1-860556-1 Oct 06 13:24:27.844148 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-554784e6-a377-40d4-8d11-2fb7a4937836 req-f5564ba6-e12f-4e6d-a91e-34bf20b27ad2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103086 Oct 06 13:24:27.845154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2878/5740] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:24:28.454084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:28.454905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a728a6dd-9eb6-4889-a237-3d5b45792dd7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:28.468366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.471773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.475057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.476601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.477350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.477989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.503463 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 HTTP/1.1 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a728a6dd-9eb6-4889-a237-3d5b45792dd7'} Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:28.506100 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. Oct 06 13:24:28.509314 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.510721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 404 to user: Instance a728a6dd-9eb6-4889-a237-3d5b45792dd7 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:28.511869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3611ee0-5a39-4938-af8b-24744405e9f6 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7" status: 404 len: 111 microversion: 2.1 time: 0.071464 Oct 06 13:24:28.512926 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2863/5741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:28 2022] GET /compute/v2.1/servers/a728a6dd-9eb6-4889-a237-3d5b45792dd7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:28.523132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:28.524772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:28.537099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.538263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.539143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.541455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.542714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.545477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.596041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:28.758442 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5e8ae707-e8cb-4fbe-acaa-714aa5c6db16 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 204 len: 0 microversion: 2.1 time: 0.240351 Oct 06 13:24:28.759376 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2879/5742] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:28 2022] DELETE /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:28.772476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:28.772476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:28.778648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.779170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.780285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.780443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.781378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.788875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:28.789985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: c0ad4f90-b708-4441-b8e5-7a1b9465d1f4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:28.798837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.830707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.831131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.832880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.833617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:28.834128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:28.834566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:28.865315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] HTTP exception thrown: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Request method failure captured: Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 HTTP/1.1 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtTsmOb2IHtwihdePXyfADQfkW9MCVUqYnyuz55PDdEtUaJQHgtSHH1_d8Z95Vl8OkADR1orN1ChZVgXm5fYPEFANxDrcd2eU6OpZ3BhqaqbU1zbg54exJX19aCxF02OkzSa-vYBp6RoWERABvtnoIm_4o1tDTtzLFkehLLNw1Jr3_c Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ed3a75f24b140e5879c48dba0eda9cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}] Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4b277518fc7b4784ba547a15bdcf3d54 Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c0ad4f90-b708-4441-b8e5-7a1b9465d1f4'} Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.867953 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Returning 404 to user: Instance c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:28.871132 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fa8a4f4-8066-408f-b466-490472d5d9ea tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4" status: 404 len: 111 microversion: 2.1 time: 0.086384 Oct 06 13:24:28.874016 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2880/5743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:28 2022] GET /compute/v2.1/servers/c0ad4f90-b708-4441-b8e5-7a1b9465d1f4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:29.169068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:29.179927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d63a2fe1-2f38-4019-9631-4dbf20efe3d7 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1674 microversion: 2.1 time: 0.416229 Oct 06 13:24:29.181130 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2864/5744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:28 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1674 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:30.212776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:30.214757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:30.232390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:30.233164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:30.234681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:30.237541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:30.240580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:30.241676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:30.696749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:30.727868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23c1ce9e-042a-40ac-b3c6-1bfecf119284 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1674 microversion: 2.1 time: 0.524481 Oct 06 13:24:30.732404 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2881/5745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:30 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1674 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:31.760013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:31.761235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:31.777762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:31.781017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:31.781689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:31.784200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:31.787829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:31.788571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:32.397156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:32.422297 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-468cc694-2c8f-4ba2-ab89-c291e925640c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1674 microversion: 2.1 time: 0.668859 Oct 06 13:24:32.424503 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2865/5746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:31 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1674 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:33.452703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:33.453261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:33.476088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:33.480975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:33.489721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:33.491840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:33.492357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:33.497213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:33.804047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:33.824958 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e8b0dae-d7dc-46b8-be1d-49ba1a6e0d8a tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1606 microversion: 2.1 time: 0.377028 Oct 06 13:24:33.826055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2882/5747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:33 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1606 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:34.854676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:34.855314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:34.876225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:34.876989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:34.878882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:34.881720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:34.882601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:34.883488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:35.742415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f8a56-ed27-431e-ac0a-48b0812b4ab5", "name": "network-vif-deleted", "tag": "a56b4312-1fa2-46e1-bc62-16a8566d8402"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:35.849250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:35.851128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:35.851593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:35.876821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7490cf4b3ec842b291c38efdf91a37ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2758cc0f71547f0a57642b4d91e62d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:35.901174 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] Creating event network-vif-deleted:a56b4312-1fa2-46e1-bc62-16a8566d8402 for instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 on n-h2-860556-1 Oct 06 13:24:35.902074 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e816b46-16bd-4e18-a599-4654d54f3468 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 200 len: 1606 microversion: 2.1 time: 1.044529 Oct 06 13:24:35.917763 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2866/5748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:34 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 1606 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:35.926560 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0da8a417-cbfa-4dd2-b221-e78d6d43c176 req-1cd7cb33-7190-4638-b6fe-73a7fa319532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185558 Oct 06 13:24:35.929289 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2883/5749] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:24:36.939436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:36.940728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] [instance: a05f8a56-ed27-431e-ac0a-48b0812b4ab5] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:36.960271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:36.966831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:36.968140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:36.977396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:36.979549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:36.981099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:37.033181 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] HTTP exception thrown: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Request method failure captured: Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 HTTP/1.1 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtSOqES2DmnIvFHi7rEW-uGezfiUZ-Vqg-TzC5I-PkyKu9pAb7nfJg4Z4LOxTqoJYALvCO3yc5Iu9RrnR4DN62y4ttaYCIHhAFlCl2wUhQlAApldtRDrPHJDRK7yg6dzt3AZZt3NcRLRsXXsWBrwdMMuIrGim7Rq7oQ5Sk_-2IovkXI Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2758cc0f71547f0a57642b4d91e62d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2758cc0f71547f0a57642b4d91e62d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2758cc0f71547f0a57642b4d91e62d1"}]}] Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: e2758cc0f71547f0a57642b4d91e62d1 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-116116283 Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 7490cf4b3ec842b291c38efdf91a37ae Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-116116283-project Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a05f8a56-ed27-431e-ac0a-48b0812b4ab5'} Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:37.036814 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. Oct 06 13:24:37.040668 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:37.043736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Returning 404 to user: Instance a05f8a56-ed27-431e-ac0a-48b0812b4ab5 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:37.050022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35e840e1-d0c0-4f11-8137-62425f76cc9c tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5" status: 404 len: 111 microversion: 2.1 time: 0.119318 Oct 06 13:24:37.051187 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2867/5750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:36 2022] GET /compute/v2.1/servers/a05f8a56-ed27-431e-ac0a-48b0812b4ab5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:37.064701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24ffc14a-b775-4580-8483-f3aea61c0749 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] Calling method '.version_select at 0x7f7d3e54d310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:37.144034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24ffc14a-b775-4580-8483-f3aea61c0749 tempest-ServerActionsTestJSON-116116283 tempest-ServerActionsTestJSON-116116283-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102683087" status: 202 len: 0 microversion: 2.1 time: 0.085874 Oct 06 13:24:37.146626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2884/5751] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:24:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102683087 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:24:40.771037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:40.771679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:40.786866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:40.794150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31d4e827-d8d6-40b6-9164-01e2c456d5c1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '.version_select at 0x7f7d47677b80>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:40.806927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:40.808496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:40.809391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:40.817126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:40.821150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:40.876221 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31d4e827-d8d6-40b6-9164-01e2c456d5c1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40940457" status: 202 len: 0 microversion: 2.1 time: 0.080703 Oct 06 13:24:40.878498 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2885/5752] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Oct 6 13:24:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40940457 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:24:40.912560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-757cccd2-4f75-4571-88e1-0b2dc84f58f5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: .version_select at 0x7f7d47677280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-172437271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMk1w7e2IhZ3bfTpkCvdEPG+yZwjNslOZGHEeKsI51tPlNUMClq0/QJGg46PF736xAn3zXyRsVWiadC/LqDJwDyy4zA/4Q8KnyGquDgWDcA819oRoTiyNA0cAfp4pJZaA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:40.948471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:41.008069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-757cccd2-4f75-4571-88e1-0b2dc84f58f5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:24:41.040535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-757cccd2-4f75-4571-88e1-0b2dc84f58f5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:24:41.178300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-757cccd2-4f75-4571-88e1-0b2dc84f58f5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.268281 Oct 06 13:24:41.179093 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2886/5753] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:24:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:24:41.218657 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99b36e15-421b-452d-bcb4-c63e2cda0845 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 204 len: 0 microversion: 2.1 time: 0.454336 Oct 06 13:24:41.226301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2868/5754] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:40 2022] DELETE /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:41.233411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:41.234195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:41.252819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:41.259625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:41.259954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:41.260753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:41.264728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:41.265865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:41.771204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:41.804799 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-873732b0-44ee-4fc4-b95e-0197ae5de912 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1551 microversion: 2.1 time: 0.576220 Oct 06 13:24:41.817725 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2887/5755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:41 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1551 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:42.855822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:42.856620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:42.877119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:42.877939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:42.879562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:42.880517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:42.886651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:42.887245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:43.726268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:43.736575 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91302ad7-a22c-43de-8877-723ec793f0e4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1551 microversion: 2.1 time: 0.885214 Oct 06 13:24:43.744953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2869/5756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:42 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1551 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:24:44.775037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:44.775627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:44.793265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:44.794439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:44.795073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:44.799182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:44.799970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:44.801007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:44.980960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:44.996160 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13e1750e-801e-4cc6-bb25-e6f7e6746dd6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1484 microversion: 2.1 time: 0.226263 Oct 06 13:24:45.024185 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2888/5757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:44 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1484 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:45.229524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c925ea6-685c-4c2c-841d-169d1a77b999", "name": "network-vif-deleted", "tag": "afd2489e-dd2a-47a7-982c-6feb3d0f270c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:45.245468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:45.254414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:45.255649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:45.281705 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] Creating event network-vif-deleted:afd2489e-dd2a-47a7-982c-6feb3d0f270c for instance 0c925ea6-685c-4c2c-841d-169d1a77b999 on n-h2-860556-1 Oct 06 13:24:45.300665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a601d8d7-4cf7-497a-8aa9-80748621fbff req-a874e742-c621-4a6f-b063-ff30d6f77a6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101194 Oct 06 13:24:45.310270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2870/5758] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:46.033649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:46.034718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:46.050708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:46.052418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:46.056420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:46.057530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:46.059034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:46.060095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:46.183153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:46.184110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:46.187018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:46.188428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lazy-loading 'fault' on Instance uuid 0c925ea6-685c-4c2c-841d-169d1a77b999 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:24:46.366236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:46.368612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:46.385474 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2828508c-de28-48a0-9749-eced366006cd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 200 len: 1339 microversion: 2.1 time: 0.354529 Oct 06 13:24:46.386612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2889/5759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:46 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 1339 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:47.417578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:47.418370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 0c925ea6-685c-4c2c-841d-169d1a77b999] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:47.443582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:47.444137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:47.445107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:47.449495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:47.450168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:47.450509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:47.499391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] HTTP exception thrown: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Request method failure captured: Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 HTTP/1.1 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtZ-yFT9sRqDdK3KezJ6h5zB3FFK0L9MFV8CLlmfI6d9zEqyx2Zk2Q1CYzjrtEGYLz7WdHgJvJzJrCAylh6KzrOuJak1oXCvEJrIJlM1jrexfHmOxHOTkv919fyMcUJNOf6dFeBDFtn8EIpAXdONDPqLKS0Rvrc5cBu8q5RlF1rqkWM Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_46ac24f87ad748e08a133a528fbc6f01", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}] Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: be83f14b61bf43338b24935f818a82a5 Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0c925ea6-685c-4c2c-841d-169d1a77b999'} Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:24:47.503646 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Returning 404 to user: Instance 0c925ea6-685c-4c2c-841d-169d1a77b999 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:24:47.508450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d2d7a19-0d29-43ba-a980-686ff62367dd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999" status: 404 len: 111 microversion: 2.1 time: 0.100582 Oct 06 13:24:47.510215 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2871/5760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:47 2022] GET /compute/v2.1/servers/0c925ea6-685c-4c2c-841d-169d1a77b999 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:24:48.368243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-deea039b-694e-47f4-9759-5cda8028dc18 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '.version_select at 0x7f7d3ecca790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:48.398407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-deea039b-694e-47f4-9759-5cda8028dc18 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1635729459" status: 202 len: 0 microversion: 2.1 time: 0.036803 Oct 06 13:24:48.399515 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2890/5761] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 13:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1635729459 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:24:56.592827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:56.594761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:56.597786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:56.607043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:56.613529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7303b73-b5cb-4cd8-bae3-573f41b738e2", "tag": "bc01fecf-0ade-4059-9cc0-d671882e9a15"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:24:56.614097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:56.617717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:56.618726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:56.619378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:56.619970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:56.664022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:56.671728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:24:56.681306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:56.683082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:56.683563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:56.721994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:24:56.753305 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] Creating event network-changed:bc01fecf-0ade-4059-9cc0-d671882e9a15 for instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 on n-h1-860556-1 Oct 06 13:24:56.794862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-aab7aeaf-6582-42b5-963d-a95eb13b6dec req-77df5590-97ff-4b8f-89ef-1fe9394761cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180763 Oct 06 13:24:56.797503 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2891/5762] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:24:57.025827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1fced1fe-0395-442b-83b8-c5885d47b7a1 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 204 len: 0 microversion: 2.1 time: 0.429564 Oct 06 13:24:57.026847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2872/5763] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:24:56 2022] DELETE /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:24:57.050091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:57.051570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:57.066045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:57.069923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:57.070719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:57.073109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:57.075472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:57.076171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:57.762880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:24:57.773789 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1cf9203b-b16f-4428-b732-35b3deee06b5 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1670 microversion: 2.1 time: 0.740077 Oct 06 13:24:57.786638 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2892/5764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:57 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1670 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:24:58.800327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:24:58.801726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:24:58.836273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:58.836870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:58.837341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:58.838139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:24:58.838613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:24:58.839058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:24:58.880747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:00.002188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:00.036639 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ea42766-52ba-4a98-80ef-b563afd5b203 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1602 microversion: 2.1 time: 1.235417 Oct 06 13:25:00.037469 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2873/5765] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:24:58 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1602 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:00.085239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2089662293", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": "none"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:00.268928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:25:00.270743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:25:00.276537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:25:00.278977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:25:00.279578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:25:00.306598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:00.307374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:00.308063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:00.310250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:00.310949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:00.312201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:00.341069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Getting quotas for project 0663d683227342bf800afc4bc90f9796. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:25:00.350144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Getting quotas for user 5e34214f6cd6448ba00920dfba424f5f and project 0663d683227342bf800afc4bc90f9796. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:25:00.367039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:25:00.370041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:25:00.400840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7303b73-b5cb-4cd8-bae3-573f41b738e2", "name": "network-vif-deleted", "tag": "bc01fecf-0ade-4059-9cc0-d671882e9a15"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:00.455173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:00.458051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:00.459237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:00.492510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] Creating event network-vif-deleted:bc01fecf-0ade-4059-9cc0-d671882e9a15 for instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 on n-h1-860556-1 Oct 06 13:25:00.499633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dffb2bee-3fe6-4e95-bc14-67fe0ce47119 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.837271 Oct 06 13:25:00.502377 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2893/5766] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Oct 6 13:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 06 13:25:00.522917 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2900a4c5-05bd-4355-b270-591a0aff1267 req-35271b89-a74a-49d3-ae18-8bb1f5ff4317 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118912 Oct 06 13:25:00.525350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:00.525569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2874/5767] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:25:00.533215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:00.719282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:00.734259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:00.736289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:00.737814 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7bb7f149-5398-4b21-aa52-b3c481dd176d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1278 microversion: 2.57 time: 0.222849 Oct 06 13:25:00.738915 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2894/5768] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:00 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:01.071151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:01.076554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:01.135418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:01.136536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:01.146742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:01.147965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:01.148915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:01.149600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:01.242384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:01.244473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:01.245904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:01.247300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lazy-loading 'fault' on Instance uuid e7303b73-b5cb-4cd8-bae3-573f41b738e2 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:25:01.379330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:01.392237 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94a629c6-f3ab-42de-a2bf-44e27f4be6b6 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 200 len: 1339 microversion: 2.1 time: 0.327306 Oct 06 13:25:01.406540 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2875/5769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:01 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 1339 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:01.771187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:01.772458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:01.829597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:01.830403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:01.831156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:01.832929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:01.833573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:01.834872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:02.420221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:02.421570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: e7303b73-b5cb-4cd8-bae3-573f41b738e2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:02.438164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:02.438989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:02.439613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:02.441008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:02.444377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:02.445465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:02.464148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] HTTP exception thrown: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Request method failure captured: Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 HTTP/1.1 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtZ-yFT9sRqDdK3KezJ6h5zB3FFK0L9MFV8CLlmfI6d9zEqyx2Zk2Q1CYzjrtEGYLz7WdHgJvJzJrCAylh6KzrOuJak1oXCvEJrIJlM1jrexfHmOxHOTkv919fyMcUJNOf6dFeBDFtn8EIpAXdONDPqLKS0Rvrc5cBu8q5RlF1rqkWM Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_46ac24f87ad748e08a133a528fbc6f01", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}] Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: be83f14b61bf43338b24935f818a82a5 Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e7303b73-b5cb-4cd8-bae3-573f41b738e2'} Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:02.478195 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. Oct 06 13:25:02.482463 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:02.484688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Returning 404 to user: Instance e7303b73-b5cb-4cd8-bae3-573f41b738e2 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:25:02.488011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fba1f41-c8c8-4701-8799-cab8c96cf5ea tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2" status: 404 len: 111 microversion: 2.1 time: 0.072856 Oct 06 13:25:02.492695 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2876/5770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:02 2022] GET /compute/v2.1/servers/e7303b73-b5cb-4cd8-bae3-573f41b738e2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:25:02.720005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:02.732076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:02.735167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:02.736954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e10c0ba9-2352-4473-a503-82ce938ffc84 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1282 microversion: 2.57 time: 0.971934 Oct 06 13:25:02.737988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2895/5771] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:01 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1282 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:03.405523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20d01f6a-3dff-4c30-b05b-d3d36ccee199 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '.version_select at 0x7f7d3e51a310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:03.462418 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20d01f6a-3dff-4c30-b05b-d3d36ccee199 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1768590005" status: 202 len: 0 microversion: 2.1 time: 0.061012 Oct 06 13:25:03.475024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2877/5772] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 13:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1768590005 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:25:03.778703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:03.780913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:03.791460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:03.792200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:03.793004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:03.794546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:03.795187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:03.796641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:03.902608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:03.913450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:03.915920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:03.917887 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a551b133-0292-4b8a-bb39-a2f589a91cc3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1336 microversion: 2.57 time: 0.145236 Oct 06 13:25:03.919157 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2896/5773] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:03 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:04.948004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:04.948667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:04.981341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:04.982646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:04.983186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:04.986735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:04.988523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:04.989000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:05.251366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:05.271301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:05.273056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:05.279455 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-919df26a-4ea2-45fb-9c45-ebebe779df32 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1336 microversion: 2.57 time: 0.333683 Oct 06 13:25:05.281641 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2878/5774] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:04 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1336 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:06.314785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:06.316307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:06.338944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:06.340568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:06.342943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:06.346861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:06.348582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:06.350615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:06.585020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:06.605017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:06.608023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:06.619283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6db41c0-7ed8-4e0d-80a9-9568adbd74e7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1336 microversion: 2.57 time: 0.311711 Oct 06 13:25:06.630095 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2897/5775] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:06 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1336 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:07.519318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525643988", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "48b6f482-2593-42cc-a274-2f92b0210825"}], "key_name": "tempest-TestNetworkAdvancedServerOps-172437271", "security_groups": [{"name": "tempest-secgroup-smoke-508841147"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:07.649511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:07.650875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:07.664108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:07.667304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:07.668116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:07.670562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:07.671404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:07.673168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:07.767581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] validate_networks() for [('48b6f482-2593-42cc-a274-2f92b0210825', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:25:07.828309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:07.839336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:07.855876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:07.857149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8d6e309f-2c28-471c-bde1-b866de85bc93 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1357 microversion: 2.57 time: 0.212921 Oct 06 13:25:07.858108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2898/5776] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:07 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:07.887590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:07.891162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:07.906214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:07.908006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:07.908863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:07.911848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:07.912555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:07.913143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:08.040618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:25:08.041463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:25:08.042353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:25:08.043052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:25:08.043711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:25:08.129470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:08.156317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:08.158109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:08.158576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:08.161783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:08.162298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:08.165146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:08.253605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3ad0c74-8d7d-4bdd-8e9f-15e271102f1d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "POST /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92/action" status: 202 len: 1138 microversion: 2.57 time: 0.368262 Oct 06 13:25:08.265992 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2899/5777] 10.222.0.26 () {62 vars in 1320 bytes} [Thu Oct 6 13:25:07 2022] POST /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92/action => generated 1138 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 06 13:25:08.288113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:08.290631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:08.312960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:08.313903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:08.317481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:08.320078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:08.324345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:08.325112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:08.767621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:08.799790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:08.804346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:08.817993 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7aef7d35-bd4c-4388-804e-b722adddc611 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.530889 Oct 06 13:25:08.817993 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2900/5778] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:08 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:09.607387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:25:09.608894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:25:09.609587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:25:09.610199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:25:09.610792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:25:09.640793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:09.641726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:09.643000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:09.648328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:09.651913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:09.652706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:09.731015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:25:09.755895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Getting quotas for user 4b277518fc7b4784ba547a15bdcf3d54 and project 0ed3a75f24b140e5879c48dba0eda9cc. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:25:09.783636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:25:09.786045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:25:09.850994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:09.852419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:09.901041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:09.904367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:09.906816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:09.910664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:09.911165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:09.914673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:09.952407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c8d04d07-7fc5-4b9d-9db7-7bce8135451b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.439178 Oct 06 13:25:09.965970 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2879/5779] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:25:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:25:09.986873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-666ad6f8-bd35-47a3-81a2-4f9c970a9245 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:09.987783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-666ad6f8-bd35-47a3-81a2-4f9c970a9245 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:10.234294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:10.291672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:10.302135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:10.306188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-748ff16a-da45-4de7-9a38-f311df39a399 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.463058 Oct 06 13:25:10.310443 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2901/5780] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:09 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:10.400065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-666ad6f8-bd35-47a3-81a2-4f9c970a9245 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:10.411552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-666ad6f8-bd35-47a3-81a2-4f9c970a9245 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1265 microversion: 2.1 time: 0.442899 Oct 06 13:25:10.413245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2880/5781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:09 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1265 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:11.354271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:11.355492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:11.357648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:11.360186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:11.388042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:11.444016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:11.445235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:11.458591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:11.462297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:11.464194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:11.465038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:11.467412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:11.467988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:11.726641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:11.748506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:11.752436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:11.766402 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-532e0012-236e-470b-8e4c-35a6fe9e6308 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.404180 Oct 06 13:25:11.768270 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2902/5782] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:11 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:11.783972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:11.791987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3dc584d5-77dc-4cb8-ba40-cd366ec75c04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1261 microversion: 2.1 time: 0.355184 Oct 06 13:25:11.812600 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2881/5783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:11 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1261 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:25:12.820538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:12.821162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:12.821689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:12.823083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:12.838241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:12.838776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:12.841567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:12.854027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:12.854131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:12.854303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:12.854439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:12.854573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:12.854573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:12.854573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:12.854885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:12.854885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:13.062806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:13.085368 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64f70f03-7b24-4471-bdf3-f838790f7623 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1323 microversion: 2.1 time: 0.269170 Oct 06 13:25:13.086820 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2882/5784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:12 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:13.179480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:13.188893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:13.190868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:13.200376 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6a7215d-52b4-40d8-aea7-1dbb40393066 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.385122 Oct 06 13:25:13.203257 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2903/5785] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:12 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:14.110593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:14.111227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:14.125945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:14.126792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:14.127448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:14.128357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:14.142984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:14.143901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:14.230901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:14.231680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:14.251488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:14.251937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:14.252384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:14.253298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:14.253956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:14.257239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:14.551851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:14.576334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:14.580294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:14.581825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-26d92f0e-3539-4db0-8780-21a3c6db32b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.355000 Oct 06 13:25:14.582820 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2904/5786] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:14 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:15.337670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:15.416907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0ee9024a-1b8f-4fd0-bf52-e292e6af6138 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 1.310126 Oct 06 13:25:15.422548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2883/5787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:14 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:15.617960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:15.618706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:15.641157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:15.645260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:15.646629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:15.648174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:15.654576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:15.655875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:15.840408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:15.880606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:15.891184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:15.894276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0638122e-9710-4b51-a47d-1d7f9548dbe9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.285038 Oct 06 13:25:15.897916 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2905/5788] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:15 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:16.486484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:16.489163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:16.513578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:16.514126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:16.518525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:16.519847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:16.520533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:16.521396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:16.934286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:16.936235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:16.945879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:16.947680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:16.948899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:16.949871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:16.950551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:16.951420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:17.111634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:17.125346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:17.126876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:17.128572 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47c060f1-57e5-420d-b238-6bd7b9905a5f tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.200112 Oct 06 13:25:17.142442 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2906/5789] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:16 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:17.222650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:17.239305 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7274fe21-0068-466b-ad8e-a674fc6eb752 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.780828 Oct 06 13:25:17.255186 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2884/5790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:16 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:17.359765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-529577392", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "6cfb5c71-b2df-4053-914f-eb2e4e98c3ea"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:17.456015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] validate_networks() for [('6cfb5c71-b2df-4053-914f-eb2e4e98c3ea', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:25:18.161629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:18.163154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:18.182419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:18.189135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:18.191141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:18.194703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:18.198318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:18.199018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:18.459231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:18.474456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:18.484875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:18.497030 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d09cf20e-28f1-4989-9587-9a62f8ee084d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.342853 Oct 06 13:25:18.499790 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2885/5791] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:18 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:18.514014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:18.524331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:18.547566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:18.549435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:18.550097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:18.550997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:18.554234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:18.558207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:19.679468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:20.019336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:20.034204 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2eaf5ce-da2e-4785-a4f9-e66b2de81e6b tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 1.528729 Oct 06 13:25:20.035134 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2886/5792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:18 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:20.052830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:20.055428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:20.076343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:20.077265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:20.079246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:20.081537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:20.084530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:20.085709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:20.402018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:20.512791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:20.536353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:20.538206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:20.539498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-63ff5a35-12bc-4e78-868c-26f1002f05c9 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.502270 Oct 06 13:25:20.540423 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2887/5793] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:20 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:20.561943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:20.596200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:20.596937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:20.597491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:20.631140 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] Creating event network-changed:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:25:20.647379 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6fac4f2d-54b1-47d8-a042-a6f19d620306 req-205f263c-ce1c-49ac-8bce-d305981ec4ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105027 Oct 06 13:25:20.648807 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2888/5794] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:21.063001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:21.064697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:21.073855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.074773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.076517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:21.083145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.084295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.088217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:21.422173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:25:21.422926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:25:21.423311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:25:21.423807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:25:21.424346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:25:21.452960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.454767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.455239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:21.457233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.457718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.459239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:21.508810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Getting quotas for project d048e27d5bcb4401af66406cf93e0cee. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:25:21.527217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Getting quotas for user c69d4b33a6bc427ebcb453cf3172c3aa and project d048e27d5bcb4401af66406cf93e0cee. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:25:21.564622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:25:21.569333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:25:21.682768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc487b7b-1e46-4189-b189-153b9517d4fe tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.537555 Oct 06 13:25:21.685400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2907/5795] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:25:21.730749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:21.752768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:21.786002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.786600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.787158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:21.788000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:21.790287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:21.791030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:22.024082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:22.473182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:22.494476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:22.502485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:22.503991 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ecf25bf0-3095-448f-a1ff-8e440d86a57e tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.815905 Oct 06 13:25:22.511072 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2908/5796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:21 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:22.525822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5d51a871-beee-4f99-be2c-3713efd809c5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:22.526869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5d51a871-beee-4f99-be2c-3713efd809c5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:22.538970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:22.549131 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb22c14f-c2ec-4172-9474-90f6609cfa53 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 1.492776 Oct 06 13:25:22.565847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2889/5797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:21 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:25:22.945284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5d51a871-beee-4f99-be2c-3713efd809c5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:22.985463 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5d51a871-beee-4f99-be2c-3713efd809c5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1213 microversion: 2.1 time: 0.471279 Oct 06 13:25:23.016433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2909/5798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:22 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1213 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:23.546339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:23.547142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:23.565537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:23.576731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:23.578092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:23.582045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:23.584054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:23.589134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:23.590397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:23.593053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:23.612330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:23.614034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:23.614517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:23.615367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:23.615914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:23.616361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:23.945152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:23.965095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:23.973155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:23.974639 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7745e83d-8add-424a-90c7-24562f0f1572 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.435047 Oct 06 13:25:23.986169 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2890/5799] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:23 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:24.019939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:24.020733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:24.042581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:24.047330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:24.048088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:24.049024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:24.050300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:24.051137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:24.191970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:24.201273 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-32ef5cc1-b604-4175-98d5-e2cd6690ef0a tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1265 microversion: 2.1 time: 0.188044 Oct 06 13:25:24.206729 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2891/5800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:24 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:24.216485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:24.239624 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-742fc318-ae34-45e0-afc9-3db2edbec883 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.667140 Oct 06 13:25:24.248062 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2910/5801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:23 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:25.009099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:25.011282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:25.032366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.033929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.037695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.038939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.039836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.041318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.237063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:25.240287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:25.241070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:25.248086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:25.253202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:25.263086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-257054cf-be3e-4855-8ddb-db6dc4fd9c8d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.260470 Oct 06 13:25:25.265517 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2892/5802] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:25 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:25.271542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.272434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.273220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.274477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.275302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.280297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:25.280857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.281779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:25.294260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.302723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.303519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.304552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:25.305243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:25.305923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:25.475307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:25.485796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c71b8254-831a-4053-93e9-ca50a5642559 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1271 microversion: 2.1 time: 0.249593 Oct 06 13:25:25.486461 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2911/5803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:25 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:25.794256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0c977ad3-1044-4a01-b4fc-6fcdfaa8c3de tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: .version_select at 0x7f7d3f2f2040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-570613791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0yiPMp3TML27nXUGogvijZpUIFllypxA7u3baIFYfs7ZkvH0lccVDWtTB3lC6anDZ5Zoi9DR7xIG9fjIPuqsKgAFbiFTIgUf+VPvR8oV12vd8ppYH7NOrBDjdwsfNNgg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:25.813327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:25.824398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dfc07bc9-a44d-428d-8e20-ba7f1fee83a9 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.549387 Oct 06 13:25:25.828379 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2893/5804] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:25 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:25.900485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0c977ad3-1044-4a01-b4fc-6fcdfaa8c3de tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:25:25.914528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0c977ad3-1044-4a01-b4fc-6fcdfaa8c3de tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:25:26.017239 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0c977ad3-1044-4a01-b4fc-6fcdfaa8c3de tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.234402 Oct 06 13:25:26.022642 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2912/5805] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:25:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:26.305115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:26.305758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:26.323774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:26.324833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:26.325948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:26.327623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:26.328318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:26.329077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:26.383540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:26.498380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:26.515073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:26.521107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:26.523201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-04f3a1db-2bd5-4b82-a176-1f4463b51f40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.228198 Oct 06 13:25:26.523854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2894/5806] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:26 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:26.533610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:26.534432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:26.548129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:26.548621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:26.549241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:26.562049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:26.562639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:26.563090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:26.755112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:26.767364 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ee47c5c-49ee-414e-9a0b-3f3ec1c6742e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1271 microversion: 2.1 time: 0.239250 Oct 06 13:25:26.768386 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2913/5807] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:26 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:27.153297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:27.154617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:27.169867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:27.172190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.179692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.198785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.200529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.204389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.218850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.552783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:27.553457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:27.557071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:27.580409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.580968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.581420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.582226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.582687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.593345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.842740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:27.856716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:27.858774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:27.860015 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9ef453a-3e80-4d36-93f2-844aa74181cb tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.311520 Oct 06 13:25:27.878185 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2914/5808] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:27 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:27.894629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:27.895614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:27.913562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.916968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.922149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.923318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:27.924992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:27.926435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:27.954681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:27.967017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ba4c545-c2f2-4a73-8c0e-3387415c8635 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 1.103898 Oct 06 13:25:27.972505 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2895/5809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:26 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:28.620901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:28.636942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-577636ab-94da-45bb-bbd6-3ea2fa088f42 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.757190 Oct 06 13:25:28.638623 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2915/5810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:27 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:28.892626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:28.893646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:28.920148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:28.932115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:28.934070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:28.935054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:28.935703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:28.937130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:29.001478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:29.002893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:29.024259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:29.025192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:29.025832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:29.026718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:29.027409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:29.027990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:29.164451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:29.180617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:29.202612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:29.204631 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2e542ddb-f9a2-40b0-822a-1d38584f44b3 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.318542 Oct 06 13:25:29.206916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2896/5811] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:28 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:29.483130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:29.506692 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49ac4ef3-fbd2-42e9-bf24-36c573ae98aa tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.510922 Oct 06 13:25:29.508099 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2916/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:28 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:29.664623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:29.665350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:29.680298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:29.680811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:29.681934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:29.682733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:29.683213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:29.683653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:29.979260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:30.007388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79f9503f-d87b-4cee-b4ac-f68386d25a84 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.345805 Oct 06 13:25:30.009980 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2897/5813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:29 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:30.242815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:30.243917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:30.273275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:30.274318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:30.275391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:30.276569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:30.278976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:30.285474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:30.531364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:30.532731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:30.545098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:30.546731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:30.556076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:30.564165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:30.564898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:30.565540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:30.616798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:30.635445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:30.637470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:30.649963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-72283354-8cec-4723-b5fa-bd72ad768c74 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.411126 Oct 06 13:25:30.650732 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2917/5814] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:30 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:30.872703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "name": "network-vif-plugged", "status": "completed", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:30.896372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:30.896839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:30.898535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:30.928517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] Creating event network-vif-plugged:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:25:30.938632 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-10276960-ac36-45e9-abd1-848f975e9115 req-f73461e9-3e0e-4bd3-9c73-66ebbe09fe4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070423 Oct 06 13:25:30.939933 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2918/5815] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:25:30.949041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1490704766", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "848bed46-66b4-41d1-8ddf-1adeaa6425e4"}], "key_name": "tempest-TestNetworkBasicOps-570613791", "security_groups": [{"name": "tempest-secgroup-smoke-1822090134"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:30.957827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:30.974471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88dd5443-8a0d-47ea-bf34-ce099f84c326 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.447142 Oct 06 13:25:30.980646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2898/5816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:30 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:31.034996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:31.036173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:31.054116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:31.054879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:31.057416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:31.058682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:31.059534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:31.060167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:31.148170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] validate_networks() for [('848bed46-66b4-41d1-8ddf-1adeaa6425e4', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:25:31.482153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:31.639795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:31.662977 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c0f0401-b30b-46eb-b4e8-83b1dc915b16 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.631653 Oct 06 13:25:31.664524 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2899/5817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:31 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:25:31.703018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:31.708959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:31.735865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:31.738181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:31.741134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:31.742912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:31.756258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:31.757578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:32.072316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:32.088941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:32.098034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:32.111073 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c515d08-b0cd-4796-a77b-231ac2c07642 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.415871 Oct 06 13:25:32.114262 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2900/5818] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:31 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:32.142763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:32.151418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:32.175636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:32.178422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:32.179162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:32.180605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:32.198292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:32.201013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:32.633713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:32.649389 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7548dfcc-6014-43e6-8b9d-2076b386aa04 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1390 microversion: 2.1 time: 0.528921 Oct 06 13:25:32.651560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2901/5819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:32 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:32.774312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:25:32.774987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:25:32.775674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:25:32.776716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:25:32.777413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:25:32.798935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:32.806811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:32.807741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:32.809153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:32.810393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:32.814305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:32.871320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:25:32.885172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Getting quotas for user be83f14b61bf43338b24935f818a82a5 and project 46ac24f87ad748e08a133a528fbc6f01. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:25:32.925671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:25:32.928627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:25:33.061863 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d892f17f-4d8c-4155-ba2d-0215de5e20bc tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.119562 Oct 06 13:25:33.063047 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2919/5820] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:25:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:25:33.079525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:33.080617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:33.108935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.150617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.154306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.156454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.159412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.168407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.242740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47ff6a1-d293-4e2b-8e45-f3fcffff2be6", "tag": "203e2f8c-7716-45e1-b155-930ba1079f3d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:33.271931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.274398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.278372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.306416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] Creating event network-changed:203e2f8c-7716-45e1-b155-930ba1079f3d for instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 on n-h2-860556-1 Oct 06 13:25:33.316006 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c4550a2d-039d-4cfd-87e5-32a8816077ee req-0af79542-894c-474f-9ab3-48994244374d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.662598 Oct 06 13:25:33.317335 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2902/5821] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:33.327319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16cab68c-b9cd-4e60-80b6-438d2193abaf tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:33.334506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16cab68c-b9cd-4e60-80b6-438d2193abaf tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:33.470440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16cab68c-b9cd-4e60-80b6-438d2193abaf tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:33.478793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16cab68c-b9cd-4e60-80b6-438d2193abaf tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1248 microversion: 2.1 time: 0.159983 Oct 06 13:25:33.500422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2903/5822] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:33 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1248 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:33.505813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:33.506604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:33.516261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.516782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.517232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.518001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.518698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.519319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.537133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:33.550222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8da68d5-6847-42c3-87c1-12fc22b2e887 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.477665 Oct 06 13:25:33.550837 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2920/5823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:33 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:33.667998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:33.682965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:33.687394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:33.688629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b26b5f0-1b7b-497a-9193-ea802eff6774 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.186986 Oct 06 13:25:33.689703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2904/5824] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:33 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.709610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:33.710741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:33.711315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:33.993717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:34.017524 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4c4afb9-9981-47f5-a075-8c5b4f87ee32 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1562 microversion: 2.1 time: 0.333357 Oct 06 13:25:34.025208 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2921/5825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:33 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1562 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:34.060240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:34.061687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:34.090580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.091486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.092284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.094634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.096488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.097978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.508984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:34.509621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:34.534304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.534808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.535251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.535969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.536431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.536863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.540171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:34.566731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e9d3876-802c-4189-8356-bc72adbb0f40 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1562 microversion: 2.1 time: 0.518925 Oct 06 13:25:34.567699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2905/5826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:34 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1562 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:34.598800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:34.610869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:34.631016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.631538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.631996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.632729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.633200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.633646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.815892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:34.830983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0df9d0b5-a160-44ff-afb5-7db733d581b0 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1300 microversion: 2.1 time: 0.321626 Oct 06 13:25:34.831660 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2922/5827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:34 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:25:34.846177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:34.847208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:34.854025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.858395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.863667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:34.864722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:34.865417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:34.866118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:35.118699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:35.132839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:35.135869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:35.138345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36152630-3729-454d-b698-3d7e87b24101 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.305507 Oct 06 13:25:35.140683 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2923/5828] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:34 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:35.170192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:35.205665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-236ec227-39bb-4dc2-97e5-97c68cc12267 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.616893 Oct 06 13:25:35.218763 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2906/5829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:34 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:35.878422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:35.879410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:35.891289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:35.892060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:35.892667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:35.894069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:35.894777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:35.895452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:35.980980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:35.991921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1785f3a0-de30-477e-9a89-6cc0ebec17b7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1306 microversion: 2.1 time: 0.130504 Oct 06 13:25:35.993508 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2924/5830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:35 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:36.180089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:36.181239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:36.193369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:36.194138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:36.194770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:36.196386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:36.197110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:36.198306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:36.233506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:36.234319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:36.243780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:36.246728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:36.247326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:36.249243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:36.252306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:36.253028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:36.363758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:36.372693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:36.378292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:36.379927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f96fd633-dd39-4e8e-abae-0da11d06de40 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1366 microversion: 2.57 time: 0.203753 Oct 06 13:25:36.382065 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2907/5831] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:36 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:36.494843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:36.506076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-19b4c4bc-5b79-4c02-8f52-5f3d11d7a344 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.276555 Oct 06 13:25:36.508827 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2925/5832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:36 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:37.022373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:37.023336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:37.040985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.041491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.042027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.042845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.043312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.046205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.182087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:37.194243 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d5fec7b-a0e6-4844-b910-e1b23ac3a0fa tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1306 microversion: 2.1 time: 0.181204 Oct 06 13:25:37.195664 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2908/5833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:37 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:37.410839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:37.412693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:37.425240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.427115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.428185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.429553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.430856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.432501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.533663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:37.534433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:37.544329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.545995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.546539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.549400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:37.550224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:37.550685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:37.562788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:37.577497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:37.585150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:37.590798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85aea531-81c1-459a-859b-17595c0595f7 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1372 microversion: 2.57 time: 0.187608 Oct 06 13:25:37.591762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2926/5834] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:37 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:37.762534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:37.775291 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8589798-f487-4223-87f1-192453f90afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.246145 Oct 06 13:25:37.776601 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2909/5835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:37 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:38.223685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:38.229405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:38.249673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.251801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.253499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.255832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.256543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.258669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.512518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:38.525824 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65e3f570-0d66-4b73-a263-b3afd81a1fa4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.308518 Oct 06 13:25:38.525824 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2927/5836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:38 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:38.625347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:38.626404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:38.640175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.641367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.642659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.644238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.645314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.646172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.746737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:38.760214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:38.762791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:38.765157 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-24554ee6-25be-46ba-9bf4-0ebbcf17828c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1372 microversion: 2.57 time: 0.147722 Oct 06 13:25:38.768394 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2910/5837] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:38 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:38.818367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:38.819204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:38.832738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.834990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.835748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.838665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:38.841149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:38.842135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:38.891995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:39.113123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:39.129073 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-940065a9-4747-4728-8756-fcca2098df2e tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.312251 Oct 06 13:25:39.129073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2928/5838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:38 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:39.559447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:39.564409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:39.603277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:39.604113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:39.604595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:39.605369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:39.611999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:39.612741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:39.807691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:39.809075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:39.820926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:39.822766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:39.823578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:39.825324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:39.825831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:39.826294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:39.894818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:39.903219 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b074627-abbd-4bd4-ae32-3aabc817592a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.356463 Oct 06 13:25:39.903914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2911/5839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:39 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:39.916733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:39.934180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:39.936365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:39.938155 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d73cf44c-ad4a-49a6-91d0-7485a75fe43d tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1372 microversion: 2.57 time: 0.137063 Oct 06 13:25:39.939169 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2929/5840] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:39 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 13:25:40.154854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:40.156722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:40.165471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:40.166233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:40.166891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:40.167820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:40.169080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:40.169080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:40.192346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:40.502103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:40.518171 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0ffabad-d3aa-4d1a-8f3f-40d502002ac0 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.369981 Oct 06 13:25:40.530651 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2912/5841] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:40 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:40.930756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:40.932110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:40.947293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:40.951040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:40.952246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:40.953979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:40.955542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:40.957526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:40.975358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:40.976708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:40.994718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:40.997444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:40.998169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:41.000101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:41.005780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:41.008021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:41.326314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:41.346012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:41.354049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:41.355689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d5dcfcd-7c26-4ef8-b7d0-4a959fdec128 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1372 microversion: 2.57 time: 0.390853 Oct 06 13:25:41.356788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2913/5842] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:40 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:41.427281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:41.473471 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5fbdd6b5-c84b-4115-9010-0a4f0e6efe78 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.545903 Oct 06 13:25:41.478482 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2930/5843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:40 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:41.544472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47ff6a1-d293-4e2b-8e45-f3fcffff2be6", "name": "network-vif-plugged", "status": "completed", "tag": "203e2f8c-7716-45e1-b155-930ba1079f3d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:41.545772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:41.546413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:41.559630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:41.561509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:41.563204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:41.563741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:41.565698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:41.566223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:41.566879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:41.567839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:41.568132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:41.590654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] Creating event network-vif-plugged:203e2f8c-7716-45e1-b155-930ba1079f3d for instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 on n-h2-860556-1 Oct 06 13:25:41.597923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-64e6de11-7eb2-41d5-8f59-487b4752b579 req-3f717cd6-cfa6-4675-9574-41f8f76a962e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064280 Oct 06 13:25:41.599347 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2914/5844] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:41.938977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:41.949317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c0ebec9-cdb4-41e0-95f4-eec7f36e3afb tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.409233 Oct 06 13:25:41.950160 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2931/5845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:41 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:42.219001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4847f6b1-8ba9-45b0-8065-1e486b9a7daa", "tag": "04170bc9-ec53-469a-946c-b8bdfddd6724"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:42.246271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.246762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.247204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.283030 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] Creating event network-changed:04170bc9-ec53-469a-946c-b8bdfddd6724 for instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa on n-h1-860556-1 Oct 06 13:25:42.291716 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-56016e93-bf57-440f-9cd4-8a5ec9021cc9 req-e45986d1-ab2e-4541-ac8c-3c90ae33ab9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078837 Oct 06 13:25:42.302724 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2915/5846] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:42.389985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:42.390546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:42.401561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.402136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.402714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.408638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.409205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.409654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.501337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:42.502131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:42.511897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.512416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.512863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.519364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.520578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.529153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.560067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:42.581375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:42.583081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:42.584458 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad42128a-53d4-4093-a21a-820e7508221c tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1357 microversion: 2.57 time: 0.199435 Oct 06 13:25:42.585156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2932/5847] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:42 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:42.625640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:42.626425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:42.642009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.642734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.643281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.644119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.644707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.645240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.701853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:25:42.854322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:42.869596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a841f3a-20a1-488c-bb55-a15cbeda2721 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.372592 Oct 06 13:25:42.871068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:42.871522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2916/5848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:42 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:42.878034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a425d575-f85e-498b-b2a6-ce41a338de1a tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 204 len: 0 microversion: 2.57 time: 0.258622 Oct 06 13:25:42.878998 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2933/5849] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Oct 6 13:25:42 2022] DELETE /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 06 13:25:42.895509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:42.898946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:42.907765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.918956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.919563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.921162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:42.921657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:42.922145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:42.981096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:42.982392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:43.000661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=18 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:43.008896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.010738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.011881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:43.015490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.017285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.020681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:43.152096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:43.162841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:43.164794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:43.166203 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ad748ae-3450-4f71-8310-4e43ad256894 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1363 microversion: 2.57 time: 0.275146 Oct 06 13:25:43.182285 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2917/5850] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:42 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:43.192871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:43.193919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:43.200655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.201785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.202542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:43.203492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.204183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.204831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:43.247379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:43.259265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39603eb6-fd13-4d84-91d9-0eb92522c4dc tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1313 microversion: 2.1 time: 0.283317 Oct 06 13:25:43.259881 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2934/5851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:42 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:43.425496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:43.435072 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a41c382d-8d64-401e-85e4-5303a95dca77 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1562 microversion: 2.1 time: 0.246653 Oct 06 13:25:43.437012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2918/5852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:43 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:43.896066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:43.896805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:43.903414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.904004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.904554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:43.905376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:43.906298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:43.906817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.122734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:44.133704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a7bab4d-0555-400e-9961-2e51a8b1a4fd tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.241763 Oct 06 13:25:44.153951 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2935/5853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:43 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:44.196038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:44.197102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:44.202579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:44.211592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:44.212385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:44.212934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.213775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:44.214472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:44.215070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.289355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:44.290096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:44.297089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:44.307638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:44.309837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:44.311602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:44.312059 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb88a69f-1f57-41a2-8095-a47cd673b283 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1363 microversion: 2.57 time: 0.120814 Oct 06 13:25:44.312340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:44.313391 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2919/5854] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:44 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:44.314136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.316644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:44.317132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:44.319345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.380319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:44.398712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:44.402463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:44.403108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:44.432151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] Creating event network-changed:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:25:44.444903 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e9c7df25-3fd7-4dda-b97c-caf95354660e req-36bb4208-8798-417a-b546-7289affcf307 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067018 Oct 06 13:25:44.447571 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2920/5855] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:25:44.545209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:44.556250 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-204ea28a-ff96-4346-9df9-379ed15eaac5 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1497 microversion: 2.1 time: 0.274581 Oct 06 13:25:44.557055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2936/5856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:44 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:45.159333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:45.160046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:45.166428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:45.166924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:45.167373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:45.168079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:45.168541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:45.169004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:45.341374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:45.342058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:45.355301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:45.355890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:45.356336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:45.357177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:45.357531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:45.358553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:46.390414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:46.403764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:46.411417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e34214f6cd6448ba00920dfba424f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0663d683227342bf800afc4bc90f9796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:46.418533 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2c96a5b-83c5-4b60-8f4d-74bab4ac54e4 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 200 len: 1363 microversion: 2.57 time: 1.081083 Oct 06 13:25:46.424353 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2937/5857] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:45 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 1363 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 13:25:46.839102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:46.862989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e6fece38-d388-496a-99bc-45830135ce28 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 1.706325 Oct 06 13:25:46.866625 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2921/5858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:45 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:47.458340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:47.459065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] [instance: 84c083e5-57e9-40e3-acb2-0ed9181a6c92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:47.473978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:47.474478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:47.474921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:47.475637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:47.476096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:47.476577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:47.511694 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] HTTP exception thrown: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Request method failure captured: Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 HTTP/1.1 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtcroT9fuqGouAG3TogMmdLtLJEEVDN4YV22ZGKkI3D6K7EQTuGvoxmUaoqul33U3A9R0D_ikCsC0rxPVzXpf2JS6Gq3xMhK1MYFfUwOXx9oS_F1Sv4COun2gOAFY75CfpBZpSIlDWgm-fx9qxwGWjdbQWg3uMOYI-tme4qfw2EavnM Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Openstack-Nova-Api-Version: 2.57 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0663d683227342bf800afc4bc90f9796 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerShowV257Test-571995917 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0663d683227342bf800afc4bc90f9796", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0663d683227342bf800afc4bc90f9796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0663d683227342bf800afc4bc90f9796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0663d683227342bf800afc4bc90f9796"}]}] Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerShowV257Test-571995917 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0663d683227342bf800afc4bc90f9796 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerShowV257Test-571995917 Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerShowV257Test-571995917-project Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 5e34214f6cd6448ba00920dfba424f5f Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerShowV257Test-571995917-project Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '84c083e5-57e9-40e3-acb2-0ed9181a6c92'} Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:47.514027 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. Oct 06 13:25:47.518361 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:25:47.523954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] Returning 404 to user: Instance 84c083e5-57e9-40e3-acb2-0ed9181a6c92 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:25:47.525107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff0988ee-d6e8-488d-a897-b3f61b919921 tempest-ServerShowV257Test-571995917 tempest-ServerShowV257Test-571995917-project] 10.222.0.26 "GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92" status: 404 len: 111 microversion: 2.57 time: 0.073531 Oct 06 13:25:47.529293 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2938/5859] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Oct 6 13:25:47 2022] GET /compute/v2.1/servers/84c083e5-57e9-40e3-acb2-0ed9181a6c92 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:25:47.912848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:47.913726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:47.928431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:47.928943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:47.929507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:47.930157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:47.930652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:47.943851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:48.467298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:48.489943 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-38e71559-7b9c-432d-af6d-fc5ace1f3a7a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.579761 Oct 06 13:25:48.492146 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2922/5860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:47 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:48.846296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4847f6b1-8ba9-45b0-8065-1e486b9a7daa", "name": "network-vif-plugged", "status": "completed", "tag": "04170bc9-ec53-469a-946c-b8bdfddd6724"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:48.878814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:48.879584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:48.881081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:48.912890 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] Creating event network-vif-plugged:04170bc9-ec53-469a-946c-b8bdfddd6724 for instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa on n-h1-860556-1 Oct 06 13:25:48.928951 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e226c639-3256-426a-816f-dd7e0fa42367 req-8d578514-1892-46ae-a806-0f494728f473 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090044 Oct 06 13:25:48.931995 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2939/5861] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:49.518351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:49.519467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:49.539407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:49.540143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:49.540600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:49.541728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:49.542517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:49.542821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:49.898199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:49.898199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1eb4426e-8cf1-487a-bfd8-c46acad7da6c tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1374 microversion: 2.1 time: 0.384177 Oct 06 13:25:49.898199 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2923/5862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:49 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1374 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:49.919473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:49.922082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:49.941599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:49.942558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:49.943236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:49.944315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:49.945104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:49.945808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:49.981637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:25:50.124584 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 204 len: 0 microversion: 2.1 time: 0.205734 Oct 06 13:25:50.130851 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2940/5863] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:25:49 2022] DELETE /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:25:50.136574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.137211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:50.148526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:50.149686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:50.150479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:50.151672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:50.152321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:50.153097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:50.404384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:50.416181 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1503 microversion: 2.1 time: 0.283660 Oct 06 13:25:50.417150 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2924/5864] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:50.506348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.507481 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002429 Oct 06 13:25:50.508222 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2941/5865] 10.222.0.26 () {56 vars in 886 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 06 13:25:50.519319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.524037 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002293 Oct 06 13:25:50.524037 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2925/5866] 10.222.0.26 () {54 vars in 1035 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 06 13:25:50.531252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.532486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-850a93bd-83cf-4a23-8e78-b74501294c37 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003044 Oct 06 13:25:50.532853 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2942/5867] 10.222.0.26 () {54 vars in 1041 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:50.543967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.545341 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef789a9e-a5a5-485a-a2c7-e4006421ace4 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001384 Oct 06 13:25:50.545723 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2926/5868] 10.222.0.26 () {56 vars in 886 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 06 13:25:50.921394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:50.922239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:50.935481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:50.936556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:50.937000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:50.941605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:50.942177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:50.942704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:51.222067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:51.235661 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-76e1ba23-ffdd-4ba0-9fff-f56be710b0d4 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1546 microversion: 2.1 time: 0.318890 Oct 06 13:25:51.251221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2943/5869] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:50 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1546 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:51.263126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:51.264398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:51.273104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:51.274013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:51.274721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:51.275719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:51.276421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:51.277160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:51.443238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:51.444279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:51.455741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:51.456571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:51.457244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:51.458230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:51.466224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:51.467694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:51.530337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:51.543652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ec5ab885-da89-466c-98a4-b0e35fa7b17d tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1546 microversion: 2.1 time: 0.285619 Oct 06 13:25:51.562127 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2927/5870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:51 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1546 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:51.670905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:51.681290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a671bd48-f85c-4437-a4a2-51ebe4358071 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1503 microversion: 2.1 time: 0.241852 Oct 06 13:25:51.708604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2944/5871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:51 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:52.633473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47ff6a1-d293-4e2b-8e45-f3fcffff2be6", "name": "network-vif-deleted", "tag": "203e2f8c-7716-45e1-b155-930ba1079f3d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:52.675925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:52.677591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:52.679250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:52.705299 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] Creating event network-vif-deleted:203e2f8c-7716-45e1-b155-930ba1079f3d for instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 on n-h2-860556-1 Oct 06 13:25:52.710074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:52.711276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:52.714824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e19a1a60-e690-4be1-abca-43d070910e7d req-f3696c88-48fa-4650-9bb4-e3a577946663 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100248 Oct 06 13:25:52.717819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2928/5872] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:52.736955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:52.737418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:52.737917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:52.738657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:52.739111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:52.746391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:52.852190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:52.955359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69d4b33a6bc427ebcb453cf3172c3aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd048e27d5bcb4401af66406cf93e0cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:25:52.963505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37fc9dff-dcc9-4961-b013-afeeb9cee0e6 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 200 len: 1298 microversion: 2.1 time: 0.257176 Oct 06 13:25:52.968100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2945/5873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:52 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:25:53.992932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:25:53.993663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] [instance: a47ff6a1-d293-4e2b-8e45-f3fcffff2be6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:54.008103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:54.008537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:54.015839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:54.016644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:54.017128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:54.020949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:54.079915 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] HTTP exception thrown: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Request method failure captured: Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 HTTP/1.1 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtc4LXLsUA2uUHheq28IfIQI56aARKBIFWJZZ6mh1G1b31oXLHjlm6ifFyRcjv_LF5JCKIDSYzICKmrzuXEO3AQZWWe5F_kCqJgI5vY6bjW8ERNmgMGvyO80b_pGRh6oZHWuHG-6L40DbfrNWsXDGluFThwHbGgF9zvX9OxAJG4qtCs Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: d048e27d5bcb4401af66406cf93e0cee Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesActionsTest-255632070 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d048e27d5bcb4401af66406cf93e0cee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d048e27d5bcb4401af66406cf93e0cee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d048e27d5bcb4401af66406cf93e0cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d048e27d5bcb4401af66406cf93e0cee"}]}] Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesActionsTest-255632070 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: d048e27d5bcb4401af66406cf93e0cee Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesActionsTest-255632070 Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesActionsTest-255632070-project Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c69d4b33a6bc427ebcb453cf3172c3aa Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesActionsTest-255632070-project Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a47ff6a1-d293-4e2b-8e45-f3fcffff2be6'} Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:25:54.084287 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. Oct 06 13:25:54.091512 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:25:54.093466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] Returning 404 to user: Instance a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:25:54.095849 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d4f00797-e6f2-4ba6-9871-311bd2b26179 tempest-VolumesActionsTest-255632070 tempest-VolumesActionsTest-255632070-project] 10.222.0.26 "GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6" status: 404 len: 111 microversion: 2.1 time: 0.110013 Oct 06 13:25:54.100024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2929/5874] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:25:53 2022] GET /compute/v2.1/servers/a47ff6a1-d293-4e2b-8e45-f3fcffff2be6 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:25:57.518879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4847f6b1-8ba9-45b0-8065-1e486b9a7daa", "tag": "04170bc9-ec53-469a-946c-b8bdfddd6724"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:57.540158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:57.544482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:57.545460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:57.566730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] Creating event network-changed:04170bc9-ec53-469a-946c-b8bdfddd6724 for instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa on n-h1-860556-1 Oct 06 13:25:57.580371 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8e182d0c-cbe0-48d4-ab64-e062a368bcac req-62f1f5ec-c5dc-47b8-9e77-c92965057557 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.038715 Oct 06 13:25:57.582525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2946/5875] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:25:58.766545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:25:58.769042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:25:58.782053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=68 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:25:58.786639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:58.792164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:58.792810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:58.793729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:25:58.794387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:25:58.795286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:25:58.897429 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71e081c1-09ed-47fe-9f5c-668015a6e472 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action" status: 200 len: 24576 microversion: 2.1 time: 0.135083 Oct 06 13:25:58.903245 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2930/5876] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:25:58 2022] POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action => generated 24576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:26:06.833326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0814d04-cbb9-4b9c-a75d-28b789f94e10 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: .version_select at 0x7f7d3ecd75e0>, body: {"keypair": {"name": "tempest-keypair-328375904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOB3jeDrLxAfCHIsNIyNazy1L0sv1WkQGTOD9uUDRBLxjNQJVKX6NTf14TIJP+qJ61Rg09qne0Rj/SUFmul/tOUDYcProZXe4SCtzu3r40srZZDGFkL9KuZBR8VArktKQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:06.853274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:06.868693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c0814d04-cbb9-4b9c-a75d-28b789f94e10 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:26:06.879289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-c0814d04-cbb9-4b9c-a75d-28b789f94e10 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:26:06.930354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0814d04-cbb9-4b9c-a75d-28b789f94e10 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.656902 Oct 06 13:26:06.931470 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2947/5877] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:26:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:09.790101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:09.794136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:09.814122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:09.815060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=77 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:09.819572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:09.821851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:09.826864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:09.828069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:09.828702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:09.829707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:10.028224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:26:10.032600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:26:10.034199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:26:10.034943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:26:10.039723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:26:10.220309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:10.285165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:10.285690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:10.286174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:10.300995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:10.305888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:10.306572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:10.442331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6330824-5c16-4c1f-96f4-fd1a4bd41589 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action" status: 202 len: 1137 microversion: 2.1 time: 0.658357 Oct 06 13:26:10.445440 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2931/5878] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:09 2022] POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action => generated 1137 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 06 13:26:10.464769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=7 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:10.469815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:10.470591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:10.506289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:10.511310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:10.514054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:10.515450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:10.517652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:10.519713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:10.738509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-654571812", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb0b016-19fe-46cc-81a2-ae79246f7798"}], "security_groups": [{"name": "tempest-securitygroup--1083502172"}], "key_name": "tempest-keypair-328375904", "user_data": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:11.550889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:11.567618 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31b669a3-468a-46f4-a333-f92469e7c6df tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 1.104304 Oct 06 13:26:11.569621 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2948/5879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:10 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:11.611967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] validate_networks() for [('2eb0b016-19fe-46cc-81a2-ae79246f7798', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:26:12.575962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:26:12.576668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:26:12.577364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:26:12.578002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:26:12.579341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:26:12.595480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:12.596771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:12.602312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:12.605325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:12.606050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:12.606850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:12.619524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:12.619524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:12.620228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:12.663147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:26:12.679471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:26:12.706285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:26:12.710142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:26:12.832337 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8444d927-8522-411e-8da4-4be7b36a1c57 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.098057 Oct 06 13:26:12.836223 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2932/5880] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:26:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:26:12.851447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fdc3d589-1cac-48a0-91af-936ee1b46999 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:12.859629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fdc3d589-1cac-48a0-91af-936ee1b46999 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:13.079443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fdc3d589-1cac-48a0-91af-936ee1b46999 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:13.090790 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fdc3d589-1cac-48a0-91af-936ee1b46999 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1240 microversion: 2.1 time: 0.246512 Oct 06 13:26:13.105837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2933/5881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:12 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1240 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:13.158065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:13.166560 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5c52cfc-7404-4f5b-97fe-b86934e53144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.576979 Oct 06 13:26:13.167356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2949/5882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:12 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:14.130770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:14.131515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:14.172723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:14.181684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:14.182451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:14.183439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:14.184410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:14.185092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:14.198309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:14.198991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:14.243436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:14.244504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:14.252787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:14.258692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:14.259368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:14.259831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:14.391741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:14.408191 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1824b4ae-a778-4ed2-b235-5e416bc80e6a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1244 microversion: 2.1 time: 0.291372 Oct 06 13:26:14.424683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2934/5883] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:14 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1244 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:14.686862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:14.700443 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2528633-52cb-45bb-a5f3-41f4bf00b028 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.510183 Oct 06 13:26:14.701666 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2950/5884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:14 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:15.432390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:15.433016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:15.452338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:15.453083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:15.454062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:15.454951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:15.456088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:15.456683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:15.603723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:15.623145 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a98ff303-1297-4260-a35b-65e3a97f1057 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1298 microversion: 2.1 time: 0.194380 Oct 06 13:26:15.626535 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2935/5885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:15 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:15.728599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:15.729232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:15.749198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:15.750195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:15.750652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:15.751385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:15.751850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:15.752286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:16.237630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:16.246814 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-687df9f6-ff87-4d37-aa60-bcb2b031d2d8 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.522066 Oct 06 13:26:16.250870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2951/5886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:15 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:16.626119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:16.629566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:16.637236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:16.638402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:16.639077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:16.640030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:16.640931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:16.641534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:16.648574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:16.649444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:16.662627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:16.665165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:16.665851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:16.669507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:16.672890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:16.673517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:16.774660 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abc59a5d-528d-49be-bec3-2ee0657f1a48 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa/action" status: 200 len: 24523 microversion: 2.1 time: 0.154461 Oct 06 13:26:16.777787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2936/5887] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:16 2022] POST /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa/action => generated 24523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:26:16.889783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:17.062009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:17.076193 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-500264da-3cd7-4ef7-aa08-fd2053767f62 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.431483 Oct 06 13:26:17.082636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2952/5888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:16 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:17.275607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:17.276332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:17.289427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:17.290375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:17.291175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:17.292138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:17.292617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:17.293072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:17.702701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:17.712559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11ceb0b2-319d-459a-9f6c-094caca46455 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.442077 Oct 06 13:26:17.713153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2937/5889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:17 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:17.787653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1317978348", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "4eeff0ee-512a-42df-87b9-81b0827c2021"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:17.930871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] validate_networks() for [('4eeff0ee-512a-42df-87b9-81b0827c2021', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:26:17.936028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c639a264-ec49-47bc-b361-aac73212ab10", "tag": "d9931541-668b-4506-81e3-ef3be8770d8a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:17.955811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:17.956687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:17.958459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:17.978981 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] Creating event network-changed:d9931541-668b-4506-81e3-ef3be8770d8a for instance c639a264-ec49-47bc-b361-aac73212ab10 on n-h2-860556-1 Oct 06 13:26:17.988853 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ea13f554-83a9-4e40-88a4-4ee45dc74177 req-916c3255-1e33-4ed1-9ce3-13dd2a7774a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058888 Oct 06 13:26:17.990219 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2938/5890] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:26:18.106452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:18.108333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:18.120742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.123971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.124652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.127753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.128538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.131057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.455651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:18.468994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92b548bc-1038-42c1-9f38-5a27bb2456ec tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.367176 Oct 06 13:26:18.471764 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2939/5891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:18 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:18.677191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:26:18.677860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:26:18.678677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:26:18.679244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:26:18.679801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:26:18.692336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.693014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.693631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.695346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.696643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.697255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.728931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Getting quotas for project b4502b6693f3421f935fac5c0f4f5b55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:26:18.739640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Getting quotas for user f7414c5526c741c7b101d28deccab90b and project b4502b6693f3421f935fac5c0f4f5b55. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:26:18.744759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:18.746182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:18.760516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.761365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.765676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.766819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:18.768328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:18.770888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:18.777368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:26:18.782133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:26:18.874699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7df031d4-9e9a-46e7-8298-8fbc5449cb4a tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391467 Oct 06 13:26:18.876923 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2953/5892] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:26:18.889340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-35cc0199-148f-4bf7-8d16-4e8960bdad5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:18.890288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-35cc0199-148f-4bf7-8d16-4e8960bdad5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:19.040160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-35cc0199-148f-4bf7-8d16-4e8960bdad5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:19.050436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-35cc0199-148f-4bf7-8d16-4e8960bdad5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1215 microversion: 2.1 time: 0.166267 Oct 06 13:26:19.051046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2954/5893] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:18 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:19.250859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:19.265189 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc9e8a33-ec99-4f5c-916f-98fdbe018032 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.531677 Oct 06 13:26:19.285393 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2940/5894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:18 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:19.494274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:19.494907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:19.516185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:19.516623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:19.517075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:19.517837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:19.518318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:19.518741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:19.980231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:19.990070 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5c39c88d-4331-4032-b7b4-6fdb6171b3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.500846 Oct 06 13:26:19.992009 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2955/5895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:19 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:20.072604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:20.073285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:20.091377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:20.092447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:20.092916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:20.093699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:20.094191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:20.094645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:20.247162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:20.262501 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3ab0f9c-870d-43b4-bebf-208299135ca2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1219 microversion: 2.1 time: 0.193757 Oct 06 13:26:20.287463 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2941/5896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:20 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:20.302195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:20.303270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:20.317378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:20.319139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:20.320664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:20.322256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:20.323344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:20.324303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:20.563916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:20.584505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e36d1163-1e92-4954-90ba-d268d6f43500 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.291189 Oct 06 13:26:20.585784 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2956/5897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:20 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:21.016819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:21.018363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:21.029564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.030583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.032075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.033272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.034201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.034943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.258353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:21.267640 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f12dc525-e079-4a2a-9a14-952119a3d153 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.257352 Oct 06 13:26:21.268240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2942/5898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:21 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:21.296690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:21.297970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:21.307161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.308831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.309577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.311184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.312168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.312880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.386694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:21.396626 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c49d5c8-7a61-4b47-8819-fcf0b48ac5b7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1211 microversion: 2.1 time: 0.105695 Oct 06 13:26:21.397505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2957/5899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:21 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:21.611007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:21.612886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:21.624844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.625936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.626757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.627825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:21.628459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:21.629863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:21.871333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:21.885752 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4814fcce-4cfa-4142-9a51-044961543816 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.279698 Oct 06 13:26:21.886927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2943/5900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:21 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:22.296602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:22.297539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:22.330000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:22.330634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:22.333107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:22.334883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:22.337130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:22.342681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:22.432043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:22.433880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:22.453092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:22.454178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:22.454848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:22.455922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:22.460205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:22.467441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:22.640684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:22.959492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:22.980923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4bbaa66c-6acc-42bf-9d80-f892fe14f78e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1273 microversion: 2.1 time: 0.560997 Oct 06 13:26:22.983152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2944/5901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:22 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1273 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:22.997017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:23.014826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:23.021217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:23.021728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:23.022224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:23.022961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:23.023429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:23.023876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:23.089021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:23.213504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:23.223309 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-352d2a97-ba08-4074-aa0b-3130db8c195d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.935032 Oct 06 13:26:23.238400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2958/5902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:22 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:23.469514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:23.479656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-50944c4f-9998-4831-ac2d-222215c21144 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.493627 Oct 06 13:26:23.485713 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2945/5903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:22 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:24.007219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:24.013064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:24.024256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.028139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.037724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.050142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.050845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.051375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.250433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:24.251410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:24.260324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.261153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.261845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.262861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.263583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.264223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.539691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:24.553087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4aeb1d81-7304-4fef-809d-dcbcaacb26b9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.550438 Oct 06 13:26:24.554230 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2959/5904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:24 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:24.561982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:24.562947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:24.570514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.571288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.571921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.572789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:24.573404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:24.574221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:24.733264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:24.744590 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5aea27b-d2ba-4754-8cde-595d8dbe88ee tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.500340 Oct 06 13:26:24.745699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2946/5905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:24 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:25.105145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:25.153983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f7e3ae00-fb26-4680-af22-a253631a3715 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.595340 Oct 06 13:26:25.181705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2960/5906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:24 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:25.268019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c639a264-ec49-47bc-b361-aac73212ab10", "name": "network-vif-plugged", "status": "completed", "tag": "d9931541-668b-4506-81e3-ef3be8770d8a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:25.278457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:25.279330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:25.280020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:25.292778 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] Creating event network-vif-plugged:d9931541-668b-4506-81e3-ef3be8770d8a for instance c639a264-ec49-47bc-b361-aac73212ab10 on n-h2-860556-1 Oct 06 13:26:25.298685 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a60133d4-c3c0-4875-9cec-3534a5002274 req-12417cb5-3f91-4abe-bfd2-ed6c0e7f67b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217181 Oct 06 13:26:25.299976 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2947/5907] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:25.584278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:25.584931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:25.600719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:25.601226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:25.601886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:25.602798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:25.603412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:25.603994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:25.783809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:25.785420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:25.798696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:25.801062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:25.801896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:25.802893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:25.806111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:25.806993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:26.141570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:26.164892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e12a49b0-b095-4a8b-8c27-a7e6cd6db2be tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.592415 Oct 06 13:26:26.178260 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2961/5908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:25 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:26.189569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:26.190283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:26.216184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:26.219589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:26.223579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:26.235410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:26.239470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:26.246900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:26.247479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:26.250363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:26.252726 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-66c1043d-c11b-4ce7-98c4-dbbeef913e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1366 microversion: 2.1 time: 0.474600 Oct 06 13:26:26.265620 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2948/5909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:25 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:26.673958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7acc65-1ecf-4441-a0bf-e0e8771c4163", "tag": "eedd3bc2-8d61-429a-8c16-ad5b52b5f487"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:26.705403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:26.705646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:26.706162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:26.710994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:26.727608 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c9bb5a3-71d8-47df-ab19-b191abe650f1 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1690 microversion: 2.1 time: 0.547015 Oct 06 13:26:26.729235 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2962/5910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:26 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1690 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:26.736436 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] Creating event network-changed:eedd3bc2-8d61-429a-8c16-ad5b52b5f487 for instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 on n-h2-860556-1 Oct 06 13:26:26.762302 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-77f466fd-9cf2-4652-ac26-af6a6a452b1b req-298f1b9c-d728-4a7c-8908-8b30401d5138 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095977 Oct 06 13:26:26.764375 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2949/5911] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:26:27.195969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:27.197503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:27.227969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.229318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.229977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.231075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.231915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.232897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.330223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:27.340394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:27.373142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.394939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.395758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.397049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.414305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.418050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.623892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:27.635528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e374134-d9d6-405b-b8f3-e5b1f93c2d50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.444093 Oct 06 13:26:27.636711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2963/5912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:27 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:27.751116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:27.753768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:27.761435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.762170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.762769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.764342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.765045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.765623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.898839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:27.908098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edd8e27b-aed4-4ab1-9f92-648d632ecfbb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1556 microversion: 2.1 time: 0.583869 Oct 06 13:26:27.908961 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2950/5913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:27 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1556 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:27.927426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:27.928485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:27.938686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.939414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.939967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:27.940800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:27.941682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:27.942423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:28.159617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:28.167954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6f94e2c-1a80-4c5d-91c8-d34cb87faae5 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1696 microversion: 2.1 time: 0.248971 Oct 06 13:26:28.168809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2951/5914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:27 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1696 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:28.175339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:28.176323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:28.184414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:28.185213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:28.187335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:28.190826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:28.190826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:28.190826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:28.292480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c4c368f1-d205-4869-a136-40cedfe101d3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122101 Oct 06 13:26:28.295042 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2952/5915] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:26:28 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:28.661584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:28.662399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:28.671005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:28.671850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:28.672377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:28.673253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:28.673848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:28.674483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:28.707760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:28.740970 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b37bb4b2-3d2a-4e24-879d-679a9608d90a tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "POST /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa/action" status: 200 len: 32590 microversion: 2.1 time: 0.994061 Oct 06 13:26:28.748385 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2964/5916] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:27 2022] POST /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa/action => generated 32590 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 13:26:29.196300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:29.197061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:29.199951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:29.215982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:29.216924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:29.217676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:29.218698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:29.219367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:29.219913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:29.768070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:29.777821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-21250b58-120d-4754-a33e-31e931357267 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 1.121037 Oct 06 13:26:29.778417 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2953/5917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:28 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:29.923963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:29.946049 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c80090ad-65c6-4d14-9a7f-e9dc86dba79e tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1696 microversion: 2.1 time: 0.754380 Oct 06 13:26:29.949579 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2965/5918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:29 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1696 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:30.805707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:30.813041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:30.842633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:30.843493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:30.846569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:30.848092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:30.848944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:30.852020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:30.972624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:30.973254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:31.000620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:31.001125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:31.001573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:31.002331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:31.002794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:31.003232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:31.074926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:31.813070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:31.834558 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d97db95-a73f-4165-9091-38c3ea1303f3 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1681 microversion: 2.1 time: 0.865839 Oct 06 13:26:31.835175 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2966/5919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:30 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1681 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:31.874405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c639a264-ec49-47bc-b361-aac73212ab10", "tag": "d9931541-668b-4506-81e3-ef3be8770d8a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:31.909771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:31.910453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:31.910914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:31.942062 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] Creating event network-changed:d9931541-668b-4506-81e3-ef3be8770d8a for instance c639a264-ec49-47bc-b361-aac73212ab10 on n-h2-860556-1 Oct 06 13:26:31.955604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b7731482-5dab-4041-8eb5-1edffde967fc req-dc32e02f-ee9f-4ac5-a642-2978378734fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116293 Oct 06 13:26:31.956235 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2967/5920] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:31.972193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "name": "network-vif-unplugged", "status": "completed", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:31.994765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:32.004410 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59d42eae-9a36-468d-9c54-8ad815f34944 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 1.202440 Oct 06 13:26:32.011503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.014301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.015445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:32.024140 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2954/5921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:30 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:32.032903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:32.036266 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] Creating event network-vif-unplugged:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:26:32.038852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:32.043280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-067f654c-1672-48c6-babb-116e1b97f403 req-3cf90a43-e664-4786-81a8-f70923f5a338 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083625 Oct 06 13:26:32.046846 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2968/5922] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:32.053594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4847f6b1-8ba9-45b0-8065-1e486b9a7daa", "tag": "04170bc9-ec53-469a-946c-b8bdfddd6724"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:32.058902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.070550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.071273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:32.076460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.077556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.078215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:32.085676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.086218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.086678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:32.094579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] Creating event network-changed:04170bc9-ec53-469a-946c-b8bdfddd6724 for instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa on n-h1-860556-1 Oct 06 13:26:32.102934 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-068370f7-a4ac-4651-a18f-672bb135fc5c req-0f0545aa-c13f-42ac-bcfc-8fd56bef650a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054240 Oct 06 13:26:32.104672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2969/5923] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:32.152429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:26:32.355520 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-295647d8-b3df-4a5c-8684-3ec027f47cac tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 204 len: 0 microversion: 2.1 time: 0.330042 Oct 06 13:26:32.359880 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2955/5924] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:26:32 2022] DELETE /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:26:32.366768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:32.368059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:32.380091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.386112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.386999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:32.388272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:32.389035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:32.389809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:33.056346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:33.057109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:33.072096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:33.072645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:33.073120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:33.073902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:33.074427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:33.074803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:33.133165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:33.149471 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36dafad3-116a-4f91-8ffc-f8fb85fad3db tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1670 microversion: 2.1 time: 0.784088 Oct 06 13:26:33.150946 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2970/5925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:32 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1670 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:33.399245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:33.410764 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89422114-6175-4740-acdf-554f6d57008c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.359170 Oct 06 13:26:33.418260 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2956/5926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:33 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:34.180402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:34.181042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:34.207012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:34.207839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:34.208480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:34.209789 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:34.217697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:34.218430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:34.456401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:34.457880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:34.472007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:34.476072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:34.479428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:34.480391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:34.483721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:34.485035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:35.164413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be83f14b61bf43338b24935f818a82a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ac24f87ad748e08a133a528fbc6f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:35.186657 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b1253aa-0cae-4119-8c19-fdece291bde7 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 200 len: 1670 microversion: 2.1 time: 1.011157 Oct 06 13:26:35.188343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2971/5927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:34 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 1670 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:35.199595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4847f6b1-8ba9-45b0-8065-1e486b9a7daa", "name": "network-vif-deleted", "tag": "04170bc9-ec53-469a-946c-b8bdfddd6724"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:35.257393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:35.258344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:35.259033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:35.283590 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] Creating event network-vif-deleted:04170bc9-ec53-469a-946c-b8bdfddd6724 for instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa on n-h1-860556-1 Oct 06 13:26:35.291056 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-69474137-0076-4111-8aeb-f5e7a5d4bbdf req-2f43905e-26ec-461c-bf26-c7edc7f02a94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101039 Oct 06 13:26:35.292164 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2972/5928] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:35.403073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:35.411703 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c4c29838-8fbc-4788-83d7-4e6aa7bace5d tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.961128 Oct 06 13:26:35.412318 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2957/5929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:34 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:35.791468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "name": "network-vif-plugged", "status": "completed", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:35.815162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:35.819017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:35.826917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:35.867315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] Creating event network-vif-plugged:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:26:35.876293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5721dd09-99ff-4893-bc92-14c70d97af4f req-6fbb7abf-e403-4c61-9afc-21d7b89005bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089758 Oct 06 13:26:35.877633 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2973/5930] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:36.212661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:36.213868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] [instance: 4847f6b1-8ba9-45b0-8065-1e486b9a7daa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:36.222340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:36.223689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:36.224622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:36.225532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:36.226229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:36.226882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:36.242360 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] HTTP exception thrown: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Request method failure captured: Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa HTTP/1.1 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtZ-yFT9sRqDdK3KezJ6h5zB3FFK0L9MFV8CLlmfI6d9zEqyx2Zk2Q1CYzjrtEGYLz7WdHgJvJzJrCAylh6KzrOuJak1oXCvEJrIJlM1jrexfHmOxHOTkv919fyMcUJNOf6dFeBDFtn8EIpAXdONDPqLKS0Rvrc5cBu8q5RlF1rqkWM Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_46ac24f87ad748e08a133a528fbc6f01", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/46ac24f87ad748e08a133a528fbc6f01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/46ac24f87ad748e08a133a528fbc6f01"}]}] Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 46ac24f87ad748e08a133a528fbc6f01 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkBasicOps-1301651061 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: be83f14b61bf43338b24935f818a82a5 Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkBasicOps-1301651061-project Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4847f6b1-8ba9-45b0-8065-1e486b9a7daa'} Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:26:36.244251 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. Oct 06 13:26:36.249037 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:26:36.250663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Returning 404 to user: Instance 4847f6b1-8ba9-45b0-8065-1e486b9a7daa could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:26:36.251719 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f35393f2-8c98-4a37-9253-6a7d5b77f446 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa" status: 404 len: 111 microversion: 2.1 time: 0.043007 Oct 06 13:26:36.255930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2958/5931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:36 2022] GET /compute/v2.1/servers/4847f6b1-8ba9-45b0-8065-1e486b9a7daa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:26:36.440175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:36.440889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:36.460805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:36.461312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:36.461780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:36.468700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:36.468700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:36.468700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:36.698440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99b6d5d3-19d0-43a8-b498-d9506dbb0047 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] Calling method '.version_select at 0x7f7d3e736280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:36.745591 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99b6d5d3-19d0-43a8-b498-d9506dbb0047 tempest-TestNetworkBasicOps-1301651061 tempest-TestNetworkBasicOps-1301651061-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-570613791" status: 202 len: 0 microversion: 2.1 time: 0.051017 Oct 06 13:26:36.750333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:36.755574 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2959/5932] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Oct 6 13:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-570613791 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:26:36.758988 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e385431-8bf1-44b6-be8e-9786a914afda tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.323603 Oct 06 13:26:36.759576 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2974/5933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:36 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:37.784676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:37.785213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:37.808849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:37.809396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:37.809883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:37.811587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:37.812066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:37.812512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:37.967461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7acc65-1ecf-4441-a0bf-e0e8771c4163", "name": "network-vif-plugged", "status": "completed", "tag": "eedd3bc2-8d61-429a-8c16-ad5b52b5f487"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:38.006248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:38.010593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:38.012437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:38.015421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:38.057771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] Creating event network-vif-plugged:eedd3bc2-8d61-429a-8c16-ad5b52b5f487 for instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 on n-h2-860556-1 Oct 06 13:26:38.068297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-466e23de-5a2f-4809-b2a1-3a37093c6a05 req-282b4b26-abd4-4856-ac68-268d645d15fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114280 Oct 06 13:26:38.070334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2975/5934] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:26:38.668586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:38.673642 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-423cf2d5-5867-49b5-bdf9-5b4ea0e61be2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.893734 Oct 06 13:26:38.674647 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2960/5935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:37 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:39.697456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:39.699530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:39.708566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:39.709427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:39.710153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:39.711301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:39.711988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:39.712638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:40.550264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:40.585137 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-886cd070-b8f5-45fb-ba85-098b26ce0fa4 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1315 microversion: 2.1 time: 0.892023 Oct 06 13:26:40.590108 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2976/5936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:39 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:41.615946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:41.618046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:41.630105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:41.632424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:41.633228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:41.634070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:41.635561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:41.636451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:41.637188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.127640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:42.147600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a82331a1-3690-40bf-a528-11f3c7705ee9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1501 microversion: 2.1 time: 0.537260 Oct 06 13:26:42.165654 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2961/5937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:41 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:42.179862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:42.181113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:42.190943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.191634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.192328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.193266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.194589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.195214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.628003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:42.636629 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4af2f48-d325-4a22-b189-edddf9b3c8c3 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1501 microversion: 2.1 time: 0.463655 Oct 06 13:26:42.638166 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2977/5938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:42 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1501 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:42.667681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:42.669842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:42.681798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.682396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.683911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.685975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.687468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.688172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.728331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lazy-loading 'flavor' on Instance uuid 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:26:42.862895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f8305cc-4d46-45d6-b176-cf7aa4195241 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action" status: 202 len: 0 microversion: 2.1 time: 0.199613 Oct 06 13:26:42.867816 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2962/5939] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:42 2022] POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:26:42.873360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:42.874445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:42.888509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.890847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.895373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:42.898123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:42.900582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:42.902096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:43.318633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:43.328855 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f20dfeb8-bb0a-4719-a4d0-15d292f51b63 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1509 microversion: 2.1 time: 0.460597 Oct 06 13:26:43.330210 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2978/5940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:42 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:44.356284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:44.357825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:44.371957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:44.373223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:44.375950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:44.379346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:44.380052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:44.380669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:45.298328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:45.307943 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca7d7c4f-4570-4810-97dc-53f55cc0ddc1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1492 microversion: 2.1 time: 0.956502 Oct 06 13:26:45.311270 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2963/5941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:44 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1492 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:45.338336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:45.342880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:45.352146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:45.353389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:45.354109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:45.354981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:45.355487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:45.356134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:45.579348 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-322b0ffe-09c1-4bec-bddc-62c722f93796 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action" status: 202 len: 0 microversion: 2.1 time: 0.246395 Oct 06 13:26:45.580159 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2979/5942] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:45 2022] POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:26:45.606702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:45.612399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:45.637195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:45.638955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:45.639971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:45.641306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:45.642145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:45.643562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:46.337579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:46.343671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:46.360689 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2bb76b04-f9bf-499c-831e-83988817538e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1498 microversion: 2.1 time: 0.773488 Oct 06 13:26:46.411657 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2964/5943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:45 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1498 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:26:47.392138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:47.395958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:47.417699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:47.423119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:47.426368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:47.428702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:47.432290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:47.435125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:47.737567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:47.746941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-565c936a-2735-4ae2-a89a-d9486aa565fa tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1498 microversion: 2.1 time: 0.363289 Oct 06 13:26:47.763404 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2980/5944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:47 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:48.772002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:48.772706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:48.797436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:48.798053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:48.798658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:48.799625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:48.800290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:48.803899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:49.346482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:49.364826 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d115c2d-d928-4e1d-b55a-ca4184126ff1 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1501 microversion: 2.1 time: 0.597656 Oct 06 13:26:49.369406 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2965/5945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:48 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1501 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:49.389674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:49.390264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:49.399602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:49.400105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:49.400551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:49.401308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:49.401712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:49.402172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:49.458653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lazy-loading 'flavor' on Instance uuid 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:26:49.600602 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a665aa01-f174-4970-8b59-f0b2607203a7 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action" status: 202 len: 0 microversion: 2.1 time: 0.215265 Oct 06 13:26:49.602217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2981/5946] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:49 2022] POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:26:49.611626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:49.612805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:49.626943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:49.628240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:49.628942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:49.630513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:49.631228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:49.631891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:49.893749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:49.936879 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-badf13f3-2459-4bfd-addc-b985fc536c50 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1509 microversion: 2.1 time: 0.325560 Oct 06 13:26:49.937557 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2966/5947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:49 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:50.976553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:50.979463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:51.004554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.006513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.009031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:51.010249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.013484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.014228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:51.365343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:51.379602 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c70278d6-4000-4c16-8ee5-a9e8c0cc5e3b tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1492 microversion: 2.1 time: 0.418193 Oct 06 13:26:51.398544 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2982/5948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:50 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1492 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:51.403394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:51.404108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:51.426552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.428836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.429302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:51.430135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.430596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.431086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:51.662951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b57ff93d-c988-4924-86f3-c99bf164d2e9 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action" status: 202 len: 0 microversion: 2.1 time: 0.263606 Oct 06 13:26:51.665467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2967/5949] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:51 2022] POST /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:26:51.675120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:51.675745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:51.691294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.692070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.692070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:51.707226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:51.709841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:51.711958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:52.468585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:52.488110 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2b28bd7-9b07-4ec9-a422-e98c9149f9c5 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1498 microversion: 2.1 time: 0.817007 Oct 06 13:26:52.496089 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2983/5950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:51 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1498 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:53.517658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:53.519305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:53.545679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:53.547187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:53.547761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:53.549365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:53.550626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:53.555032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:53.837562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:53.856434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8393fe3e-fd87-4a3a-8a21-7a3ee0c22b27 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1498 microversion: 2.1 time: 0.344191 Oct 06 13:26:53.857361 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2968/5951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:53 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1498 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:54.885171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:54.885884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:54.898613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:54.899126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:54.899579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:54.904673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:54.905169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:54.915433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:55.003206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:26:55.221919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:55.231775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-df140a86-8c6e-4e78-93ec-ea8294f48f6c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1501 microversion: 2.1 time: 0.350956 Oct 06 13:26:55.251795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2984/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:54 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1501 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:55.267686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:55.269705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:55.293450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:55.295664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:55.296716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:55.299323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:55.300948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:55.314084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:55.432147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:26:55.625616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e87099f-22eb-4c3f-a2c6-06cef23446d2 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 204 len: 0 microversion: 2.1 time: 0.364526 Oct 06 13:26:55.633868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2969/5953] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:26:55 2022] DELETE /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:26:55.639286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:55.640383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:55.654869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:55.656727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:55.658179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:55.660660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:55.662366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:55.665314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:56.040757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:56.054724 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb4bbdad-cae9-4c04-9fba-c8379c1bc785 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1507 microversion: 2.1 time: 0.419813 Oct 06 13:26:56.081626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2985/5954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:55 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:57.112545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:57.117857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:57.133982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:57.134500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:57.134943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:57.140335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:57.142399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:57.142961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:57.501911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:57.520763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed32a116-4a93-405d-bbb6-860d5e86319c tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1507 microversion: 2.1 time: 0.418612 Oct 06 13:26:57.522935 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2970/5955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:57 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:58.158223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:58.160588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:58.181472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:58.193210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:58.195010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:58.196009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:58.196685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:58.197289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:58.335111 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4801e6f-7891-40df-87d2-cf19c2cfadd4 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action" status: 200 len: 24572 microversion: 2.1 time: 0.182257 Oct 06 13:26:58.344778 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2986/5956] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:26:58 2022] POST /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020/action => generated 24572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 13:26:58.547182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:58.548768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:26:58.558014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:58.568923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:58.570005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:58.571360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:58.572031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:58.572652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:58.950571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:26:58.968825 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf7fd2cf-2bf5-444d-8b2e-2cab2399e195 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1507 microversion: 2.1 time: 0.425871 Oct 06 13:26:58.972031 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2971/5957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:58 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:26:59.205765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7acc65-1ecf-4441-a0bf-e0e8771c4163", "name": "network-vif-deleted", "tag": "eedd3bc2-8d61-429a-8c16-ad5b52b5f487"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:26:59.232673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:26:59.234225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:26:59.234676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:26:59.288946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] Creating event network-vif-deleted:eedd3bc2-8d61-429a-8c16-ad5b52b5f487 for instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 on n-h2-860556-1 Oct 06 13:26:59.304787 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3eb9ce54-e14f-4d8b-94c9-8c7b12fd7c55 req-78911fce-cb27-4c8d-95e3-647e7ee59257 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106729 Oct 06 13:26:59.305433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2987/5958] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:26:59.992651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:26:59.993959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:00.003857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:00.011243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:00.012073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:00.013676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:00.014517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:00.015111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:00.084117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:00.084117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:00.088303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:00.088303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lazy-loading 'fault' on Instance uuid 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:27:00.206216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7414c5526c741c7b101d28deccab90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4502b6693f3421f935fac5c0f4f5b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:00.230490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2b4415f4-114d-4e3a-b333-9233ce97377e tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 200 len: 1305 microversion: 2.1 time: 0.240491 Oct 06 13:27:00.232390 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2972/5959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:26:59 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 1305 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:01.257553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:01.258954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] [instance: 8c7acc65-1ecf-4441-a0bf-e0e8771c4163] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:01.277002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:01.282785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:01.283504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:01.284464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:01.294460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:01.295129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:01.336263 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] HTTP exception thrown: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Request method failure captured: Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 HTTP/1.1 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtd1rJZfasHiJsuHxD5TxfF8xG3IoMGz95pAY9MDbD4YWCh1PaYBmKJyvxK2RFnxRZTjDv6euWmJTsdD1a6_BXeV3Ae_fCYHxcZNNOL1ZmxDYT54IwA4N3ogn8WY3JZz8CkR2rUS39obkGe8JUb_tdaqOQJDTk_Af_YG-BBZqxO1Si0 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b4502b6693f3421f935fac5c0f4f5b55 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestServerAdvancedOps-1594096795 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4502b6693f3421f935fac5c0f4f5b55", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4502b6693f3421f935fac5c0f4f5b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4502b6693f3421f935fac5c0f4f5b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4502b6693f3421f935fac5c0f4f5b55"}]}] Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestServerAdvancedOps-1594096795 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b4502b6693f3421f935fac5c0f4f5b55 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestServerAdvancedOps-1594096795 Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestServerAdvancedOps-1594096795-project Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f7414c5526c741c7b101d28deccab90b Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestServerAdvancedOps-1594096795-project Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '8c7acc65-1ecf-4441-a0bf-e0e8771c4163'} Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:27:01.344417 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. Oct 06 13:27:01.352381 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:27:01.357709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] Returning 404 to user: Instance 8c7acc65-1ecf-4441-a0bf-e0e8771c4163 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:27:01.359112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5a6cd77-8f8b-411d-9727-67cd4ad468a6 tempest-TestServerAdvancedOps-1594096795 tempest-TestServerAdvancedOps-1594096795-project] 10.222.0.26 "GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163" status: 404 len: 111 microversion: 2.1 time: 0.107413 Oct 06 13:27:01.367743 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2988/5960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:01 2022] GET /compute/v2.1/servers/8c7acc65-1ecf-4441-a0bf-e0e8771c4163 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:27:13.297726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:13.298999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:13.321861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:13.328128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:13.338312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:13.340744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:13.343078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:13.363460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:13.363937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:13.369330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:13.395926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:13.439631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=27 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:13.445091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=16 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:13.453891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:13.455696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:13.457513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:13.525574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] Creating event network-changed:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:27:13.567698 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-862aea4a-3b4d-4595-aa10-40d7014e0735 req-57348892-2b7d-422d-bfb9-1ace5013e359 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164221 Oct 06 13:27:13.570799 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2989/5961] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:13.580871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:27:13.973015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df000c20-a3a9-4e65-b536-b9d9b1a6dbcb tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 204 len: 0 microversion: 2.1 time: 0.682153 Oct 06 13:27:13.979304 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2973/5962] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:27:13 2022] DELETE /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:27:13.992535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:13.994370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:14.021368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:14.024127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:14.024739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:14.025593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:14.028995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:14.031342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:14.479391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:14.497712 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b53c0e97-5b27-40aa-868f-a0453b69eebf tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1687 microversion: 2.1 time: 0.504146 Oct 06 13:27:14.498529 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2990/5963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:13 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1687 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:15.532515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:15.535051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:15.557088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:15.557848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:15.585999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:15.591880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:15.592494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:15.592956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:16.221344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:16.233230 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e1d9441-5056-414b-af50-e11ee7dc2b20 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1687 microversion: 2.1 time: 0.707714 Oct 06 13:27:16.241616 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2974/5964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:15 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1687 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:27:16.951412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40444f2d-aa0b-4646-8c82-42d1ef5a1020", "name": "network-vif-deleted", "tag": "6a7a4d9f-cfda-45cd-9f8a-d6210683cc02"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:16.994250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:16.996261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:16.996710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:17.035356 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] Creating event network-vif-deleted:6a7a4d9f-cfda-45cd-9f8a-d6210683cc02 for instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 on n-h1-860556-1 Oct 06 13:27:17.042307 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b1525403-b0ed-4b87-aef4-c52d2e38b553 req-d35b9ae2-81b3-41a2-84b5-34d11079b45f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095320 Oct 06 13:27:17.049360 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2991/5965] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:17.273552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:17.274596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:17.305931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:17.306444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:17.306893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:17.316711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:17.320139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:17.323977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:17.382222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:17.382884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:17.383178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:17.383644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lazy-loading 'fault' on Instance uuid 40444f2d-aa0b-4646-8c82-42d1ef5a1020 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:27:17.437794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b277518fc7b4784ba547a15bdcf3d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed3a75f24b140e5879c48dba0eda9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:17.453637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44b2178c-adee-4582-be7c-869b73592e59 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 200 len: 1355 microversion: 2.1 time: 0.184457 Oct 06 13:27:17.468031 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2975/5966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:17 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 1355 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:17.692366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1712192285", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a494e299-ee2e-4524-86c2-d8fbcd0ff27c"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:17.881533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] validate_networks() for [('a494e299-ee2e-4524-86c2-d8fbcd0ff27c', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:27:18.510390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:18.512130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] [instance: 40444f2d-aa0b-4646-8c82-42d1ef5a1020] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:18.525142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:18.535082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:18.537556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:18.540051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:18.540359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:18.540817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:18.593557 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] HTTP exception thrown: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Request method failure captured: Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 HTTP/1.1 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtTsmOb2IHtwihdePXyfADQfkW9MCVUqYnyuz55PDdEtUaJQHgtSHH1_d8Z95Vl8OkADR1orN1ChZVgXm5fYPEFANxDrcd2eU6OpZ3BhqaqbU1zbg54exJX19aCxF02OkzSa-vYBp6RoWERABvtnoIm_4o1tDTtzLFkehLLNw1Jr3_c Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ed3a75f24b140e5879c48dba0eda9cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ed3a75f24b140e5879c48dba0eda9cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ed3a75f24b140e5879c48dba0eda9cc"}]}] Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0ed3a75f24b140e5879c48dba0eda9cc Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1296550934 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 4b277518fc7b4784ba547a15bdcf3d54 Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1296550934-project Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '40444f2d-aa0b-4646-8c82-42d1ef5a1020'} Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:27:18.595356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Returning 404 to user: Instance 40444f2d-aa0b-4646-8c82-42d1ef5a1020 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:27:18.599860 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65d3837a-1031-46f3-95ce-43f17f24d5dc tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020" status: 404 len: 111 microversion: 2.1 time: 0.093574 Oct 06 13:27:18.605014 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2976/5967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:18 2022] GET /compute/v2.1/servers/40444f2d-aa0b-4646-8c82-42d1ef5a1020 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:27:18.652218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:27:18.652699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:27:18.653691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:27:18.654271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:27:18.654692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:27:18.666027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:18.666605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:18.667212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:18.667949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:18.668411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:18.669557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:18.693276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Getting quotas for project 5ed10bcd1ba54f64a16682d07df981c2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:27:18.699946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Getting quotas for user 646255cdb1ab4b2cbfc6ea729acd593b and project 5ed10bcd1ba54f64a16682d07df981c2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:27:18.714627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:27:18.718944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:27:18.786414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a761a17-26e9-42cb-b837-c48981477f2c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099336 Oct 06 13:27:18.789239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2992/5968] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:27:18.802295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57a9388b-2fc2-4c59-922e-967c5578ac2d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:18.803216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57a9388b-2fc2-4c59-922e-967c5578ac2d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:18.894913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-57a9388b-2fc2-4c59-922e-967c5578ac2d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:18.904984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57a9388b-2fc2-4c59-922e-967c5578ac2d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1219 microversion: 2.1 time: 0.106932 Oct 06 13:27:18.910150 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2977/5969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:18 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:19.937659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:19.938576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:19.959085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:19.962067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:19.963107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:19.970867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:19.974500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:19.975427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:20.098530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:20.112008 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3bfe1f8b-2e3b-4c4d-b347-2ab5dabac728 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1271 microversion: 2.1 time: 0.180552 Oct 06 13:27:20.114198 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2993/5970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:19 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:21.137123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:21.138236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:21.151031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:21.151824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:21.152528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:21.154818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:21.155640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:21.160101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:21.341593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:21.370771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3241f46-8f8c-4f50-826d-0fe6068a7fab tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1277 microversion: 2.1 time: 0.237905 Oct 06 13:27:21.371397 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2978/5971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:21 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:22.397815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:22.398443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:22.414197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:22.427163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:22.428169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:22.429191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:22.429862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:22.430514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:22.809694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:22.845344 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-631fd744-1be8-458c-90c9-03d2b5c7bf4f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1277 microversion: 2.1 time: 0.443080 Oct 06 13:27:22.849121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2994/5972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:22 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1277 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:23.874687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:23.875368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:23.899705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:23.900796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:23.900796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:23.901358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:23.901847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:23.902312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:24.563356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:24.572134 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b54017b9-9297-4db7-b521-9aa1e5339c44 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.702272 Oct 06 13:27:24.591718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2979/5973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:23 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:25.603356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:25.604304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:25.619009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:25.621140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:25.623254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:25.625450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:25.626305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:25.627021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:26.008529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:26.023849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2918fadc-a4cd-466f-a53d-2a883473e250 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.425584 Oct 06 13:27:26.026532 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2995/5974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:25 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:27.056759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:27.057378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:27.079328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:27.080189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:27.082330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:27.083384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:27.085414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:27.086736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:27.487825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:27.500180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-978843d5-617e-46b8-bd03-251b48c50faa tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.449571 Oct 06 13:27:27.502711 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2980/5975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:27 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:27.607611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c643b9-655b-42c2-8a96-889955dfa27d", "tag": "b1c6bf52-790c-4854-aa97-dbb7805a9931"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:27.634676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:27.636594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:27.638655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:27.670761 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] Creating event network-changed:b1c6bf52-790c-4854-aa97-dbb7805a9931 for instance e9c643b9-655b-42c2-8a96-889955dfa27d on n-h1-860556-1 Oct 06 13:27:27.700112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c9f398e0-9e69-495c-9104-c77ee3ac7513 req-f1361bb4-6ed9-4e58-9e85-c4aa144003e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127769 Oct 06 13:27:27.705983 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2996/5976] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:28.529217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:28.532127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:28.557278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:28.561313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:28.562727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:28.565161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:28.569447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:28.570283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:28.904337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:29.114009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:29.122827 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-febbd8c2-d1f8-4e5f-94ea-e531b94f0b69 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.599162 Oct 06 13:27:29.128899 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2981/5977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:28 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:30.152646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:30.154402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:30.161878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:30.169969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5e86b72-be37-477a-a3eb-f1e423481255 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] Calling method '.version_select at 0x7f7d3f1e9940>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:30.180416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:30.229061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:30.232828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:30.234849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:30.241723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:30.243411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:30.244688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:30.255143 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5e86b72-be37-477a-a3eb-f1e423481255 tempest-TestNetworkAdvancedServerOps-1296550934 tempest-TestNetworkAdvancedServerOps-1296550934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-172437271" status: 202 len: 0 microversion: 2.1 time: 0.087826 Oct 06 13:27:30.259267 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2982/5978] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 13:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-172437271 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:27:31.204321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:31.214627 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-106a189a-99ba-4ec2-b547-8f5e133847f5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 1.064187 Oct 06 13:27:31.221794 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2997/5979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:30 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:32.244380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:32.245730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:32.289857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:32.297322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:32.298088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:32.299253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:32.299909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:32.300514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:32.847944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:32.864538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-788de204-eb12-4a05-b17b-52b8e5e7e08a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.625556 Oct 06 13:27:32.866924 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2983/5980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:32 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:27:33.890016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:33.891479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:33.911009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:33.913302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:33.915138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:33.926353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:33.931737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:33.932895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:34.577262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:34.595835 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc016363-48b2-487a-876b-29503a9e1d9d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.708380 Oct 06 13:27:34.598031 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2998/5981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:33 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:35.628540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:35.629895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:35.638908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:35.639676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:35.640393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:35.641350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:35.642341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:35.643015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:36.213150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:36.224529 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b1be2c7-c0e7-477e-8dd5-4bcd828c6869 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.599571 Oct 06 13:27:36.227112 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2984/5982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:35 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:36.451572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:36.455816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:36.476037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:36.477254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:36.478144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:36.479517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:36.480449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:36.481944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:36.536987 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4bd11fc2-35e3-4df1-ab9b-70455f502444 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/ips" status: 200 len: 150 microversion: 2.1 time: 0.095255 Oct 06 13:27:36.538749 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 2999/5983] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:27:36 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:27:37.255402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:37.256038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:37.264510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:37.265484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:37.266349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:37.267332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:37.268022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:37.268678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:37.687066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:37.713452 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-198e4c44-6a5d-44b4-971c-b3c77271c6ed tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.461383 Oct 06 13:27:37.725777 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2985/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:37 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:38.023965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c643b9-655b-42c2-8a96-889955dfa27d", "name": "network-vif-plugged", "status": "completed", "tag": "b1c6bf52-790c-4854-aa97-dbb7805a9931"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:38.064034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:38.064693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:38.065069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:38.112849 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] Creating event network-vif-plugged:b1c6bf52-790c-4854-aa97-dbb7805a9931 for instance e9c643b9-655b-42c2-8a96-889955dfa27d on n-h1-860556-1 Oct 06 13:27:38.124218 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8e7b7d68-8c09-4010-b8a5-820dc91a87ce req-48135797-cfa7-47bb-8fb7-9ef36a7fff48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105412 Oct 06 13:27:38.126114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3000/5985] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:38.741609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:38.743360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:38.761494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:38.762241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:38.762764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:38.763561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:38.764100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:38.764604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:39.199115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ba046c-66ae-48da-86ac-f3c040b2b173"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:39.212569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:39.223568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:39.224359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:39.224975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:39.225897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:39.226921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:39.228153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:39.277601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:39.295735 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e1db062-4495-4d1e-a8ca-6fea8f1a4a9f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1319 microversion: 2.1 time: 0.558022 Oct 06 13:27:39.297175 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2986/5986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:38 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:40.042006 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31bb14a0-e3b0-4097-9a11-11b1fa61a36f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851770 Oct 06 13:27:40.044754 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3001/5987] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:27:39 2022] POST /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:40.327848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:40.331364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:40.368758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:40.370265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:40.371646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:40.374675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:40.376645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:40.380818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:40.933605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:27:40.948017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-640c89c3-87a4-42aa-88c4-ab66c198c1c4 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1507 microversion: 2.1 time: 0.627597 Oct 06 13:27:40.948829 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2987/5988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:40 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:41.631496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:41.633413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:41.634604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:41.635544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:41.637620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:41.639061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:41.639505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:41.711319 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aae7d328-ffc3-4e80-9f59-874fba1d5ae9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.556632 Oct 06 13:27:41.730811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3002/5989] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Oct 6 13:27:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:41.934511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1147946957", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "availability_zone": "nova:n-h2-860556-1", "networks": [{"uuid": "1113973c-aeba-4be7-8bab-349f69516529"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:42.106037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] validate_networks() for [('1113973c-aeba-4be7-8bab-349f69516529', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:27:43.511026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:27:43.511825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:27:43.512317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:27:43.512987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:27:43.514118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:27:43.554159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:43.602678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:43.603542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:43.604322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:43.605807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:43.606943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:43.607958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:43.664774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:43.736717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Getting quotas for project 18cb39d6383e4824bcb1e06ea70a952a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:27:43.749575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Getting quotas for user 123babbc8bbc4f83b235e11bcbf5f4f5 and project 18cb39d6383e4824bcb1e06ea70a952a. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:27:43.767331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:27:43.769796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:27:43.876973 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4b347dd-da0b-47fc-a858-eb0e3613bc52 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.936918 Oct 06 13:27:43.883768 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2988/5990] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:27:43.894836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ab6bf5a-0a92-4a11-9ddd-b43bcaf27d44 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:43.896287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ab6bf5a-0a92-4a11-9ddd-b43bcaf27d44 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:43.935432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:44.079606 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ab6bf5a-0a92-4a11-9ddd-b43bcaf27d44 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1329 microversion: 2.1 time: 0.183937 Oct 06 13:27:44.081267 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3003/5991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:43 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1329 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:27:45.105449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8eb9148e-b932-4c63-92b8-41f76bdf8bea tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:45.106333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8eb9148e-b932-4c63-92b8-41f76bdf8bea tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:45.270452 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8eb9148e-b932-4c63-92b8-41f76bdf8bea tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1329 microversion: 2.1 time: 0.170192 Oct 06 13:27:45.273718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2989/5992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:45 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1329 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:46.294453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:46.295612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:46.329443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:46.330013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:46.341793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:46.341793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:46.341793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:46.348150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:46.414589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:46.540868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-286a7e4e-8977-4984-a40c-f43f3ea09f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1338 microversion: 2.1 time: 0.249971 Oct 06 13:27:46.541323 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3004/5993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:46 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:47.571568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:47.573227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:47.606247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:47.607116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:47.607740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:47.619294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:47.619294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:47.623199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:47.840482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2f122e5-88dc-4238-8a39-16265a2ad6c2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1424 microversion: 2.1 time: 0.276487 Oct 06 13:27:47.850428 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2990/5994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:47 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1424 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:48.897132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:48.897790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:48.925005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:48.926760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:48.927266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:48.928482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:48.929141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:48.929596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:49.324617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3be2aca-6c79-4521-9a0f-0e238029265c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1422 microversion: 2.1 time: 0.441230 Oct 06 13:27:49.348563 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3005/5995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:48 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1422 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:50.375414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:50.376701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:50.398091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:50.417558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:50.421261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:50.422370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:50.422857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:50.423288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:51.026197 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d859867f-9c19-4035-bd3f-87e2a2ab1f73 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.652141 Oct 06 13:27:51.030499 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2991/5996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:50 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:52.057138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:52.057780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:52.068780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:52.074293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:52.077422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:52.078135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:52.086972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:52.093549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:52.094453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:52.594549 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d21c430f-2f2e-445e-8ab3-815a617f618f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.538711 Oct 06 13:27:52.596192 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3006/5997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:52 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:52.974022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13012f07-639f-4ca8-b641-2a87754b450b", "tag": "3169c05e-091d-4829-89b8-5e9a6067d39a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:52.996048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:52.996745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:52.997289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:53.028669 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] Creating event network-changed:3169c05e-091d-4829-89b8-5e9a6067d39a for instance 13012f07-639f-4ca8-b641-2a87754b450b on n-h2-860556-1 Oct 06 13:27:53.038097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-89c88876-22c0-4abf-afc4-b509a0eb6090 req-89dc3657-b8d9-46f5-b7b3-8c465f6186cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Oct 06 13:27:53.042812 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2992/5998] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:27:53.619843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:53.620617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:53.638067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:53.638575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:53.639021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:53.639768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:53.640224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:53.640794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:53.946120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-526148e9-72ef-4fac-a239-d32e491a2bc7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.329052 Oct 06 13:27:53.946777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3007/5999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:53 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:27:54.972853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:54.979105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:54.995183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:55.003464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:55.004231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:55.004886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:55.006281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:55.006963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:55.007825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:55.264474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78627d3c-d9e4-48e4-8f9c-972a1ffeb03f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.298498 Oct 06 13:27:55.266095 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2993/6000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:54 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:56.295848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:56.298920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:56.320170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:56.328470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:56.328981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:56.329433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:56.339460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:56.340059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:56.340529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:56.606965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4851ec8b-5bb8-44d7-9abb-f64c7b356322 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.316614 Oct 06 13:27:56.615914 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3008/6001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:56 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:57.639264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:57.640271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:57.642693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:27:57.660724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:57.661408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:57.662000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:57.662863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:57.663458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:57.664008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:57.956655 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52b3f798-54ad-4731-97c5-b386aabcc75d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.321321 Oct 06 13:27:57.985354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2994/6002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:57 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:59.002785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:27:59.003809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:27:59.022843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:59.025057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:59.025728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:59.030039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:27:59.031102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:27:59.032523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:27:59.358399 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8da15f49-f5bb-4bd0-8412-9e3ffa6797a5 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.362973 Oct 06 13:27:59.359980 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3009/6003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:27:58 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:27:59.626988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7f2c00ff-08fd-4935-a5c4-e77f7b336e54 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: .version_select at 0x7f7d475b1e50>, body: {"keypair": {"name": "tempest-keypair-1616430709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcsYgCrZRUCyuKhH1AjPMWmFobeGx0iU6MDMsIYmHaf+aUDZXQkm9urIFeu+K+i/COJgabLg99qOPc35RbaoyQnChnGmM/R9JXScfRLHKd2smDpvSAXwo9/IeyIFGLyCg=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:27:59.675413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7f2c00ff-08fd-4935-a5c4-e77f7b336e54 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:27:59.693608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-7f2c00ff-08fd-4935-a5c4-e77f7b336e54 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:27:59.758852 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7f2c00ff-08fd-4935-a5c4-e77f7b336e54 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157696 Oct 06 13:27:59.763713 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2995/6004] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:27:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:00.334839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13012f07-639f-4ca8-b641-2a87754b450b", "name": "network-vif-plugged", "status": "completed", "tag": "3169c05e-091d-4829-89b8-5e9a6067d39a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:00.349507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:00.350665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:00.351390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:00.371102 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] Creating event network-vif-plugged:3169c05e-091d-4829-89b8-5e9a6067d39a for instance 13012f07-639f-4ca8-b641-2a87754b450b on n-h2-860556-1 Oct 06 13:28:00.382348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:00.383391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:00.389988 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-85d6202f-4fa5-4a77-97fd-e78bd10d2651 req-6bf42c54-3cbc-462e-a6d7-2e2a0e2d0ca6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060120 Oct 06 13:28:00.393531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:00.394880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3010/6005] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:00.395608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:00.396344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:00.397329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:00.398098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:00.398769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:00.727429 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8da2bf4c-5192-4f33-aed8-7f87e9f39851 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.348797 Oct 06 13:28:00.733711 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2996/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:00 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:01.767058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:01.768656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:01.785390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:01.787052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:01.788453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:01.790302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:01.792482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:01.793941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:02.210418 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f5abe06-9660-4849-bad1-b4ab3b2cad0a tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1464 microversion: 2.1 time: 0.450457 Oct 06 13:28:02.211774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3011/6007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:01 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1464 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:03.239693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:03.240392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:03.255362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:03.256124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:03.257728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:03.259324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:03.260647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:03.261509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:03.301276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1627523630", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb0b016-19fe-46cc-81a2-ae79246f7798"}], "security_groups": [{"name": "tempest-securitygroup--1732893853"}], "key_name": "tempest-keypair-1616430709", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:03.605264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] validate_networks() for [('2eb0b016-19fe-46cc-81a2-ae79246f7798', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:28:03.901693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8dc5cf5e-15d6-4bf2-b028-522eaad9118c tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1648 microversion: 2.1 time: 0.664999 Oct 06 13:28:03.907579 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2997/6008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:03 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1648 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:03.933696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:03.935125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:03.946917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:03.947531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:03.948126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:03.960241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:03.961058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:03.961728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:04.381895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9d90ffac-525c-43a5-884a-b960bd1d967e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1648 microversion: 2.1 time: 0.453007 Oct 06 13:28:04.383599 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2998/6009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:03 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1648 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:04.410198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:04.410918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:04.423724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:04.424507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:04.425177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:04.426264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:04.427926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:04.430865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:04.646997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:28:04.647599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:28:04.647897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:28:04.648314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:28:04.648737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:28:04.664379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:04.664872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:04.665317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:04.666109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:04.666573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:04.666996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:04.736945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:28:04.755294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:28:04.782215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:28:04.791122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:28:04.842873 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f9c139cf-d837-4ad0-853a-b4d56ee393d9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1648 microversion: 2.1 time: 0.436667 Oct 06 13:28:04.845570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 2999/6010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:04 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1648 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:04.957469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf0a8099-3cff-4194-8ba6-33444c656f34 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.660094 Oct 06 13:28:04.968855 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3012/6011] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:28:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:28:04.972442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f66af23-32c5-45fd-b21f-5849dd06f205 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:04.973140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f66af23-32c5-45fd-b21f-5849dd06f205 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:05.128179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1762893266", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "availability_zone": "nova:n-h1-860556-1", "networks": [{"uuid": "1113973c-aeba-4be7-8bab-349f69516529"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:05.163316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f66af23-32c5-45fd-b21f-5849dd06f205 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:05.189710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f66af23-32c5-45fd-b21f-5849dd06f205 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1242 microversion: 2.1 time: 0.220224 Oct 06 13:28:05.190745 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3000/6012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:04 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1242 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:05.253472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] validate_networks() for [('1113973c-aeba-4be7-8bab-349f69516529', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:28:06.216499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:06.220496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:06.243027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:06.243751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:06.244895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:06.247575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:06.248799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:06.250520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:07.095987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:07.115151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28d6ae35-2539-448c-b0df-cc86e1f699f3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1238 microversion: 2.1 time: 0.902125 Oct 06 13:28:07.130208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3001/6013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:06 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1238 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:07.162322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:28:07.162889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:28:07.163788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:28:07.164707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:28:07.165592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:28:07.189387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:07.190187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:07.190801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:07.191709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:07.192334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:07.196084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:07.255094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Getting quotas for project 18cb39d6383e4824bcb1e06ea70a952a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:28:07.262305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Getting quotas for user 123babbc8bbc4f83b235e11bcbf5f4f5 and project 18cb39d6383e4824bcb1e06ea70a952a. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:28:07.278823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:28:07.281691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:28:07.396888 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c9c5d16-f0da-4ad0-8c9e-97ab79d6eab7 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272343 Oct 06 13:28:07.404553 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3013/6014] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:28:07.410496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ea79408-fa31-48d7-85a6-b69e5a0e3bb0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:07.411735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ea79408-fa31-48d7-85a6-b69e5a0e3bb0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:07.576209 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ea79408-fa31-48d7-85a6-b69e5a0e3bb0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1329 microversion: 2.1 time: 0.170221 Oct 06 13:28:07.580489 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3002/6015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:07 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:08.150359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:08.152484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:08.167958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:08.170334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:08.171438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:08.172962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:08.175549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:08.176289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:08.336351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:08.365394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2d5c0f3-3d7c-45b3-873c-b4d3c8e4e3a0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1300 microversion: 2.1 time: 0.221278 Oct 06 13:28:08.366760 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3014/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:08 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:08.604608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:08.606360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:08.627650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:08.628908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:08.630677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:08.638472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:08.640744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:08.641677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:08.896731 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8047249-39cd-49d0-98d8-9df85a80d4f0 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1338 microversion: 2.1 time: 0.294351 Oct 06 13:28:08.899138 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3003/6017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:08 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:09.401069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:09.401886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:09.428109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:09.922375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:09.923962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:09.958099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:09.959448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:09.968458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:09.971373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:09.971373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:09.971373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:10.030634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:10.064185 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-61d9f5c4-9bc3-4abc-87f5-9917d4e66654 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.664573 Oct 06 13:28:10.065217 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3015/6018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:09 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:10.311873 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b9bab35-9786-4141-a1ea-8b49720a8154 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1422 microversion: 2.1 time: 0.394762 Oct 06 13:28:10.315353 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3004/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:09 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1422 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:11.093031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:11.093862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:11.104178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:11.110217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:11.110865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:11.112622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:11.113310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:11.115873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:11.343118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:11.343853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:11.368490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:11.369267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:11.369922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:11.370841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:11.372292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:11.381988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:11.604329 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b730425e-01c6-45df-be05-32b1ae91e301 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1422 microversion: 2.1 time: 0.265895 Oct 06 13:28:11.604918 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3005/6020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:11 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1422 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:11.620400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1a355c-0c8a-4b88-be20-77d3f1043cb0", "tag": "9ad42eaf-4127-4e66-95b9-97f83dd91bc1"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:11.635978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:11.637046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:11.637675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:11.675051 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] Creating event network-changed:9ad42eaf-4127-4e66-95b9-97f83dd91bc1 for instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 on n-h1-860556-1 Oct 06 13:28:11.685766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c3bf364c-90c7-4619-ac96-35015394b3df req-6a6d488a-e268-4b6e-ad12-2d043f78d6c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078776 Oct 06 13:28:11.686398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3006/6021] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:11.721092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:11.736983 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82c23e76-fdc3-4a32-aa05-f080b6aa602c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.648672 Oct 06 13:28:11.738011 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3016/6022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:11 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:12.628515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:12.630080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:12.638380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:12.639225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:12.640014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:12.640941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:12.642454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:12.643117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:12.769502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:12.770840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:12.782662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:12.783475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:12.784693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:12.785686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:12.786383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:12.787043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:12.988281 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb8f8a04-67e9-4159-8f37-455dddd80e2e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.361109 Oct 06 13:28:13.002194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3007/6023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:12 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:13.115498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:13.132174 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-979ed437-f86a-4cdb-bd4a-01a7f39feac6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.366947 Oct 06 13:28:13.133345 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3017/6024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:12 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:14.014569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:14.015856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:14.032452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:14.039826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:14.044877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:14.047325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:14.052338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:14.055644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:14.056443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:14.061900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=84 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:14.156074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:14.157309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:14.161270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:14.179126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:14.182537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:14.183228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:14.184988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:14.186908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:14.187539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:14.913916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:14.930241 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de5c9e2b-b8cd-4faa-9fe9-0aa11bd069bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.778689 Oct 06 13:28:14.930857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3018/6025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:14 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:14.977664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91e0a7a-0000-4b6a-96e9-923030d9c003", "tag": "37f897ae-8713-48eb-a08a-3d1d35ee38e3"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:14.988414 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd497115-05fa-4212-8136-32dd2c505058 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.975628 Oct 06 13:28:14.990640 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3008/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:14 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:15.019786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:15.020302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:15.020752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:15.046709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] Creating event network-changed:37f897ae-8713-48eb-a08a-3d1d35ee38e3 for instance a91e0a7a-0000-4b6a-96e9-923030d9c003 on n-h1-860556-1 Oct 06 13:28:15.057248 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d972524c-b8ae-448f-adc6-e27b5f783f55 req-02629325-4c67-4555-98c2-936e2928b5ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107482 Oct 06 13:28:15.059214 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3019/6027] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:15.972487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:15.973367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:15.993769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:15.996756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:15.997423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:15.998433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:15.999282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:15.999903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:16.031847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:16.031847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:16.040403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:16.045126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:16.045820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:16.047702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:16.050140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:16.051016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:16.253977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:16.263437 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a413a6e6-70d0-436b-8680-b3f015e55222 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.306261 Oct 06 13:28:16.281187 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3009/6028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:15 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:16.428110 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ec357e9-487f-4cc8-a855-bf281c020ce9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.406564 Oct 06 13:28:16.429570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3020/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:16 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:17.297786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:17.300305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:17.308094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.309421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.310116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.311061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.311796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.312435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.464660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:17.470880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:17.481649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:17.482353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:17.505888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.508251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.510287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.513183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.515249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.516482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.531881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=86 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:17.573512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:17.798586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:17.812854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2752ff3-2aa9-4f18-9bd3-8ca4c6b2e5a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.517948 Oct 06 13:28:17.837141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff89cff3-882c-42c5-b33d-54b730da24e2 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.381640 Oct 06 13:28:17.842904 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3010/6030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:17 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:17.853919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bf8eab0-2ac8-492d-bca9-00d72ca71faa", "device": "/dev/sdb"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:17.854337 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3021/6031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:17 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:17.857706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:17.863792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1a355c-0c8a-4b88-be20-77d3f1043cb0", "name": "network-vif-plugged", "status": "completed", "tag": "9ad42eaf-4127-4e66-95b9-97f83dd91bc1"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:17.869592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.870793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.871715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.872932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.874054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.874906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.884205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:17.884907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:17.885255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:17.924204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] Creating event network-vif-plugged:9ad42eaf-4127-4e66-95b9-97f83dd91bc1 for instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 on n-h1-860556-1 Oct 06 13:28:17.948603 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-642968f7-3d09-4122-b4d0-6c4022a59923 req-f4cac1d2-b343-4e91-8b4b-0801c5ad9b77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088620 Oct 06 13:28:17.949944 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3022/6032] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:18.433205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da66f2ab-222a-4f02-ab19-f7041238f9a1 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "POST /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573980 Oct 06 13:28:18.434559 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3011/6033] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:28:17 2022] POST /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:18.840280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:18.842472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:18.850114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:18.850917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:18.851361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:18.852214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:18.852677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:18.853098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:18.870242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:18.871514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:18.882428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:18.883309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:18.884219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:18.885370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:18.886093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:18.886821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:19.149910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ace324c-ac10-4d00-b1a8-bfe0dbe96682 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.284434 Oct 06 13:28:19.150580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3012/6034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:18 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:28:19.158655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:19.169548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf16714a-c586-4332-a3b8-2e0dc37a3ad0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1368 microversion: 2.1 time: 0.335417 Oct 06 13:28:19.170187 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3023/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:18 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:20.176239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:20.177032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:20.196103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.200140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:20.201107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:20.201842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.204655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.212558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.213580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.214683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.219185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.219682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.220123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.220836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.221293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.221723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.598146 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-baf1d96b-2b56-4675-9d3e-699471c92416 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.426643 Oct 06 13:28:20.615570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3013/6036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:20 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:20.652213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:20.662826 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85ee992d-03b1-4003-b37e-232eeebdb12a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1558 microversion: 2.1 time: 0.469337 Oct 06 13:28:20.665393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3024/6037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:20 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1558 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:20.691052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:20.691865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:20.702807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.708192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.708993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.710566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:20.711227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:20.711822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:20.897508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-280f68ba-a546-4bf6-963f-d2fd0cb80de3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210956 Oct 06 13:28:20.898150 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3014/6038] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:28:20 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:21.621564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:21.625815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:21.650488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:21.654498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:21.655090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:21.655970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:21.656661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:21.658070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:22.159747 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ecf30f2b-d866-4706-9a95-b54aea1c479f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.543005 Oct 06 13:28:22.160345 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3025/6039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:21 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:22.495411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91e0a7a-0000-4b6a-96e9-923030d9c003", "name": "network-vif-plugged", "status": "completed", "tag": "37f897ae-8713-48eb-a08a-3d1d35ee38e3"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:22.514043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:22.514537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:22.514992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:22.548374 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] Creating event network-vif-plugged:37f897ae-8713-48eb-a08a-3d1d35ee38e3 for instance a91e0a7a-0000-4b6a-96e9-923030d9c003 on n-h1-860556-1 Oct 06 13:28:22.554680 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1024182b-005d-4b5b-9d7b-b589795bd45e req-3245fd89-3b31-4296-b948-6d7c0d429dfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075963 Oct 06 13:28:22.556150 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3015/6040] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:23.188216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:23.188851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:23.205634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:23.206219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:23.206597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:23.207327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:23.207790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:23.208218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:23.423992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1a355c-0c8a-4b88-be20-77d3f1043cb0", "tag": "9ad42eaf-4127-4e66-95b9-97f83dd91bc1"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:23.442325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:23.442822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:23.443257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:23.480210 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] Creating event network-changed:9ad42eaf-4127-4e66-95b9-97f83dd91bc1 for instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 on n-h1-860556-1 Oct 06 13:28:23.486946 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b5f121ce-d159-4362-845b-969082491751 req-213149b2-ad71-47ea-9842-2f78c58d2596 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066924 Oct 06 13:28:23.488131 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3016/6041] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:28:23.521836 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-71667d02-0388-49e3-9a3a-3c2bab54f08e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1464 microversion: 2.1 time: 0.336727 Oct 06 13:28:23.550744 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3026/6042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:23 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1464 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:24.559568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:24.561595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:24.580621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:24.581504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:24.582662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:24.585051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:24.586641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:24.588850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.113298 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5c02677-5994-4ba3-b732-9570c4bba7c6 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1649 microversion: 2.1 time: 0.559199 Oct 06 13:28:25.136882 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3017/6043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:24 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1649 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:25.143937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:25.145087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:25.159727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.162371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.175594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.175843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.176429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.176972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.400619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4041be1-b559-4a58-a038-765325194ea9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1649 microversion: 2.1 time: 0.260782 Oct 06 13:28:25.403200 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3027/6044] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:25 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1649 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:25.433076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:25.437059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:25.443481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.444203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.444805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.445674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.446485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.447076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.623269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1dd47736-f8db-421a-9239-9ac4266c5731 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1649 microversion: 2.1 time: 0.193338 Oct 06 13:28:25.634953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3018/6045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:25 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1649 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:25.653268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:25.653803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:25.662080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.663169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.663774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.664716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:25.665338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:25.665955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:25.716183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:28:26.001887 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-142b67b3-ebe0-48be-8e80-269a8e2aeaa9 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 204 len: 0 microversion: 2.1 time: 0.355020 Oct 06 13:28:26.003075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3028/6046] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:28:25 2022] DELETE /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:28:26.011582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:26.012745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:26.024964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:26.031322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:26.032379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:26.033335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:26.034026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:26.034738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:26.437844 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-808523d8-f5f5-467e-9b53-415e33ae9c9d tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1655 microversion: 2.1 time: 0.430418 Oct 06 13:28:26.443161 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3019/6047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:26 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1655 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:27.466957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:27.468120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:27.475500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:27.476116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:27.476638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:27.477455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:27.478051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:27.478544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:27.856955 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3811c5bb-fd76-4673-b8c2-69e646fd0f8f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1655 microversion: 2.1 time: 0.394232 Oct 06 13:28:27.868293 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3029/6048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:27 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1655 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:28.564775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91e0a7a-0000-4b6a-96e9-923030d9c003", "name": "network-vif-deleted", "tag": "37f897ae-8713-48eb-a08a-3d1d35ee38e3"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:28.594860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:28.597837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:28.599589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:28.631454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] Creating event network-vif-deleted:37f897ae-8713-48eb-a08a-3d1d35ee38e3 for instance a91e0a7a-0000-4b6a-96e9-923030d9c003 on n-h1-860556-1 Oct 06 13:28:28.647087 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4ff87f56-1603-47a4-abf1-da47e89f906f req-a34d1b3a-7f2d-4212-8a93-954868c27281 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091475 Oct 06 13:28:28.649294 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3020/6049] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:28.882531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:28.883339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:28.894423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:28.895193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:28.895854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:28.896909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:28.897724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:28.898414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:28.939036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:28.939722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:28.940546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:28.941311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lazy-loading 'fault' on Instance uuid a91e0a7a-0000-4b6a-96e9-923030d9c003 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:28:29.017563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b404456-1970-4611-a00f-c4641ee7c9da tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 200 len: 1454 microversion: 2.1 time: 0.139253 Oct 06 13:28:29.018770 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3030/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:28 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:30.048270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:30.049013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: a91e0a7a-0000-4b6a-96e9-923030d9c003] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:30.063946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.064839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.067126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.069855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.070358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.070887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.095407 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] HTTP exception thrown: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Request method failure captured: Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 HTTP/1.1 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtfMpQf4mDWSB5cyc9ZBqk173BgjJvFdRJpFWS-vNMsiq-Ig2uG-MMDYyfPC42o2BBPuC8N56hBQhuHVUR70CG-2XmZsE05CIDO5lPSYZOmcK-0knwy-5xNd6myitGCXJ4kIcS1IxZKekkdf-JGa9mYypCfAW-7sddTTBkxtuU4yobU Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 18cb39d6383e4824bcb1e06ea70a952a Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestServerMultinode-1420911983 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18cb39d6383e4824bcb1e06ea70a952a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18cb39d6383e4824bcb1e06ea70a952a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18cb39d6383e4824bcb1e06ea70a952a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18cb39d6383e4824bcb1e06ea70a952a"}]}] Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestServerMultinode-1420911983 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 18cb39d6383e4824bcb1e06ea70a952a Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestServerMultinode-1420911983 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestServerMultinode-1420911983-project-admin Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 123babbc8bbc4f83b235e11bcbf5f4f5 Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestServerMultinode-1420911983-project-admin Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'a91e0a7a-0000-4b6a-96e9-923030d9c003'} Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:30.097665 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Returning 404 to user: Instance a91e0a7a-0000-4b6a-96e9-923030d9c003 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3e9328b4-3b07-4fb2-aebb-ffd05ef2af7f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003" status: 404 len: 111 microversion: 2.1 time: 0.058488 Oct 06 13:28:30.101900 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3021/6051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:30 2022] GET /compute/v2.1/servers/a91e0a7a-0000-4b6a-96e9-923030d9c003 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:28:30.112956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:30.113636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:30.123769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.125684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.127140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.127418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.128086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.128716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.179903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:28:30.324729 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5392938c-3679-4d0d-81de-03c1da6b915f tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 204 len: 0 microversion: 2.1 time: 0.219095 Oct 06 13:28:30.325382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3031/6052] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:28:30 2022] DELETE /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:28:30.336418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:30.337044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:30.344495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.345076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.346123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.347341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:30.348156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:30.349039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:30.863093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a80122d6-6819-451d-a57e-65e3cd9ce96e tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1654 microversion: 2.1 time: 0.532379 Oct 06 13:28:30.874771 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3022/6053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:30 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1654 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:31.888275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:31.889932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:31.897138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:31.898024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:31.898707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:31.899946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:31.900636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:31.901280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:32.192118 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab394719-6159-49f0-9cc8-a4e200a47325 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1654 microversion: 2.1 time: 0.307738 Oct 06 13:28:32.193226 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3032/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:31 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1654 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:32.960251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13012f07-639f-4ca8-b641-2a87754b450b", "name": "network-vif-deleted", "tag": "3169c05e-091d-4829-89b8-5e9a6067d39a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:33.015842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:33.016344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:33.016815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:33.033481 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] Creating event network-vif-deleted:3169c05e-091d-4829-89b8-5e9a6067d39a for instance 13012f07-639f-4ca8-b641-2a87754b450b on n-h2-860556-1 Oct 06 13:28:33.041399 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9c2a9b64-2dfa-4058-aa03-aec1074ece3d req-b70a0447-7975-4baa-a676-ddf56d7295e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090883 Oct 06 13:28:33.043607 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3023/6055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:33.222855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:33.223984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:33.237825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:33.238544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:33.239010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:33.239762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:33.240238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:33.240677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:33.328225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:33.330216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:33.332220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:33.338172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lazy-loading 'fault' on Instance uuid 13012f07-639f-4ca8-b641-2a87754b450b {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:28:33.503179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d02b1aa4-6a90-4fe9-b3cb-18be32fea989 tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 200 len: 1454 microversion: 2.1 time: 0.285881 Oct 06 13:28:33.504082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3033/6056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:33 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 1454 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:34.529194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:34.530576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] [instance: 13012f07-639f-4ca8-b641-2a87754b450b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:34.539148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:34.540176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:34.540836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:34.542025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:34.544085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:34.544799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:34.565708 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] HTTP exception thrown: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Request method failure captured: Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b HTTP/1.1 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtfMpQf4mDWSB5cyc9ZBqk173BgjJvFdRJpFWS-vNMsiq-Ig2uG-MMDYyfPC42o2BBPuC8N56hBQhuHVUR70CG-2XmZsE05CIDO5lPSYZOmcK-0knwy-5xNd6myitGCXJ4kIcS1IxZKekkdf-JGa9mYypCfAW-7sddTTBkxtuU4yobU Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 18cb39d6383e4824bcb1e06ea70a952a Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestServerMultinode-1420911983 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18cb39d6383e4824bcb1e06ea70a952a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18cb39d6383e4824bcb1e06ea70a952a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18cb39d6383e4824bcb1e06ea70a952a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18cb39d6383e4824bcb1e06ea70a952a"}]}] Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestServerMultinode-1420911983 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 18cb39d6383e4824bcb1e06ea70a952a Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestServerMultinode-1420911983 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestServerMultinode-1420911983-project-admin Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 123babbc8bbc4f83b235e11bcbf5f4f5 Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestServerMultinode-1420911983-project-admin Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '13012f07-639f-4ca8-b641-2a87754b450b'} Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:34.568454 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. Oct 06 13:28:34.572438 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:28:34.576582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] Returning 404 to user: Instance 13012f07-639f-4ca8-b641-2a87754b450b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:28:34.577911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e265bb2-b0ee-4562-910c-0a31dc7557ed tempest-TestServerMultinode-1420911983 tempest-TestServerMultinode-1420911983-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b" status: 404 len: 111 microversion: 2.1 time: 0.054997 Oct 06 13:28:34.579172 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3024/6057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:34 2022] GET /compute/v2.1/servers/13012f07-639f-4ca8-b641-2a87754b450b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:28:51.618498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:51.619405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:51.631917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:51.633029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:51.635739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:51.637393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:51.638430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:51.639884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:51.641027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:51.641720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:52.046081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lazy-loading 'services' on Instance uuid e9c643b9-655b-42c2-8a96-889955dfa27d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:28:52.166975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c61ade1d-6bf2-4c83-8d03-f06a7cf05981 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d/os-volume_attachments/3bf8eab0-2ac8-492d-bca9-00d72ca71faa" status: 202 len: 0 microversion: 2.1 time: 0.556306 Oct 06 13:28:52.167847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3034/6058] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:28:51 2022] DELETE /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d/os-volume_attachments/3bf8eab0-2ac8-492d-bca9-00d72ca71faa => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:28:57.942792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:57.944986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:57.959365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=33 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:57.962677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:28:57.970408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:57.973154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:57.973992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:57.977141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:57.979115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:57.981904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.059878 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-34d3bfb5-58a2-4c72-9a0c-73d1586c4750 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/ips" status: 200 len: 150 microversion: 2.1 time: 0.122000 Oct 06 13:28:58.061224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3025/6059] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:28:57 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/ips => generated 150 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:28:58.074609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ba046c-66ae-48da-86ac-f3c040b2b173"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:28:58.077394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:58.097785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.098468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.099078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.099968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.100593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.101192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.248620 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/os-volume_attachments HTTP/1.1 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 74 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: {"volumeAttachment": {"volumeId": "77ba046c-66ae-48da-86ac-f3c040b2b173"}} Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'db1a355c-0c8a-4b88-be20-77d3f1043cb0', 'body': {'volumeAttachment': {'volumeId': '77ba046c-66ae-48da-86ac-f3c040b2b173'}}} Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:28:58.254398 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 400 to user: Invalid volume: volume 77ba046c-66ae-48da-86ac-f3c040b2b173 is already attached to instances: c639a264-ec49-47bc-b361-aac73212ab10 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f9663f9-9014-461a-acc3-3c4255350f8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187871 Oct 06 13:28:58.260121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3035/6060] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:28:58 2022] POST /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:28:58.267616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:58.268446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:58.278837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.280279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.280976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.282018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.282756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.283905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.372391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:28:58.577341 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c3d9ad4-8b8e-47c4-ac9c-94bfd32fd526 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 204 len: 0 microversion: 2.1 time: 0.314041 Oct 06 13:28:58.578655 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3026/6061] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:28:58 2022] DELETE /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:28:58.595236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:58.595947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:58.631777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.632929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.633698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.635712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.637025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.637730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.910309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:58.919310 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-08183c6a-c16b-4707-a9e2-2004d178814d tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1683 microversion: 2.1 time: 0.331383 Oct 06 13:28:58.925156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:58.926177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:58.933571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.933791 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3036/6062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:58 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1683 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:58.934581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.935250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.936224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:58.936920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:58.937655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:58.972514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:28:59.098651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df6cd875-2925-4c95-a1f5-2958f5b661da tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 204 len: 0 microversion: 2.1 time: 0.179682 Oct 06 13:28:59.103782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3027/6063] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:28:58 2022] DELETE /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:28:59.115508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:59.116839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:59.125004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:59.125530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:59.126205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:59.126934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:59.127632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:59.128072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:59.350400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:28:59.367306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b08fecb-e144-4cb1-8e7d-f1c70ed41fcf tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1559 microversion: 2.1 time: 0.257673 Oct 06 13:28:59.368496 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3037/6064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:59 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1559 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:28:59.949816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:28:59.950934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:28:59.962072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:59.965263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:59.966344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:28:59.968455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:28:59.969132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:28:59.969896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:00.355918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:00.366293 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-369925f7-da02-4443-b257-bebfa975252f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1683 microversion: 2.1 time: 0.421450 Oct 06 13:29:00.367719 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3028/6065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:28:59 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1683 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:00.392890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:00.393712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:00.408062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:00.408675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:00.409126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:00.409889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:00.410356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:00.410787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:00.832296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:00.850540 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-949f0666-6680-4eee-9069-a0fe42e36ca5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1513 microversion: 2.1 time: 0.459513 Oct 06 13:29:00.852141 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3038/6066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:00 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1513 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:01.391649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:01.392892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:01.404069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:01.404936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:01.405608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:01.406579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:01.407256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:01.407941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:01.876863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:01.877494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:01.889276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:01.889854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:01.890313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:01.891412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:01.891897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:01.892337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:02.596698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:02.610085 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ada9099-d0a4-4d88-b9e9-a674c04326bf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1683 microversion: 2.1 time: 1.222946 Oct 06 13:29:02.610702 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3029/6067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:01 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1683 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:02.746350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:02.778711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13becbec-4023-4e12-aeb8-1a52e40e8789 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 200 len: 1513 microversion: 2.1 time: 0.904433 Oct 06 13:29:02.780567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3039/6068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:01 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 1513 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:02.834134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c643b9-655b-42c2-8a96-889955dfa27d", "name": "network-vif-deleted", "tag": "b1c6bf52-790c-4854-aa97-dbb7805a9931"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:02.855861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:02.856633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:02.857289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:02.872661 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] Creating event network-vif-deleted:b1c6bf52-790c-4854-aa97-dbb7805a9931 for instance e9c643b9-655b-42c2-8a96-889955dfa27d on n-h1-860556-1 Oct 06 13:29:02.889706 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-56d3d994-c1de-48f6-bf37-8f7aaa93a452 req-b39709ed-911b-4fec-8bd9-e339e6a8e486 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059291 Oct 06 13:29:02.890858 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3030/6069] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:03.635182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:03.636543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:03.653910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:03.655835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:03.657968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:03.658956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:03.662696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:03.663601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:03.808862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:03.810293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: e9c643b9-655b-42c2-8a96-889955dfa27d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:03.819270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:03.820568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:03.821035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:03.822277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:03.823069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:03.824492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:03.844118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] HTTP exception thrown: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Request method failure captured: Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d HTTP/1.1 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtdUEC2Pi4OhrmMZExXcwa7gbSGTMfwfy3MxqsLpd4GpXmgbla_45HCEOKbFSNe1sY2dz0gQHJw5J7t4svVAw_cSkUSsdKS53VcEJtl13dfeO8aPcYgOwoRUK8wq-VjICkK6g1hl3X-gYXB_BjYIxKjmCVNk5Of3IXbvO7icsRGXqOs Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 5ed10bcd1ba54f64a16682d07df981c2 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ed10bcd1ba54f64a16682d07df981c2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed10bcd1ba54f64a16682d07df981c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ed10bcd1ba54f64a16682d07df981c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed10bcd1ba54f64a16682d07df981c2"}]}] Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 5ed10bcd1ba54f64a16682d07df981c2 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesSnapshotTestJSON-742689520-project Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 646255cdb1ab4b2cbfc6ea729acd593b Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesSnapshotTestJSON-742689520-project Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e9c643b9-655b-42c2-8a96-889955dfa27d'} Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:03.846407 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. Oct 06 13:29:03.851426 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:03.853830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Returning 404 to user: Instance e9c643b9-655b-42c2-8a96-889955dfa27d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:29:03.855687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56f960a1-35bf-422d-892f-89ac21990ded tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d" status: 404 len: 111 microversion: 2.1 time: 0.053017 Oct 06 13:29:03.856794 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3031/6070] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:03 2022] GET /compute/v2.1/servers/e9c643b9-655b-42c2-8a96-889955dfa27d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:29:03.896134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:03.908033 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23e17e61-0684-488a-9ed8-325793faf869 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1615 microversion: 2.1 time: 0.277576 Oct 06 13:29:03.911194 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3040/6071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:03 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1615 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:04.936938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:04.937595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:04.962751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:04.963174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:04.963626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:04.964983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:04.980605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:04.981129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:05.811941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:05.832661 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad2961b9-dd47-47df-aba7-f9314c2838d8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1615 microversion: 2.1 time: 0.894675 Oct 06 13:29:05.834367 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3032/6072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:04 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1615 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:06.039425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1a355c-0c8a-4b88-be20-77d3f1043cb0", "name": "network-vif-deleted", "tag": "9ad42eaf-4127-4e66-95b9-97f83dd91bc1"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:06.070653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:06.071444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:06.072059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:06.108759 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] Creating event network-vif-deleted:9ad42eaf-4127-4e66-95b9-97f83dd91bc1 for instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 on n-h1-860556-1 Oct 06 13:29:06.127912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-11c7c29b-ec55-48f8-9e85-b51571323713 req-fa8c4651-83a1-4657-8843-84d985757669 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093497 Oct 06 13:29:06.129922 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3041/6073] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:06.865298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:06.866854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:06.894778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:06.895813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:06.896519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:06.897614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:06.898382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:06.899055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:06.957727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:06.958676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:06.959423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:06.960159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lazy-loading 'fault' on Instance uuid db1a355c-0c8a-4b88-be20-77d3f1043cb0 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:29:07.060050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:07.074141 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8570753-70e8-4c51-b0b9-0471af8cb7be tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 200 len: 1332 microversion: 2.1 time: 0.212179 Oct 06 13:29:07.093622 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3033/6074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:06 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 1332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:08.101792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:08.102674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:08.122093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:08.122902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:08.123598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:08.124590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:08.125285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:08.126096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:08.152066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 HTTP/1.1 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'db1a355c-0c8a-4b88-be20-77d3f1043cb0'} Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:08.157984 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:29:08.163069 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:08.164788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:29:08.165926 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f4c8c9f-184f-4187-9a74-1d3fc93f9543 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 404 len: 111 microversion: 2.1 time: 0.069427 Oct 06 13:29:08.166834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3042/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:08 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:29:08.177103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72ac4fa4-a664-4ecb-ae38-d069d507e4df tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '.version_select at 0x7f7d3ea5a820>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:08.203007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-72ac4fa4-a664-4ecb-ae38-d069d507e4df tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616430709" status: 202 len: 0 microversion: 2.1 time: 0.030077 Oct 06 13:29:08.208083 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3034/6076] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616430709 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:29:10.425046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:10.425595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:10.435067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:10.436085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:10.437932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:10.438936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:10.439574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:10.440221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:10.687546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lazy-loading 'services' on Instance uuid c639a264-ec49-47bc-b361-aac73212ab10 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:29:10.884630 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bafdd654-3412-481a-9a6c-31349132cbbd tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments/77ba046c-66ae-48da-86ac-f3c040b2b173" status: 202 len: 0 microversion: 2.1 time: 0.470004 Oct 06 13:29:10.886084 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3043/6077] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:29:10 2022] DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments/77ba046c-66ae-48da-86ac-f3c040b2b173 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:29:10.903527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:10.908559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:10.934498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:10.936477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:10.958540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:10.960450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:10.963284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:10.964756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:11.052187 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b7a2a41-9089-415d-8ec1-e7e51888a890 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161386 Oct 06 13:29:11.052912 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3035/6078] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:10 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:12.068573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:12.081400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:12.124581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:12.125161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:12.125644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:12.126432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:12.126892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:12.127325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:12.213368 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8f2d081-5554-470e-b7f5-dfa0fdb1a8e3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150349 Oct 06 13:29:12.215301 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3044/6079] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:12 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:13.233628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:13.252183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:13.278685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:13.279446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:13.280103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:13.282934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:13.283689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:13.287983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:13.401172 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-26f11922-f116-434e-8974-132305300906 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174534 Oct 06 13:29:13.403104 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3036/6080] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:13 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:14.421498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:14.424862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:14.460755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:14.470971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:14.471716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:14.472690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:14.473356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:14.474038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:14.527831 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff06dade-b400-40a7-9ec2-94b663f77b28 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110368 Oct 06 13:29:14.529118 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3045/6081] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:14 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:14.581097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1187822508", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d109bd4-b722-4a4c-9991-2e9b3026f781", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:14.753719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:29:14.871847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1578229700", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "a494e299-ee2e-4524-86c2-d8fbcd0ff27c"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:14.939693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] validate_networks() for [('a494e299-ee2e-4524-86c2-d8fbcd0ff27c', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:29:15.923587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:29:15.924152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:29:15.924891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:29:15.925440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:29:15.925923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:29:15.947403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:15.947903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:15.948497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:15.949501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:15.950007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:15.950786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:15.990505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:29:16.004658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:29:16.128679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:29:16.131961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d109bd4-b722-4a4c-9991-2e9b3026f781',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:29:16.311164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b7244f74-b8fe-4c1d-872e-926b72445bd3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735037 Oct 06 13:29:16.312112 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3037/6082] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:29:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:29:16.330871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:16.365001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:16.383635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:16.384404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:16.387271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:16.389234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:16.390934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:16.400291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:16.468491 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e6d88f3a-f2ca-45fe-9cea-cf05b127a77f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154919 Oct 06 13:29:16.469093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3038/6083] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:16 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:16.484507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7a6ca85e-78e1-4584-9777-48b2b6839273 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:16.485135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7a6ca85e-78e1-4584-9777-48b2b6839273 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:16.727057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7a6ca85e-78e1-4584-9777-48b2b6839273 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:16.750015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7a6ca85e-78e1-4584-9777-48b2b6839273 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1057 microversion: 2.1 time: 0.270894 Oct 06 13:29:16.750969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3039/6084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:16 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1057 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:16.811511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:29:16.812702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:29:16.816392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:29:16.816911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:29:16.818039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:29:16.892726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:16.892879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:16.897280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:16.898496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:16.899814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:16.900261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:16.923797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Getting quotas for project 5ed10bcd1ba54f64a16682d07df981c2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:29:16.945937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Getting quotas for user 646255cdb1ab4b2cbfc6ea729acd593b and project 5ed10bcd1ba54f64a16682d07df981c2. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:29:16.988871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:29:16.991806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:29:17.112358 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2373af3-5c77-4958-a2ba-0e9ca0d3f443 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245894 Oct 06 13:29:17.113533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3046/6085] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:29:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:29:17.125661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-723af006-7b26-4897-8187-4b28657df061 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:17.127075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-723af006-7b26-4897-8187-4b28657df061 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:17.246519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-723af006-7b26-4897-8187-4b28657df061 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:17.257511 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-723af006-7b26-4897-8187-4b28657df061 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1219 microversion: 2.1 time: 0.136552 Oct 06 13:29:17.274352 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3040/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:17 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:17.482267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:17.486634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:17.509992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:17.510505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:17.511513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:17.512247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:17.512708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:17.513148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:17.594596 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44ad83a8-159f-44d3-abe9-47814836a3a2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117848 Oct 06 13:29:17.595183 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3047/6087] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:17 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:17.774496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:17.775166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:17.786910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:17.788597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:17.789225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:17.790161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:17.790795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:17.794161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:17.958613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:17.970553 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-74ef4056-3623-4a11-9a23-92a013c41d94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1155 microversion: 2.1 time: 0.201694 Oct 06 13:29:17.975964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3041/6088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:17 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1155 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:18.282474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:18.283887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:18.290848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:18.291660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:18.293044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:18.294149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:18.294858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:18.295523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:18.609160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:18.611902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:18.647958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:18.663010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:18.663541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:18.664006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:18.664763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:18.665236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:18.665683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:18.682032 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2fb52f45-1e29-4e7d-a4ca-c25393bd291d tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1215 microversion: 2.1 time: 0.404304 Oct 06 13:29:18.684328 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3048/6089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:18 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1215 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:18.766301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4d999f9-f2a7-4c62-8856-eda156c7e35a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161873 Oct 06 13:29:18.771337 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3042/6090] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:18 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:19.006229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:19.007117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:19.017369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.018193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.018950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.019683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.020258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.020693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.328456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:19.341171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-feedf681-56aa-4c33-8f9e-5d708926c6ec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1173 microversion: 2.1 time: 0.340235 Oct 06 13:29:19.359037 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3049/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:18 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1173 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:19.707847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:19.708568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:19.719681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.719965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.720605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.721524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.722048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.722483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.748524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:19.780709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:19.783129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:19.822278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:19.827348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.827855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.832746 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1eda04bc-a651-4ae5-8358-db2e2890d429 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1277 microversion: 2.1 time: 0.129025 Oct 06 13:29:19.834024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.835140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:19.835801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:19.836407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:19.837275 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3043/6092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:19 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:19.927367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16702987-0872-419e-8326-f44370b56c6b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152370 Oct 06 13:29:19.928236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3050/6093] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:29:19 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 13:29:20.003836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:20.004351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:20.012578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.013357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.014019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.014932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.015564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.016165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.073900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:29:20.231050 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0de2dbf-a5a7-4988-a2ca-4051d1a82c82 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 204 len: 0 microversion: 2.1 time: 0.230784 Oct 06 13:29:20.244327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:20.245097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:20.248492 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3044/6094] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:29:19 2022] DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:29:20.254368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.256784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.257487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.259019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.260198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.262246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.270661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:20.371131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:20.373503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:20.383495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.384249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.384868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.386531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.387255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.388017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.803016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:20.819265 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7768a203-b8f7-47b2-bb1b-02498273a1a6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1681 microversion: 2.1 time: 0.579422 Oct 06 13:29:20.820780 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3051/6095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:20 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1681 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:20.872688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:20.874283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:20.875357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:20.882269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.883144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.883810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:20.884289 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56776118-d020-4747-9b17-36c15135b691 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1215 microversion: 2.1 time: 0.521903 Oct 06 13:29:20.884914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3045/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:20 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1215 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:20.885543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:20.887015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:20.887680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:21.158286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:21.170153 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cd64be73-a934-4551-a49d-0252a1d21c97 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.300721 Oct 06 13:29:21.171892 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3052/6097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:20 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:21.598654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554f27af-3b29-469f-9e32-889e74930696", "tag": "168674d9-2b1d-4268-aeb7-592cc490a80e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:21.619922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:21.620896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:21.622074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:21.644426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] Creating event network-changed:168674d9-2b1d-4268-aeb7-592cc490a80e for instance 554f27af-3b29-469f-9e32-889e74930696 on n-h1-860556-1 Oct 06 13:29:21.652984 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e26afdc2-9a45-4949-9670-deab2fc07c18 req-5bbd6802-67a1-41cc-b3c7-756da67e803f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059411 Oct 06 13:29:21.654228 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3046/6098] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:21.847476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:21.849045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:21.857400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:21.859665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:21.860221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:21.860664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:21.861417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:21.862086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:21.862585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:21.916086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:21.917935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:21.930153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:21.930758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:21.931580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:21.933243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:21.934021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:21.934554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:22.314893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:22.325608 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d59aa2ae-055f-40d7-af32-4803c6fbec50 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1681 microversion: 2.1 time: 0.484124 Oct 06 13:29:22.329769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3053/6099] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:21 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1681 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:22.341865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5657281-731e-4cf4-a8da-5d26432149c2", "tag": "59d50937-98bc-4b30-8bb5-ed9dd5dafceb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:22.351698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:22.352391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:22.352987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:22.374523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] Creating event network-changed:59d50937-98bc-4b30-8bb5-ed9dd5dafceb for instance d5657281-731e-4cf4-a8da-5d26432149c2 on n-h1-860556-1 Oct 06 13:29:22.381680 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-10ce9824-220f-4c33-bc54-fe53b40902b4 req-fcc9aae0-5ef2-414f-b33c-f6300063c10f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050505 Oct 06 13:29:22.383004 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3054/6100] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:22.393517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:22.394545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:22.402175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:22.402961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:22.403987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:22.405017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:22.405716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:22.406405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:22.795392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:22.814568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b2adaeb-f878-48b8-a40f-762cc299b2d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1215 microversion: 2.1 time: 0.903558 Oct 06 13:29:22.826102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3047/6101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:21 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1215 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:23.010243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:23.019467 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dcd0044a-f5e4-44e7-8700-06b82790735c tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.633981 Oct 06 13:29:23.034137 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3055/6102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:22 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:23.352520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:23.353877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:23.361339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:23.361871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:23.362525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:23.363447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:23.364284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:23.364887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:23.512586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:23.521616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9f33bf2e-8d8d-4118-9572-9008cb1180af tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 200 len: 1613 microversion: 2.1 time: 0.172909 Oct 06 13:29:23.522839 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3048/6103] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:23 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 1613 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:23.840176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:23.842863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:23.871344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:23.874281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:23.875671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:23.879039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:23.880958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:23.884180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.008685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c639a264-ec49-47bc-b361-aac73212ab10", "name": "network-vif-deleted", "tag": "d9931541-668b-4506-81e3-ef3be8770d8a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:24.041726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:24.050603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:24.051312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.091937 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] Creating event network-vif-deleted:d9931541-668b-4506-81e3-ef3be8770d8a for instance c639a264-ec49-47bc-b361-aac73212ab10 on n-h2-860556-1 Oct 06 13:29:24.103246 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2ff88a19-f808-49cc-9e57-d3a1cae06fa9 req-c83d54cf-2fc7-418d-8690-25c85ffcddb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104028 Oct 06 13:29:24.104703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3049/6104] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:24.136648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:24.137622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:24.146536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:24.147388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:24.148064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.150009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:24.150713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:24.151697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.794423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:24.804232 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9d7aaf3-d36e-47a9-9d2a-b830c79f4459 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1215 microversion: 2.1 time: 0.968719 Oct 06 13:29:24.804831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3056/6105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:23 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1215 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:24.822102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:24.823708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:24.833754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:24.834257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:24.834708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.835430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:24.835898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:24.836336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:24.878570 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 HTTP/1.1 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c639a264-ec49-47bc-b361-aac73212ab10'} Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:24.884153 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:29:24.889470 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:29:24.892236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:29:24.893387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24e9433b-160d-4f4c-812c-c073907fc256 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 404 len: 111 microversion: 2.1 time: 0.086630 Oct 06 13:29:24.894682 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3057/6106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:24 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:29:24.895266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:24.909080 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ddd0eee2-c7d8-461f-8e4e-27cfed7e8d64 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.799680 Oct 06 13:29:24.910192 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3050/6107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:24 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:24.914351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f27b3d8-e66e-4f53-b9b1-41e727b950b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '.version_select at 0x7f7d475f1700>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:24.959237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f27b3d8-e66e-4f53-b9b1-41e727b950b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-328375904" status: 202 len: 0 microversion: 2.1 time: 0.058547 Oct 06 13:29:24.960117 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3058/6108] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-328375904 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:29:25.828175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:25.829365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:25.839351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:25.844213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:25.844852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:25.845813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:25.846437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:25.847021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:25.861381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62dfbef2-713f-43a8-bd91-9a474de81f2a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: .version_select at 0x7f7d47771820>, body: {"keypair": {"name": "tempest-keypair-1575644242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh7q2n12CQpyxEfVtk18/7LUMItJByiqXsI+5dO6abdSw2VtR7tP+1gNX2v3q01tYGMI0Zop20UbAZnQcGuw0uz60ea0DRbFQXmrYPgk9mvWBVF1xN0ohvBq/IWjhzhzg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:25.883484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-62dfbef2-713f-43a8-bd91-9a474de81f2a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:29:25.889509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-62dfbef2-713f-43a8-bd91-9a474de81f2a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:29:25.918663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62dfbef2-713f-43a8-bd91-9a474de81f2a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061440 Oct 06 13:29:25.920054 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3059/6109] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:29:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:25.942393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:25.943236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:25.955154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:25.957477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:25.961546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:25.965427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:25.966316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:25.966806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:25.968497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:26.139677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:26.148910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3db6c779-f43c-4393-af60-c957192ac7d0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.324531 Oct 06 13:29:26.149502 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3051/6110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:25 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:26.215834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:26.225034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30059eea-0bfb-44d6-8200-f80d35a305f9 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.288168 Oct 06 13:29:26.225919 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3060/6111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:25 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:27.174981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:27.175437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:27.183355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:27.184150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:27.184573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:27.185375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:27.186044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:27.186712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:27.251438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:27.263157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:27.264460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:27.271484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:27.273377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:27.273946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:27.274396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:27.276120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:27.276704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:27.277147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:27.546446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:27.560065 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98b88fbc-ae8d-46b1-af9e-df8aa69ed785 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.390313 Oct 06 13:29:27.562373 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3052/6112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:27 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:27.570685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-886699078", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb0b016-19fe-46cc-81a2-ae79246f7798"}], "security_groups": [{"name": "tempest-securitygroup--2027987529"}], "key_name": "tempest-keypair-1575644242", "user_data": "}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:27.598542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:27.611436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dc072768-c6e4-4c66-8de6-d40b0c00ce9b tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.352082 Oct 06 13:29:27.613447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3061/6113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:27 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:27.726322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] validate_networks() for [('2eb0b016-19fe-46cc-81a2-ae79246f7798', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:29:27.873989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5657281-731e-4cf4-a8da-5d26432149c2", "name": "network-vif-plugged", "status": "completed", "tag": "59d50937-98bc-4b30-8bb5-ed9dd5dafceb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:27.892168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:27.893234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:27.894004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:27.918569 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] Creating event network-vif-plugged:59d50937-98bc-4b30-8bb5-ed9dd5dafceb for instance d5657281-731e-4cf4-a8da-5d26432149c2 on n-h1-860556-1 Oct 06 13:29:27.925640 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-91af1cbe-6e97-422c-8b9e-7914884e1ed8 req-0e6d1b3f-c59b-45e5-b4c4-2093cfd5275c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058038 Oct 06 13:29:27.926334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3062/6114] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:27.997940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:28.458393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:29:28.461920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:29:28.462700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:29:28.463556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:29:28.464208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:29:28.477815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.478506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.479183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.480019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.480585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.481227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.502486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:29:28.508444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:29:28.524506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:29:28.527213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:29:28.586515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b70a5a13-00a3-4dcc-a6a5-1d545cde71eb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.022419 Oct 06 13:29:28.587761 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3053/6115] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:29:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:29:28.588979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:28.589779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:28.598805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.602507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.603550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.605520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.606298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.606865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.608107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01c670bd-907b-4f65-9d2e-55c5864e83b2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:28.608988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01c670bd-907b-4f65-9d2e-55c5864e83b2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:28.721229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-01c670bd-907b-4f65-9d2e-55c5864e83b2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:28.736083 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01c670bd-907b-4f65-9d2e-55c5864e83b2 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1241 microversion: 2.1 time: 0.136293 Oct 06 13:29:28.736687 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3054/6116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:28 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:28.754753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:28.757481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:28.775392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.775898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.776943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.778136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:28.788063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:28.790211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:28.955639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:28.971674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-479e394e-731a-49ef-8cd0-08cdb6965ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.387846 Oct 06 13:29:28.973576 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3063/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:28 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:29.011284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:29.023075 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a46d926-6693-49da-93d5-cc2200233656 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1319 microversion: 2.1 time: 0.281825 Oct 06 13:29:29.024251 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3055/6118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:28 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:29.762417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:29.765231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:29.774651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:29.775862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:29.776889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:29.778206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:29.779304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:29.780447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:29.888652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:29.902381 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-914562b5-f50c-4210-993d-0fd8b6081d49 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1293 microversion: 2.1 time: 0.146784 Oct 06 13:29:29.924523 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3064/6119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:29 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:29.997837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:29.999072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:30.008597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.009936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.010658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.011768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.012528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.014051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.053234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:30.054718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:30.079980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.080725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.081869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.082721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.086156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.086622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.747300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:30.759852 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35bc4039-1897-4e77-8e56-d823c5f287e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.768381 Oct 06 13:29:30.761919 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3056/6120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:29 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:30.873041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:30.889030 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-11033688-9702-4a55-b7ee-a9be4295c0e5 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1508 microversion: 2.1 time: 0.841673 Oct 06 13:29:30.919026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f722356d-6cd9-4837-9f5f-1f9e62d87c38", "device": "/dev/sdb"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:30.922150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:30.925398 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3065/6121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:30 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:30.934277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.935059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.935625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:30.936256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:30.936450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.937392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.938119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.939177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.962707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.963210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.964318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:30.965041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:30.965499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:30.968120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:31.103931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:31.124926 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49a343e8-60df-43e4-9f95-ef7d5c049fba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1299 microversion: 2.1 time: 0.196086 Oct 06 13:29:31.125815 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3066/6122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:30 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:31.797980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:31.799176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:31.815718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:31.815895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:31.816337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:31.818304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:31.819089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:31.819708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:31.820375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-766191d3-388e-4e89-8812-df8824f68d45 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "POST /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908104 Oct 06 13:29:31.822230 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3057/6123] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:29:30 2022] POST /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:32.150283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:32.151549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:32.164458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:32.164953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:32.165399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:32.166139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:32.178657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:32.179498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:32.333167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:32.341728 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-551b0f2d-5157-466d-9978-3ffdf909dd9f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1299 microversion: 2.1 time: 0.196759 Oct 06 13:29:32.343006 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3058/6124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:32 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:32.392773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:32.407811 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bdbfbeb6-d696-4d7e-be0c-c38c96679202 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.627009 Oct 06 13:29:32.410727 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3067/6125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:31 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:33.364698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:33.366079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:33.374186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:33.375042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:33.375726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:33.376679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:33.377365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:33.378182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:33.435858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:33.437864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:33.445074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:33.446003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:33.446614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:33.447482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:33.449234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:33.449885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:33.825284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:33.828886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:33.839391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:33.850529 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c778e2e1-bab0-49e6-a063-3bce0ce9dbfa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.418933 Oct 06 13:29:33.851347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3068/6126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:33 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:33.852533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b2888d84-181f-4e61-b842-aef1258d323a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.491714 Oct 06 13:29:33.861788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3059/6127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:33 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:34.765065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa534fd-854d-45ce-a09d-167c40c643fa", "tag": "ee600c88-71fa-4a91-9d47-71117568164a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:34.802234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:34.802740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:34.803336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:34.846179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] Creating event network-changed:ee600c88-71fa-4a91-9d47-71117568164a for instance 1aa534fd-854d-45ce-a09d-167c40c643fa on n-h2-860556-1 Oct 06 13:29:34.864548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3ee4e81b-8449-43d2-ac12-c78e94644e52 req-819b9cf6-0e01-44dd-a239-958c7ef26750 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110714 Oct 06 13:29:34.865181 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3069/6128] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:34.885998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:34.886614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:34.892918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:34.893647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:34.917944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:34.918455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:34.918906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:34.919640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:34.920109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:34.920544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:34.920738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:34.921456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:34.922087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:34.922986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:34.923878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:34.924316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:35.255693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:35.265353 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4ccc4ef-a1e7-48c5-88cd-4678410ada16 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.385046 Oct 06 13:29:35.266825 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3070/6129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:34 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:35.282207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:35.291505 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a0de591b-c949-4064-ba69-28a5976c16bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.416150 Oct 06 13:29:35.292988 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3060/6130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:34 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:36.064492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554f27af-3b29-469f-9e32-889e74930696", "name": "network-vif-plugged", "status": "completed", "tag": "168674d9-2b1d-4268-aeb7-592cc490a80e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:36.078219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:36.080952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:36.081930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:36.082627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:36.096343 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] Creating event network-vif-plugged:168674d9-2b1d-4268-aeb7-592cc490a80e for instance 554f27af-3b29-469f-9e32-889e74930696 on n-h1-860556-1 Oct 06 13:29:36.102808 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fdc07c29-46c9-4490-9b1a-59cd418b65a7 req-16a1a087-c715-47ad-9426-7e1ea8dc610f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042774 Oct 06 13:29:36.103705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3071/6131] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:36.288484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:36.289117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:36.300317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:36.300835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:36.301291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:36.302051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:36.302521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:36.302956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:36.327949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:36.328927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:36.337368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:36.337890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:36.338444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:36.339176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:36.339641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:36.340070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:36.590313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:36.593504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:36.603852 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3b7784c-89bc-431a-9545-600f4ee40451 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.319066 Oct 06 13:29:36.605044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3061/6132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:36 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:36.612382 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-801dc5ad-ca85-43ed-a6a8-c21afae87894 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1203 microversion: 2.1 time: 0.288736 Oct 06 13:29:36.625834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3072/6133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:36 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:37.628672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:37.629501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:37.637876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:37.639452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:37.640239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:37.642140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:37.645107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:37.645413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:37.646068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:37.646698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:37.656319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:37.657107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:37.657814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:37.658779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:37.659908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:37.660508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:37.692414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:38.082025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:38.091517 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f2f048e-3b84-496e-bc04-983a375511ce tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.466850 Oct 06 13:29:38.092121 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3062/6134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:37 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:38.128239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:38.137718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c9e8ccd7-f6c2-4253-9fce-fadd664e440a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1389 microversion: 2.1 time: 0.504237 Oct 06 13:29:38.138672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3073/6135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:37 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1389 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:38.182214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:38.183194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:38.189865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:38.190391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:38.191056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:38.191985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:38.192698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:38.193413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:38.491793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:38.658496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:38.667835 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e3b48d1f-219f-41de-b832-f6ebc7601ade tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1389 microversion: 2.1 time: 0.491711 Oct 06 13:29:38.668845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3063/6136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:38 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1389 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:38.691976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:38.693177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:38.702824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:38.703722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:38.704314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:38.705207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:38.705658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:38.706309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.007816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:39.016179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2def3461-5147-47ec-aba8-57e540d939ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1389 microversion: 2.1 time: 0.328738 Oct 06 13:29:39.017049 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3074/6137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:38 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1389 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:39.041277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:39.042677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:39.044873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:39.051110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.051684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.052305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.053027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.053487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.053960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.097964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:29:39.117948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:39.118678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:39.129300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.129839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.130285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.131043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.131503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.132352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.229556 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-436733ca-4309-4782-aab8-f2beb16437b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 204 len: 0 microversion: 2.1 time: 0.191137 Oct 06 13:29:39.230658 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3064/6138] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:29:39 2022] DELETE /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:29:39.241484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:39.242319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:39.249407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.250082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.250534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.251261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:39.251733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:39.252171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:39.636883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:39.645208 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dca12347-230d-4dde-89f3-1d80cb062dba tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.534141 Oct 06 13:29:39.646206 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3075/6139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:39 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:39.671107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:39.679383 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-42b15244-d26c-4e6f-a6dd-484932b73d34 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1395 microversion: 2.1 time: 0.442653 Oct 06 13:29:39.679983 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3065/6140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:39 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1395 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:40.670497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:40.671150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:40.681322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:40.681852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:40.682811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:40.683717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:40.684339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:40.687506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:40.707814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:40.709574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:40.719197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:40.719812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:40.720520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:40.721359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:40.722430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:40.723127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:41.160339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:41.172954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ffa3d4d-93fb-40a3-ada1-91a7a3d014a5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1395 microversion: 2.1 time: 0.469485 Oct 06 13:29:41.189767 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3066/6141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:40 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:41.192427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:41.209690 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4bbc8bd-b6ab-4175-b3b6-49a6b517c971 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.543486 Oct 06 13:29:41.211100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3076/6142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:40 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:41.728740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554f27af-3b29-469f-9e32-889e74930696", "name": "network-vif-deleted", "tag": "168674d9-2b1d-4268-aeb7-592cc490a80e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:41.747457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:41.748148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:41.749446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:41.769025 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] Creating event network-vif-deleted:168674d9-2b1d-4268-aeb7-592cc490a80e for instance 554f27af-3b29-469f-9e32-889e74930696 on n-h1-860556-1 Oct 06 13:29:41.778148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-45db6f5c-cc34-4f4b-af19-5031eac30846 req-e25a2910-be97-48d9-bfd5-7cd9ea441cb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052932 Oct 06 13:29:41.779067 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3067/6143] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:42.128320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa534fd-854d-45ce-a09d-167c40c643fa", "name": "network-vif-plugged", "status": "completed", "tag": "ee600c88-71fa-4a91-9d47-71117568164a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:42.144224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:42.145077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:42.145776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:42.159378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] Creating event network-vif-plugged:ee600c88-71fa-4a91-9d47-71117568164a for instance 1aa534fd-854d-45ce-a09d-167c40c643fa on n-h2-860556-1 Oct 06 13:29:42.165812 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f78fb74c-8ffb-411f-b6f0-15a8c73053c2 req-6e78f796-7c7e-4bf0-b61e-d5fad8fbd778 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041874 Oct 06 13:29:42.167744 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3077/6144] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:42.210421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:42.213791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:42.223114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:42.223933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:42.224615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:42.225536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:42.226236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:42.226876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:42.236475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:42.241052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:42.262191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:42.263306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:42.263761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:42.264625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:42.265084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:42.265516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:42.316761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:42.326542 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c547d323-73ff-4e3b-8ed8-8c781fed15d3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1188 microversion: 2.1 time: 0.127400 Oct 06 13:29:42.327788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3068/6145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:42 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:42.477394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:42.486209 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ef1caa6-963a-4d04-ba16-da3d426e3baf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.255161 Oct 06 13:29:42.487064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3078/6146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:42 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:43.351155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:43.352712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:43.363234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:43.363860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:43.364433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:43.365299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:43.365895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:43.366425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:43.444825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:43.454033 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d57f5064-0234-4ef5-879f-78dc71c8e81b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1188 microversion: 2.1 time: 0.106908 Oct 06 13:29:43.455110 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3069/6147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:43 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:43.509009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:43.510357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:43.520339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:43.520841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:43.521291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:43.522263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:43.522761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:43.524351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:43.778799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:43.809968 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b905c9c9-5a34-4cb5-999c-ef77addd3fc4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1367 microversion: 2.1 time: 0.304409 Oct 06 13:29:43.813987 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3079/6148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:43 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:44.482435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:44.483075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:44.490677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:44.491380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:44.492258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:44.493287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:44.493975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:44.495138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:44.707283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:44.724765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d771755-8906-4048-985d-f54c5a643477 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1188 microversion: 2.1 time: 0.246695 Oct 06 13:29:44.728885 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3070/6149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:44 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1188 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:44.837307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:44.837969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:44.846305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:44.847500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:44.848191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:44.849074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:44.849767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:44.850442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:45.136263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:45.183256 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e17d96e8-c81d-4763-aed0-5f13cda13ca3 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1557 microversion: 2.1 time: 0.345471 Oct 06 13:29:45.185979 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3080/6150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:44 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1557 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:45.222370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:45.223203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:45.233792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:45.234645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:45.235308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:45.236271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:45.236945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:45.237586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:45.562058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-417dcb39-afa4-4bd8-bfe6-9b7d2e6e9950 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.348980 Oct 06 13:29:45.563309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3071/6151] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:29:45 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-interface => generated 285 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:29:45.757499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:45.759866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:45.799149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:45.805428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:45.806600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:45.808732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:45.819004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:45.819971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:46.759912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:46.781334 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3476044e-08ef-40cf-8f1d-cf37bbc5c57c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1188 microversion: 2.1 time: 1.032786 Oct 06 13:29:46.794295 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3081/6152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:45 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1188 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:29:47.805716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:47.806410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:47.830045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:47.835254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:47.836745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:47.839182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:47.839808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:47.842433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:47.893368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:47.894267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:47.894955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:47.895854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lazy-loading 'fault' on Instance uuid 554f27af-3b29-469f-9e32-889e74930696 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:29:47.953064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:47.965000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa534fd-854d-45ce-a09d-167c40c643fa", "tag": "ee600c88-71fa-4a91-9d47-71117568164a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:47.976802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5644fda0-324a-4731-be15-ba1c7c65c2c1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 200 len: 1193 microversion: 2.1 time: 0.175753 Oct 06 13:29:47.977646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:47.978546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:47.980068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:47.981809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3072/6153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:47 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 1193 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:47.994442 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] Creating event network-changed:ee600c88-71fa-4a91-9d47-71117568164a for instance 1aa534fd-854d-45ce-a09d-167c40c643fa on n-h2-860556-1 Oct 06 13:29:48.000925 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8748da2f-01a2-4c03-a59b-36f84e4f43a8 req-d0afa70a-0b1b-4971-ae1e-1c4b48a34862 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040273 Oct 06 13:29:48.002268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3082/6154] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:29:49.009940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:49.010823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 554f27af-3b29-469f-9e32-889e74930696] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:49.024974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:49.025539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:49.026025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:49.027041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:49.027671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:49.028272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:49.053795 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 HTTP/1.1 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '554f27af-3b29-469f-9e32-889e74930696'} Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:29:49.055997 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:29:49.063189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 554f27af-3b29-469f-9e32-889e74930696 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:29:49.067120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c12bc4e6-f6ae-4416-8c0d-b63a1b254206 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696" status: 404 len: 111 microversion: 2.1 time: 0.063549 Oct 06 13:29:49.067769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3073/6155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:49 2022] GET /compute/v2.1/servers/554f27af-3b29-469f-9e32-889e74930696 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:29:55.620959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1807789919", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c7d73c0e-49fb-45fd-ba45-c85a89eada6e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:55.631912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:55.684555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:29:56.121672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:29:56.122450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:29:56.123407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:29:56.129133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:29:56.129819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:29:56.145378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:56.146494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:56.147678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:56.148830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:56.149527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:56.150291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:56.176723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:29:56.185436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:29:56.259032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:29:56.262252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7d73c0e-49fb-45fd-ba45-c85a89eada6e',volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:29:56.481367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de251b3c-25a4-48dd-afd5-1b585a74b5c4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865536 Oct 06 13:29:56.482142 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3083/6156] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:29:56.495045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-035e1c71-3bc7-4411-bcaf-e83dc044968c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:56.495701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-035e1c71-3bc7-4411-bcaf-e83dc044968c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:56.576880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-035e1c71-3bc7-4411-bcaf-e83dc044968c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:56.591710 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-035e1c71-3bc7-4411-bcaf-e83dc044968c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1057 microversion: 2.1 time: 0.101148 Oct 06 13:29:56.593445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3074/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:56 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1057 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:57.249000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:57.249663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:57.257309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:57.257950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:57.258488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:57.259603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:57.261218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:57.261761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:57.361429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lazy-loading 'services' on Instance uuid d5657281-731e-4cf4-a8da-5d26432149c2 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:29:57.444281 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6936c035-bd35-4541-978a-a50b6c100456 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2/os-volume_attachments/f722356d-6cd9-4837-9f5f-1f9e62d87c38" status: 202 len: 0 microversion: 2.1 time: 0.202046 Oct 06 13:29:57.444889 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3084/6158] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:29:57 2022] DELETE /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2/os-volume_attachments/f722356d-6cd9-4837-9f5f-1f9e62d87c38 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:29:57.616502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:57.621238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:57.639471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:57.642436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:57.643273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:57.644537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:57.648744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:57.649448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:57.733817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:57.743460 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f8f9294-53fb-4e53-b14f-a8d11d2463ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1155 microversion: 2.1 time: 0.130926 Oct 06 13:29:57.743987 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3075/6159] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:57 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:58.769786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:29:58.770529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:29:58.779854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:58.784765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:58.785608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:58.786682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:58.787405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:58.788168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:59.141521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:29:59.153113 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1290da18-38a8-47eb-b53c-28c81697dbe8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.388512 Oct 06 13:29:59.154559 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3085/6160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:29:58 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:29:59.866776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c6a144-276f-4f76-8d40-ff832de1c378", "tag": "de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:29:59.884578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:29:59.893347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:29:59.893936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:29:59.894391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:29:59.915417 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] Creating event network-changed:de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6 for instance 16c6a144-276f-4f76-8d40-ff832de1c378 on n-h2-860556-1 Oct 06 13:29:59.924558 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-89da8273-303d-4388-a9a3-e2abc91e3539 req-ea0e84d0-8ea2-4784-8347-bcb91a9e2fb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061488 Oct 06 13:29:59.925562 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3076/6161] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:30:00.185281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:00.186226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:00.194334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:00.195138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:00.195581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:00.196338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:00.196971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:00.197466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:00.435839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:00.446189 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8120086a-4678-4e52-858a-f3fd59157014 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.265216 Oct 06 13:30:00.447046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3086/6162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:00 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:01.478863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:01.479942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:01.490248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:01.491068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:01.491802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:01.492973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:01.493792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:01.495050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:01.660054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:01.663718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:01.670599 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95ac5d2c-0c7b-48c9-b06f-7b057f8affa6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.198718 Oct 06 13:30:01.671197 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3077/6163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:01 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:02.695717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:02.697121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:02.706813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:02.707645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:02.708081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:02.708968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:02.709595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:02.710050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:02.832278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:02.833217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:02.843743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:02.844884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:02.845681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:02.846843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:02.847616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:02.848274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:02.893253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:30:02.944621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:02.954542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e13b8284-2db6-46ed-86f4-c7f3b7c2e97c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.263331 Oct 06 13:30:02.962863 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3087/6164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:02 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:03.032078 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f3f18624-1d87-4ac8-b6e1-770f67ca6b49 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 204 len: 0 microversion: 2.1 time: 0.205036 Oct 06 13:30:03.033103 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3078/6165] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:30:02 2022] DELETE /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:30:03.042034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:03.042662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:03.049173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:03.050241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:03.050702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:03.051423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:03.051889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:03.052323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:03.207584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:03.217357 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ef4e254f-373d-4760-a5af-ee4de01ce647 tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1514 microversion: 2.1 time: 0.179822 Oct 06 13:30:03.217994 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3088/6166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:03 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:03.982897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:03.983613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:03.995653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:03.996921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:03.997609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:03.998462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:03.999010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:03.999606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:04.149248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:04.158475 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-890b6ca3-929b-4688-8a6e-269b5dcf1182 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.181306 Oct 06 13:30:04.159279 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3079/6167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:03 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:04.241497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:04.242246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:04.251135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:04.251648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:04.252077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:04.252805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:04.253258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:04.253685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:04.410958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:04.426648 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2be788e-cdba-4cb8-8ed2-18555b62845f tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1514 microversion: 2.1 time: 0.185816 Oct 06 13:30:04.428339 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3089/6168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:04 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:05.181319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:05.182565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:05.191096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.191826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.192103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.194271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.196166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.196672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.388807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5657281-731e-4cf4-a8da-5d26432149c2", "name": "network-vif-deleted", "tag": "59d50937-98bc-4b30-8bb5-ed9dd5dafceb"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:30:05.410976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.412131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.412953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.431037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] Creating event network-vif-deleted:59d50937-98bc-4b30-8bb5-ed9dd5dafceb for instance d5657281-731e-4cf4-a8da-5d26432149c2 on n-h1-860556-1 Oct 06 13:30:05.439144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0a63eb5e-51dd-43da-9c3b-6fc9538f8110 req-28ccad12-d00e-4381-b5fd-5be41ccd8124 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054482 Oct 06 13:30:05.442281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3090/6169] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:30:05.466533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:05.467847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:05.475659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.476524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.477358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.478392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.479108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.479783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.561655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:05.571601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a55b8f3-834d-476b-8a48-8fd97be83a1c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.394088 Oct 06 13:30:05.577436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3080/6170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:05 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:05.611799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:05.612319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:05.612842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:05.613317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lazy-loading 'fault' on Instance uuid d5657281-731e-4cf4-a8da-5d26432149c2 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:30:05.620999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:05.683140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646255cdb1ab4b2cbfc6ea729acd593b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed10bcd1ba54f64a16682d07df981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:05.691999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4bf19760-a705-4f8d-91dd-db055552e77a tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 200 len: 1309 microversion: 2.1 time: 0.233450 Oct 06 13:30:05.706382 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3091/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:05 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:06.603225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:06.604588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:06.607813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:06.614085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:06.614587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:06.615039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:06.615753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:06.616217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:06.616653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:06.716955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:06.718193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] [instance: d5657281-731e-4cf4-a8da-5d26432149c2] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:06.724580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:06.726009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:06.729851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:06.730527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:06.731161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:06.732038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:06.733338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:06.733984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:06.752939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] HTTP exception thrown: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Request method failure captured: Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 HTTP/1.1 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtdUEC2Pi4OhrmMZExXcwa7gbSGTMfwfy3MxqsLpd4GpXmgbla_45HCEOKbFSNe1sY2dz0gQHJw5J7t4svVAw_cSkUSsdKS53VcEJtl13dfeO8aPcYgOwoRUK8wq-VjICkK6g1hl3X-gYXB_BjYIxKjmCVNk5Of3IXbvO7icsRGXqOs Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5ed10bcd1ba54f64a16682d07df981c2 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ed10bcd1ba54f64a16682d07df981c2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed10bcd1ba54f64a16682d07df981c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ed10bcd1ba54f64a16682d07df981c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed10bcd1ba54f64a16682d07df981c2"}]}] Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5ed10bcd1ba54f64a16682d07df981c2 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742689520 Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-VolumesSnapshotTestJSON-742689520-project Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 646255cdb1ab4b2cbfc6ea729acd593b Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-VolumesSnapshotTestJSON-742689520-project Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'd5657281-731e-4cf4-a8da-5d26432149c2'} Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:30:06.755453 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. Oct 06 13:30:06.761276 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:06.763219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] Returning 404 to user: Instance d5657281-731e-4cf4-a8da-5d26432149c2 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:30:06.764571 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-519f2fc9-5910-4ff1-9223-9fb54ecf5afc tempest-VolumesSnapshotTestJSON-742689520 tempest-VolumesSnapshotTestJSON-742689520-project] 10.222.0.26 "GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2" status: 404 len: 111 microversion: 2.1 time: 0.051817 Oct 06 13:30:06.769011 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3092/6172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:06 2022] GET /compute/v2.1/servers/d5657281-731e-4cf4-a8da-5d26432149c2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:30:06.771185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:06.781559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4205dd32-5e77-4089-826a-a470fa079b27 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1215 microversion: 2.1 time: 0.182535 Oct 06 13:30:06.782686 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3081/6173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:06 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:07.805136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:07.805932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:07.813633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:07.814139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:07.814741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:07.815443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:07.815958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:07.816389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:07.980488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:07.989420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfbb52c2-ee9c-4c0e-871a-58b3d86b3cbc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.188066 Oct 06 13:30:07.990063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3093/6174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:07 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:09.013605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:09.014864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:09.024672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:09.026050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:09.026514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:09.027233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:09.027693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:09.028129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:09.166628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:09.181259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5854c869-7d5a-431e-b373-1e26915cc6c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.172319 Oct 06 13:30:09.195749 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3082/6175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:09 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:10.207828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:10.208544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:10.216044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:10.216774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:10.217297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:10.218040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:10.218502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:10.219126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:10.363603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:10.372183 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ca31730-b6c4-4ce2-ac8a-6959cc6c1a29 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.168535 Oct 06 13:30:10.372766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3094/6176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:10 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:11.396215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:11.397352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:11.404779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:11.405510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:11.406167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:11.406889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:11.407354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:11.407972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:11.558486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:11.567128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-64bf3832-cd48-4112-be54-52ec16eea9cf tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.174968 Oct 06 13:30:11.567708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3083/6177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:11 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:12.591242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:12.591899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:12.599113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:12.599605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:12.600054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:12.600766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:12.601230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:12.601661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:12.735907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:12.744016 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc9505e6-d129-46a6-8be9-dbe87427995d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.157309 Oct 06 13:30:12.744620 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3095/6178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:12 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:13.767132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:13.767782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:13.774851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:13.775373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:13.775814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:13.776509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:13.776966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:13.777400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:13.920924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:13.929204 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9fc0fbad-a6f1-4fe3-b013-b6dd2ef0adef tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.166032 Oct 06 13:30:13.929995 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3084/6179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:13 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:14.953944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:14.955290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:14.980206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:14.984385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:14.985117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:14.989140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:14.989908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:14.991072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:15.204067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:15.214774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48f164a9-4d3f-4996-9935-b3af95ca4115 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.266344 Oct 06 13:30:15.230068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3096/6180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:14 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:16.238213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:16.239435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:16.251569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:16.254329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:16.255023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:16.255971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:16.257599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:16.258286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:16.477244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:16.490766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35b04da8-d7fe-4c34-9a27-b4dd24c17df3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.256622 Oct 06 13:30:16.502412 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3085/6181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:16 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:17.515520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:17.516261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:17.525756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:17.527323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:17.527323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:17.529621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:17.530695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:17.531401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:17.708471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:17.719645 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aa47aaff-6b3f-4deb-bc0c-7121d01665e8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.207689 Oct 06 13:30:17.734010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3097/6182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:17 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:18.358120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c6a144-276f-4f76-8d40-ff832de1c378", "name": "network-vif-plugged", "status": "completed", "tag": "de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:30:18.386028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:18.386855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:18.387553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:18.402316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] Creating event network-vif-plugged:de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6 for instance 16c6a144-276f-4f76-8d40-ff832de1c378 on n-h2-860556-1 Oct 06 13:30:18.408479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c5499a24-899c-45e9-909b-e8c9fe6bd8ab req-842e1ef4-52e2-4fc5-a9ef-cd1c88b144ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054123 Oct 06 13:30:18.409231 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3086/6183] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:30:18.747602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:18.748387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:18.756238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:18.756723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:18.757157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:18.757900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:18.758354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:18.758778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:18.915659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:18.926640 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-384dc1ea-2925-4d99-a34c-b53384288073 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.185848 Oct 06 13:30:18.933921 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3098/6184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:18 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:19.956890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:19.959270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:19.996806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:19.999457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:20.000172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:20.002890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:20.003623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:20.004480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:20.323366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:20.335911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6032cf50-7690-4c39-b8f2-5462ebc1f58a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1203 microversion: 2.1 time: 0.385962 Oct 06 13:30:20.354403 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3087/6185] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:19 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1203 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:21.363117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:21.363730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:21.371116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.371600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.372036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.372734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.373189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.373622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.518225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:21.528361 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe8de607-5052-49ea-9df4-1385e2938218 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1390 microversion: 2.1 time: 0.169401 Oct 06 13:30:21.528942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3099/6186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:21 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:21.551254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:21.551951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:21.559407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.559913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.560357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.561081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.561547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.562008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.733782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:21.737568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f6528ce-6dd1-4f8b-8d4d-fb46bc095bbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1390 microversion: 2.1 time: 0.190556 Oct 06 13:30:21.738810 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3088/6187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:21 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:21.760528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:21.761191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:21.767589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.768087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.768517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.769425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.769918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.770532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.933598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:21.942388 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3557850-e3aa-4156-8e23-d0194a586467 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1390 microversion: 2.1 time: 0.186315 Oct 06 13:30:21.944195 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3100/6188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:21 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:21.966379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:21.966890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:21.975763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.976586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.977272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:21.978843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:21.979702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:21.980340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:22.046935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:30:22.242031 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-51df0da7-a445-4a8c-be62-9a19e3d8fd61 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 204 len: 0 microversion: 2.1 time: 0.279325 Oct 06 13:30:22.242887 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3089/6189] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:30:21 2022] DELETE /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:30:22.251674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:22.252301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:22.260775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:22.261290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:22.261763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:22.262496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:22.262963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:22.263400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:22.476319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:22.487244 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f98baa60-cd73-400b-b373-098bb260e2dc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1396 microversion: 2.1 time: 0.239586 Oct 06 13:30:22.489179 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3101/6190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:22 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:23.520415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:23.521369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:23.529671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:23.530207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:23.530657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:23.531402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:23.531885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:23.532323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:23.674330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:23.682480 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a18789f8-0469-409e-897d-94d111f6d31b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1396 microversion: 2.1 time: 0.166319 Oct 06 13:30:23.683072 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3090/6191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:23 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:24.544453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c6a144-276f-4f76-8d40-ff832de1c378", "name": "network-vif-deleted", "tag": "de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:30:24.562396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:24.562938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:24.563375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:24.579758 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] Creating event network-vif-deleted:de46c3c4-f40d-40b8-8dc8-5b4aa840f1f6 for instance 16c6a144-276f-4f76-8d40-ff832de1c378 on n-h2-860556-1 Oct 06 13:30:24.585762 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-31e74c29-07c9-4e4c-a839-2843151ff0a4 req-4dc2b7f5-c983-4a9a-888c-c97dd7e8e08b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044790 Oct 06 13:30:24.600035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3102/6192] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:30:24.705674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:24.707544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:24.728136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:24.730686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:24.731159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:24.734320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:24.736209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:24.737147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:24.836266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:24.844973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:24.848160 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c457e1df-ae13-4358-8cbe-4a9f2cfba414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1188 microversion: 2.1 time: 0.146309 Oct 06 13:30:24.853990 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3091/6193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:24 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1188 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:25.895429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:25.896317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:25.898592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:25.905886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:25.906714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:25.907421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:25.908282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:25.908740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:25.909170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:26.047983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:26.058004 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-224e207a-d256-45d8-8645-971c167e703f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1188 microversion: 2.1 time: 0.173673 Oct 06 13:30:26.059617 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3103/6194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:25 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:27.086655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:27.087363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:27.096367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:27.096873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:27.097325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:27.098078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:27.098542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:27.098979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:27.171438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:27.182864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-68c66d8f-bf0d-4c18-ab34-f270f5d77eb7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1188 microversion: 2.1 time: 0.101541 Oct 06 13:30:27.187158 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3092/6195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:27 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:28.211827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:28.212776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:28.224294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:28.224784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:28.225229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:28.225965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:28.226426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:28.226850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:28.323310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:28.334639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f064664a-fa3b-4dcd-bdf6-c60a165530a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1188 microversion: 2.1 time: 0.130517 Oct 06 13:30:28.347311 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3104/6196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:28 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:29.366684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:29.371375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:29.388401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:29.389507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:29.390566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:29.392357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:29.393613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:29.395479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:29.504879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:30:29.516793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ddacc851-b4ee-454b-b32c-6c97ff1818ad tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 200 len: 1188 microversion: 2.1 time: 0.158139 Oct 06 13:30:29.517414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3093/6197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:29 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 1188 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:30:30.547211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:30.548166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 16c6a144-276f-4f76-8d40-ff832de1c378] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:30.560801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:30.561576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:30.562735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:30.563705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:30.564398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:30.566229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:30.586088 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 HTTP/1.1 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '16c6a144-276f-4f76-8d40-ff832de1c378'} Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:30:30.588755 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 16c6a144-276f-4f76-8d40-ff832de1c378 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bea9f9d8-6239-4a1b-9d61-79fb266f84c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378" status: 404 len: 111 microversion: 2.1 time: 0.052718 Oct 06 13:30:30.593258 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3105/6198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:30:30 2022] GET /compute/v2.1/servers/16c6a144-276f-4f76-8d40-ff832de1c378 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:30:51.497419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:30:51.498631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:51.508122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:51.509822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:51.512024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:51.513150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:51.513855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:51.514791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:51.515427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:51.516029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:51.557363 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6246468-fb87-43bb-b500-13e321dc20f8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/ips" status: 200 len: 150 microversion: 2.1 time: 0.064010 Oct 06 13:30:51.558728 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3094/6199] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:30:51 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/ips => generated 150 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:30:54.348182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2c83906-5bd1-4b91-91f6-9a99d184d987"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:30:54.350719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:30:54.354453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:54.360071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=74 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:30:54.378669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:54.380100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:54.381263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:54.383826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:30:54.385598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:30:54.387561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:30:54.869378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70050bad-10f3-4769-8c7a-2687d1de3ee8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523205 Oct 06 13:30:54.871673 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3106/6200] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:30:54 2022] POST /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:01.316811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2104247293", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2a752fff-db4f-4674-9733-18a056edc3e3", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:01.427009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:31:01.555408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:01.963500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:31:01.964112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:31:01.964618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:31:01.965051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:31:01.965481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:31:01.977459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:01.977996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:01.978453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:01.979215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:01.979690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:01.980132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:02.000938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:31:02.007157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:31:02.021819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:31:02.023937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2a752fff-db4f-4674-9733-18a056edc3e3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:31:02.160152 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22dd411a-c636-4ef4-80dc-bb91773d9bdd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847561 Oct 06 13:31:02.182952 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3095/6201] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:31:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:31:02.196888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f7384dc-a58e-4eb1-a78c-73cf2f460c02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:02.198375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f7384dc-a58e-4eb1-a78c-73cf2f460c02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:02.275460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0f7384dc-a58e-4eb1-a78c-73cf2f460c02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:02.285832 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f7384dc-a58e-4eb1-a78c-73cf2f460c02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1057 microversion: 2.1 time: 0.094382 Oct 06 13:31:02.303876 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3107/6202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:02 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1057 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:03.315950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:03.317011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:03.326176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:03.326973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:03.327442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:03.328168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:03.328663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:03.329088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:03.403459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:03.416605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f45f8fb-d519-4a60-b5f9-b6d98acc8196 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1109 microversion: 2.1 time: 0.104995 Oct 06 13:31:03.417195 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3096/6203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:03 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1109 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:04.442467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:04.443820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:04.455066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:04.455961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:04.456667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:04.457623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:04.458657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:04.459321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:04.577050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:04.603526 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b2b5bc8-a9a7-4d97-bd1a-362ce7ca710d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1127 microversion: 2.1 time: 0.164121 Oct 06 13:31:04.604973 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3108/6204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:04 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1127 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:05.629023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:05.630619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:05.651987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:05.660073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:05.661002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:05.662009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:05.665607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:05.668268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:06.738546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:06.749231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2a09b574-a3b5-41f5-bf23-3d6af8ef3d16 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 1.123960 Oct 06 13:31:06.750568 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3097/6205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:05 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:07.616868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f624dd0d-596c-49a1-b1aa-75e2d1a163ac", "tag": "ea9c513b-4025-4e84-aa9c-abf1cea33ab8"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:07.662796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:07.665184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:07.665997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:07.716120 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] Creating event network-changed:ea9c513b-4025-4e84-aa9c-abf1cea33ab8 for instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac on n-h1-860556-1 Oct 06 13:31:07.728248 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f2923e6c-cd6a-4df8-b896-ab2488aad1f2 req-8483f5ff-9773-4916-9a9f-da853ca6cd3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.538633 Oct 06 13:31:07.731003 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3109/6206] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:07.773834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:07.774576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:07.813767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:07.814484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:07.820337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:07.822467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:07.827712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:07.830039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:08.344426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:08.365289 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a08e34e-ee6e-452f-93c8-0f413da2eeb1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.596331 Oct 06 13:31:08.380394 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3098/6207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:07 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:09.210796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2c83906-5bd1-4b91-91f6-9a99d184d987"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:09.214192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:09.235976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.236796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.237410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.238404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.239091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.239734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.396041 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments HTTP/1.1 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 74 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: {"volumeAttachment": {"volumeId": "e2c83906-5bd1-4b91-91f6-9a99d184d987"}} Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': '1aa534fd-854d-45ce-a09d-167c40c643fa', 'body': {'volumeAttachment': {'volumeId': 'e2c83906-5bd1-4b91-91f6-9a99d184d987'}}} Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:31:09.401567 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa Oct 06 13:31:09.406715 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:09.411140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:09.411656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:09.412952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 400 to user: Invalid volume: volume e2c83906-5bd1-4b91-91f6-9a99d184d987 is already attached to instances: 1aa534fd-854d-45ce-a09d-167c40c643fa {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:31:09.417046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c504314d-36b4-49f1-9140-7e6a51bf0d61 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208005 Oct 06 13:31:09.418055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3110/6208] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:31:09 2022] POST /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 174 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:31:09.425872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.426636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.427256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.428178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.428819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.431057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.522073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:09.522977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:09.531075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.531939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.532649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.533614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.534328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.534982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.663040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lazy-loading 'services' on Instance uuid 1aa534fd-854d-45ce-a09d-167c40c643fa {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:31:09.815755 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d82f1f1b-a0b1-4f3e-b482-0517d5d3bab4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments/e2c83906-5bd1-4b91-91f6-9a99d184d987" status: 202 len: 0 microversion: 2.1 time: 0.298782 Oct 06 13:31:09.846585 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3111/6209] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:31:09 2022] DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments/e2c83906-5bd1-4b91-91f6-9a99d184d987 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:31:09.866318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:09.871542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:09.900208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:09.902122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.903057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.903711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.905848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:09.907628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:09.908278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:09.912008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-72080ae0-2d17-4b57-9471-831b8c0ebd69 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.510105 Oct 06 13:31:09.925921 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3099/6210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:09 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:10.022147 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8de4ae50-9e34-4757-bbd4-d08d6474a91f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170391 Oct 06 13:31:10.023259 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3112/6211] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:09 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:10.950185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:10.951033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:10.966427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:10.967073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:10.971362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:10.972151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:10.972634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:10.973075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:11.045922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:11.050087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:11.094472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:11.095016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:11.098404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:11.101016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:11.101510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:11.105954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:11.224414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:11.228296 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7bb0a427-6f37-47d7-9218-a35b2a82ad67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191045 Oct 06 13:31:11.238059 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3113/6212] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:11 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:11.251911 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57d30add-4aa3-41f1-8247-f975d73e2bc2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.305537 Oct 06 13:31:11.271004 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3100/6213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:10 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:12.243233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:12.246755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:12.254683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:12.255160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:12.255605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:12.256321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:12.256774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:12.262841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:12.285849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:12.287059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:12.302474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:12.303536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:12.310449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:12.311075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:12.311656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:12.312414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:12.312969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:12.313768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:12.321030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:12.367579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87988492-f9df-4165-a631-4a7d31a54103 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128788 Oct 06 13:31:12.371899 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3114/6214] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:12 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:12.585120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:12.613345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9ad9222f-18e9-437d-81bc-4df2ecc2b414 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.332744 Oct 06 13:31:12.613983 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3101/6215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:12 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:13.394397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:13.401262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:13.418081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:13.418585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:13.427911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:13.429405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:13.433998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:13.434680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:13.572950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01d5c43b-1b94-4c59-bc5f-a0fd07a3c886 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189627 Oct 06 13:31:13.578379 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3115/6216] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:13 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:13.636407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:13.637007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:13.652678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:13.658320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:13.659258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:13.660267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:13.660970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:13.661647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:13.879160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:13.898103 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7bb2254c-6399-484a-9e2a-146561367dbe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.263717 Oct 06 13:31:13.903284 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3102/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:13 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:14.599113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:14.620914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:14.633825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:14.634676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:14.636046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:14.637328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:14.638062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:14.638730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:14.700666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b35d881-134f-4c85-80c6-c22e4cc3b91c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115785 Oct 06 13:31:14.703016 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3116/6218] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:14 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:14.928684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:14.930384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:14.951482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:14.952433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:14.953318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:14.963146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:14.963660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:14.964102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:15.355962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:15.366666 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a88d70f9-d898-4277-b574-de83f0015df4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.442135 Oct 06 13:31:15.369221 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3103/6219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:14 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:15.716040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:15.718338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:15.743698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:15.744210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:15.745090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:15.749851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:15.750637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:15.756070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:15.860339 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0fa7814a-1deb-4d6b-b91f-9b3cbace3876 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149421 Oct 06 13:31:15.861208 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3117/6220] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:15 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:16.407907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:16.409147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:16.418822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:16.428252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:16.429352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:16.440153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:16.440981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:16.441617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:16.710204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:16.727572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f545cfb-711e-4567-8cfc-6fe4f4bb3210 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.323253 Oct 06 13:31:16.727986 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3104/6221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:16 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:16.874437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:16.882301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:16.899563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:16.901443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:16.902144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:16.903050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:16.903676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:16.904260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:16.954212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0d180a3-4085-4db1-b75f-0402fac76249 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084292 Oct 06 13:31:16.955390 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3118/6222] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:16 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:17.750253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:17.751509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:17.764438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:17.771050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:17.771881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:17.772803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:17.773423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:17.774102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:17.967560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:17.970010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:17.978213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:17.979062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:17.979979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:17.980944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:17.981635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:17.982312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:18.038390 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5abd1fe4-ada7-4775-aae8-f8ed03c79ac4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074717 Oct 06 13:31:18.045055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3119/6223] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:17 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:31:18.234735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:18.252076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91ba8302-cbde-48fb-8304-cc5826d9f823 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.504095 Oct 06 13:31:18.254793 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3105/6224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:17 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:19.052365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:19.055397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:19.065365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.066310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.067032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.068037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.068732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.069518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.129770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2a515972-98cb-43a4-8755-481178e83a67 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078302 Oct 06 13:31:19.136483 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3120/6225] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:31:19 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:31:19.232525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:19.233080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:19.240111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.240598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.241045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.241771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.242238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.250406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.278585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:19.279218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:19.292587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.297499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.298337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.299542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.301532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:31:19.302961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.303972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.408071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-023a2a2b-7848-44bf-8882-25f1feca8c40 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 204 len: 0 microversion: 2.1 time: 0.178095 Oct 06 13:31:19.410159 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3106/6226] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:31:19 2022] DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:31:19.420022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:19.420754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:19.428742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.429617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.430158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.430889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:19.431421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:19.432572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:19.694705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:19.705024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e37334c4-9edc-4816-8873-3f2b312bb359 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.431248 Oct 06 13:31:19.705759 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3121/6227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:19 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:19.774027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:19.798202 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf57484f-ff09-4f75-adf4-d5d3950eeb31 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1682 microversion: 2.1 time: 0.373214 Oct 06 13:31:19.798202 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3107/6228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:19 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1682 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:20.730952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:20.731580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:20.764229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:20.764759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:20.765207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:20.766733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:20.767399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:20.768001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:20.788697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:20.821315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:20.822103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:20.841593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:20.842182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:20.845697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:20.846726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:20.848426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:20.850740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:21.393708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:21.407392 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cab931e6-4387-4ca9-b771-176b37d11599 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.679376 Oct 06 13:31:21.410156 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3122/6229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:20 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:21.464151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:21.472375 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-090c9d5e-e4a1-45dc-bdb8-b74b1011b6f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1682 microversion: 2.1 time: 0.656256 Oct 06 13:31:21.490763 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3108/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:20 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1682 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:22.435057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:22.435691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:22.448921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:22.449433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:22.453319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:22.456024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:22.457277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:22.458740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:22.505690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:22.507632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:22.521013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:22.524610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:22.527526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:22.528278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:22.529224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:22.530372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:22.533008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:22.682444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:22.708483 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-69dff94d-47c8-4e6a-a86a-9abfb16c3027 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1614 microversion: 2.1 time: 0.208259 Oct 06 13:31:22.709104 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3109/6231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:22 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1614 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:23.059598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:23.074111 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac6d5939-96e7-4492-b484-5a6394ecb154 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.643655 Oct 06 13:31:23.074773 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3123/6232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:22 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:23.482133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa534fd-854d-45ce-a09d-167c40c643fa", "name": "network-vif-deleted", "tag": "ee600c88-71fa-4a91-9d47-71117568164a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:23.521944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:23.522588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:23.541430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:23.595737 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] Creating event network-vif-deleted:ee600c88-71fa-4a91-9d47-71117568164a for instance 1aa534fd-854d-45ce-a09d-167c40c643fa on n-h2-860556-1 Oct 06 13:31:23.618093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8a1f6c3f-e28d-400e-8211-6536d8403e23 req-ff829e12-7c48-4d34-94a2-efc5b17288ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131224 Oct 06 13:31:23.618093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3110/6233] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:23.738026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:23.738026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:23.751584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:23.753838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:23.755446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:23.759228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:23.759923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:23.760654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:23.841392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:23.843336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:23.847209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:23.847994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lazy-loading 'fault' on Instance uuid 1aa534fd-854d-45ce-a09d-167c40c643fa {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:31:23.917534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:23.929021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60d3210e-c469-4957-b510-c8adba0df65e tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 200 len: 1331 microversion: 2.1 time: 0.199804 Oct 06 13:31:23.930517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3124/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:23 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:24.100987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:24.103826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:24.136612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:24.137766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:24.138497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:24.150231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:24.154211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:24.155451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:24.183301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:24.632711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:24.645850 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9e2d9236-afc3-4843-b089-aa2f18daefe1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.548767 Oct 06 13:31:24.646567 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3111/6235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:24 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:24.952476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:24.953085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:24.955838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=43 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:24.962871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:24.984627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:24.986465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:24.987558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:24.991792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:24.993052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:25.028952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa HTTP/1.1 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1aa534fd-854d-45ce-a09d-167c40c643fa'} Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:25.034164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:31:25.038519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64f71fa8-49ce-4d6b-8f8a-e304b3829d81 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 404 len: 111 microversion: 2.1 time: 0.087696 Oct 06 13:31:25.039152 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3125/6236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:24 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:31:25.046129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fbcbb224-c7ed-4ca6-9e36-89116bb4a3aa tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '.version_select at 0x7f7d3ea4eb80>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:25.089962 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fbcbb224-c7ed-4ca6-9e36-89116bb4a3aa tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575644242" status: 202 len: 0 microversion: 2.1 time: 0.047433 Oct 06 13:31:25.090649 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3112/6237] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575644242 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:31:25.675291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:25.677532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:25.694180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:25.695122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:25.695830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:25.697193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:25.697905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:25.698586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:26.124451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:26.141860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-932c687c-8755-4895-a115-67f886acc37d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.470380 Oct 06 13:31:26.142807 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3126/6238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:25 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:26.795875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1153ee0b-c551-4a11-b61f-f451c2408b48 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: .version_select at 0x7f7d3ea52670>, body: {"keypair": {"name": "tempest-keypair-598491748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQGNVgWLHeRk+lmembX0lDmD9iSv6WwxocGFIythMlvlAVYhrJOdR6k3cDEcrS6PH+SJVn5Vl9ncIE5hjeLcEpdZzV4qvaOdjw51r7V09VdXEhCZ839/aFJzRl88a3J0w=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:26.837532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1153ee0b-c551-4a11-b61f-f451c2408b48 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:31:26.844474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-1153ee0b-c551-4a11-b61f-f451c2408b48 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:31:26.903611 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1153ee0b-c551-4a11-b61f-f451c2408b48 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112012 Oct 06 13:31:26.904471 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3113/6239] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:31:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:27.167590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:27.167590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:27.181918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:27.182427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:27.182994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:27.183588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:27.184055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:27.184487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:27.470039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:27.498024 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36f98461-b797-4c63-9ab3-88d1e640e469 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.336042 Oct 06 13:31:27.500055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3127/6240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:27 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:28.530644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:28.532022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:28.557536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:28.558337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:28.559824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:28.562983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:28.567241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:28.568226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:28.795174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:28.804137 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d28ba1b5-8a42-4e98-b938-8c05b366e92c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1169 microversion: 2.1 time: 0.279551 Oct 06 13:31:28.805607 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3114/6241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:28 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1169 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:29.147304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-573672472", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb0b016-19fe-46cc-81a2-ae79246f7798"}], "security_groups": [{"name": "tempest-securitygroup--1815887666"}], "key_name": "tempest-keypair-598491748", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:29.291691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] validate_networks() for [('2eb0b016-19fe-46cc-81a2-ae79246f7798', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:31:29.829216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:29.830344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:29.842803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:29.843321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:29.846038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:29.846795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:29.848563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:29.850585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:29.959881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:31:29.960437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:31:29.961411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:31:29.962030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:31:29.962743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:31:29.982634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:29.983340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:29.987848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:29.988901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:29.989567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:29.990233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:30.033234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:31:30.045422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Getting quotas for user d2da662da4ff45da85849462545ff6c1 and project 3a00ed9555194b40a3f29c9a5f512ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:31:30.080587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:31:30.085316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:31:30.187055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:30.197002 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b04115bc-c745-45ea-8bbd-2b6bf5feaeb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.371268 Oct 06 13:31:30.199048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3115/6242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:29 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:30.204981 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d499e17d-eedd-4aa5-86e1-c0c354a312b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.064439 Oct 06 13:31:30.208510 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3128/6243] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:31:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:31:30.222693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edf57dfc-056d-46e4-9caa-c8cbd6091346 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:30.223594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edf57dfc-056d-46e4-9caa-c8cbd6091346 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:30.341012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edf57dfc-056d-46e4-9caa-c8cbd6091346 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:30.351620 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edf57dfc-056d-46e4-9caa-c8cbd6091346 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1240 microversion: 2.1 time: 0.132933 Oct 06 13:31:30.357047 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3116/6244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:30 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:31.228381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:31.230295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:31.239839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:31.240581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:31.242994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:31.244906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:31.245620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:31.246245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:31.388185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:31.388818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:31.405071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:31.412019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:31.413489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:31.414944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:31.418861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:31.419874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:31.558422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:31.562657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:31.579676 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2ae28d3-5c46-47ba-b1aa-828a10bed899 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1292 microversion: 2.1 time: 0.202865 Oct 06 13:31:31.581172 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca2f760e-335b-41d1-a2c2-94cbbe93add4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.360780 Oct 06 13:31:31.582311 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3129/6245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:31 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:31.595424 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3117/6246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:31 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1292 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:32.616383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:32.617124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:32.618283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:32.618882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:32.633502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:32.634040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:32.634494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:32.635288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:32.635690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:32.639020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:32.639747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:32.641486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:32.642273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:32.642912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:32.643788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:32.644607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:33.184021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:33.204204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:33.211996 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc86735c-3de2-4e11-9248-0440a2d1c1d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.605107 Oct 06 13:31:33.214041 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3130/6247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:32 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:33.219148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-feb99a2f-c529-4a7f-a893-bd514b3d6a63 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.613628 Oct 06 13:31:33.219837 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3118/6248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:32 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:34.186326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ad2b75-d594-43ab-b75c-46d7b384167c", "tag": "e0e0d111-5a2e-4b96-b357-b5e9e45a5de6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:34.215092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:34.218673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:34.219662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:34.236034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:34.237873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:34.246403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:34.247219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:34.248082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:34.248740 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] Creating event network-changed:e0e0d111-5a2e-4b96-b357-b5e9e45a5de6 for instance c4ad2b75-d594-43ab-b75c-46d7b384167c on n-h2-860556-1 Oct 06 13:31:34.249402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:34.250122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:34.250782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:34.256952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5c3f47e7-71c5-407d-8ac6-787f5263f3a3 req-3a075608-6fdf-45e9-999f-76ddfb1e79b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085812 Oct 06 13:31:34.260364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3131/6249] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:34.275569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:34.277165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:34.293894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:34.294775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:34.296240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:34.297023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:34.297503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:34.297971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:34.663467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:34.667355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:34.694170 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23078a6e-9e19-408d-a39b-b11cd8fe97fe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.458900 Oct 06 13:31:34.698291 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-09dabe08-8a9a-461a-9660-8b45a197bba8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.431998 Oct 06 13:31:34.700993 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3132/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:34 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:34.707714 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3119/6251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:34 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:35.737491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:35.739107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:35.741061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:35.741369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:35.752371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:35.753582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:35.754242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:35.755212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:35.755853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:35.756464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:35.771910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:35.772492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:35.772951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:35.773952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:35.778466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:35.779116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:36.033619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:36.044773 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3041af3a-9f55-4910-983c-f72a7168713a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.313062 Oct 06 13:31:36.046990 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3133/6252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:35 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:36.079990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:36.090299 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f366359-571d-4032-8af2-59c5cee7f1ad tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.358316 Oct 06 13:31:36.104589 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3120/6253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:35 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:37.071191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:37.072736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:37.086465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:37.087234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:37.087680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:37.088408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:37.088867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:37.089299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:37.119594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:37.123812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:37.134254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:37.135013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:37.135601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:37.136428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:37.136965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:37.137753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:37.367847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:37.379701 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e8d382f-a6e8-4561-849f-82946193110a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.264261 Oct 06 13:31:37.395721 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3121/6254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:37 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:37.396807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:37.407041 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c2d564e-390e-4b62-8aa6-2a6d943e8738 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.340379 Oct 06 13:31:37.407640 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3134/6255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:37 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:38.405100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:38.405772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:38.415188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:38.416722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:38.417819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:38.419066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:38.419811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:38.420475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:38.431766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:38.432804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:38.444186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:38.445770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:38.446728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:38.447949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:38.448618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:38.449273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:38.687495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:38.691162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:38.699950 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c7722b8-47a5-4c2c-8cd6-0de82dcd54b8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.299597 Oct 06 13:31:38.701894 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-29f13940-f8c1-440a-9ea5-d274f5e2a131 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.273699 Oct 06 13:31:38.702048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3122/6256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:38 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:38.703806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3135/6257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:38 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:38.897524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f624dd0d-596c-49a1-b1aa-75e2d1a163ac", "name": "network-vif-plugged", "status": "completed", "tag": "ea9c513b-4025-4e84-aa9c-abf1cea33ab8"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:38.914594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:38.915506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:38.916134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:38.932760 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] Creating event network-vif-plugged:ea9c513b-4025-4e84-aa9c-abf1cea33ab8 for instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac on n-h1-860556-1 Oct 06 13:31:38.940600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cb923dc0-3827-4be4-a15b-c431eb2bdc03 req-ff9efc9a-bf63-48be-97de-4cb5ef0a430c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236506 Oct 06 13:31:38.941539 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3123/6258] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:39.726101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:39.727437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:39.728199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:39.729688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:39.735730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:39.736350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:39.736502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:39.736986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:39.737102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:39.737427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:39.737998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:39.738191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:39.738645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:39.738849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:39.739257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:39.739367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:40.002989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:40.012068 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43c66d43-39c5-4481-ae9c-c58147afd537 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1203 microversion: 2.1 time: 0.289330 Oct 06 13:31:40.016039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:40.023130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:40.029883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3124/6259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:39 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1203 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:40.032058 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-463883b1-3750-4b83-95f8-b1e14f6c82e0 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.309984 Oct 06 13:31:40.033145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3136/6260] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:39 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:40.967374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ad2b75-d594-43ab-b75c-46d7b384167c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e0d111-5a2e-4b96-b357-b5e9e45a5de6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:40.979708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:40.991006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:40.991493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:40.991991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.004908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] Creating event network-vif-plugged:e0e0d111-5a2e-4b96-b357-b5e9e45a5de6 for instance c4ad2b75-d594-43ab-b75c-46d7b384167c on n-h2-860556-1 Oct 06 13:31:41.011942 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a84356da-3a2b-47e3-a0a2-947fb5ed6225 req-c31ce2b3-16c2-4663-961d-96a7eb7777a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054870 Oct 06 13:31:41.018967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3125/6261] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:41.036630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:41.037438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:41.040352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:41.047288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.048085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.048767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.049992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.050663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.051178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.069649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:41.071904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:41.081128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.082610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.083252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.084315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.084944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.086488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.449387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:41.464264 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59bdc050-ac8b-46e0-acc0-5da004bdf036 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.410462 Oct 06 13:31:41.465114 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3126/6262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:41 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:41.465443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:41.473979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cd0046b3-d7ab-4818-8bfb-84e39df698eb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1389 microversion: 2.1 time: 0.441922 Oct 06 13:31:41.492121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3137/6263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:41 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1389 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:41.499819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:41.500501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:41.514150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.518244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.518808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.519623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.520161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.520674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.768819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:41.780180 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9cc54d89-cf09-4e5c-a39a-d0134ca173bc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1389 microversion: 2.1 time: 0.284375 Oct 06 13:31:41.781424 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3127/6264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:41 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:41.803731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:41.812307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:41.820804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.821954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.822862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:41.824342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:41.825153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:41.825798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.070832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:42.083362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22a7e20f-d5e0-4297-b21e-9338a38e359a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1389 microversion: 2.1 time: 0.284473 Oct 06 13:31:42.106280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3138/6265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:41 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1389 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:42.193572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:42.196745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:42.204448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.204946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.205395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.206260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.206728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.207162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.233536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:31:42.326954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7c7e3004-72ab-432b-8483-9e7784a38e17 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 204 len: 0 microversion: 2.1 time: 0.137239 Oct 06 13:31:42.328351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3128/6266] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:31:42 2022] DELETE /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:31:42.336401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:42.337025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:42.343468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.343963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.344406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.345115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.345576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.346248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.508671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:42.510667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:42.522948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.525054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.526307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.528465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:42.529777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:42.530922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:42.798663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:42.829441 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-316a2d2e-ec86-4961-aa4f-60326f111f4c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1395 microversion: 2.1 time: 0.496936 Oct 06 13:31:42.846491 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3139/6267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:42 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1395 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:42.910562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:42.920067 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77592597-4f3b-4bff-8bdc-a7d0dac2c06f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1366 microversion: 2.1 time: 0.424971 Oct 06 13:31:42.934640 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3129/6268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:42 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:43.861840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:43.862479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:43.870679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:43.871586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:43.872067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:43.872852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:43.873654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:43.874114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:43.893536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:43.952420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:43.953081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:43.968832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:43.970658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:43.971442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:43.972625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:43.973321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:43.974865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:44.015171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:44.213001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:44.222045 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92ede6a2-2504-4a26-b18b-8ccb82b92661 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1395 microversion: 2.1 time: 0.365741 Oct 06 13:31:44.223007 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3140/6269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:43 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1395 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:44.401705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:44.416559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-54530763-c1dd-46b8-825f-49dab6d37e5c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1555 microversion: 2.1 time: 0.477408 Oct 06 13:31:44.418046 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3130/6270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:43 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1555 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:44.440047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:44.440770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:44.448071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:44.448803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:44.449426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:44.450350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:44.450977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:44.451602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:44.550349 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59dd411b-6e0b-452a-a606-cffa50e664cf tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112026 Oct 06 13:31:44.554073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3141/6271] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:31:44 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:44.779672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f624dd0d-596c-49a1-b1aa-75e2d1a163ac", "name": "network-vif-deleted", "tag": "ea9c513b-4025-4e84-aa9c-abf1cea33ab8"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:44.803903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:44.805192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:44.805928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:44.824690 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] Creating event network-vif-deleted:ea9c513b-4025-4e84-aa9c-abf1cea33ab8 for instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac on n-h1-860556-1 Oct 06 13:31:44.836302 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1065a0c8-1364-43cb-a040-df1a306ad9a8 req-171bbe74-f100-4841-931f-c4959621f595 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060585 Oct 06 13:31:44.836944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3131/6272] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:45.254007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:45.260540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:45.275573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:45.279470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:45.280644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:45.281778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:45.282720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:45.284683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:45.422469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:45.434743 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bff583c7-dfbb-48ae-9ac9-ed99aebaf9fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1188 microversion: 2.1 time: 0.193531 Oct 06 13:31:45.448266 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3142/6273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:45 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:46.461897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:46.462617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:46.476892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:46.479191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:46.480139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:46.481903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:46.484544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:46.487190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:46.633402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:46.645621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff334fc7-3ca9-4915-9da1-aa85ff458c37 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1188 microversion: 2.1 time: 0.189007 Oct 06 13:31:46.647228 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3143/6274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:46 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1188 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:46.659654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ad2b75-d594-43ab-b75c-46d7b384167c", "tag": "e0e0d111-5a2e-4b96-b357-b5e9e45a5de6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:31:46.674004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:46.675149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:46.675772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:46.689018 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] Creating event network-changed:e0e0d111-5a2e-4b96-b357-b5e9e45a5de6 for instance c4ad2b75-d594-43ab-b75c-46d7b384167c on n-h2-860556-1 Oct 06 13:31:46.695566 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cda0214d-bf80-45be-9e8b-6e670a1690b5 req-35c4c9c6-b2f8-439d-abc1-9ddd3ccb09cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305268 Oct 06 13:31:46.696834 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3132/6275] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:31:47.671987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:47.672759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:47.681554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:47.682854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:47.683776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:47.684778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:47.685340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:47.686032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:47.796975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:47.816428 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac6c061b-74b7-459e-9ff1-f01a8b36edde tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1188 microversion: 2.1 time: 0.148032 Oct 06 13:31:47.817935 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3144/6276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:47 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:31:48.843956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:48.844663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:48.851693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:48.852186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:48.852628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:48.853380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:48.853859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:48.854290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:48.921111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:48.930077 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-489c3b45-8516-4a82-b488-19d23ba9ebee tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1188 microversion: 2.1 time: 0.091315 Oct 06 13:31:48.930744 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3133/6277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:48 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:49.954935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:49.957229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:49.968529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:49.969380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:49.970768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:49.971368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:49.972041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:49.972683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:50.059830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:50.068053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-550ba187-e7f3-4d5a-a0f4-c6f8365b9577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1188 microversion: 2.1 time: 0.118237 Oct 06 13:31:50.068640 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3145/6278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:49 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1188 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:51.096704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:51.096704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:51.112148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:51.113331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:51.114528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:51.116521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:51.117785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:51.118420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:51.166657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:51.167612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:51.168249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:51.168871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lazy-loading 'fault' on Instance uuid f624dd0d-596c-49a1-b1aa-75e2d1a163ac {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:31:51.235647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:31:51.246643 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7bd94820-923a-4de4-879b-6ed80fcbcd9c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 200 len: 1193 microversion: 2.1 time: 0.154017 Oct 06 13:31:51.258558 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3134/6279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:51 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 1193 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:31:52.280415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:52.281050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:52.289031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:52.289533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:52.290015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:52.290734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:52.291196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:52.291634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:52.308053 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac HTTP/1.1 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f624dd0d-596c-49a1-b1aa-75e2d1a163ac'} Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:52.309753 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:52.314641 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:52.316847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:31:52.317750 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5fa16b2f-1cf6-426c-a5bd-469b7755a008 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 404 len: 111 microversion: 2.1 time: 0.047390 Oct 06 13:31:52.318338 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3146/6280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:52 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:31:53.434697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:53.435214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:53.438280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:31:53.443955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:53.444721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:53.445787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:53.446524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:53.446997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:53.447434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:53.464651 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac HTTP/1.1 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'f624dd0d-596c-49a1-b1aa-75e2d1a163ac'} Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:31:53.466713 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d9f3caa-82ff-409e-a119-6cc3e0d59371 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 404 len: 111 microversion: 2.1 time: 0.037381 Oct 06 13:31:53.484355 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3135/6281] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:31:53 2022] DELETE /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: f624dd0d-596c-49a1-b1aa-75e2d1a163ac] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:31:53.490195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:31:53.506354 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac HTTP/1.1 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'f624dd0d-596c-49a1-b1aa-75e2d1a163ac'} Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:31:53.508530 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance f624dd0d-596c-49a1-b1aa-75e2d1a163ac could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-182b4292-e43c-4ab4-b740-9f120de6c412 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac" status: 404 len: 111 microversion: 2.1 time: 0.036637 Oct 06 13:31:53.512629 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3147/6282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:31:53 2022] GET /compute/v2.1/servers/f624dd0d-596c-49a1-b1aa-75e2d1a163ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:32:15.655346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1589590985", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c693e770-98e7-4dd9-bfe1-b2c2fc2912cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:15.666053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=22 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:15.718177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:32:16.134108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:32:16.134672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:32:16.135270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:32:16.135616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:32:16.136035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:32:16.145786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:16.146318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:16.146767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:16.148047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:16.148519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:16.148987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:16.167598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:32:16.173214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:32:16.235204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:32:16.237910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c693e770-98e7-4dd9-bfe1-b2c2fc2912cb',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:32:16.393869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5633144a-3615-46e1-98f2-1496dabe10f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742087 Oct 06 13:32:16.395574 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3136/6283] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:32:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:32:16.407550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c85e2d0c-b812-47b6-9321-3239a80d2264 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:16.408191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c85e2d0c-b812-47b6-9321-3239a80d2264 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:16.422698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:16.423988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=34 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:16.491342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c85e2d0c-b812-47b6-9321-3239a80d2264 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:16.499946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c85e2d0c-b812-47b6-9321-3239a80d2264 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1071 microversion: 2.1 time: 0.097164 Oct 06 13:32:16.500645 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3148/6284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:16 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1071 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:17.525200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:17.526835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:17.541994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:17.542537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:17.542992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:17.543720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:17.544197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:17.544636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:17.697982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:17.706988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b4d7ed4e-9ff1-4172-8db8-ab29cde97bbb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1177 microversion: 2.1 time: 0.187651 Oct 06 13:32:17.707699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3137/6285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:17 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1177 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:18.731341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:18.732136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:18.753038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:18.753700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:18.754351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:18.755183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:18.755844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:18.756402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:19.028227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:19.036246 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a708a06e-6f24-4126-bbcf-8fcd4cf212db tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1229 microversion: 2.1 time: 0.308780 Oct 06 13:32:19.037082 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3149/6286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:18 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1229 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:32:19.332591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b", "tag": "bb76288a-9e5d-4e9b-97aa-af0ae8f9b504"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:19.348074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:19.348893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:19.349521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:19.364994 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] Creating event network-changed:bb76288a-9e5d-4e9b-97aa-af0ae8f9b504 for instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b on n-h1-860556-1 Oct 06 13:32:19.371846 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e871ea52-fd82-4d24-b36c-cd8e17f51b72 req-d469e26d-d2c0-4fb7-8513-5900868ebb41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044457 Oct 06 13:32:19.372689 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3138/6287] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:32:20.061037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:20.062578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:20.069629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:20.070346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:20.070981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:20.071859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:20.072484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:20.073081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:20.331676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:20.342493 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc58e98d-75cc-471d-9a53-8aa59914edb4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1229 microversion: 2.1 time: 0.285415 Oct 06 13:32:20.343849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3150/6288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:20 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1229 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:21.368785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:21.369333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:21.375790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:21.376288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:21.376894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:21.377634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:21.378125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:21.378563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:21.517508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:21.526284 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27ba2940-1fe1-46fa-931d-2b52da45ab90 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1229 microversion: 2.1 time: 0.163489 Oct 06 13:32:21.529872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3139/6289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:21 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:22.549025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:22.550023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:22.557977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:22.558782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:22.559143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:22.559959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:22.560549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:22.561088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:23.031046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:23.038767 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba8c13f2-29da-4374-b093-0269d277b19e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1229 microversion: 2.1 time: 0.493848 Oct 06 13:32:23.040409 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3151/6290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:22 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1229 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:24.061968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:24.062741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:24.070042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:24.070625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:24.071529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:24.072249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:24.072716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:24.073154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:24.204886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:24.213539 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e2e128a-df27-4e8b-8a2d-b312d8d2d0a3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.155864 Oct 06 13:32:24.214257 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3140/6291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:24 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:25.237192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:25.237863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:25.244491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:25.244974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:25.245410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:25.246124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:25.246579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:25.247036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:25.377610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:25.386492 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2132a04f-f885-4f18-be2f-428407e16707 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.153089 Oct 06 13:32:25.387087 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3152/6292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:25 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:26.409684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:26.410348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:26.413950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:26.414678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:26.423281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:26.423794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:26.424273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:26.425330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:26.425832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:26.426273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:26.566143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:26.574344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d0a182d-c6a2-43bf-bfe9-39030ba5651f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.168629 Oct 06 13:32:26.574937 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3141/6293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:26 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:27.597658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:27.598462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:27.601951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:27.607568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:27.608131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:27.608606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:27.609336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:27.609814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:27.610242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:27.743877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:27.751796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ac89c157-95d7-41a6-8787-220230f3fe41 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.158034 Oct 06 13:32:27.752459 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3153/6294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:27 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:28.780742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:28.781303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:28.788287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:28.788785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:28.789234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:28.789986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:28.790460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:28.790900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:28.929356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:28.937349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57c3095a-1e7b-483c-aca3-0d07bfa96485 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.160618 Oct 06 13:32:28.938079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3142/6295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:28 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:29.960825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:29.961355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:29.968719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:29.969262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:29.969701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:29.970409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:29.970862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:29.971292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:30.102731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:30.110753 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d0eb928e-949d-4e41-bb8f-cd6d07e139de tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.154357 Oct 06 13:32:30.111343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3154/6296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:29 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:31.135173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:31.136439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:31.147728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:31.148326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:31.157321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:31.159003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:31.159566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:31.160083 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:31.302521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:31.312215 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e94b4243-bb13-4a92-84f1-f52fe74f31d6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.182693 Oct 06 13:32:31.312817 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3143/6297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:31 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:32.337100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:32.338063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:32.345251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:32.346270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:32.346709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:32.347413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:32.347895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:32.348546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:32.487194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:32.495530 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b8850ad-f06c-4be5-93be-8ffc6bd076ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.162487 Oct 06 13:32:32.495848 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3155/6298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:32 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:32.715219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b", "name": "network-vif-plugged", "status": "completed", "tag": "bb76288a-9e5d-4e9b-97aa-af0ae8f9b504"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:32.728166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:32.728728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:32.729243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:32.740951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] Creating event network-vif-plugged:bb76288a-9e5d-4e9b-97aa-af0ae8f9b504 for instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b on n-h1-860556-1 Oct 06 13:32:32.746293 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-610b8529-c99a-4fd1-9205-e3b591895030 req-26f8397f-03bc-4170-9103-c3f35905778f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034808 Oct 06 13:32:32.747309 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3144/6299] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:32:33.517933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:33.518561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:33.526317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:33.526806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:33.527261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:33.527958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:33.528454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:33.528856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:33.684370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:33.692470 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4fc5468-db0c-4127-877a-0a21da5dec2a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1217 microversion: 2.1 time: 0.178483 Oct 06 13:32:33.693052 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3156/6300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:33 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:34.722679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:34.723402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:34.729615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:34.730155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:34.730604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:34.731308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:34.731771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:34.732206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:34.865002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:34.873343 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ca6c1e5-8fed-4e44-a49b-fec2de49946a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1404 microversion: 2.1 time: 0.155955 Oct 06 13:32:34.873950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3145/6301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:34 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:34.895907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:34.896580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:34.898914 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:32:34.899068 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b (ip 10.222.0.26) !!! Oct 06 13:32:34.910906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:34.911396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:34.911837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:34.912535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:34.912992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:34.913424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:35.064193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:35.072757 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a293cd02-522b-4ed5-9158-8e8d714d2405 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1404 microversion: 2.1 time: 0.180686 Oct 06 13:32:35.073364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3157/6302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:34 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:35.102180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1806771628"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:35.104522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:35.110703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:35.111198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:35.111650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:35.112357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:35.112823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:35.113262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:35.213525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Attempting to quiesce instance before volume snapshot. Oct 06 13:32:35.280497 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 06 13:32:35.352680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Creating snapshot from volume c693e770-98e7-4dd9-bfe1-b2c2fc2912cb. {{(pid=129614) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 06 13:32:36.145526 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5bb9379f-265c-4d02-9f2d-70aa73da68ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b/action" status: 202 len: 0 microversion: 2.1 time: 1.047801 Oct 06 13:32:36.146311 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3146/6303] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:32:35 2022] POST /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b/action => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 13:32:37.311358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1616602997", "imageRef": "73d6d6a8-1ef7-486a-9e6d-4420b9aba5b6", "flavorRef": "452", "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:37.368735 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:32:37.756693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:32:37.757126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:32:37.757604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:32:37.758044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:32:37.758464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:32:37.767629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:37.768123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:37.768568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:37.769304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:37.769807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:37.770215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:37.788470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:32:37.793974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:32:37.807669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:32:37.810298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1de8172c-bfd2-42af-bd6a-70f4d4eaaa97',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:32:37.890883 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6230317-97f4-4564-9fb1-016f103b4983 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583416 Oct 06 13:32:37.891735 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3158/6304] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:32:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:32:37.905302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-850c967d-4ec5-4897-b964-34727e79148f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:37.924147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-850c967d-4ec5-4897-b964-34727e79148f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:37.980285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-850c967d-4ec5-4897-b964-34727e79148f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:37.988155 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-850c967d-4ec5-4897-b964-34727e79148f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1230 microversion: 2.1 time: 0.088517 Oct 06 13:32:37.989835 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3147/6305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:37 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:39.016321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:39.017025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:39.023229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:39.023707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:39.024160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:39.024868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:39.025342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:39.025791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:39.147166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:39.171447 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4c14c66-9cc5-4758-8ff8-a04d188cab2e tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1290 microversion: 2.1 time: 0.161184 Oct 06 13:32:39.174102 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3159/6306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:39 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:40.202050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:40.203702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:40.211849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:40.212588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:40.213551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:40.214607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:40.215250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:40.215861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:40.440338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:40.455130 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57505228-8be1-4630-9f80-e4e7ac82aad0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.258785 Oct 06 13:32:40.455919 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3148/6307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:40 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:32:40.812192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5321d4dd-3229-4358-a066-926721c6e68e", "tag": "4a3a376b-6f61-4104-b1a9-0c6314f07330"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:40.823692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:40.824475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:40.825129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:40.860075 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] Creating event network-changed:4a3a376b-6f61-4104-b1a9-0c6314f07330 for instance 5321d4dd-3229-4358-a066-926721c6e68e on n-h2-860556-1 Oct 06 13:32:40.867405 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fe180d68-d743-4a76-a4a7-dfb07331afa0 req-5db13b69-616d-4aee-b327-ff49846c2a91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059667 Oct 06 13:32:40.868685 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3160/6308] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:32:41.480503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:41.481545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:41.490127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:41.494795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:41.499024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:41.500136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:41.500808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:41.501719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:41.870289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:41.879988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be7ccf7f-1397-4c38-b3fe-31603ec36145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.403338 Oct 06 13:32:41.881872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3149/6309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:41 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:42.906966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:42.907513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:42.919463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:42.920231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:42.920870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:42.921871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:42.922562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:42.923254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:43.136645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:43.151054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cbecc9cd-451a-41d1-97d5-7b501ad8990b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.250756 Oct 06 13:32:43.152195 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3161/6310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:42 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:44.184548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:44.185722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:44.200908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:44.201441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:44.202091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:44.202824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:44.203299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:44.203774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:44.410598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:44.424986 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a77e46e-1ffc-4fc7-aedd-f680cf3a05a6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.245770 Oct 06 13:32:44.425718 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3150/6311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:44 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:45.462020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:45.463773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:45.471915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:45.472664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:45.473906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:45.475705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:45.475705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:45.478480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:45.628540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:45.637473 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6a5deff-9d87-46b5-b101-b081a21a2973 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.180350 Oct 06 13:32:45.654251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3162/6312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:45 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:46.661729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:46.662951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:46.669888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:46.671936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:46.672914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:46.672914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:46.675919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:46.675919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:46.675919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:46.678848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:46.846721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:46.857149 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a6f880f-d25a-474a-b032-aaeecc269b28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.199219 Oct 06 13:32:46.864244 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3151/6313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:46 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:47.880366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:47.884181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:47.893474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:47.895294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:47.896510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:47.899473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:47.900646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:47.901788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:47.903095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:47.903823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:47.905020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:47.918635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=77 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:48.076092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:48.084798 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e4fdf23-6d1c-49fe-b2cc-4c85481edae6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.207649 Oct 06 13:32:48.085957 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3163/6314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:47 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:49.108889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:49.109572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:49.113012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:32:49.119344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:49.135656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:49.136424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:49.137580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:49.138341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:49.138974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:49.289264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:49.298123 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-082178bb-6e5a-472d-9eed-3cdab7a892b8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.193229 Oct 06 13:32:49.298703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3152/6315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:49 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:50.322131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:50.323108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:50.329949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:50.330565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:50.331099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:50.331889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:50.332530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:50.333096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:50.456746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:50.460775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:50.476762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:50.477266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:50.478089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:50.478569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:50.479062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:50.479584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:50.480033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:50.487150 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c02fc4cd-e84b-467a-b22e-5af1b275ab6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.168746 Oct 06 13:32:50.497772 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3164/6316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:50 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:50.526412 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eff83f56-7c87-4089-8b99-beacd8c2d693 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/ips" status: 200 len: 149 microversion: 2.1 time: 0.073480 Oct 06 13:32:50.527527 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3153/6317] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Oct 6 13:32:50 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/ips => generated 149 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:32:51.514425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:51.515050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:51.526031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:51.526768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:51.527382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:51.528267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:51.528927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:51.529336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:51.730918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:51.740567 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c01900da-f47b-40ae-a321-505f6d5d7cd2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.229935 Oct 06 13:32:51.741731 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3165/6318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:51 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:51.952095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb049c11-770d-4b62-96b7-651d28de58e4"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:32:51.954626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:51.962402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:51.963033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:51.963500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:51.964342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:51.964821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:51.965318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:52.275831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-124d4829-429d-4619-8d72-3ec2b71bce79 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "POST /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327498 Oct 06 13:32:52.276581 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3154/6319] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:32:51 2022] POST /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:32:52.769072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:52.770752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:52.780362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:52.781298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:52.782144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:52.783062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:52.783688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:52.784281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:52.978800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:52.987621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d730b95a-900e-4a37-bb3e-8c642e6fb445 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1342 microversion: 2.1 time: 0.223290 Oct 06 13:32:52.997900 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3166/6320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:52 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:54.012865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:54.016173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:54.024557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:54.025237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:54.026496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:54.027373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:54.027959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:54.028501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:54.657326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:54.668044 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d081b63-99e0-4b09-9b39-37f7988ea674 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1388 microversion: 2.1 time: 0.660352 Oct 06 13:32:54.668645 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3155/6321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:54 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1388 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:55.692816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:55.693443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:55.701913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:55.702759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:55.703383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:55.704325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:55.704790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:55.705246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:55.857302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:55.869436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9031ccf-c0dc-4ecb-8d81-75be645854e7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.180974 Oct 06 13:32:55.870583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3167/6322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:55 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:56.893918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:56.895358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:56.904416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:56.905103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:56.905850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:56.906840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:56.907485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:56.908100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:57.088184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:57.097914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2030bf31-4775-49d6-baec-353b76a8f2ca tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.207855 Oct 06 13:32:57.098646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3156/6323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:56 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:58.122755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:58.123376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:58.131613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:58.132104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:58.132551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:58.133257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:58.133721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:58.134178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:58.264778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:58.272848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-434d9715-a4e4-4285-b649-e4bd23400d81 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.154022 Oct 06 13:32:58.273436 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3168/6324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:58 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:32:59.296532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:32:59.297269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:32:59.305665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:59.306255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:59.306717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:59.307436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:32:59.307907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:32:59.308349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:32:59.466636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:32:59.476113 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-596fc84d-2b72-45fb-8ade-3b2011be96ea tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.183798 Oct 06 13:32:59.476710 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3157/6325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:32:59 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:00.501824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:00.502453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:00.511131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:00.511683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:00.512129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:00.513093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:00.513618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:00.514121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:00.663320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:00.672697 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f78893dd-0379-4c94-8e65-84382e082a5c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.175861 Oct 06 13:33:00.673299 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3169/6326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:00 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:01.697522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:01.698633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:01.706784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:01.707291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:01.707746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:01.708466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:01.709450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:01.709926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:01.871808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:01.882426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c50c3420-32b0-46d2-a13c-deb30f625eed tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.189551 Oct 06 13:33:01.883301 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3158/6327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:01 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:02.906878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:02.907423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:02.915366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:02.915876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:02.916321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:02.917048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:02.917506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:02.917967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:03.061010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:03.069882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81092fcc-fbc7-4566-bbe6-d7d9706f3901 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.167060 Oct 06 13:33:03.070727 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3170/6328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:02 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:04.095604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:04.096300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:04.103525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:04.104141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:04.104683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:04.105447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:04.106022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:04.106552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:04.244151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:04.252471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-94d58500-d28c-4aae-85c1-d6a26bebddd8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.160923 Oct 06 13:33:04.253051 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3159/6329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:04 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:05.278525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:05.279701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:05.295645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.296499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.297146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.298089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.298727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.300360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.319163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5321d4dd-3229-4358-a066-926721c6e68e", "name": "network-vif-plugged", "status": "completed", "tag": "4a3a376b-6f61-4104-b1a9-0c6314f07330"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:05.342872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.343479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.344009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.372927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] Creating event network-vif-plugged:4a3a376b-6f61-4104-b1a9-0c6314f07330 for instance 5321d4dd-3229-4358-a066-926721c6e68e on n-h2-860556-1 Oct 06 13:33:05.378699 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cf12dc03-0178-4cff-aefc-2fa16ca6247c req-65d3109d-1b99-4d68-ac4a-9ad3c13b4897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064342 Oct 06 13:33:05.379845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3160/6330] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:33:05.402084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:05.403255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:05.418706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.419493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.420126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.421070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.421990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.422244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.487848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:05.498642 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a93bfce9-c6c5-4e37-8ebf-63a85b778e66 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.224135 Oct 06 13:33:05.499316 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3171/6331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:05 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:05.579013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lazy-loading 'services' on Instance uuid c4ad2b75-d594-43ab-b75c-46d7b384167c {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:33:05.663627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87b889c6-a9f6-466a-bc4c-b524caee4992 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments/bb049c11-770d-4b62-96b7-651d28de58e4" status: 202 len: 0 microversion: 2.1 time: 0.268536 Oct 06 13:33:05.665818 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3161/6332] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:33:05 2022] DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments/bb049c11-770d-4b62-96b7-651d28de58e4 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 13:33:05.673501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:05.676130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:05.683014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.683769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.684246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.685194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:05.685861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:05.686832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:05.722950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8c9294c0-7f18-4a21-a1e3-04ac2fbd7e07 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053530 Oct 06 13:33:05.724215 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3172/6333] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:05 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:06.529565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:06.530835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:06.538453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:06.538984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:06.539450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:06.543081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:06.544239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:06.545146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:06.717203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:06.726771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-75cc16d0-85b0-4fa7-b12c-55470947aa28 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1376 microversion: 2.1 time: 0.202967 Oct 06 13:33:06.727460 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3162/6334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:06 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1376 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:06.736463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:06.739079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:06.747157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:06.747780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:06.748287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:06.749182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:06.749727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:06.750380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:06.786433 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-75de2723-52d2-489d-a352-2534420b11b4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054229 Oct 06 13:33:06.787507 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3173/6335] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:06 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:07.750632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:07.751368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:07.759630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.760143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.760605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:07.761399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.761986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.762472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:07.800326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:07.803405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:07.813452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.814071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.814504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:07.815217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.815682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.816139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:07.854271 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b453ffe-1e70-4e8e-b34c-7d12c6778bb4 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058116 Oct 06 13:33:07.855333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3174/6336] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:07 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:07.933378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:07.942506 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0722911b-9eb5-4ba7-a470-bf7f37d18d04 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1563 microversion: 2.1 time: 0.195794 Oct 06 13:33:07.944285 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3163/6337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:07 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:07.966254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:07.967122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:07.973126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.973617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.974095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:07.975043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:07.975512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:07.975946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.127663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:08.137815 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ba6e2352-9c70-4d29-a8ea-f44c098beca4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1563 microversion: 2.1 time: 0.175278 Oct 06 13:33:08.138533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3175/6338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:07 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:08.233528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:08.234176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:08.240743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.241251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.241769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.242474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.242947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.243390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.272268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:33:08.353863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aef19cd2-3a98-47d9-9792-f69d8c0bf768 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 204 len: 0 microversion: 2.1 time: 0.123898 Oct 06 13:33:08.354526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3164/6339] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:08 2022] DELETE /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:33:08.362974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:08.363603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:08.371046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.371494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.372007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.372730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.373192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.373618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.526957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:08.535923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cd7143a7-a3e9-445e-9730-a63f630e9ff3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1569 microversion: 2.1 time: 0.176816 Oct 06 13:33:08.536575 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3176/6340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:08 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:08.871596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:08.874014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:08.884654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.885227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.885986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.887089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:08.887089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:08.887422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:08.890489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:08.926547 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff0fa19b-efc1-49e5-a535-faab6684eea6 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060379 Oct 06 13:33:08.927259 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3165/6341] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:08 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:09.562407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:09.562950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:09.569979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:09.570514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:09.570948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:09.571722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:09.572212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:09.572677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:09.727120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:09.739477 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8b87f338-0e9b-4ce6-9286-1de6f219869f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1569 microversion: 2.1 time: 0.182203 Oct 06 13:33:09.740209 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3177/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:09 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:09.941292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:09.943793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:09.951065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:09.951691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:09.952155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:09.952909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:09.953454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:09.953926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:09.985639 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5bb8541-e364-4d2d-a27e-dd28d4dd0752 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Oct 06 13:33:09.986249 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3166/6343] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:09 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:10.687872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5321d4dd-3229-4358-a066-926721c6e68e", "name": "network-vif-deleted", "tag": "4a3a376b-6f61-4104-b1a9-0c6314f07330"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:10.700852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:10.702391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:10.703247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:10.734867 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] Creating event network-vif-deleted:4a3a376b-6f61-4104-b1a9-0c6314f07330 for instance 5321d4dd-3229-4358-a066-926721c6e68e on n-h2-860556-1 Oct 06 13:33:10.741975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-57f938b8-2138-42ee-9aa7-14fd4087635a req-a762b9da-f4a5-45b2-b009-93822d2ab7e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057823 Oct 06 13:33:10.743186 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3178/6344] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:10.778357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:10.784351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:10.806033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:10.806594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:10.807076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:10.807819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:10.808345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:10.808729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:10.898188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:10.909831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5504ecdc-03f3-4f62-8cb7-3dc695781012 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.148367 Oct 06 13:33:10.910436 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3167/6345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:10 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:10.999294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:11.001964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:11.010342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:11.011050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:11.011593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:11.012613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:11.013263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:11.014081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:11.048820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b2eb0b87-7702-44bd-a973-79cacf9533e5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054099 Oct 06 13:33:11.049332 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3179/6346] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:10 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:11.936765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:11.937609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:11.946646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:11.947263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:11.947883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:11.948699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:11.949190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:11.949640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:12.024286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:12.032915 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-710751f6-c44b-44e3-ba9b-ebdd0e82b1e9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.101957 Oct 06 13:33:12.033861 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3168/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:11 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:12.061412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:12.063876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:12.070769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:12.071447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:12.072028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:12.072749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:12.073256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:12.073691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:12.088777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:12.109245 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce1341a0-f0c0-42eb-aee3-be9a0ef7b68a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052295 Oct 06 13:33:12.110694 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3180/6348] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:12 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:13.057215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:13.057928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:13.065167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.065608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.066110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.066837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.067348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.068366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.123755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:13.127216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:13.138114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:13.138306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.138707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.139178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.140010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.140653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.141085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.150097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7910df1-8b96-460e-917c-956c69d0128a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.096663 Oct 06 13:33:13.151061 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3169/6349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:13 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:13.174142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c06926f-40b2-4a3f-bf01-9901b113def5 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055533 Oct 06 13:33:13.174975 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3181/6350] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:33:13 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:33:13.241150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:13.241806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:13.248372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.248886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.249347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.250106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.250588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.251035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.277215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:33:13.362241 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7cf52276-fceb-4d3d-871c-c8da01016f46 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 204 len: 0 microversion: 2.1 time: 0.125209 Oct 06 13:33:13.362964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3170/6351] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:13 2022] DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:33:13.371678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:13.372293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:13.378234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.378717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.379155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.379838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:13.380436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:13.380876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:13.513200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:13.521130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23732bec-dd6e-4bb3-92ed-a3539c8ba3a8 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1680 microversion: 2.1 time: 0.153239 Oct 06 13:33:13.521710 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3182/6352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:13 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:14.173198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:14.174032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:14.181624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:14.182163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:14.182629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:14.183364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:14.183875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:14.184321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:14.256895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:14.264936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a86bb39-d56d-402e-8c6d-9ec66b941580 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.096070 Oct 06 13:33:14.265507 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3171/6353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:14 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:14.545190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:14.545705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:14.554050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:14.554651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:14.555617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:14.557877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:14.558537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:14.559173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:14.717771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:14.728547 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-945d4bd2-154b-4519-b3a1-1a4fa0807a0f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1680 microversion: 2.1 time: 0.185963 Oct 06 13:33:14.728547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3183/6354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:14 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:15.289272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:15.290190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:15.297940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:15.298781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:15.299246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:15.300247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:15.300723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:15.301349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:15.403366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:15.412592 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e15781bf-6cd2-4109-b5f4-17aa1ef452ae tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.127245 Oct 06 13:33:15.413556 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3172/6355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:15 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:15.751247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:15.752508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:15.760542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:15.761936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:15.761936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:15.762852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:15.763479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:15.764070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:15.863044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da662da4ff45da85849462545ff6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00ed9555194b40a3f29c9a5f512ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:15.872257 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79b5271b-afa1-4d0b-acd9-79bb23f47405 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 200 len: 1612 microversion: 2.1 time: 0.124996 Oct 06 13:33:15.873532 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3184/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:15 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 1612 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:16.057761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ad2b75-d594-43ab-b75c-46d7b384167c", "name": "network-vif-deleted", "tag": "e0e0d111-5a2e-4b96-b357-b5e9e45a5de6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:16.088035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:16.088563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:16.089026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:16.109880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] Creating event network-vif-deleted:e0e0d111-5a2e-4b96-b357-b5e9e45a5de6 for instance c4ad2b75-d594-43ab-b75c-46d7b384167c on n-h2-860556-1 Oct 06 13:33:16.117906 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-89fc540e-171a-4109-8be3-291a9fbd39c3 req-0e8aab4e-d740-4dcf-95a1-8380479548d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065291 Oct 06 13:33:16.119132 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3173/6357] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:16.437713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:16.438600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:16.524213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:16.617790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:16.640581 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f381a2cf-1e3b-4076-b7dd-c62e511a43ff tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.208398 Oct 06 13:33:16.642724 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3185/6358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:16 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:16.898471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:16.900852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:16.912481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:16.914273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:16.914793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:16.915367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:16.916393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:16.916931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:16.917450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:16.934948 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c HTTP/1.1 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c4ad2b75-d594-43ab-b75c-46d7b384167c'} Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:16.936999 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6becc628-ed7f-4128-ab17-7311a63f90f1 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 404 len: 111 microversion: 2.1 time: 0.045882 Oct 06 13:33:16.941546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3174/6359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:16 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:16.949352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-edc37199-2fd4-4c09-ab91-25b6082d96fb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '.version_select at 0x7f7d3e038550>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:16.978156 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-edc37199-2fd4-4c09-ab91-25b6082d96fb tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598491748" status: 202 len: 0 microversion: 2.1 time: 0.034135 Oct 06 13:33:16.979356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3186/6360] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Oct 6 13:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598491748 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:33:17.672064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:17.672757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:17.690231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:17.690769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:17.692383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:17.696154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:17.697507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:17.698082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:17.870642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:17.892863 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96e27b76-9953-4d84-98d2-322c207c1298 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.226389 Oct 06 13:33:17.897913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3175/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:17 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:18.920919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:18.921806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:18.926234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:18.931922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:18.932527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:18.933034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:18.934082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:18.934622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:18.935132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:19.012958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:19.022292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9bba777f-8d1f-4541-8e35-71c04e116dd6 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1361 microversion: 2.1 time: 0.105472 Oct 06 13:33:19.023172 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3187/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:18 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1361 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:20.047213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:20.047803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:20.058127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:20.058952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:20.059534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:20.060482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:20.061508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:20.062380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:20.134196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:20.134918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:20.135744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:20.136405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lazy-loading 'fault' on Instance uuid 5321d4dd-3229-4358-a066-926721c6e68e {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:33:20.254654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:20.288815 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f115e328-c965-4929-a34d-b70b7c6561c8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 200 len: 1366 microversion: 2.1 time: 0.245524 Oct 06 13:33:20.290060 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3176/6363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:20 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:21.316264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:21.317127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:21.325710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:21.326326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:21.326952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:21.327756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:21.328295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:21.329242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:21.353655 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e HTTP/1.1 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '5321d4dd-3229-4358-a066-926721c6e68e'} Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:21.357181 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:21.367399 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:21.369577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:21.370639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5017d76-7c73-41c8-a6b9-d175a8811cc4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 404 len: 111 microversion: 2.1 time: 0.059468 Oct 06 13:33:21.371236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3188/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:21 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:23.439896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:23.440397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:23.448294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:23.448891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:23.449462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:23.450461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:23.451016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:23.451648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:23.475765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c HTTP/1.1 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c4ad2b75-d594-43ab-b75c-46d7b384167c'} Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:23.477669 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.482903 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.484879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:23.486220 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08493a8b-8c1b-49dd-a7f4-538b6339030a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 404 len: 111 microversion: 2.1 time: 0.052809 Oct 06 13:33:23.487030 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3177/6365] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:23 2022] DELETE /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:23.495316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:23.496695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c4ad2b75-d594-43ab-b75c-46d7b384167c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:23.504314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:23.505511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:23.506463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:23.507450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:23.508095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:23.508991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:23.528346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c HTTP/1.1 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c4ad2b75-d594-43ab-b75c-46d7b384167c'} Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:23.530060 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. Oct 06 13:33:23.536209 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:23.538084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c4ad2b75-d594-43ab-b75c-46d7b384167c could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:23.539131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d376cccf-9a72-4d51-8bba-7eeb320f5e8b tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c" status: 404 len: 111 microversion: 2.1 time: 0.047746 Oct 06 13:33:23.539927 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3189/6366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:23 2022] GET /compute/v2.1/servers/c4ad2b75-d594-43ab-b75c-46d7b384167c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:26.888675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:26.889428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:26.898194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:26.898775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:26.899366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:26.900187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:26.900727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:26.901685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:26.935609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:33:26.984630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:26.985883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:26.995436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:26.996352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:26.997237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:26.999371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.000053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.000662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.030453 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.031431 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00898c1e-9e1b-476c-bd1c-67ee4fa7331f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 204 len: 0 microversion: 2.1 time: 0.146257 Oct 06 13:33:27.032438 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3178/6367] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:26 2022] DELETE /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa HTTP/1.1 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1aa534fd-854d-45ce-a09d-167c40c643fa'} Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:27.035655 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.042863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.048699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:27.050067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2cbfb8b2-b0b4-4594-9155-4901aa49194c tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 404 len: 111 microversion: 2.1 time: 0.069838 Oct 06 13:33:27.053617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:27.054822 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3190/6368] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:26 2022] DELETE /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:27.055403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:27.062556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:27.063547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: 1aa534fd-854d-45ce-a09d-167c40c643fa] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:27.069128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.069669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.070699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.071486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.071973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.072431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.072891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.085396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.085396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.085396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.086177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.086449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.107731 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa HTTP/1.1 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '1aa534fd-854d-45ce-a09d-167c40c643fa'} Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.110093 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance 1aa534fd-854d-45ce-a09d-167c40c643fa could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-288c53db-2940-444d-8b41-8396e57720fc tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa" status: 404 len: 111 microversion: 2.1 time: 0.052704 Oct 06 13:33:27.116464 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3191/6369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:27 2022] GET /compute/v2.1/servers/1aa534fd-854d-45ce-a09d-167c40c643fa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:33:27.120659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:27.121189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:27.127634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.128130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.128577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.129284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.130515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.130906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.147939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 HTTP/1.1 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'db1a355c-0c8a-4b88-be20-77d3f1043cb0'} Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:27.149827 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.155058 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.161134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:27.161134 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6a30553-6613-472e-ab27-efaa546da0f7 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 404 len: 111 microversion: 2.1 time: 0.040671 Oct 06 13:33:27.161528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3192/6370] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:27 2022] DELETE /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:33:27.166855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:27.167691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: db1a355c-0c8a-4b88-be20-77d3f1043cb0] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:27.174016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.174710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.175565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.176441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:27.177580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:27.178284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:27.196250 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 HTTP/1.1 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'db1a355c-0c8a-4b88-be20-77d3f1043cb0'} Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:27.197863 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance db1a355c-0c8a-4b88-be20-77d3f1043cb0 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e98a9a89-ca02-4476-94c1-c81a0f24ab3a tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0" status: 404 len: 111 microversion: 2.1 time: 0.036573 Oct 06 13:33:27.202368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3193/6371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:27 2022] GET /compute/v2.1/servers/db1a355c-0c8a-4b88-be20-77d3f1043cb0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:27.279287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:27.291562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-431bd80f-5ad3-46d7-ab78-3a614942c795 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1410 microversion: 2.1 time: 0.245602 Oct 06 13:33:27.306722 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3179/6372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:27 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1410 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:28.317453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:28.318720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:28.325983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:28.326696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:28.327354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:28.328218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:28.328858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:28.330380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:28.510584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:28.520454 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33de99e1-ae76-4c11-ad95-4fc1d32916ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1410 microversion: 2.1 time: 0.206200 Oct 06 13:33:28.529379 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3194/6373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:28 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1410 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:29.350555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b", "name": "network-vif-deleted", "tag": "bb76288a-9e5d-4e9b-97aa-af0ae8f9b504"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:29.366266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:29.367384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:29.367843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:29.372586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:29.398714 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] Creating event network-vif-deleted:bb76288a-9e5d-4e9b-97aa-af0ae8f9b504 for instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b on n-h1-860556-1 Oct 06 13:33:29.405303 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1582fc90-3e66-4cc7-9e58-f49d881e5718 req-65be342b-8ba3-4c09-92c1-d762f70afe23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063723 Oct 06 13:33:29.405788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3180/6374] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:29.548445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:29.550412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:29.572127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:29.572624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:29.573064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:29.574259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:29.574259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:29.574659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:29.668421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:29.677623 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e6b4890b-a54a-4d17-8848-548e683f9860 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1202 microversion: 2.1 time: 0.133182 Oct 06 13:33:29.678481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3195/6375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:29 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1202 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:30.559006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:30.559700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:30.569241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.569776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.570241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:30.571097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.571841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.572302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:30.590346 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 HTTP/1.1 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'c639a264-ec49-47bc-b361-aac73212ab10'} Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:30.592634 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.598221 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.600676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:30.601815 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3313d3c3-7998-4dd4-ae38-38a37f786e37 tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 404 len: 111 microversion: 2.1 time: 0.049090 Oct 06 13:33:30.624117 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3181/6376] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:30 2022] DELETE /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:30.638407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:30.640939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] [instance: c639a264-ec49-47bc-b361-aac73212ab10] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:30.658349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.658580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.659217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:30.660364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.661727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.663078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:30.688179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] HTTP exception thrown: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Request method failure captured: Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 HTTP/1.1 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtduifx0JFmO4_k53RDv5cP1htHPMTXT1RaS_rO6nMqJPJmA8iLDdwK2TWXCMgJ6I_hLa5yMtaXQSIDmjrUJk79-bzOfplLPLZf3gMy96jwwQ5heZKM8no37R1sflSIpSJy-eTFQfgoV6WITfQ7iCzm1jUlG-oyx4-GTydLCpJ3xRUk Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a00ed9555194b40a3f29c9a5f512ad4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a00ed9555194b40a3f29c9a5f512ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a00ed9555194b40a3f29c9a5f512ad4"}]}] Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 3a00ed9555194b40a3f29c9a5f512ad4 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1403332095 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: d2da662da4ff45da85849462545ff6c1 Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-AttachVolumeNegativeTest-1403332095-project Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c639a264-ec49-47bc-b361-aac73212ab10'} Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:30.690266 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. Oct 06 13:33:30.695418 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:30.697523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] Returning 404 to user: Instance c639a264-ec49-47bc-b361-aac73212ab10 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:30.704364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:30.705427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:30.711287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-137142fd-03df-4556-97d9-befb3d48893f tempest-AttachVolumeNegativeTest-1403332095 tempest-AttachVolumeNegativeTest-1403332095-project] 10.222.0.26 "GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10" status: 404 len: 111 microversion: 2.1 time: 0.103981 Oct 06 13:33:30.713853 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3196/6377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:30 2022] GET /compute/v2.1/servers/c639a264-ec49-47bc-b361-aac73212ab10 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:30.718883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.719402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.719859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:30.720587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:30.721056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:30.721527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:31.091468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:31.106079 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2acd00a4-80d4-4dcb-b0d2-84b33ff77a6c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1202 microversion: 2.1 time: 0.402215 Oct 06 13:33:31.106808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3182/6378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:30 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:32.133022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:32.133693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:32.146295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:32.147096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:32.147717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:32.149017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:32.149937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:32.150606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:32.255076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:32.266317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eeb7d7af-1632-445a-bcda-b38c1908a692 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1202 microversion: 2.1 time: 0.136919 Oct 06 13:33:32.267305 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3197/6379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:32 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1202 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:33.292734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:33.294075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:33.303223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:33.304072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:33.304722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:33.306302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:33.307074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:33.307742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:33.398199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:33.408728 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2420eacb-409b-4570-91dd-6173b87fae48 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1202 microversion: 2.1 time: 0.121706 Oct 06 13:33:33.425174 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3183/6380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:33 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1202 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:34.432794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:34.433424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:34.456450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:34.462656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:34.464224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:34.465590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:34.466378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:34.467304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:34.523449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:34.525066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:34.526067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:34.526699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lazy-loading 'fault' on Instance uuid 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:33:34.579263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:34.588433 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f9bd398-01fa-4757-95eb-83617ba5a77d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 200 len: 1207 microversion: 2.1 time: 0.159510 Oct 06 13:33:34.607041 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3198/6381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:34 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 1207 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:35.612261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:35.612981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:35.620576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:35.621082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:35.621542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:35.622308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:35.623134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:35.623592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:35.641630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b HTTP/1.1 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b'} Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:35.643242 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ca391286-9dbb-4693-84c1-227c8ad77d0f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 404 len: 111 microversion: 2.1 time: 0.036307 Oct 06 13:33:35.649356 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3184/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:35 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:38.878627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:38.879385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:38.890943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:38.891797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:38.892505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:38.893712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:38.896247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:38.897301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:38.918340 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e HTTP/1.1 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '5321d4dd-3229-4358-a066-926721c6e68e'} Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:38.920404 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.925941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:38.928205 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02157b59-bdcb-4567-986f-77027073136f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 404 len: 111 microversion: 2.1 time: 0.055218 Oct 06 13:33:38.929880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3199/6383] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:38 2022] DELETE /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:38.936482 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:38.937110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 5321d4dd-3229-4358-a066-926721c6e68e] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:38.946305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:38.947990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:38.948669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:38.950334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:38.950995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:38.951615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:38.970559 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e HTTP/1.1 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5321d4dd-3229-4358-a066-926721c6e68e'} Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:38.972409 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 5321d4dd-3229-4358-a066-926721c6e68e could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:38.980864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d673feb-1a74-4624-8477-032d007db944 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e" status: 404 len: 111 microversion: 2.1 time: 0.041798 Oct 06 13:33:38.990079 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3185/6384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:38 2022] GET /compute/v2.1/servers/5321d4dd-3229-4358-a066-926721c6e68e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:39.903317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:39.903938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:39.912310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:39.912813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:39.913261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:39.914017 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:39.914738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:39.915329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:39.933839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b HTTP/1.1 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b'} Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:39.935520 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.940779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:39.942187 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-50d05ce6-5629-4108-93a6-7588c3be1024 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 404 len: 111 microversion: 2.1 time: 0.041697 Oct 06 13:33:39.943038 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3200/6385] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:33:39 2022] DELETE /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:39.950880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:39.951634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:39.960985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:39.961499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:39.962007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:39.962766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:39.963379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:39.963842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:39.986039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b HTTP/1.1 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b'} Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:33:39.987752 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-89097903-f8ca-44b0-9435-bbf62097d163 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b" status: 404 len: 111 microversion: 2.1 time: 0.042324 Oct 06 13:33:39.996554 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3186/6386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:39 2022] GET /compute/v2.1/servers/4c6cbc3b-0636-48a0-a8e5-4ac18e2c2e8b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:33:40.076676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bbfc4ec9-859f-4a9e-b370-b2c7eb04d9d5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: .version_select at 0x7f7d3e076dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-530459456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAPfGftdWC/gUEL502Gs8weTdy4OR/c9AavFLDxz7vsBypx+T4TbifgokhENdORaEeWsYV2lhgkrChaQBxawFnKVQ/waxxSDtglqvjw+qYDz0DVci0crRc7uW4cq/3ptg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:40.106609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bbfc4ec9-859f-4a9e-b370-b2c7eb04d9d5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:33:40.113696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bbfc4ec9-859f-4a9e-b370-b2c7eb04d9d5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:33:40.142482 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bbfc4ec9-859f-4a9e-b370-b2c7eb04d9d5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.071757 Oct 06 13:33:40.143259 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3201/6387] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:33:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:40.181150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-969f8152-eb01-4848-b980-72b6fe56c5ea tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Action: 'create', calling method: .version_select at 0x7f7d3f1bca60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1076956574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYxpiWPXvuyMR076vP7N2WNR4YqjPKzYcM6ZeiiAb4EkTZ935zF4Ea4Eb9KSySvgJvjuNZ/Ej6ltH5Z6CNiYuAyky1wwoxjDeH4qPJaiebMAB+dfT6cudqzijPrQId67g=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:40.202354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-969f8152-eb01-4848-b980-72b6fe56c5ea tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Getting quotas for project 5118db502c2a4d5a9efcc982171eee24. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:33:40.208969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-969f8152-eb01-4848-b980-72b6fe56c5ea tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Getting quotas for user eca6eb9c3d2a49d29e1da00f11fad56a and project 5118db502c2a4d5a9efcc982171eee24. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:33:40.240807 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-969f8152-eb01-4848-b980-72b6fe56c5ea tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064437 Oct 06 13:33:40.247916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3187/6388] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:33:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:41.628732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1447294456", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "22761faf-bc65-4c21-a741-c8f0dad489b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1076956574", "security_groups": [{"name": "tempest-secgroup-smoke-443158514"}], "networks": [{"uuid": "4ac4cfb7-ccdd-4084-95bb-24edb9ba050a"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:41.760784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] validate_networks() for [('4ac4cfb7-ccdd-4084-95bb-24edb9ba050a', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:33:42.220701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:33:42.221134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:33:42.221856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:33:42.222278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:33:42.222917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:33:42.233498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:42.234067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:42.234515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:42.235251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:42.235714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:42.236149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:42.243871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=84 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:42.261348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Getting quotas for project 5118db502c2a4d5a9efcc982171eee24. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:33:42.266906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Getting quotas for user eca6eb9c3d2a49d29e1da00f11fad56a and project 5118db502c2a4d5a9efcc982171eee24. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:33:42.340108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:33:42.343122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22761faf-bc65-4c21-a741-c8f0dad489b3',volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:33:42.518443 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1d4474b-0842-462d-ba76-cc88c54e6a8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.896250 Oct 06 13:33:42.520230 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3202/6389] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:33:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:33:42.537421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-503a6920-b682-4347-91af-45bf6edeabf2 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:42.538122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-503a6920-b682-4347-91af-45bf6edeabf2 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:42.652415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-503a6920-b682-4347-91af-45bf6edeabf2 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:42.661662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-503a6920-b682-4347-91af-45bf6edeabf2 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1099 microversion: 2.1 time: 0.129218 Oct 06 13:33:42.675331 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3188/6390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:42 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1099 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:43.687903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:43.689012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:43.696827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:43.697634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:43.698494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:43.699272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:43.699923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:43.700651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:43.773391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:43.782542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1ba17015-6bd9-45e9-9691-ecc0d1e59ad3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1197 microversion: 2.1 time: 0.099768 Oct 06 13:33:43.783071 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3203/6391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:43 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:44.807757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:44.809480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:44.821416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:44.822314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:44.823488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:44.825037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:44.826054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:44.826758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:45.415669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:45.430129 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2ba4279e-095b-4121-b7b7-8e5ffb63369e tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1282 microversion: 2.1 time: 0.626432 Oct 06 13:33:45.431519 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3189/6392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:44 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1282 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:46.177950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:33:46.212834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:46.215635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:46.221658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:46.245212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] Creating event network-changed:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:33:46.255519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-34f8c354-3446-483c-bc35-f70a22525ac4 req-080191ed-2728-4a38-953f-31aa895e85e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082268 Oct 06 13:33:46.258284 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3204/6393] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:33:46.456943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:46.458874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:46.472317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:46.473327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:46.474093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:46.475018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:46.475537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:46.476244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:46.766309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:46.779588 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd177bc2-d64f-4629-b6dd-8410831ca14d tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1282 microversion: 2.1 time: 0.326617 Oct 06 13:33:46.781789 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3190/6394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:46 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:47.807523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:47.809007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:47.818173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:47.819168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:47.820231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:47.821674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:47.822512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:47.823230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:48.007381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:48.019451 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5d7e535-27c8-4214-8e81-e07b0caf0b08 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1282 microversion: 2.1 time: 0.217650 Oct 06 13:33:48.020340 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3205/6395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:47 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:49.045663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:49.046524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:49.050754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:49.059398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:49.060552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:49.064954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:49.065957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:49.066519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:49.067086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:49.230072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:49.240612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ff13614-f09d-49aa-8b3e-d7467e82c697 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1282 microversion: 2.1 time: 0.201784 Oct 06 13:33:49.258240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3191/6396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:49 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:50.266337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:50.269292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:50.278262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:50.279893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:50.280677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:50.281156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:50.282071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:50.282609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:50.282962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:50.440777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:50.451511 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-25a3988b-5593-4488-8360-79d4c68a0f59 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.190828 Oct 06 13:33:50.462207 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3206/6397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:50 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:51.476393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:51.477760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:51.485871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:51.486819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:51.487386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:51.488234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:51.488852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:51.489412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:51.643471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:51.652237 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9cf6b4d-1112-434b-85dd-9b9d6bd9c474 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.180488 Oct 06 13:33:51.653101 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3192/6398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:51 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:52.674800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:52.675937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:52.680857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:52.681487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:52.688585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:52.689081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:52.689531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:52.690272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:52.690732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:52.691166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:53.090215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:53.099290 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6d60bb4-ec53-4ef5-8842-47bffab50d7c tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.426148 Oct 06 13:33:53.114548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3207/6399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:52 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:54.122868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:54.123593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:54.127117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:33:54.134777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:54.135699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:54.136163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:54.136884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:54.137546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:54.138044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:54.307643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:54.320282 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f33ed77d-cbcb-44a5-84b2-0ec2bf01d3c8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.200458 Oct 06 13:33:54.321367 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3193/6400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:54 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:33:55.342595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:55.343374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:55.350042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:55.350537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:55.351302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:55.352028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:55.352491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:55.353135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:55.523349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:55.531439 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d523957d-86db-459e-8edb-f1ffbcafba98 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.193041 Oct 06 13:33:55.532037 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3208/6401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:55 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:56.558446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:56.558446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:56.564113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:56.564691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:56.565227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:56.566051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:56.566737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:56.567263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:56.720981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:56.731649 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c7490fd-2ca4-4736-8515-522ee48b2373 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.179810 Oct 06 13:33:56.744376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3194/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:56 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:57.756055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:57.756691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:57.766281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:57.766768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:57.767466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:57.768177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:57.769316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:57.770255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:57.952593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:57.961214 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b44e210-acdc-4a87-a515-37d3f51595af tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.209195 Oct 06 13:33:57.965819 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3209/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:57 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:33:58.986553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:33:58.987269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:33:58.997056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:58.998080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:58.998604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:58.999375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:33:59.000641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:33:59.001127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:33:59.191640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:33:59.211692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6b91464-912b-4df0-b12e-74165eab6da0 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.229036 Oct 06 13:33:59.212469 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3195/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:33:58 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:00.238041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:00.239271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:00.255102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:00.255933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:00.265648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:00.266875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:00.267645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:00.268363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:00.429119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:00.438262 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41dfcf98-5804-49e4-adbc-bcf2d81e0624 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.205128 Oct 06 13:34:00.439109 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3210/6405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:00 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:00.490829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-724534323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530459456", "security_groups": [{"name": "tempest-secgroup-smoke-1056352036"}], "block_device_mapping_v2": [{"uuid": "07db0d46-baad-44e5-ab40-9487d123ba2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:00.619334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:34:01.136739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:34:01.137418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:34:01.137945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:34:01.138373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:34:01.138799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:34:01.153207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:01.154042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:01.154496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:01.155240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:01.155709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:01.156149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:01.163525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=64 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:01.174759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:34:01.181109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:34:01.240763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:34:01.243460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07db0d46-baad-44e5-ab40-9487d123ba2f',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:34:01.380790 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c809328f-2e94-421c-9a4d-48374fa49156 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.894240 Oct 06 13:34:01.381500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3196/6406] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:34:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:34:01.392649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e02a137-36a4-4d09-8c54-e723e7509174 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:01.393417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e02a137-36a4-4d09-8c54-e723e7509174 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:01.458031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e02a137-36a4-4d09-8c54-e723e7509174 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:01.474180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:01.474866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:01.485781 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e02a137-36a4-4d09-8c54-e723e7509174 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1093 microversion: 2.1 time: 0.088656 Oct 06 13:34:01.485781 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3211/6407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:01 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:01.486116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:01.486116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:01.486116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:01.486498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:01.486990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:01.487449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:01.654347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "name": "network-vif-plugged", "status": "completed", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:01.668431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:01.669023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:01.669520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:01.684727 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] Creating event network-vif-plugged:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:01.690730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-84062d0a-da25-482b-aaa0-b07ce25298d9 req-75542c90-351d-4127-9f5f-11b698e0108b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040133 Oct 06 13:34:01.692942 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3212/6408] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:34:01.707590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:01.730181 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c631925b-1df0-4762-b763-d1ef46e2e7f9 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.264137 Oct 06 13:34:01.731929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3197/6409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:01 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:02.504194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:02.504937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:02.511426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:02.511924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:02.512368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:02.513068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:02.513523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:02.513985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:02.590041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:02.599981 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0514e562-c46c-452a-9cb5-316938fa257a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1191 microversion: 2.1 time: 0.100898 Oct 06 13:34:02.600587 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3213/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:02 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:02.757632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:02.758374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:02.765141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:02.765649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:02.766135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:02.766845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:02.767573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:02.768247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:02.995730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:03.004998 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81143dab-731c-40d8-a82d-a11d839654d7 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1270 microversion: 2.1 time: 0.252906 Oct 06 13:34:03.005599 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3198/6411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:02 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:03.622411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:03.623078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:03.631551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:03.632468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:03.633112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:03.634618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:03.635263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:03.635708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:03.922454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:03.930576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38f04c94-977d-46a7-ac6f-f27bab232988 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1277 microversion: 2.1 time: 0.312155 Oct 06 13:34:03.931525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3214/6412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:03 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:04.029665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:04.030461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:04.038414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.039216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.039783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.040770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.041310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.041853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.257489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:04.266490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df2e0d5b-60e6-4ea6-9acd-1448b8418ec4 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1459 microversion: 2.1 time: 0.241001 Oct 06 13:34:04.267101 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3199/6413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:04 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1459 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:34:04.289697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:04.290352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:04.296621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.297119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.297562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.298299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.298754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.299180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.493945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dfab66-5a12-4538-8230-103539b52c8f", "tag": "34d3e7a7-ee38-4522-9e66-4ecd2a378a6d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:04.512468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.513524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.514193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.527193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] Creating event network-changed:34d3e7a7-ee38-4522-9e66-4ecd2a378a6d for instance 82dfab66-5a12-4538-8230-103539b52c8f on n-h1-860556-1 Oct 06 13:34:04.533071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-126b2978-07c1-48e9-bca9-84087e432a7c req-fc916b50-3c4a-4ab7-a414-f091c3a32c1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044698 Oct 06 13:34:04.534412 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3200/6414] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:04.587700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:04.601683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efe3909a-42de-4bfe-9482-40d21107d5e8 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1459 microversion: 2.1 time: 0.316280 Oct 06 13:34:04.602316 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3215/6415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:04 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1459 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:04.954512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:04.955699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:04.962587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.963331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.963989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:04.964910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:04.965697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:04.966391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:05.548684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:05.563830 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7173ffb3-ccaa-4cb8-be49-b273edea4869 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1277 microversion: 2.1 time: 0.613618 Oct 06 13:34:05.564940 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3201/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:04 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1277 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:06.596470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:06.604690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:06.646069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:06.646798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:06.647261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:06.648023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:06.648491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:06.648930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:06.683823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:06.696897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:06.697704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:06.698989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:06.714471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] Creating event network-changed:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:06.720100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7ca6780f-544e-4938-9508-57a4d0542ef5 req-e0ac7b7b-e0f5-4228-ba02-1373dda5a8e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040268 Oct 06 13:34:06.725701 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3202/6417] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:34:07.079096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:07.088296 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63693a14-8dd8-490d-9f5b-16b91cb1712c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1277 microversion: 2.1 time: 0.501735 Oct 06 13:34:07.089842 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3216/6418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:06 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1277 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:08.114465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:08.115464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:08.121929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:08.122446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:08.122914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:08.123737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:08.124102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:08.124587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:08.329005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:08.341906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:08.342398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:08.342839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:08.355369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] Creating event network-changed:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:08.360892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d276f895-2bd1-441a-94a0-8d2bdb69855e req-3d00ed60-6401-4791-9379-9bb214661a3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 Oct 06 13:34:08.361517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3217/6419] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:34:08.366532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:08.374586 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-739b4b2f-a03d-456c-93d3-14e7b75b0ad5 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1277 microversion: 2.1 time: 0.265896 Oct 06 13:34:08.375167 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3203/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:08 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:09.398540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:09.399160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:09.405344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:09.405991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:09.406431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:09.407134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:09.407592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:09.408020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:09.542787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:09.551671 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5967eec-d076-4b26-9ff2-663390406b21 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.157874 Oct 06 13:34:09.552258 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3218/6421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:09 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:10.376900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:10.387387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:10.387881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:10.388329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:10.400173 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] Creating event network-changed:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:10.406098 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-102e0f32-dc2c-4ef0-9f39-9f0353d47565 req-0d858589-9f52-4ac6-80ab-5b14c2eed78e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032981 Oct 06 13:34:10.406700 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3204/6422] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:10.574597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:10.575375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:10.583214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:10.584035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:10.584336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:10.585058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:10.585551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:10.586009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:11.203606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:11.213674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f99e4421-1ff3-4ded-9bb9-e4335e3a3886 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.642943 Oct 06 13:34:11.214325 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3219/6423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:10 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:12.234219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:12.234998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:12.240655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:12.241348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:12.249034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:12.249543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:12.250022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:12.250743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:12.251212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:12.251655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:12.384315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:12.392195 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9890e259-d35a-419d-9140-2cfa4a893d97 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.158965 Oct 06 13:34:12.392769 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3205/6424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:12 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:13.415830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:13.416496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:13.418972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:13.426768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:13.427441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:13.427885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:13.428894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:13.429428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:13.429881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:13.434717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=86 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:13.578558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:13.588375 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea5a3fab-2790-4705-88ed-f796e6228329 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.177150 Oct 06 13:34:13.588960 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3220/6425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:13 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:14.610593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:14.611218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:14.619229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:14.619729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:14.620202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:14.620915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:14.621384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:14.621858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:14.754791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:14.762634 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e6624ed7-5a6c-4e7c-b7fa-12f90fd59df8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.155977 Oct 06 13:34:14.763210 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3206/6426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:14 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:15.786344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:15.786960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:15.794486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:15.794969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:15.795408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:15.796106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:15.796561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:15.796988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:15.929872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:15.939362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b40bd091-ddd5-403d-b9e9-3dd477e1e1cd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.157488 Oct 06 13:34:15.940361 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3221/6427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:15 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:16.963080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:16.963708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:16.970766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:16.971261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:16.971711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:16.972445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:16.972967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:16.973406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:17.111386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:17.119968 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09b2216b-ace2-4134-a15f-922184eddbdb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.160747 Oct 06 13:34:17.120559 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3207/6428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:16 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:18.142214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:18.142845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:18.149842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:18.150339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:18.150787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:18.151489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:18.151952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:18.152386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:18.282989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:18.290830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-afebd879-80e3-4b6e-8b2e-eca099faf5fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.152522 Oct 06 13:34:18.291408 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3222/6429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:18 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:19.239567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dfab66-5a12-4538-8230-103539b52c8f", "name": "network-vif-plugged", "status": "completed", "tag": "34d3e7a7-ee38-4522-9e66-4ecd2a378a6d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:19.245654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:19.251597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:19.252164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:19.252665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:19.266473 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] Creating event network-vif-plugged:34d3e7a7-ee38-4522-9e66-4ecd2a378a6d for instance 82dfab66-5a12-4538-8230-103539b52c8f on n-h1-860556-1 Oct 06 13:34:19.273779 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8ba5c11b-64f6-4c1a-82b9-1de52428bff7 req-64949022-e59b-4329-ae00-08b9dc795078 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037408 Oct 06 13:34:19.275155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3208/6430] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:19.315208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:19.316597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:19.323929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:19.324422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:19.324864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:19.325571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:19.326056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:19.326480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:19.514671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:19.522993 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-96dec8d6-5fe8-464e-8c8b-8044edf8cd91 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.212108 Oct 06 13:34:19.523584 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3223/6431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:19 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:20.545894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:20.546773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:20.556200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:20.557112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:20.557983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:20.558733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:20.559289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:20.559738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:20.724287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:20.735115 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-518469f2-be78-4731-9061-6901f4587a59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1265 microversion: 2.1 time: 0.193537 Oct 06 13:34:20.735751 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3209/6432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:20 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:21.760351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:21.760981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:21.763401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=38 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:21.768901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:21.769945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:21.770417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:21.771130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:21.771598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:21.772034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:21.927164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:21.937374 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aef1858c-48a8-46e9-af3c-ac3f36cdff94 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1451 microversion: 2.1 time: 0.182595 Oct 06 13:34:21.938077 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3224/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:21 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:21.963133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:21.963796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:21.971313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:21.971819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:21.972297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:21.973013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:21.973484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:21.973957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:22.116545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:22.124855 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-35b54172-41c3-41af-93fd-a89277b5d8c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1451 microversion: 2.1 time: 0.167181 Oct 06 13:34:22.125447 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3210/6434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:21 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:24.280304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dfab66-5a12-4538-8230-103539b52c8f", "tag": "34d3e7a7-ee38-4522-9e66-4ecd2a378a6d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:24.291453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:24.291950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:24.292391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:24.304736 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] Creating event network-changed:34d3e7a7-ee38-4522-9e66-4ecd2a378a6d for instance 82dfab66-5a12-4538-8230-103539b52c8f on n-h1-860556-1 Oct 06 13:34:24.311488 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5e93fc23-b6d1-4ced-8b6d-aa49d581363c req-842f6fa3-7ad1-45ba-82e9-dd17cb6f4907 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035724 Oct 06 13:34:24.312362 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3225/6435] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:38.330688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:38.334395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=31 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:38.335747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:38.336267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:38.350436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:38.356324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:38.357673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=69 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:34:38.359714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:38.363437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:38.364150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:38.365386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:38.367436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:38.369078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:38.377451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:38.380470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:38.381560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:38.401350 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] Creating event network-changed:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:38.409279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1894dea1-164d-4c60-8066-256bc0eaade0 req-48c40778-2170-4c80-82d4-83c6245ce7c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081128 Oct 06 13:34:38.415447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3226/6436] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:38.421177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:34:38.583163 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61149460-90c8-4b34-b926-e2662a0f13ae tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 204 len: 0 microversion: 2.1 time: 0.257341 Oct 06 13:34:38.587293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3211/6437] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:34:38 2022] DELETE /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:34:38.616055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:38.616788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:38.633771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:38.634252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:38.634697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:38.640913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:38.641416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:38.642726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:38.910267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:38.933222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5da00a9-7ec0-411f-bb75-fea3efde773b tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1584 microversion: 2.1 time: 0.340454 Oct 06 13:34:38.934013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3227/6438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:38 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1584 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:39.969865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:39.970609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:39.977828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:39.978408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:39.978891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:39.979701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:39.980181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:39.980859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:40.174823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:40.184712 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8726eba-0f3d-47de-88b0-9766bf349b8f tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1584 microversion: 2.1 time: 0.220162 Oct 06 13:34:40.185670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3212/6439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:39 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1584 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:41.162319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee6e818-67f2-4759-8ca5-033e37de64f3", "name": "network-vif-deleted", "tag": "e1d98f7b-9bfa-474e-b148-c3f44f476fef"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:34:41.181578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:41.182128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:41.182946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:41.195999 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] Creating event network-vif-deleted:e1d98f7b-9bfa-474e-b148-c3f44f476fef for instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 on n-h2-860556-1 Oct 06 13:34:41.202133 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-48daf8c8-6dc2-4f1a-90ee-fed46cd7d6fd req-70da1d5a-2ecc-43e8-ace2-543c769a2dd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044894 Oct 06 13:34:41.204032 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3228/6440] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:34:41.209807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:41.210472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:41.217786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:41.218308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:41.218771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:41.219495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:41.220170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:41.220811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:41.304316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:41.319424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f2d3d5ca-48c7-45be-b037-4a6e80f14851 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1230 microversion: 2.1 time: 0.114294 Oct 06 13:34:41.320019 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3213/6441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:41 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:42.350719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:42.351442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:42.358324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:42.358888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:42.359339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:42.360078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:42.360677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:42.361119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:42.430237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:42.439535 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff120933-2c79-4534-a36f-69eb0bf45318 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1230 microversion: 2.1 time: 0.094996 Oct 06 13:34:42.440121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3229/6442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:42 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:34:43.465630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:43.467118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:43.474757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:43.475610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:43.476336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:43.477407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:43.478147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:43.478830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:43.573311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:43.584972 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cfef742-fe68-41e0-a7c5-a3ffc14db4c1 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1230 microversion: 2.1 time: 0.123167 Oct 06 13:34:43.585661 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3214/6443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:43 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1230 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:44.613702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:44.614752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:44.622121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:44.622741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:44.623219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:44.624232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:44.624903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:44.625365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:44.707100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:44.715495 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad1c866b-c70b-4a5b-8d86-f3739ee70827 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1230 microversion: 2.1 time: 0.106891 Oct 06 13:34:44.716571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3230/6444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:44 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:45.740981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:45.742335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:45.755800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:45.758037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:45.758787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:45.761833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:45.762585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:45.765367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:45.870374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca6eb9c3d2a49d29e1da00f11fad56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5118db502c2a4d5a9efcc982171eee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:34:45.881824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c11af411-8d7d-4145-bb1e-13f1dca2ecda tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 200 len: 1230 microversion: 2.1 time: 0.146120 Oct 06 13:34:45.883959 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3215/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:45 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 1230 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:34:46.907223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:46.907840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] [instance: 9ee6e818-67f2-4759-8ca5-033e37de64f3] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:34:46.918285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:46.919094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:46.919865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:46.920950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:34:46.921556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:34:46.922030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:34:46.941074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] HTTP exception thrown: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Request method failure captured: Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 HTTP/1.1 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtijm5V3DC4eMY3kjtS7rNDSNKX3irmtwXKsrKfILgzIGG7nOObPS7xoSw458Ger5OLbQNXDlGOgii9bZXqB9BtxFBH-QfCfkPyR0hRkHGoycyeMJh2pVmNFzpnc-Sl74e0Apn5mUAWK81ukb1xbZphL_wzgdpn_iuow6hRr-JI5ItU Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 5118db502c2a4d5a9efcc982171eee24 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBackupRestore-14676420 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5118db502c2a4d5a9efcc982171eee24", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5118db502c2a4d5a9efcc982171eee24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5118db502c2a4d5a9efcc982171eee24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5118db502c2a4d5a9efcc982171eee24"}]}] Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBackupRestore-14676420 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 5118db502c2a4d5a9efcc982171eee24 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBackupRestore-14676420 Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBackupRestore-14676420-project Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: eca6eb9c3d2a49d29e1da00f11fad56a Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBackupRestore-14676420-project Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '9ee6e818-67f2-4759-8ca5-033e37de64f3'} Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:34:46.943098 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Returning 404 to user: Instance 9ee6e818-67f2-4759-8ca5-033e37de64f3 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5b11cb62-4141-4d64-8334-319a39114e00 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3" status: 404 len: 111 microversion: 2.1 time: 0.042174 Oct 06 13:34:46.952345 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3231/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:34:46 2022] GET /compute/v2.1/servers/9ee6e818-67f2-4759-8ca5-033e37de64f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:34:47.172354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48f86ea5-5212-4cf0-9d66-6eaa156198b3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] Calling method '.version_select at 0x7f7d3f1e01f0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:34:47.215838 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48f86ea5-5212-4cf0-9d66-6eaa156198b3 tempest-TestVolumeBackupRestore-14676420 tempest-TestVolumeBackupRestore-14676420-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1076956574" status: 202 len: 0 microversion: 2.1 time: 0.047009 Oct 06 13:34:47.216525 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3216/6447] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 13:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1076956574 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:35:32.920376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1205947287", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "5e54fb70-6426-4502-86b0-0b5aa01e9ce0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:32.931340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:32.931987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=24 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:32.982289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] validate_networks() for [('5e54fb70-6426-4502-86b0-0b5aa01e9ce0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:35:33.356074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:35:33.356506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:35:33.356991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:35:33.357413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:35:33.357873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:35:33.368895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:33.369814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:33.370885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:33.377300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:33.377300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:33.377300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:33.390164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Getting quotas for project c5c5d6218361442b97378539c40545b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:35:33.396109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Getting quotas for user 1559d8d943fb462983a254011a1651cd and project c5c5d6218361442b97378539c40545b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:35:33.413076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:35:33.415365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:35:33.460991 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-642ffef4-37ce-4ecc-9ceb-07302f2b96f5 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544643 Oct 06 13:35:33.461649 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3232/6448] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 13:35:33.472937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b989f53-9198-46dd-aec0-98d5889fcd3e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:33.473586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b989f53-9198-46dd-aec0-98d5889fcd3e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:33.477134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:33.478244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:33.542437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0b989f53-9198-46dd-aec0-98d5889fcd3e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:33.551105 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b989f53-9198-46dd-aec0-98d5889fcd3e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1214 microversion: 2.1 time: 0.082025 Oct 06 13:35:33.551826 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3217/6449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:33 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:34.575935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:34.576615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:34.585092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:34.585943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:34.586392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:34.587115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:34.587582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:34.588028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:34.660917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:34.669957 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-455b8e89-7180-47ea-be67-fe60899ce578 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1274 microversion: 2.1 time: 0.098708 Oct 06 13:35:34.677777 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3233/6450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:34 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:35.698253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:35.698943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:35.706509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:35.707082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:35.707622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:35.708527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:35.709072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:35.709604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:35.859122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:35.868230 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-477ae83b-a32a-4e76-99b2-b7486b1b8788 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.175142 Oct 06 13:35:35.868819 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3218/6451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:35 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:36.398917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6515350e-37b2-4edf-9348-b0515503d123", "tag": "bd0982b9-b2c0-493c-b73c-209cdfeb30a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:36.410629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:36.411398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:36.411835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:36.423684 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] Creating event network-changed:bd0982b9-b2c0-493c-b73c-209cdfeb30a9 for instance 6515350e-37b2-4edf-9348-b0515503d123 on n-h2-860556-1 Oct 06 13:35:36.429647 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-046476b1-9535-401c-984c-095fdde2442c req-6e9884a7-9a20-4cdf-bfbc-55d5e7a6e270 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Oct 06 13:35:36.430318 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3234/6452] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:35:36.892954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:36.894137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:36.901971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:36.902483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:36.902951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:36.903686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:36.904167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:36.904619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:37.036369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:37.044362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-53d62271-2027-485f-a4fa-7ddf4e45f497 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.155451 Oct 06 13:35:37.044944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3219/6453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:36 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:38.069665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:38.070493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:38.077079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:38.077581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:38.078066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:38.078778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:38.079243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:38.079716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:38.210404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:38.218046 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6365db8-30dd-47d5-8080-411ea7cbcacf tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.153771 Oct 06 13:35:38.218627 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3235/6454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:38 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:39.243361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:39.243934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:39.250595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:39.251103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:39.251561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:39.252275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:39.252747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:39.253190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:39.400092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:39.408113 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05f8126e-6bc8-4789-91be-2fa64666f285 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.168722 Oct 06 13:35:39.409214 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3220/6455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:39 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:35:40.439358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:40.440089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:40.451364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:40.452144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:40.452599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:40.453325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:40.453817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:40.454251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:40.594190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:40.602700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-aaa095b3-c32b-45e1-90a4-0cbf04b041b6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.167309 Oct 06 13:35:40.603284 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3236/6456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:40 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:41.624726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:41.625388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:41.633192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:41.633698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:41.634175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:41.634899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:41.635368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:41.635808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:41.781869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:41.792064 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14a83717-567d-4a32-8084-f643f9152674 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.171166 Oct 06 13:35:41.792853 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3221/6457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:41 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:42.032150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6515350e-37b2-4edf-9348-b0515503d123", "name": "network-vif-plugged", "status": "completed", "tag": "bd0982b9-b2c0-493c-b73c-209cdfeb30a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:42.043430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:42.043990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:42.044350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:42.056835 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] Creating event network-vif-plugged:bd0982b9-b2c0-493c-b73c-209cdfeb30a9 for instance 6515350e-37b2-4edf-9348-b0515503d123 on n-h2-860556-1 Oct 06 13:35:42.061994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3e87849c-3418-4f80-ba46-78a3a7c987fd req-ce27cedc-fac0-48df-a300-c0e03a2dcf1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033543 Oct 06 13:35:42.062600 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3237/6458] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:35:42.817296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:42.818036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:42.826137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:42.826744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:42.827255 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:42.828165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:42.828676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:42.829133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:42.978516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:42.986468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-528b9e87-449f-417a-86fa-b0a5caa21389 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1314 microversion: 2.1 time: 0.173872 Oct 06 13:35:42.987044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3222/6459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:42 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:44.007730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:44.008546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:44.013010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:44.013724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:44.021343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.022048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.022518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.023220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.023683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.024116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.161461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:44.169253 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4c4652f-36cd-49e2-a63f-a92e1c78f5b1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1497 microversion: 2.1 time: 0.163359 Oct 06 13:35:44.169865 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3238/6460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:44 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:44.539448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:44.539990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:44.542101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:44.548144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.548648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.549103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.549848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.550354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.551066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.576912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:35:44.654018 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a1799022-5abd-489a-b7e8-c77ecab7bf32 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 204 len: 0 microversion: 2.1 time: 0.118016 Oct 06 13:35:44.654774 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3223/6461] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:35:44 2022] DELETE /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:35:44.663279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:44.663885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:44.670066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.670546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.670977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.671705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:44.672137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:44.672568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:44.802557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:44.810473 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79c6ac43-f4b6-47fb-b7ac-2e3609cc9ab6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1503 microversion: 2.1 time: 0.151016 Oct 06 13:35:44.811063 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3239/6462] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:44 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:45.835465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:45.837008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:45.844089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:45.844591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:45.845043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:45.845781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:45.846254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:45.846739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:46.282267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:46.290282 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3524cb61-946d-40ba-af16-5761724d8ee6 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 200 len: 1503 microversion: 2.1 time: 0.459853 Oct 06 13:35:46.291138 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3224/6463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:45 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:46.732981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6515350e-37b2-4edf-9348-b0515503d123", "name": "network-vif-deleted", "tag": "bd0982b9-b2c0-493c-b73c-209cdfeb30a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:46.746990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:46.747469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:46.748047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:46.761240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] Creating event network-vif-deleted:bd0982b9-b2c0-493c-b73c-209cdfeb30a9 for instance 6515350e-37b2-4edf-9348-b0515503d123 on n-h2-860556-1 Oct 06 13:35:46.767993 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-fe8bbc57-26ad-4d11-b60a-b6f9db9249e6 req-bed21ae9-b112-4c13-a609-afb0c1b755ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038760 Oct 06 13:35:46.769011 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3240/6464] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:35:47.314243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:47.314873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 6515350e-37b2-4edf-9348-b0515503d123] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:47.322978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:47.323595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:47.324170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:47.324900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:47.325509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:47.325979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:47.339632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] HTTP exception thrown: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Request method failure captured: Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 HTTP/1.1 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtmjnbsSDZksH9U5kb6fHVIKGAUQtbuyEP8_-_T30WiuZwfTCOMceaECBphRH-XqUxPtoNfBWMLO9FHOVvkkEa0paQ8OKrus2XHqddhCmnWAo8fAHo1P95BCuOqSeG0JAJNoFn_7qGzECyiklpvOQ4-ZnaZc0lgnSTabBp9jQDXea4M Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c5c5d6218361442b97378539c40545b6 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesActionsTest-633836840 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5c5d6218361442b97378539c40545b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5c5d6218361442b97378539c40545b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5c5d6218361442b97378539c40545b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5c5d6218361442b97378539c40545b6"}]}] Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesActionsTest-633836840 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c5c5d6218361442b97378539c40545b6 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesActionsTest-633836840 Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesActionsTest-633836840-project Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1559d8d943fb462983a254011a1651cd Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesActionsTest-633836840-project Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6515350e-37b2-4edf-9348-b0515503d123'} Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:35:47.341285 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Returning 404 to user: Instance 6515350e-37b2-4edf-9348-b0515503d123 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b69b778-2486-426b-afe8-04500b331ec0 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123" status: 404 len: 111 microversion: 2.1 time: 0.032618 Oct 06 13:35:47.347605 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3225/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:47 2022] GET /compute/v2.1/servers/6515350e-37b2-4edf-9348-b0515503d123 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:35:47.393534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1644470142", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "5e54fb70-6426-4502-86b0-0b5aa01e9ce0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:47.449295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] validate_networks() for [('5e54fb70-6426-4502-86b0-0b5aa01e9ce0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:35:47.813335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:35:47.813980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:35:47.814376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:35:47.814786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:35:47.815199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:35:47.824168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:47.824647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:47.825082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:47.825832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:47.826290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:47.826710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:47.843943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Getting quotas for project c5c5d6218361442b97378539c40545b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:35:47.849954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Getting quotas for user 1559d8d943fb462983a254011a1651cd and project c5c5d6218361442b97378539c40545b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:35:47.862202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:35:47.864713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:35:47.910107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1017c433-265e-49b5-94f1-76becd691235 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520796 Oct 06 13:35:47.910877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3241/6466] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:35:47.921709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c638329d-93ce-43f8-bf43-92cab59329fa tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:47.922431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c638329d-93ce-43f8-bf43-92cab59329fa tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:47.976942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c638329d-93ce-43f8-bf43-92cab59329fa tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:47.983829 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c638329d-93ce-43f8-bf43-92cab59329fa tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1214 microversion: 2.1 time: 0.065909 Oct 06 13:35:47.984396 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3226/6467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:47 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:49.009862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:49.009862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:49.016645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:49.017141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:49.017906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:49.018630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:49.019098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:49.019583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:49.090069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:49.101713 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf826eb7-f262-411e-9b49-ca64e7acb28b tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1274 microversion: 2.1 time: 0.099281 Oct 06 13:35:49.102280 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3242/6468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:49 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:50.125971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:50.126630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:50.137916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:50.138549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:50.139016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:50.139830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:50.140320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:50.140779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:50.282824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:50.291406 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2768e091-42df-421f-9909-26bca3208591 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.169492 Oct 06 13:35:50.291985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3227/6469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:50 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:50.420390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647a3be-86e3-4f8a-ba0e-cdab2c8c5565", "tag": "35a2c62f-01f1-49af-8e4e-cb1fc6417e1d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:50.433154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:50.433659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:50.434136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:50.445419 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] Creating event network-changed:35a2c62f-01f1-49af-8e4e-cb1fc6417e1d for instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 on n-h2-860556-1 Oct 06 13:35:50.450838 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-14fea1d5-f531-4cfd-9af1-75f5e701ea23 req-53bce559-68cb-43d1-8f0c-88386c44d373 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035207 Oct 06 13:35:50.451452 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3243/6470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:35:51.315377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:51.316019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:51.323217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:51.323728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:51.324189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:51.324913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:51.325393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:51.325910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:51.455154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:51.464632 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a7ce9fe0-c5e6-4bde-a867-8c3509683696 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.153865 Oct 06 13:35:51.465222 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3228/6471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:51 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:52.488673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:52.489389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:52.495973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:52.496458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:52.496904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:52.497610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:52.498179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:52.498617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:52.642795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:52.652917 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-85c21357-5e6d-4670-a73a-40ba97fc537a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.169378 Oct 06 13:35:52.653511 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3244/6472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:52 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:53.676648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:53.677446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:53.684508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:53.685025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:53.685487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:53.686248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:53.686728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:53.687190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:53.839113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:53.847761 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d9681c1-d91e-4cc8-9cf8-f1d6b881a95e tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.175862 Oct 06 13:35:53.848342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3229/6473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:53 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:54.870415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:54.871036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:54.877842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:54.878337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:54.878775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:54.879474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:54.879935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:54.880363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:55.008658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:55.016353 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-59f2f5e4-2b2c-47ef-b570-04b52264c56a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.149861 Oct 06 13:35:55.016935 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3245/6474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:54 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:56.041187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:56.041834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:56.048598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:56.049100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:56.050286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:56.051261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:56.051806 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:56.052177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:56.069332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647a3be-86e3-4f8a-ba0e-cdab2c8c5565", "name": "network-vif-plugged", "status": "completed", "tag": "35a2c62f-01f1-49af-8e4e-cb1fc6417e1d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:35:56.083678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:56.084319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:56.084771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:56.095605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] Creating event network-vif-plugged:35a2c62f-01f1-49af-8e4e-cb1fc6417e1d for instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 on n-h2-860556-1 Oct 06 13:35:56.103286 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dc509a32-ce71-4117-a5d3-a1ea180ae0e2 req-8b0f1713-0ee6-4b7f-a7cf-a392796b9c55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Oct 06 13:35:56.104206 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3246/6475] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:35:56.197870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:56.205809 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba450b6d-4f5c-4830-83e1-58c17056485f tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.170886 Oct 06 13:35:56.206399 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3230/6476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:56 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:57.230824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:57.231536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:57.238605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:57.239072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:57.239510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:57.240210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:57.240663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:57.241085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:57.373954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:57.381768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3f1e74c-2f78-431e-a3e2-24f4703a426a tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1314 microversion: 2.1 time: 0.156175 Oct 06 13:35:57.382364 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3247/6477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:57 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:58.404510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:58.405070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:58.407707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:58.413072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:58.413571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:58.414058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:58.414770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:58.415249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:58.415698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:58.554723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:58.562500 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-055330ea-1539-4ad6-88f2-9cc0e28e96c7 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1498 microversion: 2.1 time: 0.161990 Oct 06 13:35:58.563077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3231/6478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:58 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:35:58.977034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:58.977600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:58.979515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:58.980315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:35:58.986876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:58.987361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:58.988343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:58.989040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:58.989498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:58.989956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:59.015632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:35:59.091796 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ff250df-1698-43ee-bfba-d409eaba477c tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 204 len: 0 microversion: 2.1 time: 0.118341 Oct 06 13:35:59.092594 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3248/6479] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:35:58 2022] DELETE /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:35:59.101795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:35:59.102555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:35:59.108932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:59.109440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:59.109934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:59.110652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:35:59.111131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:35:59.111580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:35:59.242135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:35:59.250090 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-66d388dd-7ed1-47dd-b74c-30ac65939837 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1504 microversion: 2.1 time: 0.152519 Oct 06 13:35:59.250677 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3232/6480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:35:59 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:00.276743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:00.278800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:00.285979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:00.286484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:00.286919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:00.287667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:00.288125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:00.290107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:00.427280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:00.435087 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa50f781-8763-444a-97ad-cc4a21bc6e70 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1504 microversion: 2.1 time: 0.164594 Oct 06 13:36:00.435673 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3249/6481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:00 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:01.115194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647a3be-86e3-4f8a-ba0e-cdab2c8c5565", "name": "network-vif-deleted", "tag": "35a2c62f-01f1-49af-8e4e-cb1fc6417e1d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:01.126982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:01.127771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:01.128569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:01.140475 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] Creating event network-vif-deleted:35a2c62f-01f1-49af-8e4e-cb1fc6417e1d for instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 on n-h2-860556-1 Oct 06 13:36:01.146078 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6c54fd29-6bee-4dc0-a72c-f46e2a660e33 req-db09940d-6740-43bd-b34e-02bcd9560a7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035390 Oct 06 13:36:01.146782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3233/6482] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:36:01.459375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:01.459921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:01.466819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:01.467303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:01.467746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:01.468441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:01.468903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:01.469332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:01.500114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:01.500594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:01.501032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:01.501482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lazy-loading 'fault' on Instance uuid 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:36:01.545557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1559d8d943fb462983a254011a1651cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c5d6218361442b97378539c40545b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:01.554009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b24e289c-52d4-4f34-9df7-35239e742cd1 tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 200 len: 1304 microversion: 2.1 time: 0.099149 Oct 06 13:36:01.554599 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3250/6483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:01 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:02.578198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:02.578834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] [instance: 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:02.585077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:02.585582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:02.586073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:02.586799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:02.587276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:02.587798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:02.602525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] HTTP exception thrown: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Request method failure captured: Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 HTTP/1.1 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtmjnbsSDZksH9U5kb6fHVIKGAUQtbuyEP8_-_T30WiuZwfTCOMceaECBphRH-XqUxPtoNfBWMLO9FHOVvkkEa0paQ8OKrus2XHqddhCmnWAo8fAHo1P95BCuOqSeG0JAJNoFn_7qGzECyiklpvOQ4-ZnaZc0lgnSTabBp9jQDXea4M Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: c5c5d6218361442b97378539c40545b6 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-VolumesActionsTest-633836840 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5c5d6218361442b97378539c40545b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5c5d6218361442b97378539c40545b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5c5d6218361442b97378539c40545b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5c5d6218361442b97378539c40545b6"}]}] Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-VolumesActionsTest-633836840 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: c5c5d6218361442b97378539c40545b6 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-VolumesActionsTest-633836840 Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-VolumesActionsTest-633836840-project Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1559d8d943fb462983a254011a1651cd Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-VolumesActionsTest-633836840-project Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '5647a3be-86e3-4f8a-ba0e-cdab2c8c5565'} Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:36:02.605038 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] Returning 404 to user: Instance 5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-93094533-762a-404a-8f7b-8a39656a8cae tempest-VolumesActionsTest-633836840 tempest-VolumesActionsTest-633836840-project] 10.222.0.26 "GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565" status: 404 len: 111 microversion: 2.1 time: 0.033594 Oct 06 13:36:02.616298 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3234/6484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:02 2022] GET /compute/v2.1/servers/5647a3be-86e3-4f8a-ba0e-cdab2c8c5565 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:36:22.227265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:22.227774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:22.230451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:22.231254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:22.237784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:22.238950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:22.239590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:22.240298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:22.240761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:22.241201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:22.270408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:36:22.353483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d447c78-875e-42a4-9523-031175c258e3 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 204 len: 0 microversion: 2.1 time: 0.130321 Oct 06 13:36:22.354368 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3251/6485] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:36:22 2022] DELETE /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:36:22.362926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:22.363588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:22.366239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:22.366997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:22.373686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:22.374234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:22.374699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:22.375420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:22.375896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:22.376343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:22.517018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:22.526398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-28028a0d-ae29-4e07-bce3-dc98fd1c072d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1575 microversion: 2.1 time: 0.167444 Oct 06 13:36:22.533300 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3235/6486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:22 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:23.551700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:23.553230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:23.560686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:23.561274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:23.561825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:23.563037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:23.563583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:23.564446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:23.704572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:23.713502 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-daad39a7-a97d-4673-a2ba-55fb1a23ab6a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1575 microversion: 2.1 time: 0.167314 Oct 06 13:36:23.713869 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3252/6487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:23 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:24.738651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:24.740056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:24.747071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:24.747583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:24.748041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:24.748767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:24.749245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:24.749688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:24.847292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:24.856424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a668a853-933e-4bb2-ac28-a9b6d08a64d9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1507 microversion: 2.1 time: 0.123605 Oct 06 13:36:24.871830 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3236/6488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:24 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1507 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:25.249987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dfab66-5a12-4538-8230-103539b52c8f", "name": "network-vif-deleted", "tag": "34d3e7a7-ee38-4522-9e66-4ecd2a378a6d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:25.278072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:25.278864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:25.284429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:25.300175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] Creating event network-vif-deleted:34d3e7a7-ee38-4522-9e66-4ecd2a378a6d for instance 82dfab66-5a12-4538-8230-103539b52c8f on n-h1-860556-1 Oct 06 13:36:25.315479 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-aca242ca-3295-4e46-9774-e29301f2d4a6 req-52c87ba2-e631-4d31-89e8-013290343b0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264210 Oct 06 13:36:25.321610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3253/6489] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:36:25.878730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:25.879487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:25.892015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:25.893002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:25.893702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:25.895489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:25.896766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:25.897475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:25.999754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:26.017356 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6e3fb753-ccfc-4b92-b03b-e69252694fd4 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1224 microversion: 2.1 time: 0.142149 Oct 06 13:36:26.019153 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3237/6490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:25 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:27.043118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:27.043861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:27.050397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:27.051686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:27.052133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:27.052832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:27.053288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:27.053715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:27.117791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:27.125677 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc6e7493-a477-4ffd-8e93-00f0e934dd02 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1224 microversion: 2.1 time: 0.087707 Oct 06 13:36:27.126286 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3254/6491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:27 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:28.149081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:28.149715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:28.156343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:28.156846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:28.157334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:28.158045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:28.158527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:28.158978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:28.227155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:28.235916 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-caa9d2c5-7229-4e58-b92f-1036470567be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1224 microversion: 2.1 time: 0.091433 Oct 06 13:36:28.236525 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3238/6492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:28 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:29.260140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:29.260678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:29.267878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:29.268372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:29.268807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:29.269600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:29.270090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:29.270515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:29.337489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:29.345919 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91ef9a2e-82c0-4d01-9be1-c3b3747ebdda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 200 len: 1224 microversion: 2.1 time: 0.089660 Oct 06 13:36:29.346514 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3255/6493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:29 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:30.370343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:30.371090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:30.378239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:30.378849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:30.379452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:30.380218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:30.380765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:30.381284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:30.395923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f HTTP/1.1 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '82dfab66-5a12-4538-8230-103539b52c8f'} Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:36:30.397609 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aaad4b51-833e-473b-aad3-7716a4a82028 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 404 len: 111 microversion: 2.1 time: 0.032778 Oct 06 13:36:30.401048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3239/6494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:30 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:36:30.510822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-301889106", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530459456", "security_groups": [{"name": "tempest-secgroup-smoke-1056352036"}], "block_device_mapping_v2": [{"uuid": "07db0d46-baad-44e5-ab40-9487d123ba2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:30.626954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:36:31.200988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:36:31.201426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:36:31.201954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:36:31.202407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:36:31.202829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:36:31.212640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:31.213075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:31.213518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:31.214298 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:31.214761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:31.215191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:31.232407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:36:31.238018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:36:31.297932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:36:31.300114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07db0d46-baad-44e5-ab40-9487d123ba2f',volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:36:31.439346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b512df1f-f88d-4b1d-9769-356a34089efe tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.932320 Oct 06 13:36:31.440243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3256/6495] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:36:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:36:31.452037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba3fdf4f-33ed-41f6-afd3-b503a413ca82 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:31.452718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba3fdf4f-33ed-41f6-afd3-b503a413ca82 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:31.509203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba3fdf4f-33ed-41f6-afd3-b503a413ca82 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:31.518908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba3fdf4f-33ed-41f6-afd3-b503a413ca82 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1093 microversion: 2.1 time: 0.070958 Oct 06 13:36:31.519585 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3240/6496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:31 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:32.542711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:32.543529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:32.550111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:32.550736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:32.551974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:32.552692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:32.553174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:32.553607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:32.626070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:32.641644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6243bb50-8f90-47c5-88e8-7c767fbf2eda tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1191 microversion: 2.1 time: 0.103518 Oct 06 13:36:32.642755 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3257/6497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:32 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:36:33.667942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:33.670154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:33.681598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:33.682401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:33.682989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:33.683853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:33.684411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:33.684978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:33.863398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:33.873476 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-57ece284-a844-4b4f-9ad0-ca82fe27b427 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1277 microversion: 2.1 time: 0.210499 Oct 06 13:36:33.874186 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3241/6498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:33 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:34.698927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23", "tag": "a702ec01-4d04-411a-9c91-182b6c87217a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:34.711743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:34.713033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:34.713833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:34.727130 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] Creating event network-changed:a702ec01-4d04-411a-9c91-182b6c87217a for instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 on n-h2-860556-1 Oct 06 13:36:34.734637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d688bd5b-1fd1-4721-8052-4cf1d2dd781d req-53d1ea51-ef4c-4221-bd6f-7635b55b0d3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038797 Oct 06 13:36:34.735960 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3258/6499] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:36:34.904697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:34.906259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:34.916148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:34.917217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:34.917905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:34.919286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:34.921517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:34.922174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:35.149034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:35.165008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7121daba-f8f9-46ad-83bc-55b686431732 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1277 microversion: 2.1 time: 0.267783 Oct 06 13:36:35.181768 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3242/6500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:34 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:36.194198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:36.195200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:36.203617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:36.204237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:36.204892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:36.205681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:36.206377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:36.206877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:36.372168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:36.382102 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-87a541ca-f8cb-4c4e-8477-a1051fc9c918 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1277 microversion: 2.1 time: 0.192915 Oct 06 13:36:36.382940 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3259/6501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:36 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:37.406560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:37.407756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:37.416276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:37.416791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:37.417417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:37.418184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:37.418661 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:37.419107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:37.588642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:37.597242 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be5da4c2-7ee9-4430-9178-fc323b4497be tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1277 microversion: 2.1 time: 0.194665 Oct 06 13:36:37.598009 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3243/6502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:37 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:38.620452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:38.621053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:38.628287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:38.629342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:38.629812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:38.630630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:38.631208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:38.631648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:38.786757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:38.796718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c67f266d-e51e-4f08-bb62-c7288dc3200f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.180170 Oct 06 13:36:38.797322 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3260/6503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:38 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:39.826783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:39.827886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:39.835425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:39.835947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:39.836412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:39.837152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:39.837630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:39.838109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:39.995716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:40.004383 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-562ce08d-558d-47f2-a449-5b22560a3dc7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.180980 Oct 06 13:36:40.005247 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3244/6504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:39 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:41.027722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:41.028388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:41.035522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:41.036004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:41.036438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:41.037128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:41.037584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:41.038037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:41.182092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:41.190142 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2edfe348-61ee-4a8c-9c57-13f6b07277ce tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.166352 Oct 06 13:36:41.192376 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3261/6505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:41 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:42.213651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:42.214351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:42.217026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:42.223948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:42.224742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:42.225208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:42.226167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:42.226745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:42.227196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:42.384560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:42.392530 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6b612ee3-f30f-47cb-abe1-7d6712341d45 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.182765 Oct 06 13:36:42.393120 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3245/6506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:42 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:43.415514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:43.416133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:43.418157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:43.418818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:43.426457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:43.427124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:43.427362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:43.428101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:43.428560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:43.428988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:43.577132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:43.585678 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6bbb4120-3cf1-4f6d-b4b8-e1307637af88 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.174068 Oct 06 13:36:43.586322 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3262/6507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:43 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:44.610935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:44.612064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:44.620866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:44.621587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:44.622090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:44.622833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:44.623312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:44.623763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:44.761687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:44.770728 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8efeee94-fe84-4973-ac98-2a2d040520ba tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.165588 Oct 06 13:36:44.771358 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3246/6508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:44 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:45.794310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:45.795102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:45.803881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:45.804550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:45.804958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:45.805857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:45.806319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:45.806794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:45.960979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:45.969060 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8968b51-fe71-4f56-9489-401774bb5880 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.178799 Oct 06 13:36:45.969683 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3263/6509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:45 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:46.992971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:46.993748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:47.001055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:47.001655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:47.002149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:47.002895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:47.003371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:47.004421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:47.146034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:47.154235 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d908d1d1-6924-47d5-b394-44b3fcd299fa tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.165915 Oct 06 13:36:47.154818 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3247/6510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:46 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:48.177550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:48.178217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:48.185416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:48.185942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:48.186387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:48.187096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:48.187558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:48.187992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:48.343719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:48.354312 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-004f6f51-e9c1-4b62-b408-8ab83b1caaab tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.181453 Oct 06 13:36:48.354985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3264/6511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:48 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:36:48.496111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23", "name": "network-vif-plugged", "status": "completed", "tag": "a702ec01-4d04-411a-9c91-182b6c87217a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:48.506060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:48.506560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:48.507278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:48.519645 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] Creating event network-vif-plugged:a702ec01-4d04-411a-9c91-182b6c87217a for instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 on n-h2-860556-1 Oct 06 13:36:48.524883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ea861199-ef38-4e45-b6f6-1f3d0adf9049 req-8d3a7b84-81c3-42c0-8589-61dd609d4350 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127279 Oct 06 13:36:48.525491 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3248/6512] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:36:49.377921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:49.380179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:49.386904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:49.387544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:49.388063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:49.388877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:49.389419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:49.389963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:49.538672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:49.546699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c5f66e25-4810-418c-b818-43f3edf2bced tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1265 microversion: 2.1 time: 0.172805 Oct 06 13:36:49.547290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3265/6513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:49 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:50.573190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:50.573934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:50.580304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:50.580808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:50.581288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:50.582619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:50.583098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:50.583545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:50.726127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:50.734245 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92744df4-e5f7-47fb-927a-914fd18c2ec2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1452 microversion: 2.1 time: 0.166309 Oct 06 13:36:50.734840 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3249/6514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:50 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:50.757236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:36:50.757876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:36:50.764626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:50.765105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:50.765541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:50.766262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:50.766716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:50.767140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:50.908853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:36:50.917948 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6c7b552-77d3-4cc1-8f6a-11a6a983513c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1452 microversion: 2.1 time: 0.165291 Oct 06 13:36:50.918667 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3266/6515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:36:50 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:36:52.950771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23", "tag": "a702ec01-4d04-411a-9c91-182b6c87217a"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:36:52.967275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=33 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:52.969695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:36:52.970582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:36:52.971368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:36:52.976333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=77 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:36:52.987325 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] Creating event network-changed:a702ec01-4d04-411a-9c91-182b6c87217a for instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 on n-h2-860556-1 Oct 06 13:36:52.994232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-83e5bb99-4cec-412d-b721-0343040ee8f9 req-a25d3e25-fbf7-4253-aadc-614b11c00ee8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137964 Oct 06 13:36:52.995414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3250/6516] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:37:25.723328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:25.724074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:25.866919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efe70449-4142-448c-9913-454eba035028 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-186576899", "availability_zone": "foo_zone"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:25.870547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.aggregate [None req-efe70449-4142-448c-9913-454eba035028 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Generated uuid acd4cc1b-6fad-43fa-bfef-cf6ced1dbd57 for aggregate {{(pid=129615) create /opt/stack/nova/nova/objects/aggregate.py:305}} Oct 06 13:37:25.898945 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efe70449-4142-448c-9913-454eba035028 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.181947 Oct 06 13:37:25.899652 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3267/6517] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Oct 6 13:37:25 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:25.909328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:25.910124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:25.914582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30aaceb6-fbe4-49d9-bc71-f6d96c065613 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:25.926287 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30aaceb6-fbe4-49d9-bc71-f6d96c065613 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] [fb2b4302-a92b-446b-82c7-f28357b34b0e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:37:26.943016 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [None req-30aaceb6-fbe4-49d9-bc71-f6d96c065613 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] [fb2b4302-a92b-446b-82c7-f28357b34b0e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 44568. Oct 06 13:37:26.983797 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30aaceb6-fbe4-49d9-bc71-f6d96c065613 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.075747 Oct 06 13:37:26.991010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3251/6518] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 13:37:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.001960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:27.006672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:27.007170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:27.007962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:27.009275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:27.009872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:27.010381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:27.058831 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e3b3c8d-9f1a-4a79-bc0c-6ccb159c6d10 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062229 Oct 06 13:37:27.066974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3268/6519] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Oct 6 13:37:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.072688 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3444e52-5c02-4694-9b91-acd974765a69 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:27.080427 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3444e52-5c02-4694-9b91-acd974765a69 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.011585 Oct 06 13:37:27.081062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3252/6520] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Oct 6 13:37:27 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:37:27.101591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ed3534f-c7a6-4c1b-b4fe-9dde6c27339c tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860556-1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:27.116065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ed3534f-c7a6-4c1b-b4fe-9dde6c27339c tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:27.116708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ed3534f-c7a6-4c1b-b4fe-9dde6c27339c tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:27.117228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ed3534f-c7a6-4c1b-b4fe-9dde6c27339c tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:27.448215 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ed3534f-c7a6-4c1b-b4fe-9dde6c27339c tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.358400 Oct 06 13:37:27.449302 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3269/6521] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 13:37:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.465392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95069a7d-96f8-4911-8786-209a1b6c4a0e tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:27.474279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95069a7d-96f8-4911-8786-209a1b6c4a0e tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013671 Oct 06 13:37:27.474870 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3253/6522] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:37:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:37:27.488167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-35558ac0-700d-425c-a580-b086b7ac28a1 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-401447263", "availability_zone": "foo_zone"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:27.540509 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-35558ac0-700d-425c-a580-b086b7ac28a1 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.057847 Oct 06 13:37:27.541969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3270/6523] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Oct 6 13:37:27 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.554353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0c9e2e03-d6f0-4840-be57-fd7f7ee54df7 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:27.589707 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0c9e2e03-d6f0-4840-be57-fd7f7ee54df7 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.040863 Oct 06 13:37:27.590529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3254/6524] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 13:37:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.602128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da9d8811-f1d5-4051-8886-b28f037300d0 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:27.610702 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da9d8811-f1d5-4051-8886-b28f037300d0 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.012547 Oct 06 13:37:27.612762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3271/6525] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Oct 6 13:37:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.623910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cae7991d-9921-4763-bcee-2851c2f9a246 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860556-1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:27.636491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cae7991d-9921-4763-bcee-2851c2f9a246 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:27.637231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cae7991d-9921-4763-bcee-2851c2f9a246 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:27.638110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cae7991d-9921-4763-bcee-2851c2f9a246 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:27.844425 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cae7991d-9921-4763-bcee-2851c2f9a246 tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.224378 Oct 06 13:37:27.845024 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3255/6526] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Oct 6 13:37:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:27.856930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13ebf1d4-4f74-4cd3-9141-6e57ce7617ad tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:27.881791 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13ebf1d4-4f74-4cd3-9141-6e57ce7617ad tempest-TestAggregatesBasicOps-1237587282 tempest-TestAggregatesBasicOps-1237587282-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.028579 Oct 06 13:37:27.882387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3272/6527] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 13:37:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 06 13:37:46.435330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:46.437668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:46.681274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4cce3baf-2e21-473b-99ba-0f0d20a60971 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Action: 'create', calling method: .version_select at 0x7f7d3de668b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-430587219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeyvXPDA7u3p0N/Jfxq6QM7jMRd2Cc3qZnfgOPveSlNKCR25Wp4T5hI5Uo2ymX6hikGLXLv0dDheSqHifyzvvpKCkmdXH2dv+kDOD/fkjmk/eKMnKIV1qos7tBSEwO9SA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:46.698952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4cce3baf-2e21-473b-99ba-0f0d20a60971 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for project d4e19e5779814af99bcb2e0d5821d2d1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:37:46.706155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4cce3baf-2e21-473b-99ba-0f0d20a60971 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for user 9d59b4f03aea44f9a0b79c1fed74cc16 and project d4e19e5779814af99bcb2e0d5821d2d1. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:37:46.737562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4cce3baf-2e21-473b-99ba-0f0d20a60971 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.304973 Oct 06 13:37:46.738337 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3256/6528] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:37:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:47.860761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:47.861593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:47.862273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:47.866618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1480273799", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-430587219", "security_groups": [{"name": "tempest-secgroup-smoke-345612863"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0a9234e4-09a9-4492-a101-994a75cd9f6f"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:47.980461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] validate_networks() for [('0a9234e4-09a9-4492-a101-994a75cd9f6f', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:37:48.385193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for project d4e19e5779814af99bcb2e0d5821d2d1. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:37:48.390757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for user 9d59b4f03aea44f9a0b79c1fed74cc16 and project d4e19e5779814af99bcb2e0d5821d2d1. Resources: dict_keys(['metadata_items']) {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:37:48.405666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:37:48.406113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:37:48.406599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:37:48.407016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:37:48.407436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:37:48.416172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:48.416657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:48.417096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:48.417862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:48.418326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:48.418757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:48.437769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for project d4e19e5779814af99bcb2e0d5821d2d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:37:48.445347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Getting quotas for user 9d59b4f03aea44f9a0b79c1fed74cc16 and project d4e19e5779814af99bcb2e0d5821d2d1. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:37:48.460762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:37:48.463199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:37:48.514683 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cabb4f64-d8e4-4f83-a7da-621c81d5f4eb tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.656029 Oct 06 13:37:48.515400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3273/6529] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:37:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:37:48.528074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a1b8ba15-00b4-4d56-bb5c-b8ac29f79550 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:48.529552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a1b8ba15-00b4-4d56-bb5c-b8ac29f79550 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:48.606035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a1b8ba15-00b4-4d56-bb5c-b8ac29f79550 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:48.615155 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a1b8ba15-00b4-4d56-bb5c-b8ac29f79550 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1302 microversion: 2.1 time: 0.091812 Oct 06 13:37:48.616385 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3257/6530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:48 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:49.639148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:49.639892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:49.648087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:49.648587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:49.649028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:49.649769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:49.650364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:49.650805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:49.731691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:49.739932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00ed6c77-6b29-432f-9c27-4a534622ae91 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1354 microversion: 2.1 time: 0.104669 Oct 06 13:37:49.740531 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3274/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:49 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:50.765120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:50.765913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:50.788862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:50.790847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:50.791511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:50.792441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:50.793077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:50.793679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:51.045233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:51.056362 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2f02fa97-322d-45e5-9d1f-001c9ceb85e8 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.295068 Oct 06 13:37:51.057589 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3258/6532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:50 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:37:51.722114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691a5f01-20a1-478e-8a99-07115b6453b4", "tag": "f53f857b-43ae-4fa0-ac2e-899dbf3950a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:51.751005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:51.751826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:51.752508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:51.766280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] Creating event network-changed:f53f857b-43ae-4fa0-ac2e-899dbf3950a9 for instance 691a5f01-20a1-478e-8a99-07115b6453b4 on n-h1-860556-1 Oct 06 13:37:51.777872 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a080cf5d-4e8d-4fad-97fe-cac9d3344d3f req-7bfe2430-30d6-4bdf-99a9-e9cc06ba6c14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062139 Oct 06 13:37:51.778483 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3275/6533] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:52.084350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:52.085161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:52.094399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:52.094947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:52.095400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:52.096669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:52.097139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:52.097583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:52.310785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:52.319507 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-46964fb1-4209-46f0-99da-3c066160dde6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.242150 Oct 06 13:37:52.320133 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3259/6534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:52 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:53.344465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:53.345263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:53.351397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:53.351876 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:53.352312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:53.352997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:53.353448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:53.353924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:53.570464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:53.578406 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2631b431-07fc-4054-acd8-c0c73f89bd5f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.239024 Oct 06 13:37:53.578987 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3276/6535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:53 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:54.600499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:54.601135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:54.608146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:54.608663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:54.609126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:54.609890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:54.610371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:54.610833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:54.749500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:54.759625 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5570cbbc-c177-4418-890a-df05923f4992 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.162859 Oct 06 13:37:54.760225 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3260/6536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:54 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:55.783125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:55.783692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:55.790539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:55.791027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:55.791467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:55.792166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:55.792625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:55.793048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:55.931910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:55.940505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1c67716-e62c-49fd-a78b-d1711ed3a7d3 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.161338 Oct 06 13:37:55.941312 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3277/6537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:55 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:56.062964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691a5f01-20a1-478e-8a99-07115b6453b4", "name": "network-vif-plugged", "status": "completed", "tag": "f53f857b-43ae-4fa0-ac2e-899dbf3950a9"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:37:56.078241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:56.078821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:56.079346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:56.092070 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] Creating event network-vif-plugged:f53f857b-43ae-4fa0-ac2e-899dbf3950a9 for instance 691a5f01-20a1-478e-8a99-07115b6453b4 on n-h1-860556-1 Oct 06 13:37:56.097524 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-735db456-edee-4999-9ad6-3450eac910ce req-68ddf5e3-7d6e-416d-a435-6fbe4a7ef569 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Oct 06 13:37:56.098327 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3261/6538] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:37:56.965165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:56.965750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:56.972397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:56.972888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:56.973328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:56.974072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:56.974534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:56.974972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:57.125464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:57.134715 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4578b5d-3b50-42b9-9df4-0a73c6e676ec tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1427 microversion: 2.1 time: 0.173413 Oct 06 13:37:57.134715 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3278/6539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:56 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:58.161063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:58.161889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:58.168919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.169420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.169911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.170620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.171098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.171535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.307643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:58.315687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4d1752f-40f5-4a69-9888-b9ea261dbfbd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1607 microversion: 2.1 time: 0.161389 Oct 06 13:37:58.316264 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3262/6540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:58 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1607 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:58.338352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:58.338974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:58.345956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.346445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.346886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.348447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.349198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.349641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.424304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:58.453012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:58.484861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:58.493023 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-03825fed-dc70-4876-ab22-bc8f057c7027 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1607 microversion: 2.1 time: 0.158502 Oct 06 13:37:58.493631 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3279/6541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:58 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1607 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:37:58.515152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:37:58.515784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:37:58.523220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.523736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.524195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.524921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:37:58.525395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:37:58.525873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:37:58.611295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:37:58.678254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:37:58.686511 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85948f81-ee8c-4c28-b01a-2bdb8f3d1824 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1607 microversion: 2.1 time: 0.175240 Oct 06 13:37:58.687108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3263/6542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:37:58 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1607 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:00.388921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691a5f01-20a1-478e-8a99-07115b6453b4", "tag": "f53f857b-43ae-4fa0-ac2e-899dbf3950a9"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:38:00.400494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:00.400981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:00.401425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:00.412743 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] Creating event network-changed:f53f857b-43ae-4fa0-ac2e-899dbf3950a9 for instance 691a5f01-20a1-478e-8a99-07115b6453b4 on n-h1-860556-1 Oct 06 13:38:00.417977 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-19651443-ddf0-42cc-9be0-2ca1ea0cb0ca req-a31c6671-e445-443f-bc34-5517bf5d70f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Oct 06 13:38:00.418873 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3280/6543] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:38:38.894740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:38.895786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:38.904226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:38.905330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=32 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:38.916075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:38.917057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:38.917721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:38.918646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:38.919223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:38.919727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:38.961391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-97bd37c4-2b57-4431-bac3-a4a8fbcf5792 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.076236 Oct 06 13:38:38.962908 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3264/6544] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Oct 6 13:38:38 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4/os-server-password => generated 116 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:38:43.363039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:43.363824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:43.368149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1429450064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530459456", "security_groups": [{"name": "tempest-secgroup-smoke-1056352036"}], "block_device_mapping_v2": [{"uuid": "80007e46-b7e1-4295-8351-339e12ef2d2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63a68802-78a7-4997-8f63-6231883d52d5"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:38:43.485666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] validate_networks() for [('63a68802-78a7-4997-8f63-6231883d52d5', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:38:43.903346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:38:43.903774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:38:43.904253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:38:43.904675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:38:43.905100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:38:43.914945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:43.915431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:43.915871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:43.916616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:43.917077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:43.917509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:43.935906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:38:43.941187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Getting quotas for user 9973d8fdad864c6a964200b223370657 and project 0434355208004f72a081529f8f08dbfb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:38:44.004076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:38:44.006408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80007e46-b7e1-4295-8351-339e12ef2d2e',volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:38:44.138484 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-610f0551-2bf6-4c98-a0ae-03a04aa4ba6b tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777915 Oct 06 13:38:44.139220 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3281/6545] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:38:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:38:44.151054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-809edc7c-a316-4a8b-bf84-510f751ec577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:44.151725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-809edc7c-a316-4a8b-bf84-510f751ec577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:44.264540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-809edc7c-a316-4a8b-bf84-510f751ec577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:44.272458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-809edc7c-a316-4a8b-bf84-510f751ec577 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1094 microversion: 2.1 time: 0.125378 Oct 06 13:38:44.272943 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3265/6546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:44 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:38:45.298502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:45.299032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:45.305433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:45.305964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:45.306400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:45.307098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:45.307556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:45.307989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:45.383068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:45.392285 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-50628ec2-fb0c-494c-96c4-9c109124745f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1192 microversion: 2.1 time: 0.098519 Oct 06 13:38:45.393225 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3282/6547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:45 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:46.416601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:46.417403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:46.436380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:46.437086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:46.437654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:46.438530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:46.439123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:46.439676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:46.733065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:46.741551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d24cb5e5-9f84-44f7-aeb7-b3161f6ac73a tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1278 microversion: 2.1 time: 0.329064 Oct 06 13:38:46.755051 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3266/6548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:46 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:47.228485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5912af-b302-435a-ad8b-0434be5f89e6", "tag": "f4a69e99-76dd-481b-9e39-9288930a810b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:38:47.240458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:47.241047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:47.241618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:47.254844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] Creating event network-changed:f4a69e99-76dd-481b-9e39-9288930a810b for instance 4a5912af-b302-435a-ad8b-0434be5f89e6 on n-h2-860556-1 Oct 06 13:38:47.259991 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1829085c-9c30-40d4-9c68-ba89b9ab29b5 req-f45254d8-cf53-46dc-9d16-ce30d0699aaa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037033 Oct 06 13:38:47.260612 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3283/6549] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:38:47.766328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:47.766958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:47.774677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:47.775327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:47.775995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:47.776724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:47.777231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:47.777694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:47.933289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:47.942919 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c9726bb-231e-4bc1-9415-77d274e5c145 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1278 microversion: 2.1 time: 0.180430 Oct 06 13:38:47.943612 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3267/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:47 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:38:48.967548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:48.968374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:48.976097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:48.976591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:48.977035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:48.977783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:48.978308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:48.978740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:49.119837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:49.129528 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bcd24327-d58a-4bc2-b641-e31b26dc37f2 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1278 microversion: 2.1 time: 0.167062 Oct 06 13:38:49.130150 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3284/6551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:48 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:38:50.152635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:50.153258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:50.160759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:50.161257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:50.161711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:50.162808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:50.163056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:50.163551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:50.306651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:50.320562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7732119b-4932-4944-930d-9dc6cd97db25 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1278 microversion: 2.1 time: 0.171710 Oct 06 13:38:50.321321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3268/6552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:50 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:51.344059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:51.344764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:51.351881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:51.352444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:51.352798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:51.353494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:51.353978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:51.354408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:51.491206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:51.499700 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34e72f2f-56db-4077-90f1-caf3468cc7c0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.159714 Oct 06 13:38:51.501094 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3285/6553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:51 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:52.523532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:52.524070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:52.531292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:52.531798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:52.532262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:52.532987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:52.533509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:52.534006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:52.680614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:52.688781 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d0c366a2-de53-4830-9764-925dcb361c8c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.169231 Oct 06 13:38:52.689353 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3269/6554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:52 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:53.712438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:53.713304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:53.724116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:53.724908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:53.725538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:53.726301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:53.727104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:53.727894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:53.926003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:53.949082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:53.973025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:53.982349 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b82fc5e-0626-4238-9990-c42296c8ddf8 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.274796 Oct 06 13:38:53.982946 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3286/6555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:53 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:38:55.007560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:55.008307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:55.010957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:38:55.018716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:55.019862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:55.020525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:55.021344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:55.022023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:55.022314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:55.205382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:55.215691 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-376e6387-9ef0-4a27-acee-db20e9b71f1d tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.212876 Oct 06 13:38:55.216512 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3270/6556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:55 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:38:56.247065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:56.248210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:56.255814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:56.256300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:56.256742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:56.257434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:56.257936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:56.258370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:56.394623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:56.402420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4a484db-2978-42db-87f6-ad14ab9fd915 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.163070 Oct 06 13:38:56.403009 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3287/6557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:56 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:57.424563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:57.425915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:57.432780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:57.433289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:57.434196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:57.434955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:57.436151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:57.436634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:57.582671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:57.591248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65c0b893-b3d0-430a-b58e-13c2de69e914 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.170652 Oct 06 13:38:57.591854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3271/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:57 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:58.614535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:58.615186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:58.622181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:58.622711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:58.623154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:58.623857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:58.624320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:58.624749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:58.768693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:58.777316 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-72f57457-f15c-4f34-a025-c561311ba092 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.166725 Oct 06 13:38:58.777913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3288/6559] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:58 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:38:59.800244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:38:59.800805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:38:59.807848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:59.808361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:59.809097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:59.809863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:38:59.810350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:38:59.810799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:38:59.944520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:38:59.952284 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e0b0090b-a028-445a-ac00-8e931047ba40 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.156050 Oct 06 13:38:59.952852 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3272/6560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:38:59 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:39:00.979196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:39:00.979823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:39:00.987044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:00.988145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:00.988595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:00.989308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:00.989793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:00.990232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:01.036530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5912af-b302-435a-ad8b-0434be5f89e6", "name": "network-vif-plugged", "status": "completed", "tag": "f4a69e99-76dd-481b-9e39-9288930a810b"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:39:01.047940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:01.048455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:01.048918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:01.062606 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] Creating event network-vif-plugged:f4a69e99-76dd-481b-9e39-9288930a810b for instance 4a5912af-b302-435a-ad8b-0434be5f89e6 on n-h2-860556-1 Oct 06 13:39:01.068673 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-24b2b139-57f2-4931-b020-a2d292d643f1 req-faed499d-4261-4e09-8571-04c0a4684ddf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Oct 06 13:39:01.070156 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3273/6561] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:39:01.140820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:39:01.149154 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0e04cdb-6bf1-4d87-aee8-2df330d1acec tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.173895 Oct 06 13:39:01.149782 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3289/6562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:39:00 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:39:02.175497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:39:02.176206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:39:02.182583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:02.183089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:02.183798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:02.184506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:02.184977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:02.185417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:02.325865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:39:02.333814 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e690f093-3f71-482a-9ed2-5fa81948b300 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1266 microversion: 2.1 time: 0.164965 Oct 06 13:39:02.334403 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3274/6563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:39:02 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:39:03.357499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:39:03.358131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:39:03.365830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:03.366341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:03.366776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:03.367486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:03.367950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:03.368384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:03.498172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:39:03.505950 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6416c8d5-d720-46db-bf4d-2341303c8e2c tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1453 microversion: 2.1 time: 0.152956 Oct 06 13:39:03.506531 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3290/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:39:03 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:39:03.528269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:39:03.528901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:39:03.536636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:03.537132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:03.537585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:03.538398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:03.538866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:03.539307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:03.678019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:39:03.687001 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7cc00cb9-a0b3-4880-bf14-e51ea2ab6386 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1453 microversion: 2.1 time: 0.162785 Oct 06 13:39:03.687582 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3275/6565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:39:03 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:39:05.622269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5912af-b302-435a-ad8b-0434be5f89e6", "tag": "f4a69e99-76dd-481b-9e39-9288930a810b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:39:05.633449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:39:05.633960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:39:05.635562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:39:05.645633 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] Creating event network-changed:f4a69e99-76dd-481b-9e39-9288930a810b for instance 4a5912af-b302-435a-ad8b-0434be5f89e6 on n-h2-860556-1 Oct 06 13:39:05.650941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-8bdadc3a-ce20-4d94-af22-8e8a621fea87 req-182777bc-d87e-4eab-98ad-c4a34eb750cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Oct 06 13:39:05.654698 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3291/6566] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:40:45.268764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:45.270283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:45.270951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:40:45.271766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=54 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:40:45.273224 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:40:45.273371 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 13:40:45.277245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=26 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:40:45.278433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=60 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:40:45.279739 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:40:45.279739 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 (ip 10.222.0.26) !!! Oct 06 13:40:45.281359 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 13:40:45.281523 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 (ip 10.222.0.26) !!! Oct 06 13:40:45.292685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:45.293276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:45.293539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5912af-b302-435a-ad8b-0434be5f89e6", "tag": "f4a69e99-76dd-481b-9e39-9288930a810b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:40:45.293906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:45.294706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:45.295392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:45.295925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:45.308261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:45.308743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:45.309172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:45.321639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] Creating event network-changed:f4a69e99-76dd-481b-9e39-9288930a810b for instance 4a5912af-b302-435a-ad8b-0434be5f89e6 on n-h2-860556-1 Oct 06 13:40:45.327065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dd5e385f-5d05-4edf-91d6-8326e7ea35f0 req-b5efd5eb-2c27-4a13-9210-4f04eac007f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064322 Oct 06 13:40:45.327967 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3292/6567] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:40:45.329463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:40:45.420053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc612c31-9e68-4987-b01b-a47c581805bb tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 204 len: 0 microversion: 2.1 time: 0.159041 Oct 06 13:40:45.421663 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3276/6568] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:40:45 2022] DELETE /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:40:45.431554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:45.432378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:45.439324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:45.439817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:45.440265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:45.440970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:45.441432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:45.441895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:45.590649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:45.598618 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-817d5f1e-4460-47cf-844d-bcbaa8a84709 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1578 microversion: 2.1 time: 0.171277 Oct 06 13:40:45.599196 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3293/6569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:45 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:46.622867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:46.623578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:46.631606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:46.632108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:46.632559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:46.633541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:46.634053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:46.634519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:46.774211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:46.783671 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18fb4bdd-d193-4dd0-b61f-b8bc847a8411 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1578 microversion: 2.1 time: 0.165577 Oct 06 13:40:46.784390 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3277/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:46 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:47.746362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5912af-b302-435a-ad8b-0434be5f89e6", "name": "network-vif-deleted", "tag": "f4a69e99-76dd-481b-9e39-9288930a810b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:40:47.756620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:47.757108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:47.757545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:47.769483 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] Creating event network-vif-deleted:f4a69e99-76dd-481b-9e39-9288930a810b for instance 4a5912af-b302-435a-ad8b-0434be5f89e6 on n-h2-860556-1 Oct 06 13:40:47.774496 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-421d5483-4d50-462c-bbfd-64c801b91236 req-83345d4b-0c6f-4c8e-a059-da5eb5a958af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Oct 06 13:40:47.775145 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3294/6571] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:40:47.808106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:47.808746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:47.816752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:47.817365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:47.817935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:47.818759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:47.819315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:47.819852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:47.885563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:47.894391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f2b28764-2bcb-41e2-b3f9-1cd25e6374fc tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1225 microversion: 2.1 time: 0.090733 Oct 06 13:40:47.894968 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3278/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:47 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:48.919815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:48.920402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:48.926633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:48.927115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:48.927549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:48.928240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:48.928695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:48.929122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:48.993442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:49.001280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e3c41f73-f9a9-4e38-a183-57b6c6a527b7 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1225 microversion: 2.1 time: 0.087233 Oct 06 13:40:49.002095 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3295/6573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:48 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:50.023214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:50.023879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:50.031230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:50.031745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:50.032205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:50.032933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:50.033409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:50.033960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:50.100467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:50.108923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e9e911a-b6db-4ff6-856f-147d710dc060 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1225 microversion: 2.1 time: 0.089625 Oct 06 13:40:50.109509 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3279/6574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:50 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:51.132176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:51.132918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:51.140726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:51.141215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:51.141666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:51.142386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:51.142836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:51.143260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:51.209387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:51.218031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a20868f-8068-4004-8e97-b4fa2545f24f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1225 microversion: 2.1 time: 0.089651 Oct 06 13:40:51.218618 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3296/6575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:51 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:40:52.240558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:52.241196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:52.248502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:52.249022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:52.249538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:52.250254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:52.250734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:52.251247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:52.285300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:52.285834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:52.286295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:52.286793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lazy-loading 'fault' on Instance uuid 4a5912af-b302-435a-ad8b-0434be5f89e6 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:40:52.334048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:40:52.344187 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b89a017f-481c-448e-bffb-5139cf7020f1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 200 len: 1230 microversion: 2.1 time: 0.107519 Oct 06 13:40:52.345096 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3280/6576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:52 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:40:53.369246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:40:53.369893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 4a5912af-b302-435a-ad8b-0434be5f89e6] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:40:53.377154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:53.377644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:53.378111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:53.378819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:40:53.379276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:40:53.379704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:40:53.655830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 HTTP/1.1 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '4a5912af-b302-435a-ad8b-0434be5f89e6'} Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:40:53.657434 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 4a5912af-b302-435a-ad8b-0434be5f89e6 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b09b0184-badc-4391-b9ca-6f5d139582fd tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6" status: 404 len: 111 microversion: 2.1 time: 0.294122 Oct 06 13:40:53.661559 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3297/6577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:40:53 2022] GET /compute/v2.1/servers/4a5912af-b302-435a-ad8b-0434be5f89e6 => generated 111 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:41:00.230108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:00.230899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:00.238738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:00.239245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:00.239701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:00.240423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:00.240893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:00.241097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23", "tag": "a702ec01-4d04-411a-9c91-182b6c87217a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:41:00.241524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:00.253085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:00.253667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:00.254489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:00.266430 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] Creating event network-changed:a702ec01-4d04-411a-9c91-182b6c87217a for instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 on n-h2-860556-1 Oct 06 13:41:00.268964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:41:00.271591 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1510914c-81be-43bf-8513-c3d7accf8099 req-adc94374-24e8-415a-b43a-dd00cfbe9325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034878 Oct 06 13:41:00.272192 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3298/6578] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:41:00.362720 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aad01b5d-ab15-49b8-ad22-9e89b658cd59 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 204 len: 0 microversion: 2.1 time: 0.136890 Oct 06 13:41:00.363649 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3281/6579] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:41:00 2022] DELETE /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:41:00.372972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:00.373680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:00.380186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:00.380674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:00.381100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:00.381831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:00.382285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:00.382866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:00.532809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:00.541485 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d7cc66b0-57a1-40a7-9efa-f8696ea74b14 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1577 microversion: 2.1 time: 0.173338 Oct 06 13:41:00.542131 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3299/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:00 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:41:01.565647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:01.566438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:01.574430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:01.574941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:01.575398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:01.576125 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:01.576610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:01.577059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:01.719831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:01.728205 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78d371bd-8d78-40e6-aeac-633cf7e379f9 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1577 microversion: 2.1 time: 0.166855 Oct 06 13:41:01.728800 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3282/6581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:01 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:41:02.597605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23", "name": "network-vif-deleted", "tag": "a702ec01-4d04-411a-9c91-182b6c87217a"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:41:02.609077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:02.609568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:02.610029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:02.622582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] Creating event network-vif-deleted:a702ec01-4d04-411a-9c91-182b6c87217a for instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 on n-h2-860556-1 Oct 06 13:41:02.628299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-92e7b90a-bb1b-4571-ac6e-2ad57fbcbb53 req-ea31238b-b381-4947-807d-0fb5d5780791 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Oct 06 13:41:02.628928 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3300/6582] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:41:02.751854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:02.752497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:02.759580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:02.760093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:02.760556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:02.761352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:02.761857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:02.762311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:02.836959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:02.845489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b15e50e3-aebb-4a2d-a63b-2597bc510cb0 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1224 microversion: 2.1 time: 0.097607 Oct 06 13:41:02.846108 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3283/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:02 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:41:03.870522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:03.871226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:03.877692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:03.878221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:03.878663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:03.879368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:03.879828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:03.880263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:03.943555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:03.951636 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90c509b4-4d83-4dbf-b8ea-34e3d7aabd92 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1224 microversion: 2.1 time: 0.086771 Oct 06 13:41:03.952223 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3301/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:03 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:41:04.974762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:04.975404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:04.985340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:04.985928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:04.986401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:04.987155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:04.987671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:04.988160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:05.057846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:05.066684 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0a5f50a4-e216-4139-af57-1177bb2aeb52 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1224 microversion: 2.1 time: 0.095563 Oct 06 13:41:05.067452 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3284/6585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:04 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:41:06.091032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:06.091692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:06.099090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:06.099678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:06.100119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:06.100962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:06.101458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:06.101924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:06.166258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9973d8fdad864c6a964200b223370657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0434355208004f72a081529f8f08dbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:41:06.175650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3ce28fe-1a8b-4ae9-ab63-d0e3a26f0279 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 200 len: 1224 microversion: 2.1 time: 0.089375 Oct 06 13:41:06.176442 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3302/6586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:06 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:41:07.199400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:07.200731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:07.208272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.208778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.209236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.209994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.210471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.210916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.225692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 HTTP/1.1 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23'} Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.227517 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c3f4872d-2942-49ef-8563-b5919cb42806 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23" status: 404 len: 111 microversion: 2.1 time: 0.034657 Oct 06 13:41:07.231872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3285/6587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:07 2022] GET /compute/v2.1/servers/6ed4ab3a-bad5-4ca5-a45a-6a1f5a944b23 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:41:07.678519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:07.679032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:07.686194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.686688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.687549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.688252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.688714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.689162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.702958 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f HTTP/1.1 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '82dfab66-5a12-4538-8230-103539b52c8f'} Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:41:07.704624 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8319ddb3-6514-4cdc-a06a-774d727ad0a1 tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 404 len: 111 microversion: 2.1 time: 0.031487 Oct 06 13:41:07.708536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3303/6588] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:41:07 2022] DELETE /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:41:07.715579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:07.716355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] [instance: 82dfab66-5a12-4538-8230-103539b52c8f] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:41:07.722488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.722997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.723460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.724177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:41:07.724659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:41:07.725120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:41:07.738700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] HTTP exception thrown: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Request method failure captured: Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f HTTP/1.1 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtgazQw6Gh_dnoeNu4JSdp6YUUJRF6lbDVF2MV66dfaYSMXrb1H0sSWsecNSKPK7s08wlzTLQuOdPkDaQIbIR14QEjgglSxWgrPiXwzJ6TsqCfDZ3F4zHI3XVlo0PrNedphvUrfx5AAk5Aq4-4kgx5An0c-j2M94lAhwElFuO4AwYA4 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0434355208004f72a081529f8f08dbfb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0434355208004f72a081529f8f08dbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0434355208004f72a081529f8f08dbfb"}]}] Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0434355208004f72a081529f8f08dbfb Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestVolumeBootPattern-1286436199 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9973d8fdad864c6a964200b223370657 Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestVolumeBootPattern-1286436199-project Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '82dfab66-5a12-4538-8230-103539b52c8f'} Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:41:07.740249 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Returning 404 to user: Instance 82dfab66-5a12-4538-8230-103539b52c8f could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e553373-0b49-44c6-8f6e-fd1008546dac tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f" status: 404 len: 111 microversion: 2.1 time: 0.030699 Oct 06 13:41:07.745093 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3286/6589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:41:07 2022] GET /compute/v2.1/servers/82dfab66-5a12-4538-8230-103539b52c8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:41:11.170688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-646474bf-27bd-47ba-be06-fd1bd3b43b4f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] Calling method '.version_select at 0x7f7d3de86e50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:41:11.200732 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-646474bf-27bd-47ba-be06-fd1bd3b43b4f tempest-TestVolumeBootPattern-1286436199 tempest-TestVolumeBootPattern-1286436199-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530459456" status: 202 len: 0 microversion: 2.1 time: 0.033609 Oct 06 13:41:11.205351 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3304/6590] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Oct 6 13:41:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530459456 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:42:42.515383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:42:42.516121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:42:42.522350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:42.522919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:42.531745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:42.532347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:42.532798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:42.533552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:42.534056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:42.534502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:42.565718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:42:42.653789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-26c05d9e-816d-4f48-89bc-154f750edb1c tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "DELETE /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 204 len: 0 microversion: 2.1 time: 0.140346 Oct 06 13:42:42.654513 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3287/6591] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:42:42 2022] DELETE /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:42:42.661305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=48 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:42:42.662801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:42:42.663688 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:42:42.663834 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 (ip 10.222.0.26) !!! Oct 06 13:42:42.670303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:42.670936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:42.680828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:42.681391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:42.681902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:42.682615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:42.683083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:42.683583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:42.833677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:42:42.841671 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-172e4e6d-83a9-4730-81ff-bd7e568b2fde tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1730 microversion: 2.1 time: 0.182760 Oct 06 13:42:42.842371 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3305/6592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:42:42 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:42:43.866894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:43.867619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:43.875299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:43.875766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:43.876221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:43.877020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:43.877489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:43.878033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:44.023451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:42:44.031464 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcfa276c-9039-4370-a5d9-b6cbea9039a6 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1730 microversion: 2.1 time: 0.170040 Oct 06 13:42:44.032042 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3288/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:42:43 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:42:45.056205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:45.056939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:45.064479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:45.065008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:45.065535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:45.066302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:45.066767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:45.067201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:45.455558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d59b4f03aea44f9a0b79c1fed74cc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e19e5779814af99bcb2e0d5821d2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:42:45.465423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eff1f85d-6e23-48d8-a5fc-7ba2e44c4291 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 200 len: 1663 microversion: 2.1 time: 0.413022 Oct 06 13:42:45.466074 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3306/6594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:42:45 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 1663 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:42:45.807758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691a5f01-20a1-478e-8a99-07115b6453b4", "name": "network-vif-deleted", "tag": "f53f857b-43ae-4fa0-ac2e-899dbf3950a9"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:42:45.823382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:45.823940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:45.824420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:45.836324 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] Creating event network-vif-deleted:f53f857b-43ae-4fa0-ac2e-899dbf3950a9 for instance 691a5f01-20a1-478e-8a99-07115b6453b4 on n-h1-860556-1 Oct 06 13:42:45.842081 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0cde2622-634f-4b51-aa41-2f06378ee979 req-eb642894-25e5-4967-944c-9bc4ab7ee9a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198641 Oct 06 13:42:45.842679 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3289/6595] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:42:46.488501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:46.489119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:46.496464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:46.496986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:46.497395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:46.498142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:46.498599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:46.499024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:46.514415 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] HTTP exception thrown: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Request method failure captured: Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 HTTP/1.1 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtolCTea8EbYhw6XaZGVJF5WKStK0AER-Dpnafe6bEKzztJ0LsXd_1sBVVP2zLt1il9Z46quwbd-IJ2PShF9Kr9TrEbqd2fzKwBMN1FdiAqj6CbeQ97diIjektzTD6RCBy-ZK-7XqUEuIZLZ5cSv08RQDgj2mANwHqkI1DHycC1FAI4 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d4e19e5779814af99bcb2e0d5821d2d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}] Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9d59b4f03aea44f9a0b79c1fed74cc16 Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '691a5f01-20a1-478e-8a99-07115b6453b4'} Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:46.516110 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Returning 404 to user: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10f3affa-aa59-4390-a6b1-e785d7fbb2dd tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 404 len: 111 microversion: 2.1 time: 0.033044 Oct 06 13:42:46.519985 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3307/6596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:42:46 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:42:47.103193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:47.103795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:47.110134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:47.110634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:47.111086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:47.111920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:47.112396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:47.112837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:47.127124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] HTTP exception thrown: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Request method failure captured: Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 HTTP/1.1 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtolCTea8EbYhw6XaZGVJF5WKStK0AER-Dpnafe6bEKzztJ0LsXd_1sBVVP2zLt1il9Z46quwbd-IJ2PShF9Kr9TrEbqd2fzKwBMN1FdiAqj6CbeQ97diIjektzTD6RCBy-ZK-7XqUEuIZLZ5cSv08RQDgj2mANwHqkI1DHycC1FAI4 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d4e19e5779814af99bcb2e0d5821d2d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}] Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 9d59b4f03aea44f9a0b79c1fed74cc16 Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '691a5f01-20a1-478e-8a99-07115b6453b4'} Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:42:47.128786 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Returning 404 to user: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a09e3d4e-cbfc-46f6-a7c4-937b898e59e7 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "DELETE /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 404 len: 111 microversion: 2.1 time: 0.137259 Oct 06 13:42:47.133552 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3290/6597] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:42:46 2022] DELETE /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:42:47.141510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:47.142389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] [instance: 691a5f01-20a1-478e-8a99-07115b6453b4] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:42:47.151588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:47.152258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:47.152912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:47.153939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:42:47.154455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:42:47.154889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:42:47.169238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] HTTP exception thrown: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Request method failure captured: Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 HTTP/1.1 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtolCTea8EbYhw6XaZGVJF5WKStK0AER-Dpnafe6bEKzztJ0LsXd_1sBVVP2zLt1il9Z46quwbd-IJ2PShF9Kr9TrEbqd2fzKwBMN1FdiAqj6CbeQ97diIjektzTD6RCBy-ZK-7XqUEuIZLZ5cSv08RQDgj2mANwHqkI1DHycC1FAI4 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d4e19e5779814af99bcb2e0d5821d2d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d4e19e5779814af99bcb2e0d5821d2d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d4e19e5779814af99bcb2e0d5821d2d1"}]}] Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: d4e19e5779814af99bcb2e0d5821d2d1 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestServerBasicOps-2128643956 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 9d59b4f03aea44f9a0b79c1fed74cc16 Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestServerBasicOps-2128643956-project Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '691a5f01-20a1-478e-8a99-07115b6453b4'} Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:42:47.170745 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Returning 404 to user: Instance 691a5f01-20a1-478e-8a99-07115b6453b4 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0eeb12b-a4d5-4624-a4af-d0d95ed7aed1 tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4" status: 404 len: 111 microversion: 2.1 time: 0.036983 Oct 06 13:42:47.175223 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3308/6598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:42:47 2022] GET /compute/v2.1/servers/691a5f01-20a1-478e-8a99-07115b6453b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:42:47.342775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef7ff1bf-d35d-4074-b84c-ac1d6594dd9f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] Calling method '.version_select at 0x7f7d3deba670>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:42:47.369541 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef7ff1bf-d35d-4074-b84c-ac1d6594dd9f tempest-TestServerBasicOps-2128643956 tempest-TestServerBasicOps-2128643956-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-430587219" status: 202 len: 0 microversion: 2.1 time: 0.030597 Oct 06 13:42:47.370051 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3291/6599] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Oct 6 13:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-430587219 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:43:06.105307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:06.106195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=16 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:06.222798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1842181059", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:06.279837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] validate_networks() for None {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:43:06.567080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:43:06.567547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:43:06.568027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:43:06.568441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:43:06.568864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:43:06.577903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:06.578392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:06.578849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:06.579562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:06.580025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:06.580452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:06.597715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Getting quotas for project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:43:06.603513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Getting quotas for user a548f5f5a276407d8c6dbb14889b70e2 and project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:43:06.615774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:43:06.618096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:43:06.663834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7e3ecf2e-793a-4bbc-9ffd-4e2a2cf4ed4f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563417 Oct 06 13:43:06.664490 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3309/6600] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:43:06.676893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-23068840-762a-4385-a5ee-3da503e74b30 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:06.677657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-23068840-762a-4385-a5ee-3da503e74b30 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:06.683998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:06.684668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:06.741042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-23068840-762a-4385-a5ee-3da503e74b30 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:06.748390 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-23068840-762a-4385-a5ee-3da503e74b30 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1222 microversion: 2.1 time: 0.075237 Oct 06 13:43:06.748984 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3292/6601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:06 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:07.776597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94cceb87-e05b-4df1-a2e6-ccca47970494 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:07.777779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-94cceb87-e05b-4df1-a2e6-ccca47970494 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:07.839207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94cceb87-e05b-4df1-a2e6-ccca47970494 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:07.846315 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-94cceb87-e05b-4df1-a2e6-ccca47970494 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1222 microversion: 2.1 time: 0.076954 Oct 06 13:43:07.846988 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3310/6602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:07 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:08.870868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-627414dc-1823-483e-bcce-8257622e63b4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:08.871463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-627414dc-1823-483e-bcce-8257622e63b4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:08.925178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-627414dc-1823-483e-bcce-8257622e63b4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:08.932936 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-627414dc-1823-483e-bcce-8257622e63b4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1222 microversion: 2.1 time: 0.066088 Oct 06 13:43:08.933520 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3293/6603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:08 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:09.955694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fffe0736-1a87-4fc3-803a-c5ee31ad8244 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:09.956343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fffe0736-1a87-4fc3-803a-c5ee31ad8244 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:10.011599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fffe0736-1a87-4fc3-803a-c5ee31ad8244 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:10.018738 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fffe0736-1a87-4fc3-803a-c5ee31ad8244 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1222 microversion: 2.1 time: 0.066884 Oct 06 13:43:10.019311 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3311/6604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:09 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:11.042601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:11.043233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:11.050784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:11.051293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:11.051756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:11.052470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:11.052949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:11.053398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:11.114470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:11.122228 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ed39166-235b-41dc-81e1-76534b7f289c tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1226 microversion: 2.1 time: 0.083522 Oct 06 13:43:11.122810 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3294/6605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:11 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:12.144760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:12.146207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:12.154560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:12.155060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:12.155511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:12.156227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:12.157295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:12.157295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:12.238201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:12.247987 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7769673f-aa8f-42b2-89ac-f32131fa11fa tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1280 microversion: 2.1 time: 0.106821 Oct 06 13:43:12.248593 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3312/6606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:12 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:13.271945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:13.272571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:13.280300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:13.280914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:13.281399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:13.282231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:13.282756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:13.283260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:13.519549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:13.533266 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f5aafc2-8d5c-45aa-aa89-622cf691f665 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.265268 Oct 06 13:43:13.534350 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3295/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:13 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:13.667745 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a203c9d-046d-4d07-8e3a-401ff1936b1c", "tag": "da91bd99-b37b-4de1-b42c-bae705966ccd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:13.680347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:13.680997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:13.681360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:13.695192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] Creating event network-changed:da91bd99-b37b-4de1-b42c-bae705966ccd for instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c on n-h2-860556-1 Oct 06 13:43:13.701107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f9fadccb-4368-4516-8ad9-7b351f6b08cf req-25f6343e-d04d-43aa-b6cc-a852fcba5400 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037961 Oct 06 13:43:13.701883 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3313/6608] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:43:14.557191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:14.557720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:14.565107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:14.565612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:14.566102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:14.566820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:14.567336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:14.567780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:14.709440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:14.721667 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a832626d-6506-40f5-b2f4-f87abfcc49d7 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.167837 Oct 06 13:43:14.722430 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3296/6609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:14 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:15.750979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:15.751719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:15.757973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:15.758461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:15.758901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:15.759600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:15.760050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:15.760481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:15.888243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:15.895946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c5d6b56-6b1a-4150-b1bf-f4c5145023d4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.150108 Oct 06 13:43:15.896519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3314/6610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:15 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:16.918585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:16.919342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:16.926302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:16.927330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:16.927782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:16.928484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:16.928952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:16.929419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:17.059573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:17.068293 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-848b7fad-5db1-465d-9bdf-7b9f1dd8c7f4 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.153677 Oct 06 13:43:17.068876 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3297/6611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:16 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:18.091261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:18.091802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:18.093816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:18.101370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:18.101901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:18.102343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:18.103059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:18.103514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:18.103941 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:18.253334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:18.262645 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52fdc527-9b64-4ee2-a17a-9cc45d80c81b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.175251 Oct 06 13:43:18.263268 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3315/6612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:18 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:19.291218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:19.291753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:19.294531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:19.299898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:19.300410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:19.300966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:19.301824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:19.302300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:19.302742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:19.450848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:19.459233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ea93484-1e83-4967-a53b-40478c5c0c8e tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.172214 Oct 06 13:43:19.459814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3298/6613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:19 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:20.218760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:20.286578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a203c9d-046d-4d07-8e3a-401ff1936b1c", "name": "network-vif-plugged", "status": "completed", "tag": "da91bd99-b37b-4de1-b42c-bae705966ccd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:20.296156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:20.296645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:20.297086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:20.308583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] Creating event network-vif-plugged:da91bd99-b37b-4de1-b42c-bae705966ccd for instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c on n-h2-860556-1 Oct 06 13:43:20.313864 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-32c3533e-b684-4da3-ac36-62fd7a74f3b4 req-df8b719e-8afe-4f53-9142-4b1cd41b9d52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105542 Oct 06 13:43:20.314467 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3316/6614] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:20.481353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:20.482654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:20.490381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:20.490907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:20.491362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:20.492109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:20.492585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:20.493033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:20.642670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:20.652419 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-310f0a6d-2c9e-4bdc-8aa4-7fb5a1c42b90 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.175021 Oct 06 13:43:20.653015 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3299/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:20 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:21.677890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:21.678606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:21.685281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:21.685798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:21.686502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:21.687204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:21.687660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:21.688087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:21.826057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:21.834486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-218e7a4c-f1a1-491b-9fe7-a27d18f9664a tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1322 microversion: 2.1 time: 0.161659 Oct 06 13:43:21.834995 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3317/6616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:21 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:22.857102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:22.857721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:22.864576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:22.865068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:22.865516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:22.866315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:22.866789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:22.867227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:22.996215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:23.003933 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-68feee45-a4f9-40ad-9651-779f69bd6475 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1472 microversion: 2.1 time: 0.150734 Oct 06 13:43:23.004515 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3300/6617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:22 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:23.080459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-991183c3-6f14-4804-828f-fa4245478016 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '.version_select at 0x7f7d3dfc1790>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.149784 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-991183c3-6f14-4804-828f-fa4245478016 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/38229e7e2ebf4ffb81ccf1d75a36ed59" status: 200 len: 371 microversion: 2.1 time: 0.124978 Oct 06 13:43:23.150366 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3318/6618] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 13:43:23 2022] GET /compute/v2.1/os-quota-sets/38229e7e2ebf4ffb81ccf1d75a36ed59 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:23.162348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ad9287a9-10d5-434e-97f7-196fe3d17468 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-387160148", "id": 2125584882, "os-flavor-access:is_public": "True"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:23.180966 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ad9287a9-10d5-434e-97f7-196fe3d17468 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022284 Oct 06 13:43:23.181578 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3301/6619] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:43:23 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:23.194842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2125584882"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:23.197205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:23.203311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.203835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.204287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.204989 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.205463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.205957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.397309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1eb9e48d6f6b494eab092a955dd528d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38229e7e2ebf4ffb81ccf1d75a36ed59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:23.403804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-387160148 {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:43:23.410805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.411867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.412309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.413051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.413513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.413968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.437937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Getting quotas for project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'cores', 'ram'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:43:23.443679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Getting quotas for user a548f5f5a276407d8c6dbb14889b70e2 and project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'cores', 'ram'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:43:23.456576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.compute.api [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] ram quota exceeded for 38229e7e2ebf4ffb81ccf1d75a36ed59, tried to resize instance. Oct 06 13:43:23.457131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Request method failure captured: Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action HTTP/1.1 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 39 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPttpeCcK0IYetJpUPj6_jvpYVi0pjkWVRq2_nbeZJQamsFw_IkJMWuUZawpz91T40wf_paRFATg-Ul4rbawX2ZZz1IWNHhJqQpau-xauehZWeKTjTmw_sv7u8nK5io984QhvW6DXozTIMA4Up53cWagGLi_YE6kPTAesNuHGiN-rGLM Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 38229e7e2ebf4ffb81ccf1d75a36ed59 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader,admin Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader,admin Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38229e7e2ebf4ffb81ccf1d75a36ed59", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}] Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 38229e7e2ebf4ffb81ccf1d75a36ed59 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersAdminNegativeTestJSON-270800125-project-admin Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 1eb9e48d6f6b494eab092a955dd528d2 Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270800125-project-admin Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: {"resize": {"flavorRef": "2125584882"}} Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0a203c9d-046d-4d07-8e3a-401ff1936b1c', 'body': {'resize': {'flavorRef': '2125584882'}}} Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.466921 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-07bcecec-f929-44e9-aed2-26e7acfa27f3 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action" status: 403 len: 118 microversion: 2.1 time: 0.278010 Oct 06 13:43:23.471466 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3319/6620] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:43:23 2022] POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action => generated 118 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:43:23.478615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1dc3690-0df0-410b-8812-aea4371653f6 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.495812 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1dc3690-0df0-410b-8812-aea4371653f6 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2125584882" status: 202 len: 0 microversion: 2.1 time: 0.021018 Oct 06 13:43:23.496386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3302/6621] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Oct 6 13:43:23 2022] DELETE /compute/v2.1/flavors/2125584882 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:43:23.504291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca765868-c9ae-4ba3-bfd1-3eb734101141 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.527918 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca765868-c9ae-4ba3-bfd1-3eb734101141 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027272 Oct 06 13:43:23.528485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3320/6622] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:43:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:23.550009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cc56c115-91e8-4988-ba1b-34dd1bc4db78 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '.version_select at 0x7f7d3de66160>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.624428 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cc56c115-91e8-4988-ba1b-34dd1bc4db78 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/38229e7e2ebf4ffb81ccf1d75a36ed59" status: 200 len: 371 microversion: 2.1 time: 0.078007 Oct 06 13:43:23.625004 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3303/6623] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Oct 6 13:43:23 2022] GET /compute/v2.1/os-quota-sets/38229e7e2ebf4ffb81ccf1d75a36ed59 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:23.637617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c8b177df-ed78-4843-bfc4-a8b3ff51993c tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1756052088", "id": 89230901, "os-flavor-access:is_public": "True"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:23.656474 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c8b177df-ed78-4843-bfc4-a8b3ff51993c tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.022794 Oct 06 13:43:23.657228 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3321/6624] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:43:23 2022] POST /compute/v2.1/flavors => generated 431 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:23.669579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "89230901"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:23.672164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:23.678849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.679356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.679813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.680559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.681037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.681484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.827500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1eb9e48d6f6b494eab092a955dd528d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38229e7e2ebf4ffb81ccf1d75a36ed59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:23.833970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1756052088 {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:43:23.841522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.842070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.842529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.843275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.844160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.844300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.871481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Getting quotas for project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:43:23.876674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Getting quotas for user a548f5f5a276407d8c6dbb14889b70e2 and project 10f18cc3645d43b8b2f3cc8753143656. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:43:23.890882 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] cores quota exceeded for 38229e7e2ebf4ffb81ccf1d75a36ed59, tried to resize instance. Oct 06 13:43:23.891450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Request method failure captured: Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action HTTP/1.1 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 37 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPttpeCcK0IYetJpUPj6_jvpYVi0pjkWVRq2_nbeZJQamsFw_IkJMWuUZawpz91T40wf_paRFATg-Ul4rbawX2ZZz1IWNHhJqQpau-xauehZWeKTjTmw_sv7u8nK5io984QhvW6DXozTIMA4Up53cWagGLi_YE6kPTAesNuHGiN-rGLM Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 38229e7e2ebf4ffb81ccf1d75a36ed59 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader,admin Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader,admin Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38229e7e2ebf4ffb81ccf1d75a36ed59", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38229e7e2ebf4ffb81ccf1d75a36ed59"}]}] Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 38229e7e2ebf4ffb81ccf1d75a36ed59 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270800125 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminNegativeTestJSON-270800125-project-admin Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 1eb9e48d6f6b494eab092a955dd528d2 Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270800125-project-admin Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: {"resize": {"flavorRef": "89230901"}} Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0a203c9d-046d-4d07-8e3a-401ff1936b1c', 'body': {'resize': {'flavorRef': '89230901'}}} Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.893465 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-271ed18e-1984-450c-96bc-d48c99217380 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action" status: 403 len: 113 microversion: 2.1 time: 0.229442 Oct 06 13:43:23.898193 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3304/6625] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:43:23 2022] POST /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c/action => generated 113 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:43:23.906408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce1a6ea3-8f48-432d-b3c9-65795bcc3be7 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.925055 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce1a6ea3-8f48-432d-b3c9-65795bcc3be7 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/89230901" status: 202 len: 0 microversion: 2.1 time: 0.022347 Oct 06 13:43:23.925657 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3322/6626] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Oct 6 13:43:23 2022] DELETE /compute/v2.1/flavors/89230901 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:43:23.933769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a6db1a5c-e7a5-4fa3-b78c-e3636d0b65f4 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.954596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a6db1a5c-e7a5-4fa3-b78c-e3636d0b65f4 tempest-ServersAdminNegativeTestJSON-270800125 tempest-ServersAdminNegativeTestJSON-270800125-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024467 Oct 06 13:43:23.955167 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3305/6627] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Oct 6 13:43:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:23.975969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:23.976482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:23.982526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.983022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.983465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:23.984162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:23.984626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:23.985059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:24.010805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:43:24.092639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c89f8477-e1ac-4514-89a1-5e929ba3ad1b tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 204 len: 0 microversion: 2.1 time: 0.120374 Oct 06 13:43:24.093310 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3323/6628] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:43:23 2022] DELETE /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:43:24.101291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:24.102034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:24.108780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:24.109287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:24.109769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:24.110476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:24.110948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:24.111391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:24.241044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:24.248882 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-040e8dc0-0324-4bd2-9f19-e787649c8f81 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1478 microversion: 2.1 time: 0.151523 Oct 06 13:43:24.249450 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3306/6629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:24 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1478 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:25.273927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:25.274558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:25.281223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:25.281720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:25.282199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:25.282939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:25.283409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:25.283847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:25.421503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:25.429360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16853614-e090-43ee-bfe0-2c4636ddbd55 tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1478 microversion: 2.1 time: 0.160509 Oct 06 13:43:25.429966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3324/6630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:25 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:26.216440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a203c9d-046d-4d07-8e3a-401ff1936b1c", "name": "network-vif-deleted", "tag": "da91bd99-b37b-4de1-b42c-bae705966ccd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:26.229195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:26.229824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:26.230281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:26.249047 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] Creating event network-vif-deleted:da91bd99-b37b-4de1-b42c-bae705966ccd for instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c on n-h2-860556-1 Oct 06 13:43:26.254974 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9a42d115-3d0a-46f2-8bec-05cdf4feff52 req-480fe6d2-8fcf-43ae-9281-11ac33ce18a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042193 Oct 06 13:43:26.256102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3307/6631] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:26.454044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:26.454682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:26.462951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:26.463443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:26.463894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:26.464610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:26.465078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:26.465506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:26.499834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:26.500330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:26.500781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:26.501247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lazy-loading 'fault' on Instance uuid 0a203c9d-046d-4d07-8e3a-401ff1936b1c {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:43:26.555254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a548f5f5a276407d8c6dbb14889b70e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f18cc3645d43b8b2f3cc8753143656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:26.564283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eaca13f5-b27b-4864-a35e-7670dea384cc tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 200 len: 1312 microversion: 2.1 time: 0.114103 Oct 06 13:43:26.564880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3325/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:26 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:27.590525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:27.591279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] [instance: 0a203c9d-046d-4d07-8e3a-401ff1936b1c] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:27.597497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:27.598032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:27.598489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:27.599206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:27.599676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:27.600686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:27.615357 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] HTTP exception thrown: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Request method failure captured: Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c HTTP/1.1 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPttpOKtLmgGsoIE6wSJ1aq4p7rn1IVn0HwLso5rtohapON_m6Sj9N_WcPwAKmWlkQba5mb9_CyzJBeIKjOdXXBqqNtBimHpQAqf-xBbOI5v400-cucTSuOlXJczPmHsTLnJ90fLOuVzkfmLkbLLRifdnsnyZ8yXYH_ZZoAmOAdjDTBo Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 10f18cc3645d43b8b2f3cc8753143656 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1010027196 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10f18cc3645d43b8b2f3cc8753143656", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10f18cc3645d43b8b2f3cc8753143656"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10f18cc3645d43b8b2f3cc8753143656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10f18cc3645d43b8b2f3cc8753143656"}]}] Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1010027196 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 10f18cc3645d43b8b2f3cc8753143656 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1010027196 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersAdminNegativeTestJSON-1010027196-project Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: a548f5f5a276407d8c6dbb14889b70e2 Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1010027196-project Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0a203c9d-046d-4d07-8e3a-401ff1936b1c'} Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:27.617053 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] Returning 404 to user: Instance 0a203c9d-046d-4d07-8e3a-401ff1936b1c could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c14da50c-e428-42e3-8b05-d3695709354f tempest-ServersAdminNegativeTestJSON-1010027196 tempest-ServersAdminNegativeTestJSON-1010027196-project] 10.222.0.26 "GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c" status: 404 len: 111 microversion: 2.1 time: 0.034680 Oct 06 13:43:27.621220 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3308/6633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:27 2022] GET /compute/v2.1/servers/0a203c9d-046d-4d07-8e3a-401ff1936b1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:43:33.679665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:33.680589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:33.822478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2104244031", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "094ae610-7c52-48ac-8ce4-46d06ed725ca"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:33.879314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] validate_networks() for [('094ae610-7c52-48ac-8ce4-46d06ed725ca', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:43:34.294826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:43:34.295353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:43:34.296147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:43:34.296591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:43:34.297006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:43:34.309221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:34.310535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:34.310986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:34.312090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:34.312705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:34.313303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:34.332340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Getting quotas for project 772689924ce246d584e49ea04eef1891. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:43:34.338678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Getting quotas for user 64320af9965b446e9151d17f76d8567f and project 772689924ce246d584e49ea04eef1891. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:43:34.352905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:43:34.357391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:43:34.405877 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7aa64d91-6240-41f3-a9d4-be4bd2bb3656 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732413 Oct 06 13:43:34.406577 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3326/6634] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:43:34.418089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd3fd2b3-6815-4413-a253-e9217ae19915 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:34.419117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd3fd2b3-6815-4413-a253-e9217ae19915 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:34.422197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:34.423170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:34.480824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd3fd2b3-6815-4413-a253-e9217ae19915 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:34.488754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd3fd2b3-6815-4413-a253-e9217ae19915 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1215 microversion: 2.1 time: 0.074664 Oct 06 13:43:34.489546 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3309/6635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:34 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:35.511704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:35.512339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:35.520594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:35.521103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:35.522082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:35.522995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:35.523469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:35.523915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:35.629816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:35.639584 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ae1032f-8a68-4cc5-98ac-91bd56fa23df tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1275 microversion: 2.1 time: 0.131607 Oct 06 13:43:35.641964 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3327/6636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:35 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:36.669011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:36.670337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:36.678425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:36.679027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:36.679547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:36.680512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:36.681089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:36.681539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:37.205114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:37.212700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=70 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:37.216535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2622b5e-b28c-43dc-98e4-9c31a2ab242d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.551414 Oct 06 13:43:37.230040 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3310/6637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:36 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:37.549473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:37.559402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:37.573683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:37.574383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:37.574618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:37.580192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:37.592854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] Creating event network-changed:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h2-860556-1 Oct 06 13:43:37.600580 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-1fa098b2-40c7-445e-ae1f-f0b04f6a2876 req-e83756d8-e3d3-498c-87cb-f86a5b050ee8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054425 Oct 06 13:43:37.601221 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3328/6638] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:43:38.242155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:38.242694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:38.245770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:38.252360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:38.252882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:38.253354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:38.254236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:38.254747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:38.255208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:38.392051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:38.399918 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-335b964c-f5d3-4ae8-b8dd-2af3ecca4c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.162366 Oct 06 13:43:38.400500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3311/6639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:38 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:39.425591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:39.426329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:39.434796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:39.435291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:39.435736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:39.436702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:39.437172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:39.437603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:39.579727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:39.589655 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-39bc2261-ff34-44eb-b24d-40aed1eddd3e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.169716 Oct 06 13:43:39.590379 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3329/6640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:39 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:40.622775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:40.623533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:40.630362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:40.630951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:40.631480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:40.632272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:40.632821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:40.633337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:40.778399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:40.786774 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20e0f768-9a1b-4ced-aefa-0c54372d139b tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.168051 Oct 06 13:43:40.788014 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3312/6641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:40 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:41.811284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:41.812179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:41.819145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:41.819635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:41.820079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:41.820781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:41.821246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:41.821675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:41.951198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:41.959557 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b62e9bf-a017-4ea5-a988-7cd80115682e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.151746 Oct 06 13:43:41.960139 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3330/6642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:41 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:42.294907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "name": "network-vif-plugged", "status": "completed", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:42.305691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:42.306226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:42.306681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:42.320120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] Creating event network-vif-plugged:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h2-860556-1 Oct 06 13:43:42.325456 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-684c7f1b-fa4d-41ba-a25d-b81d2619d053 req-ce87af7a-4863-44c1-9d3f-f1711fac2d15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034288 Oct 06 13:43:42.326104 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3313/6643] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:43:42.981947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:42.982569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:42.991544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:42.992053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:42.992497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:42.993218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:42.993683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:42.994151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:43.141554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:43.150341 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3b889002-95fa-422a-8c20-ab729b155d67 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1315 microversion: 2.1 time: 0.172320 Oct 06 13:43:43.150955 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3331/6644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:42 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:44.175623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:44.176352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:44.183411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.183918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.184378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.185095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.185576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.186051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.397051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:44.405017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-883dabbc-abdb-4fab-8694-0e9df9b81189 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1501 microversion: 2.1 time: 0.234546 Oct 06 13:43:44.405824 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3314/6645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:44 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:44.429301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:43:44.431695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:44.434651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:44.435429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:44.442366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.442859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.443336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.444091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.444551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.444977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.475976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:44.485584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Old instance type m1.heat2, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:43:44.493617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:43:44.494064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:43:44.494550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:43:44.494961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:43:44.495379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:43:44.577874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-57626327-6c27-49ef-81b1-bd43bde6c3cb tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "POST /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878/action" status: 202 len: 0 microversion: 2.1 time: 0.153029 Oct 06 13:43:44.578875 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3332/6646] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:43:44 2022] POST /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:43:44.588729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:44.589774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:44.592392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:43:44.598809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.600189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.600666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.601421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:44.601928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:44.602383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:44.759020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:44.768605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a4b1f10-2f63-4fac-952c-d777feb78c13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1510 microversion: 2.1 time: 0.184716 Oct 06 13:43:44.769445 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3315/6647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:44 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:45.803257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:45.803886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:45.812705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:45.813200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:45.813639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:45.814907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:45.815375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:45.815807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:45.953217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:45.961098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e356bdbe-0983-4782-b371-d0b3139a3efc tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1510 microversion: 2.1 time: 0.162922 Oct 06 13:43:45.961692 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3333/6648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:45 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:46.983997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:46.984621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:46.991795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:46.992294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:46.992748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:46.993455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:46.993957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:46.994508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:47.410256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:47.418014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1bdf91e9-fca8-4b3f-95e1-0cd390590c2e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.437984 Oct 06 13:43:47.418720 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3316/6649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:46 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:48.442238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:48.442765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:48.450603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:48.451093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:48.451530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:48.452235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:48.452688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:48.453228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:48.591799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:48.600297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d9f4032-fc81-4396-8c37-25eea4f2bad4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.162172 Oct 06 13:43:48.600874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3334/6650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:48 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:49.623726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:49.624355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:49.631474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:49.631989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:49.632453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:49.633181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:49.633662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:49.634142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:49.772864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:49.780702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-704a7ee6-c335-4df6-9434-7fd68fd00b27 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.160898 Oct 06 13:43:49.781266 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3317/6651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:49 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:50.805461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:50.806128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:50.813305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:50.813818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:50.814408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:50.815124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:50.815628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:50.816138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:50.961519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:50.971222 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-749efaab-99ab-4bbe-ba45-e1421164b490 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.170412 Oct 06 13:43:50.971880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3335/6652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:50 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:51.994763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:51.995512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:52.002271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:52.002778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:52.003235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:52.003954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:52.004426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:52.004873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:52.136003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:52.144084 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6940a013-8e9b-44e7-891a-1ea2db10bbac tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.153902 Oct 06 13:43:52.144664 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3318/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:51 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:53.168408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:53.169043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:53.176889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:53.177292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:53.178359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:53.179157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:53.179650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:53.180083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:53.376763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:53.386119 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5345ceea-40d2-425f-9beb-1f6a4ec661c4 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.221777 Oct 06 13:43:53.386733 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3336/6654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:53 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:54.415700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:54.416347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:54.423489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:54.423997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:54.424479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:54.425205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:54.425679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:54.426175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:54.564983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:54.573763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0558a07-b06e-4553-98d1-b2d036959c32 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.162249 Oct 06 13:43:54.574359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3319/6655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:54 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:55.597010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:55.597635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:55.605034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:55.605530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:55.606014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:55.606761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:55.607228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:55.607662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:55.746071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:55.755179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5fb9dc2-a0bc-49e9-9c9e-c7799f164200 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.162142 Oct 06 13:43:55.755868 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3337/6656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:55 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:56.779736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:56.780395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:56.787236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:56.787750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:56.788300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:56.789035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:56.789518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:56.789991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:56.929627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:56.937880 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e2b9930-f131-47b1-ad37-d42dee66cda2 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.162108 Oct 06 13:43:56.938500 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3320/6657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:56 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:57.961505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:57.962147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:57.969043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:57.969532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:57.969990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:57.970689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:57.971148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:57.971576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:58.111966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:58.119745 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64db3f1f-bb06-4c8d-884f-eb38ebda3bff tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.162761 Oct 06 13:43:58.120324 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3338/6658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:57 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:43:59.142750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:43:59.143391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:43:59.150570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:59.151087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:59.151553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:59.152287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:43:59.152765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:43:59.153220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:43:59.292429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:43:59.300811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9247935-d3c9-40bb-b583-1467fc821e96 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.161972 Oct 06 13:43:59.301402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3321/6659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:43:59 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:00.324672 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:00.325288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:00.332280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:00.332774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:00.333217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:00.334028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:00.334428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:00.335360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:00.473175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:00.481565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8508889f-bd5b-46e1-869a-661b9239a662 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.160810 Oct 06 13:44:00.482263 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3339/6660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:00 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:44:01.510910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:01.511651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:01.519099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:01.519601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:01.520063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:01.520776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:01.521250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:01.521695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:01.657918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:01.665830 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8370ac13-6e72-4d4d-b8af-d830c36fbc0d tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.159525 Oct 06 13:44:01.666414 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3322/6661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:01 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:02.691537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:02.692341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:02.702979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:02.703677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:02.704352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:02.705642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:02.706550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:02.707356 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:02.854762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:02.864834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b8652e0-74e5-4049-8794-8785b90cf3f5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.177826 Oct 06 13:44:02.864834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3340/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:02 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:03.886646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:03.887273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:03.894324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:03.894829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:03.895286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:03.896010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:03.896483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:03.896933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:04.029655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:04.037487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5b93541-f40d-406a-a067-f1ceb54dc199 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.155073 Oct 06 13:44:04.038741 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3323/6663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:03 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:05.061016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:05.061643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:05.069091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:05.070121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:05.070571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:05.071284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:05.071748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:05.072182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:05.213555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:05.221890 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88a656ba-77e7-4cac-80d0-ca15eb74b6b6 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.164701 Oct 06 13:44:05.222494 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3341/6664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:05 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:06.246689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:06.247317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:06.254335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:06.254845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:06.255308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:06.256030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:06.261339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:06.261871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:06.392340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:06.400263 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-56583444-22fc-4e4f-9ccc-6697584a7363 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.157594 Oct 06 13:44:06.400846 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3324/6665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:06 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:07.423327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:07.423940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:07.430897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:07.431383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:07.431819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:07.432511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:07.432965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:07.433389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:07.565535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:07.574121 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c853dc22-6251-41ca-9155-90e3ef4e1a87 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.154568 Oct 06 13:44:07.574752 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3342/6666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:07 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:08.597567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:08.598225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:08.601052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=28 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:08.607473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:08.607971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:08.608427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:08.609140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:08.609614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:08.610084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:08.612817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=82 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:08.743183 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:08.751017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f14455f5-7964-4d18-9bf9-de450a141151 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.157380 Oct 06 13:44:08.751596 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3325/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:08 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:09.775449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:09.776078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:09.778940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=34 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:09.784262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:09.784767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:09.785221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:09.785966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:09.786437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:09.786878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:09.789872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:09.923765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:09.932192 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0a506d6f-2020-4c56-be63-a2be20f7197e tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.161322 Oct 06 13:44:09.932775 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3343/6668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:09 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:10.955615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:10.956282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:10.962935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:10.963437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:10.963909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:10.964608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:10.965079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:10.965522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:11.097074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:11.105471 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77f24d92-c141-4f09-96d5-33866a263767 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.153897 Oct 06 13:44:11.106078 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3326/6669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:10 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:12.128935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:12.129555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:12.136517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:12.137000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:12.137437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:12.138169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:12.138612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:12.139038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:12.269576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:12.278194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f37d4819-db8d-4a4c-a9a5-f99895cd6485 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.153162 Oct 06 13:44:12.278838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3344/6670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:12 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:13.302044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:13.302671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:13.309686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:13.310211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:13.310663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:13.311368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:13.312091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:13.312539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:13.447879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:13.455662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8fab33c0-0034-4c1d-8acb-62fc48a1ea1f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1515 microversion: 2.1 time: 0.157550 Oct 06 13:44:13.456236 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3327/6671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:13 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:14.479264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:14.479957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:14.487343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:14.487836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:14.488274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:14.488975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:14.489434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:14.489903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:14.712714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:14.719223 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "name": "network-vif-unplugged", "status": "completed", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:14.734903 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2bbf83bf-73f0-4496-b2d1-98570c2d2bf8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1514 microversion: 2.1 time: 0.260087 Oct 06 13:44:14.735614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:14.736134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:14.736597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:14.746334 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3345/6672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:14 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:14.749942 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Creating event network-vif-unplugged:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h1-860556-1 Oct 06 13:44:14.756504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] Instance 7487351f-75b1-4834-b3d5-0f042f75e878 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:44:14.768869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-08ed2a63-7ab4-4e07-b27d-f562cc2bb931 req-200b8ddd-a7ba-48a0-bb16-ed5a632a1d49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053112 Oct 06 13:44:14.769383 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3328/6673] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:44:15.759908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:15.760544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:15.767756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:15.768253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:15.768707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:15.769421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:15.769920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:15.770357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:15.993858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:16.002873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f18818c9-65c2-4b58-9679-1f8b2e2a3fc8 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1514 microversion: 2.1 time: 0.247370 Oct 06 13:44:16.003489 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3346/6674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:15 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:44:16.798693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:16.810022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:16.810490 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:16.810950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:16.824574 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Creating event network-changed:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h1-860556-1 Oct 06 13:44:16.830225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] Instance 7487351f-75b1-4834-b3d5-0f042f75e878 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:44:16.842699 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0ea484d6-8959-4227-b970-2c217a200f40 req-43d6dba6-b538-42b0-a95b-45a63c82078d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049042 Oct 06 13:44:16.843325 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3329/6675] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:44:17.026165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:17.026934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:17.034140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:17.034640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:17.035077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:17.035833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:17.036236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:17.036660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:17.251801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:17.259934 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-40eabbf2-f8dd-4e66-b811-baae83a7797a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1512 microversion: 2.1 time: 0.237719 Oct 06 13:44:17.260736 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3347/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:17 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:18.284427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:18.285155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:18.291971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:18.292514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:18.292976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:18.293699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:18.294205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:18.294655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:18.433878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:18.447334 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-55c0bae4-8c67-4e0c-bdb4-a152aaa9c3e5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1509 microversion: 2.1 time: 0.167822 Oct 06 13:44:18.447944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3330/6677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:18 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:18.470249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:18.470749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:18.478474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:18.478963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:18.479403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:18.480104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:18.480564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:18.480997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:18.506828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:44:18.557422 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.compute.api [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Found an unconfirmed migration during delete, id: 16, status: finished Oct 06 13:44:20.279443 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-effe663b-0032-4b3f-9aea-c85fb4709518 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 204 len: 0 microversion: 2.1 time: 1.813172 Oct 06 13:44:20.281407 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3348/6678] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:44:18 2022] DELETE /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 0 bytes in 1816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:44:20.290795 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:20.291590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:20.298486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:20.298981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:20.299449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:20.300184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:20.300663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:20.301252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:20.448030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:20.456086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fddd70ab-52bd-4ac8-b504-0439b5d32687 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1501 microversion: 2.1 time: 0.169555 Oct 06 13:44:20.456680 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3331/6679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:20 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:21.479666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:21.480372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:21.487135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:21.487624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:21.488064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:21.488769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:21.489225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:21.489651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:21.627429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64320af9965b446e9151d17f76d8567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772689924ce246d584e49ea04eef1891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:21.635965 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-734e293d-dd34-4659-bec1-96eddb96868a tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 200 len: 1501 microversion: 2.1 time: 0.160500 Oct 06 13:44:21.636571 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3349/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:21 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:21.904323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "name": "network-vif-plugged", "status": "completed", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:21.919574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:21.920410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:21.921114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:21.934280 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] Creating event network-vif-plugged:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h1-860556-1 Oct 06 13:44:21.942983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d3037358-fdd8-4bfe-aa95-6805a4b7be82 req-a0e46da6-d175-49f0-b813-b57990c224f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043015 Oct 06 13:44:21.943756 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3332/6681] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:44:22.234992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7487351f-75b1-4834-b3d5-0f042f75e878", "name": "network-vif-deleted", "tag": "db17cc1e-350d-4068-b0dc-1ed52e57f076"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:22.254034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.254536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.255155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.271122 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] Creating event network-vif-deleted:db17cc1e-350d-4068-b0dc-1ed52e57f076 for instance 7487351f-75b1-4834-b3d5-0f042f75e878 on n-h1-860556-1 Oct 06 13:44:22.277436 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c58f0cb9-acdc-4153-8b1f-2d966e6072c5 req-baf06d86-23b3-4609-9486-f85ac287de9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047407 Oct 06 13:44:22.278525 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3350/6682] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:44:22.657074 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:44:22.657277 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 (ip 10.222.0.26) !!! Oct 06 13:44:22.662477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:22.663231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:22.674710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.675356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.675844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.676685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.677192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.677637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.692042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] HTTP exception thrown: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Request method failure captured: Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 HTTP/1.1 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtuFPamOKGObFu-5pf1K6yqnY5Qw3O3X8wT1x1xX6N3jGYK-ndeJD9MoeoD7Vp-2XrVIN-mHOjpN4_WaWncLWD1tkkihFAJe9VpOAJ9y2c5qJ9j-Jm9aZ1tWFCsScrvVlAJniknth4q3yLPx-_7vtatoI463fzh7aZcAZYcJTEjrwxQ Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_772689924ce246d584e49ea04eef1891", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/772689924ce246d584e49ea04eef1891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}] Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 64320af9965b446e9151d17f76d8567f Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '7487351f-75b1-4834-b3d5-0f042f75e878'} Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.693719 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Returning 404 to user: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f1b3455e-dcf0-4996-b26f-54992cec56a5 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 404 len: 111 microversion: 2.1 time: 0.039671 Oct 06 13:44:22.698749 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3333/6683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:22 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:44:22.708847 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:44:22.709302 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 (ip 10.222.0.26) !!! Oct 06 13:44:22.714383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:22.715339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:22.723482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.723973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.724416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.725117 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.725580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.726075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.742268 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] HTTP exception thrown: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Request method failure captured: Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 HTTP/1.1 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtuFPamOKGObFu-5pf1K6yqnY5Qw3O3X8wT1x1xX6N3jGYK-ndeJD9MoeoD7Vp-2XrVIN-mHOjpN4_WaWncLWD1tkkihFAJe9VpOAJ9y2c5qJ9j-Jm9aZ1tWFCsScrvVlAJniknth4q3yLPx-_7vtatoI463fzh7aZcAZYcJTEjrwxQ Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_772689924ce246d584e49ea04eef1891", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/772689924ce246d584e49ea04eef1891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}] Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 64320af9965b446e9151d17f76d8567f Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '7487351f-75b1-4834-b3d5-0f042f75e878'} Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:44:22.744013 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Returning 404 to user: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97bb6056-c932-4513-8326-394f6e229f13 tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 404 len: 111 microversion: 2.1 time: 0.038582 Oct 06 13:44:22.748066 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3351/6684] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:44:22 2022] DELETE /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:44:22.754470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:22.755144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] [instance: 7487351f-75b1-4834-b3d5-0f042f75e878] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:22.761978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.762500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.762971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.763701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:22.764184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:22.764637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:22.779201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] HTTP exception thrown: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Request method failure captured: Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 HTTP/1.1 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtuFPamOKGObFu-5pf1K6yqnY5Qw3O3X8wT1x1xX6N3jGYK-ndeJD9MoeoD7Vp-2XrVIN-mHOjpN4_WaWncLWD1tkkihFAJe9VpOAJ9y2c5qJ9j-Jm9aZ1tWFCsScrvVlAJniknth4q3yLPx-_7vtatoI463fzh7aZcAZYcJTEjrwxQ Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_772689924ce246d584e49ea04eef1891", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/772689924ce246d584e49ea04eef1891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/772689924ce246d584e49ea04eef1891"}]}] Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 772689924ce246d584e49ea04eef1891 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-DeleteServersTestJSON-1654896965 Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 64320af9965b446e9151d17f76d8567f Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-DeleteServersTestJSON-1654896965-project Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '7487351f-75b1-4834-b3d5-0f042f75e878'} Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:44:22.780918 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] Returning 404 to user: Instance 7487351f-75b1-4834-b3d5-0f042f75e878 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61e21b18-8380-4ace-a56d-718095ffe67f tempest-DeleteServersTestJSON-1654896965 tempest-DeleteServersTestJSON-1654896965-project] 10.222.0.26 "GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878" status: 404 len: 111 microversion: 2.1 time: 0.031744 Oct 06 13:44:22.785602 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3334/6685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:22 2022] GET /compute/v2.1/servers/7487351f-75b1-4834-b3d5-0f042f75e878 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:44:31.867419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1763638827", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "f38a17ac-487c-4d3f-b997-b5ccd9a67452"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:31.925564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] validate_networks() for [('f38a17ac-487c-4d3f-b997-b5ccd9a67452', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:44:32.301705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:44:32.302186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:44:32.302663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:44:32.303255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:44:32.303667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:44:32.314981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:32.315474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:32.315919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:32.316660 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:32.317125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:32.317559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:32.335009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for project b86c6be242aa42abb80903898ad6ff4b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:44:32.341039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for user c6cdca7035a548f5bd1a1e93936057cb and project b86c6be242aa42abb80903898ad6ff4b. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:44:32.354175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:44:32.356546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:44:32.403941 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5752a7a1-688d-4db5-a76d-4a94eeee70e7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664575 Oct 06 13:44:32.404610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3352/6686] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:44:32.416196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fde42820-b636-4c22-9add-90d92b2cb682 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:32.416822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fde42820-b636-4c22-9add-90d92b2cb682 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:32.478224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fde42820-b636-4c22-9add-90d92b2cb682 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:32.486656 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fde42820-b636-4c22-9add-90d92b2cb682 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1218 microversion: 2.1 time: 0.074594 Oct 06 13:44:32.487394 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3335/6687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:32 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:33.511543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:33.512348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:33.520492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:33.521157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:33.521597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:33.522506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:33.523414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:33.523844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:33.590707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:33.599694 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f9589820-b320-4901-9b65-7c65234962c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1270 microversion: 2.1 time: 0.092963 Oct 06 13:44:33.600570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3353/6688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:33 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:34.624474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:34.625116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:34.627109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=43 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:34.635600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:34.636367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:34.637006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:34.638053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:34.638704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:34.639312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:34.889519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:34.897693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c4ffc506-7efd-4c89-b110-fb49937c880f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.277061 Oct 06 13:44:34.898401 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3336/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:34 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:35.327176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:35.340148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:35.340971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:35.341479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:35.357054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] Creating event network-changed:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h1-860556-1 Oct 06 13:44:35.362445 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-27504760-7be0-4366-830d-0dc0677bcf94 req-f3a1c39c-84b2-4330-8121-3d844fc97eaa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042814 Oct 06 13:44:35.363647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3354/6690] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:44:35.921702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:35.922319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:35.929433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:35.929979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:35.930439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:35.931162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:35.931636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:35.932082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:36.070836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:36.079941 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bd1e9b43-6c55-4a1d-bef3-638f766be44a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.162285 Oct 06 13:44:36.083665 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3337/6691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:35 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:37.107771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:37.108495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:37.115457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:37.115947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:37.116563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:37.117285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:37.117763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:37.118239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:37.276340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:37.284276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36bfb657-169e-498e-8723-448c451b3991 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.184628 Oct 06 13:44:37.284880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3355/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:37 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:38.308574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:38.309144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:38.317191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:38.317703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:38.318195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:38.319008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:38.319557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:38.320171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:38.466264 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:38.474434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ef03ab42-033f-4a64-a375-cfe21f4e63c1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.170473 Oct 06 13:44:38.475002 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3338/6693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:38 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:39.498044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:39.498664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:39.505658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:39.506177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:39.506621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:39.507327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:39.507781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:39.508204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:39.650891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:39.658542 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4b6f4f3-aaa1-4abc-8bb4-6431687690ad tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.164627 Oct 06 13:44:39.659107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3356/6694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:39 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:40.102043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "name": "network-vif-plugged", "status": "completed", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:40.107856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=30 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:40.114408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:40.115038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:40.115611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:40.128680 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] Creating event network-vif-plugged:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h1-860556-1 Oct 06 13:44:40.134468 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-dd6f5f7c-7135-425a-9078-b4ae6779c6dd req-527ff7b9-2e6a-4ad2-83f6-70a040b2a2f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036324 Oct 06 13:44:40.135208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3339/6695] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:44:40.682518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:40.683168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:40.686109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:40.692487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:40.692979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:40.693419 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:40.694148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:40.694673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:40.695103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:40.700450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:40.829578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:40.838175 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-873d45f0-b3a9-4159-8882-6fd4852c3a72 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1318 microversion: 2.1 time: 0.160144 Oct 06 13:44:40.838750 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3357/6696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:40 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:41.862259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:41.863010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:41.870112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:41.870616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:41.871075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:41.871788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:41.872267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:41.872740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.005221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.013188 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-011a63fa-0743-4d92-b1d5-255c95cb6eb8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1509 microversion: 2.1 time: 0.156035 Oct 06 13:44:42.013780 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3340/6697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:41 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:42.034868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:42.035527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.043115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.043604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.044047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.044746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.045217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.045649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.177456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.185992 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f2a748ce-b3d9-401d-88c6-327e496abb4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1509 microversion: 2.1 time: 0.154998 Oct 06 13:44:42.186570 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3358/6698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:42 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:42.211311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:42.213867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.220333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.220842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.221307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.222073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.222551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.222998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.285638 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5dfb67e7-b91a-497f-9960-e78adf43c3e5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "PUT /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1081 microversion: 2.1 time: 0.079871 Oct 06 13:44:42.286838 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3341/6699] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Oct 6 13:44:42 2022] PUT /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1081 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:42.306643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:42.307268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.313883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.314373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.314819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.315521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.315981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.316412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.334250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:42.350173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:42.451361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.459424 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-092f5c4c-36d8-470f-ad5a-c033d2a79db5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1507 microversion: 2.1 time: 0.156693 Oct 06 13:44:42.460024 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3359/6700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:42 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:42.482096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:42.482729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.484765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:44:42.490646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.491149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.491602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.492311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.492782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.493227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.625332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.634002 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6dbd2fd5-856a-47c0-90c3-bdb50eee91be tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1507 microversion: 2.1 time: 0.155724 Oct 06 13:44:42.634577 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3342/6701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:42 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:42.656395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:44:42.658663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.664645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.665129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.665560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.666277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.666727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.667147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.696069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.701950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Old instance type m1.heat2, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:44:42.708441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:44:42.708987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:44:42.709462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:44:42.709898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:44:42.710931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:44:42.773241 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9a73fb67-1648-4e72-b2ee-54cc15d73974 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d/action" status: 202 len: 0 microversion: 2.1 time: 0.120319 Oct 06 13:44:42.774004 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3360/6702] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:44:42 2022] POST /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:44:42.782137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:42.782923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:42.790220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.791001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.791578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.792372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:42.792929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:42.793768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:42.932912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:42.942335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d05dbea3-f5da-4627-a660-e73e02ebaa81 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1518 microversion: 2.1 time: 0.164062 Oct 06 13:44:42.942913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3343/6703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:42 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:43.967880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:43.968503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:43.979522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:43.980026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:43.980525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:43.981729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:43.982644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:43.983571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:44.217773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:44.225636 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f941a7e7-39ac-4463-8ce8-57bf0fad0b9b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1518 microversion: 2.1 time: 0.262595 Oct 06 13:44:44.226273 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3361/6704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:43 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:45.249003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:45.249639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:45.256732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:45.257381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:45.258084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:45.259015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:45.259496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:45.259945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:45.393190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:45.401540 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5317101-3ccf-44c0-bb39-90f3696d990a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.156527 Oct 06 13:44:45.402141 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3344/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:45 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:46.426562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:46.427181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:46.434828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:46.435314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:46.435753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:46.436612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:46.436913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:46.437616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:46.581802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:46.589880 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4dcdaf7d-8daf-41ad-86c6-8c2918a68d26 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.167222 Oct 06 13:44:46.590473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3362/6706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:46 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:47.614955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:47.615610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:47.623251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:47.623752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:47.624215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:47.624923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:47.625396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:47.625893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:47.754899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:47.763196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-932fb091-1a93-406b-ab27-f11a23fca4c6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.152179 Oct 06 13:44:47.763768 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3345/6707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:47 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:48.786273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:48.786895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:48.794147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:48.794678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:48.795125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:48.795854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:48.796294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:48.796725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:48.931991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:48.940033 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b4a6c0e9-6064-4472-a1b2-94aacda70c0d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.157725 Oct 06 13:44:48.940657 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3363/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:48 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:49.965139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:49.965810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:49.973190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:49.973693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:49.974176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:49.974890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:49.975354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:49.976403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:50.109027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:50.117117 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-929380a6-5f31-441d-a826-d06fc189fc1b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.155880 Oct 06 13:44:50.117693 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3346/6709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:49 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:51.147608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:51.148231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:51.156845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:51.157339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:51.157806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:51.158511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:51.158965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:51.159392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:51.293104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:51.300956 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eeba8665-33b1-4ddd-b2ff-76dd5a0a5ea5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.164334 Oct 06 13:44:51.301542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3364/6710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:51 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:52.324625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:52.325265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:52.332374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:52.332881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:52.333367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:52.334133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:52.334612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:52.335104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:52.545534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:52.554726 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2261d0a5-c89c-4820-99be-90619cdcebe9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.233175 Oct 06 13:44:52.555661 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3347/6711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:52 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:53.578454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:53.579077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:53.586295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:53.586788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:53.587232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:53.587931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:53.588388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:53.588854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:53.719526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:53.727202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-78fd3405-c8cf-4958-ac59-0138eefcc244 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.152709 Oct 06 13:44:53.727799 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3365/6712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:53 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:54.751935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:54.752576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:54.760054 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:54.760555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:54.761010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:54.761723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:54.762220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:54.762664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:55.222291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:55.230327 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d529c75d-f84b-469a-8ecd-a902ae553527 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.482214 Oct 06 13:44:55.231046 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3348/6713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:54 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:56.254580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:56.255204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:56.262521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:56.263022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:56.263467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:56.264172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:56.264631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:56.265061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:56.397358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:56.405458 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-74d580ef-515f-492c-b607-7064dd181f75 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.154850 Oct 06 13:44:56.406099 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3366/6714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:56 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:57.428746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:57.429384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:57.436071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:57.436575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:57.437035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:57.438043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:57.438525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:57.438978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:57.577289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:57.585824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11a65f4c-d653-4fda-ba04-b948955c4408 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.160511 Oct 06 13:44:57.586351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3349/6715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:57 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:58.608994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:58.609645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:58.617695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:58.618209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:58.618644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:58.619345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:58.619798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:58.620226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:58.764501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:58.772421 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-774ad7c1-423e-4a6b-a2d8-47ea6d62f70b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.167892 Oct 06 13:44:58.773002 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3367/6716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:58 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:44:59.795520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:44:59.796176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:44:59.803182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:59.803691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:59.804162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:59.804900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:44:59.805383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:44:59.806333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:44:59.952875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:44:59.961344 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-078e284c-1a06-4da4-bd7c-a2b79f1471ee tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.169821 Oct 06 13:44:59.962087 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3350/6717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:44:59 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:00.983707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:00.984332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:00.991840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:00.992330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:00.992770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:00.993524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:00.993963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:00.994397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:01.127333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:01.136234 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84ad2d3d-e2a7-4f7e-9cdf-e8aa077bd3ab tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.156391 Oct 06 13:45:01.136830 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3368/6718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:00 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:02.160885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:02.162081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:02.173620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:02.174527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:02.175247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:02.176435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:02.177212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:02.177994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:02.320445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:02.328600 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d524435e-857a-4f6b-8d00-855fb5892430 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.172296 Oct 06 13:45:02.329187 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3351/6719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:02 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:03.352591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:03.353213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:03.360446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:03.360966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:03.361412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:03.362148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:03.362610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:03.363043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:03.499189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:03.508007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be316c14-ea64-4e89-b9b9-f94043daecaa tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.159436 Oct 06 13:45:03.508597 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3369/6720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:03 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:04.531452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:04.532092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:04.539547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:04.540064 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:04.540558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:04.541285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:04.541793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:04.542248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:04.560642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:04.674529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:04.684158 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30e877a2-c9ec-4984-aace-2a0a86e942c2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.156635 Oct 06 13:45:04.684746 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3352/6721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:04 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:05.708218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:05.708863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:05.716317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:05.716809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:05.717350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:05.718003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:05.718450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:05.718881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:05.859006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:05.868391 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f907a8b6-ed9f-464a-a6e9-705290a36e2b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.164039 Oct 06 13:45:05.868996 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3370/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:05 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:06.893830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:06.894632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:06.902945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:06.903439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:06.903896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:06.904832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:06.905311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:06.905987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:07.042423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:07.050272 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8a4ad694-b042-491b-a0ad-3d61d8888687 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.161191 Oct 06 13:45:07.050848 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3353/6723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:06 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:08.074082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:08.074610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:08.081458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:08.081976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:08.082417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:08.083128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:08.083569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:08.083994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:08.222873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:08.231256 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4140df40-59f3-4be0-9b0c-a2bdb2d94259 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.161244 Oct 06 13:45:08.231844 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3371/6724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:08 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:09.255450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:09.256082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:09.262902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:09.263410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:09.263884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:09.264641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:09.265124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:09.265576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:09.403352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:09.411226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cbc4dbda-8700-45ae-bf9c-20945b8fcd0f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.159766 Oct 06 13:45:09.411809 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3354/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:09 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:10.435373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:10.436021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:10.443277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:10.443776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:10.444223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:10.444965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:10.445428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:10.445903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:10.464341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:10.591394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:10.599297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f9e07a3-634c-46d5-b88b-3966f8a9d51f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.167917 Oct 06 13:45:10.600740 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3372/6726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:10 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:11.623163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:11.623822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:11.626559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=32 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:11.632501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:11.633013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:11.633477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:11.634234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:11.634771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:11.635596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:11.817720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:11.826793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a15a516a-ede0-454a-8584-e5998e528124 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1523 microversion: 2.1 time: 0.207217 Oct 06 13:45:11.828009 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3355/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:11 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:12.467428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "name": "network-vif-unplugged", "status": "completed", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:12.473945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:12.482089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:12.482619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:12.483416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:12.497607 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Creating event network-vif-unplugged:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h2-860556-1 Oct 06 13:45:12.503935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:45:12.516033 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-53ff28d6-e41d-4412-aa43-a429bef26a16 req-1daffc4b-ad34-43d3-b8fb-f3d8d91d7fb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052222 Oct 06 13:45:12.517246 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3373/6728] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:12.852742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:12.853543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:12.860942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:12.861473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:12.861967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:12.862703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:12.863185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:12.863628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:13.094715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:13.102810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-162744a4-05c5-4e38-996c-51d39811c699 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1522 microversion: 2.1 time: 0.255102 Oct 06 13:45:13.103405 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3356/6729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:12 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:14.128602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:14.129310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:14.136563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:14.137060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:14.137512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:14.138250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:14.138711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:14.139147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:14.283568 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:14.291504 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0b7dbb3c-f67a-400b-908e-239afda252dc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1520 microversion: 2.1 time: 0.168067 Oct 06 13:45:14.292083 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3374/6730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:14 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:14.544301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:14.555443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:14.555952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:14.556415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:14.568447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Creating event network-changed:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h2-860556-1 Oct 06 13:45:14.574724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:45:14.585675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ff51f58e-4f80-4d13-8d2f-86490d5acc6b req-c88be3a8-0d80-48cd-91cd-cd2af1cb5004 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045130 Oct 06 13:45:14.586335 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3357/6731] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:15.316395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:15.317026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:15.324328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:15.324885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:15.325333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:15.326078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:15.326539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:15.326974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:15.462743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:15.471200 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99c42ff1-84d2-430a-823b-cccd3cff621e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1520 microversion: 2.1 time: 0.159422 Oct 06 13:45:15.471801 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3375/6732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:15 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:45:16.497094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:16.497888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:16.508014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.508919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.509765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:16.511377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.512266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.513049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:16.721298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:16.732100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-328e256a-669d-49d9-a3b9-28f48d089a8e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1517 microversion: 2.1 time: 0.240695 Oct 06 13:45:16.732920 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3358/6733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:16 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:16.756102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:16.757613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:16.775628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.776133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.776592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:16.777310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.777797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.778236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:16.846751 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8a75694-b5e9-4b32-9d55-b4df394850fc tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d/action" status: 204 len: 0 microversion: 2.1 time: 0.094764 Oct 06 13:45:16.847445 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3376/6734] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:45:16 2022] POST /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:45:16.856117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:16.856757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:16.862932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.863444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.863906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:16.864972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:16.865425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:16.866056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:17.073699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:17.081704 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-527965e8-bdac-40f8-8f67-b3151d68aa89 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1517 microversion: 2.1 time: 0.229489 Oct 06 13:45:17.082449 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3359/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:16 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:18.106498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:18.107247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:18.113626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:18.114154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:18.114601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:18.115314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:18.116369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:18.116822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:18.255508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:18.263844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4dde128a-f69b-4d2e-b455-4ea5e2ee75f1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1517 microversion: 2.1 time: 0.162585 Oct 06 13:45:18.264430 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3377/6736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:18 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:18.769301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "name": "network-vif-plugged", "status": "completed", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:18.780563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:18.781076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:18.781557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:18.793275 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] Creating event network-vif-plugged:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h2-860556-1 Oct 06 13:45:18.798816 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d24c2f46-ed23-42bf-920b-82ac633bc02c req-1f75be32-e6ee-4405-8597-3280df4f5450 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Oct 06 13:45:18.799605 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3360/6737] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:19.288056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:19.288619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:19.295491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:19.295978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:19.296416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:19.297118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:19.297577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:19.298034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:19.430579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:19.439074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ef6c32e-d781-42b5-8b4b-15cb2872ccd7 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1509 microversion: 2.1 time: 0.155591 Oct 06 13:45:19.439693 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3378/6738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:19 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:19.461635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:19.462384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:19.469170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:19.469680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:19.470172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:19.470894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:19.471376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:19.471836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:19.606504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:19.614441 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95074eac-453b-4b63-8131-49753cf56f4c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1509 microversion: 2.1 time: 0.157170 Oct 06 13:45:19.615033 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3361/6739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:19 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:19.640122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ef4f00d-4cc7-4435-bc9d-319f3f1881b3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'create', calling method: .version_select at 0x7f7d3f126940>, body: {"keypair": {"name": "tempest-keypair-69493240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6+38Genvu9yTkWba+SD4m+yGweAHDsxT5DqNWk09lRXGuf617o+1bVC9AqYfxqb+coICFzSgajgerQZVaCDXX7ddR4YB1/jyLF6an4eWvXPjhlDR4KGx5ve3sDMCVKQQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:19.655469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8ef4f00d-4cc7-4435-bc9d-319f3f1881b3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for project b86c6be242aa42abb80903898ad6ff4b. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:45:19.660593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-8ef4f00d-4cc7-4435-bc9d-319f3f1881b3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for user c6cdca7035a548f5bd1a1e93936057cb and project b86c6be242aa42abb80903898ad6ff4b. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:45:19.689258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ef4f00d-4cc7-4435-bc9d-319f3f1881b3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.052978 Oct 06 13:45:19.690081 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3379/6740] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:45:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:20.874085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:20.874729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:20.881567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:20.882113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:20.882579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:20.883301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:20.883940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:20.884253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:21.023188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:21.031350 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efdab1d0-89d4-48ba-8a36-73c90eb08f7f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 200 len: 1509 microversion: 2.1 time: 0.161187 Oct 06 13:45:21.031933 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3362/6741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:20 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:21.056041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:21.056624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:21.063599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:21.064090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:21.064531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:21.065225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:21.065684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:21.066149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:21.091942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:45:21.168820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e9469b4-68a6-41a0-a26a-8308fd4f920d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 204 len: 0 microversion: 2.1 time: 0.118294 Oct 06 13:45:21.169433 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3380/6742] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:45:21 2022] DELETE /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:45:21.226801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-333548066", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "f38a17ac-487c-4d3f-b997-b5ccd9a67452"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:21.279379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] validate_networks() for [('f38a17ac-487c-4d3f-b997-b5ccd9a67452', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:45:21.662073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:45:21.662521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:45:21.663023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:45:21.663465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:45:21.663932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:45:21.673018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:21.673527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:21.674033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:21.674792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:21.675273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:21.675726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:21.692906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for project b86c6be242aa42abb80903898ad6ff4b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:45:21.698987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Getting quotas for user c6cdca7035a548f5bd1a1e93936057cb and project b86c6be242aa42abb80903898ad6ff4b. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:45:21.712191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:45:21.714544 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:45:21.759943 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-df065c6a-86a9-42e0-9b54-714b11a1bbd5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537778 Oct 06 13:45:21.765924 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3363/6743] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:45:21.772755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-347f2dc5-dad8-4bcf-8b5d-2b64e7edc712 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:21.773821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-347f2dc5-dad8-4bcf-8b5d-2b64e7edc712 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:21.830193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-347f2dc5-dad8-4bcf-8b5d-2b64e7edc712 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:21.842135 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-347f2dc5-dad8-4bcf-8b5d-2b64e7edc712 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1217 microversion: 2.1 time: 0.074116 Oct 06 13:45:21.842743 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3381/6744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:21 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:22.865471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:22.866829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:22.874065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:22.874686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:22.875273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:22.876065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:22.876622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:22.877077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:22.965862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:22.973627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6189a3dd-65fa-437b-84be-d2c199f19689 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1269 microversion: 2.1 time: 0.113022 Oct 06 13:45:22.974239 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3364/6745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:22 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:23.259732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df526e6d-880e-45cd-89d6-5b232a5b0b4d", "name": "network-vif-deleted", "tag": "6a75f359-6e55-453e-a5ba-b3cbf3d6b451"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:23.289222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:23.289836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:23.290274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:23.302440 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] Creating event network-vif-deleted:6a75f359-6e55-453e-a5ba-b3cbf3d6b451 for instance df526e6d-880e-45cd-89d6-5b232a5b0b4d on n-h2-860556-1 Oct 06 13:45:23.311360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3953619f-2e21-4b4c-a4b0-633530971913 req-fe3fbb80-cf15-4e88-8ab0-ffc1107f808a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055959 Oct 06 13:45:23.312032 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3382/6746] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:23.997228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:23.998031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:24.008940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:24.009298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:24.009785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:24.010827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:24.011300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:24.012252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:24.154804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:24.164963 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c0c28807-b713-489c-8053-41b2cf9386da tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.171808 Oct 06 13:45:24.165731 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3365/6747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:23 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:24.695860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:24.706847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:24.707414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:24.707850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:24.719728 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] Creating event network-changed:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h2-860556-1 Oct 06 13:45:24.726359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-016b448a-56db-4017-a846-e865a264c1d0 req-b59fc001-44ea-4b97-8be2-81bb0fcea054 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106476 Oct 06 13:45:24.727125 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3383/6748] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:25.188870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:25.189510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:25.197202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:25.197717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:25.198211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:25.198952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:25.199431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:25.199887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:25.334122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:25.342086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-045c5275-f03f-4fff-aa27-b9e3aed54210 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.157442 Oct 06 13:45:25.342834 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3366/6749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:25 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:26.367334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:26.368044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:26.375094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:26.375590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:26.376037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:26.376763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:26.377212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:26.377647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:26.508731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:26.517627 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1a353e5-c5ee-4708-9b2d-bcb125f5f096 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.155374 Oct 06 13:45:26.518251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3384/6750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:26 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:27.542098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:27.542816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:27.550025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:27.550535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:27.550998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:27.551724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:27.552203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:27.552708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:27.691974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:27.699714 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00d81701-d275-4de5-9c88-ea6cbedea496 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.163147 Oct 06 13:45:27.700291 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3367/6751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:27 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:28.722649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:28.723267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:28.730626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:28.731123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:28.731563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:28.732272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:28.732731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:28.733161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:28.871063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:28.879092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d79e411b-0af1-4101-83e4-de68356249a2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.160505 Oct 06 13:45:28.879689 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3385/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:28 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:29.903520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:29.904149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:29.911148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:29.911660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:29.912113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:29.912824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:29.913312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:29.914243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:30.047369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:30.055064 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22679ad8-1a95-4932-acb8-4a61ac802cb1 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.156136 Oct 06 13:45:30.055670 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3368/6753] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:29 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:30.848034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "name": "network-vif-plugged", "status": "completed", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:30.860601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:30.861808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:30.862251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:30.877287 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] Creating event network-vif-plugged:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h2-860556-1 Oct 06 13:45:30.882532 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-110168a5-b7a0-4e2d-ab35-4c169356ffdf req-e13e9d03-787f-4e40-8690-9cd685e5a085 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038300 Oct 06 13:45:30.883346 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3386/6754] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:45:31.078272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:31.078905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:31.085767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:31.086274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:31.086737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:31.087961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:31.088433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:31.088934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:31.228649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:31.236323 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ad24cf6-c61a-4c0b-98b1-c47c620cd19a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.161996 Oct 06 13:45:31.236892 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3369/6755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:31 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:32.256104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:32.261410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:32.262250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:32.268879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:32.269372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:32.269841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:32.270543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:32.271005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:32.271441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:32.403450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:32.411848 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3e89da9a-faca-45b6-a9e3-407224e8fc90 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1317 microversion: 2.1 time: 0.156812 Oct 06 13:45:32.412420 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3387/6756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:32 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:33.438250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:33.439070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:33.441369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:33.442094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:33.450528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.451158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.451620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.452351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.453093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.453821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.602554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:33.606777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=100 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:33.612206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bbd45662-c1fd-4f47-9e06-a473f736e337 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1507 microversion: 2.1 time: 0.179893 Oct 06 13:45:33.612806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3370/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:33 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:33.634935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:33.635561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:33.642533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.643024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.643467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.644171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.644683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.645275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.781380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:33.789326 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7865d4d9-f662-4117-974b-b5c5466567a5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1507 microversion: 2.1 time: 0.158309 Oct 06 13:45:33.790753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3388/6758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:33 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:33.815607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:45:33.818120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:33.824438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.824947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.825412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.826166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.826659 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.827095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.856548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:33.862431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Old instance type m1.heat2, new instance type m1.heat {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:45:33.868980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:45:33.869421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:45:33.869955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:45:33.870390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:45:33.870822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:45:33.934097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4c41ed8d-581b-4ae3-9470-af10ceb1f59f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121/action" status: 202 len: 0 microversion: 2.1 time: 0.122701 Oct 06 13:45:33.938152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3371/6759] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:45:33 2022] POST /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:45:33.943014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:33.943644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:33.949934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.950428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.950877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:33.951588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:33.952059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:33.952490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:34.089471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:34.097539 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-56379b3c-e2a4-4606-9bf9-bc725fc670e2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1514 microversion: 2.1 time: 0.158407 Oct 06 13:45:34.098153 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3389/6760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:33 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:45:35.122593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:35.123242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:35.130316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:35.130814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:35.131266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:35.132120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:35.132833 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:35.133281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:35.276706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:35.284850 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-71dc9d9f-5168-403b-9d86-a85405c69f74 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1514 microversion: 2.1 time: 0.167781 Oct 06 13:45:35.285432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3372/6761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:35 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:36.308868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:36.309522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:36.316695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:36.317181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:36.317622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:36.318342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:36.318799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:36.319229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:36.338145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:36.451817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:36.459595 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1305771d-7193-41b0-b6f9-3021d40a6247 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.155245 Oct 06 13:45:36.460175 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3390/6762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:36 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:37.484944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:37.485854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:37.493434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:37.493983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:37.494446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:37.495171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:37.495644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:37.496091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:37.638365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:37.646465 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0aa49fb2-1c03-4038-8a28-a957b07ceaa6 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.167216 Oct 06 13:45:37.647051 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3373/6763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:37 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:38.670028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:38.670686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:38.677833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:38.678333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:38.678769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:38.679462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:38.679917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:38.680346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:38.814863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:38.823604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-821d6d78-d2ed-42d6-8429-0094c029a39c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.158161 Oct 06 13:45:38.824393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3391/6764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:38 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:39.848122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:39.848764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:39.856211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:39.856719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:39.857185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:39.857941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:39.858421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:39.858875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:39.994283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:40.002192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac2006c1-ef29-4f41-8df7-66ee64216a7a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.157908 Oct 06 13:45:40.002782 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3374/6765] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:39 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:41.025083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:41.025702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:41.032564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:41.033050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:41.033495 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:41.034223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:41.034685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:41.036678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:41.472770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:41.480629 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4519e0d2-6109-463e-b523-5f2263db9ea3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.459496 Oct 06 13:45:41.481215 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3392/6766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:41 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:42.504426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:42.505056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:42.507812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:42.513690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:42.514227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:42.514687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:42.515402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:42.515875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:42.516322 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:42.644853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:42.654197 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-18e2c7de-2aec-44d7-b583-2fc86b7edaa9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.153721 Oct 06 13:45:42.654792 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3375/6767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:42 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:43.677958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:43.678580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:43.681367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:45:43.686784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:43.687294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:43.687736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:43.688698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:43.689154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:43.689583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:43.825364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:43.833171 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b602ba04-06c4-454a-bf54-f844f9aeca8f tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.159168 Oct 06 13:45:43.833778 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3393/6768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:43 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:44.857036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:44.857667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:44.864807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:44.865305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:44.865780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:44.866492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:44.866965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:44.867573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:45.002066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:45.010249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d3d3e796-6a8e-4a87-9b8a-8ade9141232e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.157451 Oct 06 13:45:45.010841 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3376/6769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:44 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:46.033516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:46.034170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:46.040963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:46.041556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:46.042037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:46.042743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:46.043210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:46.043648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:46.177016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:46.186501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ea2cc31-5cae-4c7d-ab11-edebec0bdac8 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.156904 Oct 06 13:45:46.187126 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3394/6770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:46 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:47.215860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:47.216521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:47.223628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:47.224135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:47.224597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:47.225319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:47.225820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:47.226268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:47.355176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:47.363246 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ea8c39f-9f8c-4fdc-970c-1259b5eccd42 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.152095 Oct 06 13:45:47.363825 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3377/6771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:47 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:48.386933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:48.387553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:48.394535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:48.395023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:48.395463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:48.396156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:48.396610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:48.397034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:48.531265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:48.539078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b771923f-afc3-48c5-9cd8-a9e7baf52eb3 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.156041 Oct 06 13:45:48.539675 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3395/6772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:48 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:49.562377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:49.563288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:49.570372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:49.570875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:49.571335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:49.572042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:49.573107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:49.573551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:49.702092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:49.709939 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d9685fd-90ce-44ff-848a-51d61a2f1526 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.151479 Oct 06 13:45:49.710527 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3378/6773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:49 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:50.733021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:50.733640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:50.740744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:50.741236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:50.741679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:50.742413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:50.742874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:50.743310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:50.875024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:50.882866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-761d4040-9d98-40d5-995a-326b1a10f1cd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.153915 Oct 06 13:45:50.883471 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3396/6774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:50 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:51.906972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:51.907598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:51.914778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:51.915282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:51.915736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:51.916450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:51.916923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:51.917364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:52.050549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:52.058832 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-87c7ba49-6319-4451-84fb-84d988f06d6d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.155856 Oct 06 13:45:52.059406 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3379/6775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:51 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:53.083180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:53.083692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:53.091219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:53.091708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:53.092153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:53.092850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:53.093309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:53.093767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:53.221935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:53.229765 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-904aee1e-2c77-4353-af5b-37ca024eed48 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.150655 Oct 06 13:45:53.230337 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3397/6776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:53 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:54.252757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:54.253540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:54.261601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:54.262131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:54.262595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:54.263311 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:54.263909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:54.264364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:54.405278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:54.413171 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5487ae0-249e-4705-a439-d24b6dabea4a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.164338 Oct 06 13:45:54.413783 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3380/6777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:54 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:55.436347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:55.436949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:55.443987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:55.444473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:55.444915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:55.445607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:55.446093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:55.446526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:55.579424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:55.587291 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0154ed20-0b67-40aa-9e03-df4e2641adb5 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.154989 Oct 06 13:45:55.587874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3398/6778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:55 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:56.613984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:56.615165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:56.623584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:56.624103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:56.624573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:56.625316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:56.625935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:56.626435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:56.770782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:56.781350 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5a410a5-25cf-47a3-8512-b732e71aa878 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.174347 Oct 06 13:45:56.781964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3381/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:56 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:57.804360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:57.804910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:57.812073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:57.812574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:57.813018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:57.814020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:57.814524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:57.814954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:57.951489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:57.959429 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-573fb4f1-5666-49f3-b575-f638d3533be2 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.159115 Oct 06 13:45:57.960013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3399/6780] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:57 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:45:58.983434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:45:58.984066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:45:58.991042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:58.991542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:58.992027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:58.992741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:45:58.993217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:45:58.993660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:45:59.130757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:45:59.139209 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aea9866f-e82a-4739-8620-258c85fe8f92 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.160179 Oct 06 13:45:59.139810 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3382/6781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:45:58 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:00.163166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:00.163783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:00.170578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:00.171062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:00.171494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:00.172182 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:00.172632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:00.173058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:00.305469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:00.313576 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ac2e0db-138c-43eb-a3eb-51eca0a8929c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.154123 Oct 06 13:46:00.314180 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3400/6782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:00 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:01.337364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:01.338032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:01.345558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:01.346112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:01.346579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:01.347307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:01.347791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:01.348242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:01.490014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:01.500611 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9093190-03bf-4142-a13c-47043ad7c501 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.167117 Oct 06 13:46:01.501224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3383/6783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:01 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:02.523959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:02.524584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:02.531794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:02.532288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:02.532732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:02.533446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:02.533940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:02.534374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:02.677995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:02.685996 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-94c4930b-01c7-456b-8cd0-77977686d744 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1519 microversion: 2.1 time: 0.166003 Oct 06 13:46:02.686596 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3401/6784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:02 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:03.704320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "name": "network-vif-unplugged", "status": "completed", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:03.709028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:03.709917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:03.712131 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:46:03.712311 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:46:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 13:46:03.718500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:03.719194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:03.719792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:03.721163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:03.721279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:03.721677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:03.721805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:03.722160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:03.722295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:03.734991 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Creating event network-vif-unplugged:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h1-860556-1 Oct 06 13:46:03.740957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:46:03.753318 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a7e5f901-22b7-4aa2-9847-2a730a1039a2 req-e2c869a1-18f3-4fad-897e-3ff1fcd72ce4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053638 Oct 06 13:46:03.753979 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3384/6785] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:03.952887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:03.960931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62f1ef28-13a3-4809-8924-f699fa36f26c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1518 microversion: 2.1 time: 0.255706 Oct 06 13:46:03.961520 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3402/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:03 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:46:04.986152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:04.987006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:04.993142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:04.993644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:04.994128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:04.994839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:04.995316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:04.995764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:04.998969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:05.130254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:05.138788 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-175de828-7362-4097-8fdc-5e2ee205ff40 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1516 microversion: 2.1 time: 0.157797 Oct 06 13:46:05.139376 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3385/6787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:04 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:46:05.780459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:05.791665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:05.792157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:05.792597 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:05.806488 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Creating event network-changed:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h1-860556-1 Oct 06 13:46:05.812965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:46:05.824403 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3b20186b-d24d-4410-b529-55c7b7dcb25f req-073f2109-2b10-4980-8fa2-23e30c6789e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048101 Oct 06 13:46:05.825023 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3403/6788] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:06.162483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:06.163792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:06.171637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:06.172533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:06.173219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:06.174254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:06.175936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:06.176617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:06.371503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:06.380988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-988353af-8984-479f-83c5-a99b3a9cc13c tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1516 microversion: 2.1 time: 0.222822 Oct 06 13:46:06.381944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3386/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:06 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:07.408150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:07.408851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:07.415081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.415572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.416009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.416701 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.417156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.417588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.420954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=79 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:07.551362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:07.559190 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f4844a0-9683-489f-b324-bcfca9795315 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1513 microversion: 2.1 time: 0.156786 Oct 06 13:46:07.559769 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3404/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:07 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:07.582263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:07.582820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:07.589874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.590375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.590830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.592248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.592720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.593166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.655543 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a66cafca-275e-4484-b3c4-8504c9215abd tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "POST /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121/action" status: 204 len: 0 microversion: 2.1 time: 0.076732 Oct 06 13:46:07.656240 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3387/6791] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:46:07 2022] POST /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:46:07.664689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:07.665320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:07.672002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.672002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.672403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.673114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:07.673573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:07.674033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:07.813912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:07.821916 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f5ad30ae-0df8-4208-a1f0-c4718fc733a0 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1513 microversion: 2.1 time: 0.161241 Oct 06 13:46:07.822517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3405/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:07 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:08.462219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "name": "network-vif-plugged", "status": "completed", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:08.473243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:08.474303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:08.475638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:08.489259 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Creating event network-vif-plugged:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h1-860556-1 Oct 06 13:46:08.495618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:46:08.508766 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4e25cdd7-19c2-4146-83ff-5b5592d35ea8 req-a593e07c-8680-4520-a567-1fa750ee0134 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050568 Oct 06 13:46:08.509806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3388/6793] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:08.845853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:08.846591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:08.853381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:08.854131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:08.854572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:08.855274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:08.855982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:08.856318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:08.988225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:08.996098 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51cb7d23-c007-43cd-b819-e572f7cfbb08 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1513 microversion: 2.1 time: 0.154632 Oct 06 13:46:08.996684 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3406/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:08 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:10.021185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.021933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.028291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.028807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.030022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.030744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.031219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.031670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.164549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:10.172349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-926834b4-19c0-43d7-a10b-8429b77ce81d tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1505 microversion: 2.1 time: 0.156446 Oct 06 13:46:10.172924 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3389/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:10 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:10.195471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.196092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.203600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.204081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.204518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.205211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.205695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.206153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.338184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:10.345984 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fa806f69-b24a-479b-a1be-e07c29a6b6c9 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1505 microversion: 2.1 time: 0.154457 Oct 06 13:46:10.346572 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3407/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:10 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:10.368690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.369348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.376097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.376608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.377071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.377829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.378308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.378761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.508337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:10.516076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-72c7ae0f-ef17-475f-b15f-33816042f068 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1505 microversion: 2.1 time: 0.151736 Oct 06 13:46:10.516656 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3390/6797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:10 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:10.537800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.538307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.544247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.545237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.545681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.546401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.546862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.547324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.572681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:46:10.650011 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0743b13-e473-48ea-a500-7e0878adf030 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 204 len: 0 microversion: 2.1 time: 0.115847 Oct 06 13:46:10.650587 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3408/6798] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:46:10 2022] DELETE /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:46:10.665483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.666133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.672752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.673257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.673718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.674565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.675048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.675516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.701345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:46:10.745596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.compute.api [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Instance is already in deleting state, ignoring this request Oct 06 13:46:10.746469 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-558a6c24-ff9b-4d9d-8e67-52856e6d142a tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 204 len: 0 microversion: 2.1 time: 0.085062 Oct 06 13:46:10.747048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3391/6799] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:46:10 2022] DELETE /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:46:10.756623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:10.757357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:10.763824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.764332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.764766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.765453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:10.765946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:10.766406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:10.903021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:10.910913 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16b98076-1f6d-4852-a10e-a30d2b000880 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1511 microversion: 2.1 time: 0.158584 Oct 06 13:46:10.911488 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3409/6800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:10 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:11.933978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:11.934621 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:11.941779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:11.942292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:11.942754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:11.943466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:11.943940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:11.944388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:12.079756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cdca7035a548f5bd1a1e93936057cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c6be242aa42abb80903898ad6ff4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:12.087592 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59a2f3d6-2055-4963-8141-0d51882bf24e tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 200 len: 1511 microversion: 2.1 time: 0.157581 Oct 06 13:46:12.088172 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3392/6801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:11 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:12.599055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6d8d24-5950-470e-b12a-a005b3ede121", "name": "network-vif-deleted", "tag": "54ce7ded-81fb-4914-8e63-f85ce902b28c"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:12.611967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:12.612370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:12.613218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:12.630610 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] Creating event network-vif-deleted:54ce7ded-81fb-4914-8e63-f85ce902b28c for instance 4a6d8d24-5950-470e-b12a-a005b3ede121 on n-h1-860556-1 Oct 06 13:46:12.635989 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7efa1b14-5b13-4f71-876a-0701be0b61e8 req-e434d6c8-fe07-4d50-a6ee-dd16b9c4305b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Oct 06 13:46:12.636634 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3410/6802] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:13.112803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:13.113447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: 4a6d8d24-5950-470e-b12a-a005b3ede121] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:13.116249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=36 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:13.121571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.122110 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.123220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.123947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.124425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.124874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.138447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] HTTP exception thrown: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Request method failure captured: Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 HTTP/1.1 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtu_ORSojTfWNWQiKk5w608F4J2Px9fQklAOkdBMyEnQ8Qa8XjxM4W3k237q31BQTTg-Hq5YKirw2lSJNRdudr_21yVu1O-fb17mH34jeX2e-ofIPPrnJKxKuFtkryMtqQKXA-tNA0Gmab7d9I5ko4NM1k5SNu0IL0qM9tiLfmkxgVE Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b86c6be242aa42abb80903898ad6ff4b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}] Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c6cdca7035a548f5bd1a1e93936057cb Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '4a6d8d24-5950-470e-b12a-a005b3ede121'} Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.140104 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Returning 404 to user: Instance 4a6d8d24-5950-470e-b12a-a005b3ede121 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c10312e-b18a-4834-ac38-2a634905f54b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121" status: 404 len: 111 microversion: 2.1 time: 0.032718 Oct 06 13:46:13.144416 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3393/6803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:13 2022] GET /compute/v2.1/servers/4a6d8d24-5950-470e-b12a-a005b3ede121 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:46:13.150990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8f12ac3-b9c5-4b8a-bd30-273fa4a5eb14 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '.version_select at 0x7f7d3f693e50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:13.172748 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8f12ac3-b9c5-4b8a-bd30-273fa4a5eb14 tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69493240" status: 202 len: 0 microversion: 2.1 time: 0.025906 Oct 06 13:46:13.173340 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3411/6804] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Oct 6 13:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69493240 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:46:13.768576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:13.769102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:13.775233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.775679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.776141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.776857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.777333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.777805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.792069 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] HTTP exception thrown: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Request method failure captured: Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d HTTP/1.1 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtu_ORSojTfWNWQiKk5w608F4J2Px9fQklAOkdBMyEnQ8Qa8XjxM4W3k237q31BQTTg-Hq5YKirw2lSJNRdudr_21yVu1O-fb17mH34jeX2e-ofIPPrnJKxKuFtkryMtqQKXA-tNA0Gmab7d9I5ko4NM1k5SNu0IL0qM9tiLfmkxgVE Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b86c6be242aa42abb80903898ad6ff4b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}] Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: c6cdca7035a548f5bd1a1e93936057cb Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'df526e6d-880e-45cd-89d6-5b232a5b0b4d'} Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:46:13.793649 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Returning 404 to user: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb4b49de-5ac7-45f6-9587-29be4e35a51b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 404 len: 111 microversion: 2.1 time: 0.030490 Oct 06 13:46:13.798552 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3394/6805] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:46:13 2022] DELETE /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:46:13.805112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:13.806058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] [instance: df526e6d-880e-45cd-89d6-5b232a5b0b4d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:13.808010 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:13.814317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.814800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.815240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.815963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:13.816418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:13.816842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:13.832365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] HTTP exception thrown: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Request method failure captured: Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d HTTP/1.1 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtu_ORSojTfWNWQiKk5w608F4J2Px9fQklAOkdBMyEnQ8Qa8XjxM4W3k237q31BQTTg-Hq5YKirw2lSJNRdudr_21yVu1O-fb17mH34jeX2e-ofIPPrnJKxKuFtkryMtqQKXA-tNA0Gmab7d9I5ko4NM1k5SNu0IL0qM9tiLfmkxgVE Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b86c6be242aa42abb80903898ad6ff4b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b86c6be242aa42abb80903898ad6ff4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b86c6be242aa42abb80903898ad6ff4b"}]}] Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: b86c6be242aa42abb80903898ad6ff4b Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1975771959 Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: c6cdca7035a548f5bd1a1e93936057cb Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerDiskConfigTestJSON-1975771959-project Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'df526e6d-880e-45cd-89d6-5b232a5b0b4d'} Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:46:13.834049 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] Returning 404 to user: Instance df526e6d-880e-45cd-89d6-5b232a5b0b4d could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6794848e-1d79-495d-9d5e-89492c71c49b tempest-ServerDiskConfigTestJSON-1975771959 tempest-ServerDiskConfigTestJSON-1975771959-project] 10.222.0.26 "GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d" status: 404 len: 111 microversion: 2.1 time: 0.035186 Oct 06 13:46:13.838551 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3412/6806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:13 2022] GET /compute/v2.1/servers/df526e6d-880e-45cd-89d6-5b232a5b0b4d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:46:22.357812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-45017ed3-727d-418e-9637-b247331579aa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: .version_select at 0x7f7d3e78bf70>, body: {"keypair": {"name": "tempest-keypair-1931333948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmwdOP4+do+RKawnjBOEUkGIOatGMUjYFI9G1+1HKiyMsqqKE2qDSSDYJ5eHeHjcW7zpCuzUgMenjynaiQJlKFO6r/j4uAVQTmXdy+jzvdHMBwW7PJRQbTcGLWBVVE1UA=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:22.374099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-45017ed3-727d-418e-9637-b247331579aa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:46:22.383285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-45017ed3-727d-418e-9637-b247331579aa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:46:22.414249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-45017ed3-727d-418e-9637-b247331579aa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300431 Oct 06 13:46:22.414781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3395/6807] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:46:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:23.769600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-270422574", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d830276e-fb4a-4aa7-9e9b-05f020c03c9b"}], "security_groups": [{"name": "tempest-securitygroup--990383096"}], "key_name": "tempest-keypair-1931333948", "user_data": "}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:23.823119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:23.941640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] validate_networks() for [('d830276e-fb4a-4aa7-9e9b-05f020c03c9b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:46:24.372428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:46:24.373716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:46:24.374223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:46:24.374665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:46:24.375271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:46:24.384280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:24.384792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:24.385212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:24.385970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:24.386461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:24.386863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:24.406836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:46:24.412600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:46:24.429085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:46:24.431531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:46:24.483855 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-47cef041-86cc-4145-b903-0deb0ff7727f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.720894 Oct 06 13:46:24.484905 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3413/6808] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:46:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:46:24.495975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-170d9472-1cb8-41c5-9a25-77c305dd6d7d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:24.496786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-170d9472-1cb8-41c5-9a25-77c305dd6d7d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:24.500530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:24.676068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-170d9472-1cb8-41c5-9a25-77c305dd6d7d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:24.686697 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-170d9472-1cb8-41c5-9a25-77c305dd6d7d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1238 microversion: 2.1 time: 0.193192 Oct 06 13:46:24.688661 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3396/6809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:24 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1238 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:25.710165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:25.710798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:25.719864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:25.720365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:25.721258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:25.722426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:25.722861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:25.723715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:25.847700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:25.861821 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-313a5ffe-0ca2-4125-b15e-8e73897f7b3d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1298 microversion: 2.1 time: 0.155298 Oct 06 13:46:25.873895 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3414/6810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:25 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:26.894586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:26.895236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:26.902937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:26.903456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:26.904543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:26.905284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:26.905787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:26.906229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:27.448162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:27.460601 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d38d4bb7-a219-45ca-a040-fa7017135fc4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.570151 Oct 06 13:46:27.461467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3397/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:26 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:27.753372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:27.767479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:27.768293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:27.769140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:27.781952 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] Creating event network-changed:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h1-860556-1 Oct 06 13:46:27.787236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-df84adee-df11-4a3e-9f0b-6661587090b4 req-f3f7428f-4169-4a25-b6d6-8ae51ec24f13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039474 Oct 06 13:46:27.788035 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3415/6812] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:28.487037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:28.487818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:28.495953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:28.496480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:28.496953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:28.497694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:28.498277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:28.498738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:28.631187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:28.639616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c453085-f9ed-470e-bb31-a999c22c235e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.159296 Oct 06 13:46:28.640203 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3398/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:28 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:29.664520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:29.665259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:29.672340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:29.672826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:29.673279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:29.674025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:29.674494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:29.674933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:29.907855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:29.915604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4c15bfe1-1d78-4bad-96c5-864ae24f789e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.256508 Oct 06 13:46:29.916191 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3416/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:29 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:30.938368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:30.939328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:30.946178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:30.946691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:30.947184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:30.947909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:30.948387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:30.948837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:31.086826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:31.095019 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d2e74cda-dea9-4ca7-9a52-8753b38976e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.160713 Oct 06 13:46:31.095591 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3399/6815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:30 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:32.116796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:32.117426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:32.124580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:32.125096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:32.125542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:32.126279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:32.126746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:32.127181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:32.261208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:32.269935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-908cb6e4-e722-4d60-9253-0b1d3060518a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.157046 Oct 06 13:46:32.270504 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3417/6816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:32 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:32.569815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "name": "network-vif-plugged", "status": "completed", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:32.581895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:32.582689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:32.582908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:32.595677 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] Creating event network-vif-plugged:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h1-860556-1 Oct 06 13:46:32.605930 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5acfd073-76fc-410c-8416-a7cb724d615a req-a963c528-9ad7-4fb6-8495-3825fd7a0472 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Oct 06 13:46:32.605930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3400/6817] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:46:33.293546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:33.294816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:33.302047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:33.302538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:33.302983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:33.303687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:33.304152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:33.304583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:33.434178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:33.442162 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f6e34396-6734-47ec-ac56-85a2798a50d3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1363 microversion: 2.1 time: 0.152780 Oct 06 13:46:33.442752 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3418/6818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:33 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:46:34.465928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:34.466591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:34.472896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:34.473395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:34.473885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:34.474602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:34.475075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:34.475526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:34.611337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:46:34.619213 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd1f7dd4-9723-41ff-8380-ba1e597bdec2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1549 microversion: 2.1 time: 0.158475 Oct 06 13:46:34.619787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3401/6819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:46:34 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:46:34.642185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:46:34.642957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:46:34.645967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:34.646737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:34.653053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:34.653551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:34.654014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:34.654713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:34.655169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:34.655593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:34.732521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-adc9b7d3-2d3c-467b-aae1-483c8cb9549c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093706 Oct 06 13:46:34.733129 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3419/6820] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:46:34 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:46:35.680887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:46:35.686069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:46:35.693154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:46:35.693759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:46:35.694591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:46:35.705635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] Creating event network-changed:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h1-860556-1 Oct 06 13:46:35.710901 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-79b03a3f-ace5-4103-a7c3-89b52ddf2623 req-b7caac07-5a47-4fe9-bce8-eadc388a5d85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Oct 06 13:46:35.711502 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3402/6821] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:11.572103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:11.572966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=32 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:11.577515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:11.578149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:11.585382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.585888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.586332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:11.587021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.587475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.587899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:11.721795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:11.729923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-28f01449-25ae-4107-8ffd-b4a37ed33254 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.160225 Oct 06 13:47:11.730528 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3420/6822] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:11 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:11.751782 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:11.752604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=28 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:11.757349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:11.758098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:11.765519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.766061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.766526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:11.767242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.767719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.768170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:11.905072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:11.913067 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14c502b0-e912-4b65-95ba-22db71578587 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.163566 Oct 06 13:47:11.913652 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3403/6823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:11 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:11.935202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:11.935841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:11.942222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.942708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.943150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:11.943853 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:11.944307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:11.944737 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:12.077157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:12.084954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34123306-50d9-452a-b3f3-e6cf6b14a83e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.154109 Oct 06 13:47:12.085515 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3421/6824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:11 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:12.107303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:12.109562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:12.115633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:12.116169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:12.116633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:12.117349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:12.117863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:12.118315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:12.147445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:12.152820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Old instance type m1.heat2, new instance type m1.heat {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:47:12.159290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:47:12.159730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:47:12.160219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:47:12.160646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:47:12.161077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:47:12.227580 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6476f7b8-9437-45d1-8433-2a3156708df6 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/action" status: 202 len: 0 microversion: 2.1 time: 0.124071 Oct 06 13:47:12.231854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3404/6825] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:47:12 2022] POST /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:47:12.237157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:12.237821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:12.243786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:12.244271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:12.244706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:12.245408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:12.245885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:12.246310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:12.391981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:12.399882 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8ec3bf3c-e909-47bb-aa13-2c240d9b02fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1677 microversion: 2.1 time: 0.166533 Oct 06 13:47:12.400626 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3422/6826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:12 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:13.423866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:13.424502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:13.432477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:13.432973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:13.433426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:13.434208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:13.434684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:13.435128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:13.655363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:13.663153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d86f5a81-b88a-4ee6-a401-71791b83cfea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1677 microversion: 2.1 time: 0.244159 Oct 06 13:47:13.663739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3405/6827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:13 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:14.686948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:14.687605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:14.694658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:14.695133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:14.695570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:14.696258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:14.696712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:14.697138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:14.838029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:14.846297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c2fe5d7c-eb8b-4170-aa2f-eb3744359f5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.163325 Oct 06 13:47:14.846873 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3423/6828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:14 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:15.870399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:15.871031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:15.878710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:15.879242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:15.879697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:15.880406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:15.880875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:15.881316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:16.014790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:16.022639 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f7d8d1be-1129-4dde-807d-23cc44b07a4d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.156282 Oct 06 13:47:16.023218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3406/6829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:15 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:17.046756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:17.047307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:17.054416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:17.054908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:17.055349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:17.056050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:17.056506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:17.057159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:17.190591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:17.198641 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d3bf072a-a7d3-41ed-bbf0-0b77ecb37ed7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.155820 Oct 06 13:47:17.199204 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3424/6830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:17 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:18.222503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:18.223135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:18.230093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:18.230604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:18.231082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:18.231858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:18.232363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:18.232817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:18.366296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:18.374727 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-653939f3-0663-472d-945b-36857e62525b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.156143 Oct 06 13:47:18.375305 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3407/6831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:18 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:19.397617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:19.398341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:19.405135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:19.405637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:19.406092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:19.406791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:19.407252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:19.407687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:19.536725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:19.545194 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-412af6cf-f8c3-43b1-a2e5-f2b63f8d780d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.151515 Oct 06 13:47:19.545793 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3425/6832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:19 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:20.568734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:20.569394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:20.576934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:20.577441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:20.577930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:20.578654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:20.579134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:20.579587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:20.709538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:20.717455 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d979636b-c7d2-4672-9dee-2a63557b48ff tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.152660 Oct 06 13:47:20.718069 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3408/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:20 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:21.741706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:21.742390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:21.749599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:21.750116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:21.750552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:21.751258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:21.751717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:21.752143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:21.889097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:21.897230 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c261631-86c6-474d-a18c-3711b94a2c6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.159913 Oct 06 13:47:21.897601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3426/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:21 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:22.921280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:22.921938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:22.929070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:22.929577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:22.930066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:22.930783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:22.931257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:22.931702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:23.063251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:23.071313 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f63b8c2e-7b6a-4bd3-bba3-4be9c9837fa1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.154680 Oct 06 13:47:23.071894 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3409/6835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:22 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:24.095962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:24.096524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:24.104729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:24.105224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:24.105666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:24.106403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:24.106860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:24.107292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:24.254472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:24.263860 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cae9929d-d127-4058-aa86-db139b4e906b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.173367 Oct 06 13:47:24.264450 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3427/6836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:24 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:25.287018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:25.287737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:25.294720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:25.295225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:25.295721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:25.296435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:25.296910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:25.297353 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:25.428316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:25.436787 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-417c2b0a-f084-4412-a719-1589a4b7de0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.153669 Oct 06 13:47:25.437378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3410/6837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:25 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:26.460746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:26.461364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:26.469002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:26.469491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:26.469960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:26.470665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:26.471123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:26.471553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:26.606021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:26.614136 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16cf48e0-a1ab-4614-908a-5149d7610f7e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.157502 Oct 06 13:47:26.614727 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3428/6838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:26 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:27.638391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:27.639036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:27.645692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:27.646238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:27.646712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:27.647438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:27.647927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:27.648384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:28.091191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:28.099851 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6e6fd03-0653-449a-ae42-de04d0614a5a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.465554 Oct 06 13:47:28.100466 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3411/6839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:27 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:29.123216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:29.123841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:29.131054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:29.131781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:29.131991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:29.132708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:29.133632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:29.133632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:29.270325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:29.278755 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-19754c0e-6987-4696-8e9b-565f63704856 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.159411 Oct 06 13:47:29.279838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3429/6840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:29 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:30.303997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:30.303997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:30.310913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:30.311421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:30.311879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:30.312594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:30.313075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:30.313524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:30.450147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:30.458094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9eac16d6-02ce-4ff8-a651-b8862ffca6c2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1682 microversion: 2.1 time: 0.159393 Oct 06 13:47:30.458677 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3412/6841] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:30 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:31.482828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:31.483454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:31.490725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:31.491227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:31.491708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:31.492446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:31.492914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:31.493346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:31.635226 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:31.643102 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cfcee3c3-7854-4ee0-8045-1715da78eaf2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1681 microversion: 2.1 time: 0.164910 Oct 06 13:47:31.643684 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3430/6842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:31 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:32.148416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "name": "network-vif-unplugged", "status": "completed", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:32.158612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:32.159201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:32.159727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:32.175225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Creating event network-vif-unplugged:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h2-860556-1 Oct 06 13:47:32.181033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] Instance 60c58a87-8cce-4929-a4a8-756991c8515b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:47:32.193850 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5995b8d8-ab0a-4edb-9632-89269746da42 req-e1fa0bc4-298b-4aa9-8e21-4caa705d8964 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100948 Oct 06 13:47:32.194266 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3413/6843] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:32.666604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:32.667402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:32.674506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:32.675000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:32.675640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:32.676362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:32.676830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:32.677271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:32.813567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:32.822379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-42ddcf27-44e5-44aa-be1a-6ba5bfa07978 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1681 microversion: 2.1 time: 0.159606 Oct 06 13:47:32.822969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3431/6844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:32 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:33.846280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:33.847001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:33.854510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:33.855013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:33.855471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:33.856190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:33.856666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:33.857649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:33.998408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:34.007233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5944be08-57cc-4fa1-964e-f386376c78cc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1679 microversion: 2.1 time: 0.165190 Oct 06 13:47:34.008229 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3414/6845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:33 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:34.209128 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:34.220132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:34.220618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:34.221058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:34.233828 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Creating event network-changed:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h2-860556-1 Oct 06 13:47:34.239140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] Instance 60c58a87-8cce-4929-a4a8-756991c8515b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:47:34.250440 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d3def5cf-818f-4559-be9f-1b529b3e48e3 req-9a736b2f-c872-439f-bf66-48b8dc30fdfb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045002 Oct 06 13:47:34.251106 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3432/6846] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:35.031777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:35.032599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:35.039896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:35.040401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:35.040859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:35.041574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:35.042082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:35.042530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:35.181076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:35.188923 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a45fad01-9f54-4b07-bc42-892a1b3ef58c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1679 microversion: 2.1 time: 0.161664 Oct 06 13:47:35.189778 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3415/6847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:35 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:36.213879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:36.214611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:36.222011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:36.222506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:36.222954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:36.223678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:36.224145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:36.224580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:36.389268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:36.399097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9dc7ce3b-d65d-4e3f-ba70-3336e509c3b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1679 microversion: 2.1 time: 0.190261 Oct 06 13:47:36.399950 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3433/6848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:36 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:37.422883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:37.423724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:37.431305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.431817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.432279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.433019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.433502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.433984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.580005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:37.588126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4eff019-6caf-4b1a-a4e1-7c3fdd8dc737 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1676 microversion: 2.1 time: 0.169333 Oct 06 13:47:37.588735 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3416/6849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:37 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:37.611744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:37.612329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:37.619836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.620318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.620755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.621452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.621934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.622992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.693188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ceb0b9ad-801f-4729-9ebc-0d6f11e8a5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/action" status: 204 len: 0 microversion: 2.1 time: 0.085146 Oct 06 13:47:37.694342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3434/6850] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:47:37 2022] POST /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:47:37.704827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:37.706050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:37.713031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.714470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.715082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.716391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.717364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.718026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.749337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "name": "network-vif-plugged", "status": "completed", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:37.759254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:37.759760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:37.760214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:37.774005 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Creating event network-vif-plugged:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h2-860556-1 Oct 06 13:47:37.779816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] Instance 60c58a87-8cce-4929-a4a8-756991c8515b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:47:37.792754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-81b0d7a2-a04f-42a4-a607-439d5e105401 req-6fcf6007-d8e3-4315-99e1-5064c90599bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103698 Oct 06 13:47:37.793543 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3417/6851] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:47:37.931949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:37.934328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:37.942282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a60872ae-04f2-4be8-8097-909962ec6cb5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1676 microversion: 2.1 time: 0.242413 Oct 06 13:47:37.942903 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3435/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:37 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:38.967451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:38.968276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:38.975889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:38.976416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:38.976880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:38.977616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:38.978140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:38.978594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:39.149307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:39.155411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:39.162809 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99190637-e9c6-47d0-9a73-c97291e50dc2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1676 microversion: 2.1 time: 0.199740 Oct 06 13:47:39.163560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3418/6853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:38 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:40.189545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:40.190232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:40.198175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.198659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.199103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.199803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.200274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.200746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.345403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:40.353453 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fbc87443-a542-4994-8a10-f6fb5623060c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.168026 Oct 06 13:47:40.354081 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3436/6854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:40 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:40.378488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:40.379204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:40.387398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.387940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.388417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.389165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.389650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.390144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.531685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:40.540144 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8d5181d2-3e52-4f19-87c5-ed54dd9e0c7b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.166151 Oct 06 13:47:40.540727 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3419/6855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:40 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:40.562706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:40.563321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:40.569978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.570463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.570899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.571632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.572084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.572522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.737125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:40.745387 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-af152c14-7fb2-44c3-b911-a095b34b66bd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1668 microversion: 2.1 time: 0.186740 Oct 06 13:47:40.746011 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3437/6856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:40 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:40.781593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:40.782563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:40.795393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.795908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.796405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.797177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.797658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.798133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.826511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:47:40.907618 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4fbd8ac-ce6a-43a6-930d-7d1491030bb9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 204 len: 0 microversion: 2.1 time: 0.131276 Oct 06 13:47:40.911915 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3420/6857] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:47:40 2022] DELETE /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:47:40.918244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:40.918980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:40.925574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.926105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.926550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:40.927264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:40.927727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:40.928161 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:41.076270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:41.084520 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-516e4352-6d90-42cc-bdae-f2f57bd15030 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1674 microversion: 2.1 time: 0.171354 Oct 06 13:47:41.085114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3438/6858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:40 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:42.109873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:42.110593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:42.113633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:42.119962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:42.120469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:42.120923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:42.121640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:42.122141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:42.123192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:42.265844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:42.273763 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1671d4b4-d665-481f-a656-a23eb3e5329a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1674 microversion: 2.1 time: 0.168818 Oct 06 13:47:42.274345 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3421/6859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:42 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:43.296938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:43.297680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:43.300638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=39 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:43.306684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:43.307186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:43.307628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:43.308340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:43.308803 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:43.309248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:43.380474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:43.395102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c58a87-8cce-4929-a4a8-756991c8515b", "name": "network-vif-deleted", "tag": "c8cef725-8b1a-4b2d-914d-17d749bbdb2d"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:43.402789 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6b51c8e9-49ef-4fcd-a1db-e2d70beb77d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 200 len: 1607 microversion: 2.1 time: 0.109721 Oct 06 13:47:43.405330 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3439/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:43 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:43.410011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:43.410524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:43.411369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:43.424983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] Creating event network-vif-deleted:c8cef725-8b1a-4b2d-914d-17d749bbdb2d for instance 60c58a87-8cce-4929-a4a8-756991c8515b on n-h2-860556-1 Oct 06 13:47:43.433084 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4c614453-45cc-4b70-a236-169f6d7c0d48 req-0fca55c0-ec40-4472-86d5-cf6ddde0813e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043888 Oct 06 13:47:43.433928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3422/6861] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:44.428216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:44.428841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:44.437993 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:44.438491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:44.438933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:44.439913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:44.440369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:44.440796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:44.455509 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b HTTP/1.1 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '60c58a87-8cce-4929-a4a8-756991c8515b'} Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:47:44.457164 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9333a57-209a-4275-95f2-7194d485c5d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 404 len: 111 microversion: 2.1 time: 0.035054 Oct 06 13:47:44.462480 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3440/6862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:44 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:47:44.477222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:44.477985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:44.485956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:44.486467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:44.486922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:44.487647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:44.488120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:44.488565 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:44.502336 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b HTTP/1.1 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '60c58a87-8cce-4929-a4a8-756991c8515b'} Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:47:44.504001 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a46cb1b4-b109-44d2-84d1-b7a118c2d2e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 404 len: 111 microversion: 2.1 time: 0.032750 Oct 06 13:47:44.508317 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3423/6863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:44 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:47:44.557020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1811953790", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d830276e-fb4a-4aa7-9e9b-05f020c03c9b"}], "security_groups": [{"name": "tempest-securitygroup--990383096"}], "key_name": "tempest-keypair-1931333948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:44.673143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] validate_networks() for [('d830276e-fb4a-4aa7-9e9b-05f020c03c9b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:47:45.141198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:47:45.141637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:47:45.142180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:47:45.142591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:47:45.143028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:47:45.155183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:45.155678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:45.156123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:45.156865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:45.157327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:45.157776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:45.189187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:47:45.195396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:47:45.209445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:47:45.211819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:47:45.271218 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f7d3561-5172-4fe7-8359-d20ac9ebe9a5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718014 Oct 06 13:47:45.271899 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3441/6864] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:47:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:47:45.284030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5c300dfe-9dc1-4093-96ec-fe8f853f2792 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:45.284985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5c300dfe-9dc1-4093-96ec-fe8f853f2792 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:45.348296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5c300dfe-9dc1-4093-96ec-fe8f853f2792 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:45.367914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5c300dfe-9dc1-4093-96ec-fe8f853f2792 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1239 microversion: 2.1 time: 0.086786 Oct 06 13:47:45.368705 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3424/6865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:45 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:46.391680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:46.392710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:46.401500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:46.402028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:46.402587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:46.403360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:46.403863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:46.404305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:46.479640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:46.493783 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4463daa-bf30-4328-9256-6c6e4181dcb0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1299 microversion: 2.1 time: 0.107643 Oct 06 13:47:46.494575 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3442/6866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:46 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:47:47.518203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:47.518842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:47.527744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:47.528270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:47.529301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:47.530084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:47.530599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:47.531065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:47.679689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:47.688464 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb18c149-f856-4e69-a941-3729ca6c1055 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.174113 Oct 06 13:47:47.689058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3425/6867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:47 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:47.929671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:47.941901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:47.942490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:47.943038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:47.958533 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] Creating event network-changed:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h2-860556-1 Oct 06 13:47:47.965464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dbc29b63-3558-433a-ad83-d4a4e3ad923d req-099944cf-a3d8-48d7-a8f2-8c102507e883 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039457 Oct 06 13:47:47.966148 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3443/6868] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:48.714771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:48.715439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:48.722435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:48.722947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:48.723411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:48.724140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:48.725147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:48.725147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:48.859408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:48.867150 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-142dae5d-f104-4580-bcf7-0a4ea25f23bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.156394 Oct 06 13:47:48.867741 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3426/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:48 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:49.896728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:49.897431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:49.904177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:49.904659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:49.905097 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:49.905815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:49.906270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:49.906695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:50.036891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:50.045342 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13faff55-19c2-4a5f-b111-fbba95d9290b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.153833 Oct 06 13:47:50.045940 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3444/6870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:49 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:51.068657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:51.069316 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:51.076944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:51.077456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:51.077951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:51.078678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:51.079160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:51.079609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:51.214294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:51.222895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4946e8a3-ccde-4c3f-b048-abcfab3124b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.158421 Oct 06 13:47:51.223476 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3427/6871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:51 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:52.246142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:52.246761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:52.253653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:52.254176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:52.254622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:52.255316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:52.255778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:52.256215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:52.386269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:52.393988 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7be00ba2-40b7-4c48-9a87-39e9f19683b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.151818 Oct 06 13:47:52.394568 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3445/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:52 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:53.417894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:53.418534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:53.426123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:53.426635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:53.427089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:53.428124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:53.428777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:53.429249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:53.528267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "name": "network-vif-plugged", "status": "completed", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:53.539958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:53.540799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:53.541484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:53.555963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] Creating event network-vif-plugged:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h2-860556-1 Oct 06 13:47:53.562512 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d19187df-1d6c-42a5-95a7-e0372f62a075 req-ceb86f17-d91f-4368-a9a4-99806500df43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037933 Oct 06 13:47:53.563726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3446/6873] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:53.569907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:53.578210 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2644bd0b-fc31-4142-a138-4eed9f9d13d5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.164314 Oct 06 13:47:53.578790 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3428/6874] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:53 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:54.603407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:54.604121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:54.610962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:54.611448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:54.611892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:54.612591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:54.613057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:54.613535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:54.744503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:54.752886 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-19b1829d-aec1-4085-966a-f666888ecdf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1364 microversion: 2.1 time: 0.153776 Oct 06 13:47:54.753463 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3447/6875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:54 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:55.776518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:55.777168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:55.780664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:55.786695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:55.787220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:55.787687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:55.788422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:55.788929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:55.789362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:55.927256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:47:55.934783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c30bfd5-d43e-496a-931e-eee3736e3b5b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1551 microversion: 2.1 time: 0.162182 Oct 06 13:47:55.935378 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3429/6876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:47:55 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:47:55.959764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:47:55.960264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:47:55.962526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:55.963658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:47:55.972032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:55.972519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:55.972953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:55.973652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:55.974137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:55.974563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:56.054742 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64441b95-2f5b-4f82-af9b-70808becfdcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098842 Oct 06 13:47:56.055347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3448/6877] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:47:55 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:47:57.096908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:47:57.106777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:47:57.107275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:47:57.108286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:47:57.119700 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] Creating event network-changed:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h2-860556-1 Oct 06 13:47:57.125319 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9e1372d8-7e7f-44dd-aebc-cc333a0868c9 req-00e4ac76-a3f4-48be-98d3-f7f744ec8258 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086685 Oct 06 13:47:57.126161 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3430/6878] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:49:09.119903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:09.120794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=61 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:09.125915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:09.133985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:09.134494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:09.134939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:09.163651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 13:49:09.211301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0f369000-9286-422b-ac5a-b5248627fb90 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action" status: 202 len: 0 microversion: 2.1 time: 0.094672 Oct 06 13:49:09.211911 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3449/6879] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:49:09 2022] POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:49:09.219021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=21 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:09.220395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:09.225691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:09.226887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:09.235819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:09.236327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:09.236799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:09.237545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:09.238081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:09.238540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:09.392719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:09.401030 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43b8ef33-c8d9-48cd-a01f-08b6526d3958 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.184222 Oct 06 13:49:09.401617 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3431/6880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:09 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:10.426058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:10.426779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:10.433329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:10.433860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:10.434307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:10.435014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:10.435477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:10.435910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:10.571504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:10.579198 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20bf516e-d60f-46da-a71d-698ed8407c66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.158378 Oct 06 13:49:10.579774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3450/6881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:10 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:11.604977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:11.605623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:11.615729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:11.616246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:11.616723 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:11.617457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:11.617994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:11.618450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:11.767851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:11.776026 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d05e08b6-d319-4285-8304-4e5f277fcfd1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.174862 Oct 06 13:49:11.776626 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3432/6882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:11 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:12.800561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:12.801205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:12.808817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:12.809308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:12.809773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:12.810477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:12.810930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:12.811357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:12.944892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:12.952706 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bb3ec365-832a-4262-a76c-dbe70697647f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.156644 Oct 06 13:49:12.953292 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3451/6883] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:12 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:13.976193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:13.976740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:13.983634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:13.984133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:13.984590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:13.985298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:13.985798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:13.986244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:14.127189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:14.135753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-46b372cd-460c-4760-acc9-488dcfed5b45 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.163646 Oct 06 13:49:14.136342 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3433/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:13 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:15.159619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:15.160283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:15.167765 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:15.168257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:15.168702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:15.169405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:15.169895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:15.170332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:15.305407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:15.313241 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8ba1d41-1495-4956-982c-8252978f3658 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.157519 Oct 06 13:49:15.313913 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3452/6885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:15 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:16.336761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:16.337422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:16.344323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:16.344823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:16.345287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:16.346024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:16.346499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:16.346944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:16.478005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:16.485810 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2b96f981-270a-4037-a893-bc4015ed9664 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.153090 Oct 06 13:49:16.486400 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3434/6886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:16 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:49:17.510519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:17.511209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:17.518493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:17.518982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:17.519421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:17.520112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:17.520569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:17.521773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:17.652823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:17.660617 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e670dd2-d964-43a3-9651-ae0f897d6e0b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.155073 Oct 06 13:49:17.661197 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3453/6887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:17 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:18.684131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:18.684771 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:18.691986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:18.692489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:18.693009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:18.693729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:18.694230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:18.694680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:18.826528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:18.835780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67dc48ff-7acf-4cb2-b757-0a66adaeca92 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.155592 Oct 06 13:49:18.836659 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3435/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:18 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:19.860321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:19.860935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:19.867920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:19.868399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:19.868833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:19.869524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:19.870007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:19.870432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:20.001818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:20.011179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e25805ce-71db-4bff-8027-d0ab91f0ce68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1657 microversion: 2.1 time: 0.154807 Oct 06 13:49:20.011762 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3454/6889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:19 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:20.034375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:20.036789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:20.043955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:20.044469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:20.044933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:20.045660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:20.046169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:20.046625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:20.079097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:20.084687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Old instance type m1.heat2, new instance type m1.heat {{(pid=129614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:49:20.094150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:49:20.094592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:49:20.095116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:49:20.095519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:49:20.095949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:49:20.160147 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1013524d-07db-4956-ad81-6e3b04e623e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action" status: 202 len: 0 microversion: 2.1 time: 0.129716 Oct 06 13:49:20.160825 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3436/6890] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:49:20 2022] POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:49:20.169383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:20.170041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:20.176974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:20.177668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:20.178270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:20.179084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:20.179560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:20.179998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:20.323329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:20.331306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79f9fc1c-6b91-4b86-87ef-ef5b1d5c2210 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.166045 Oct 06 13:49:20.332126 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3455/6891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:20 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:21.356583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:21.357242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:21.364385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:21.365119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:21.365589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:21.366868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:21.367348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:21.367794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:21.515338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:21.523161 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07fdda9d-3a36-4f26-91a9-8324c42a265b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1680 microversion: 2.1 time: 0.171378 Oct 06 13:49:21.523802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3437/6892] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:21 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:22.555519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:22.556150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:22.564469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:22.565262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:22.566036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:22.566741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:22.567198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:22.567631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:22.709942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:22.717805 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ebc51d52-58c8-490b-be61-17ec049008a8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1685 microversion: 2.1 time: 0.167865 Oct 06 13:49:22.718392 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3456/6893] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:22 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:23.741693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:23.742364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:23.749216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:23.749730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:23.750222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:23.751018 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:23.751502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:23.751956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:23.884769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:23.893484 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c8a966f-d8ca-43a1-920c-6c1ca230c2f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1685 microversion: 2.1 time: 0.155729 Oct 06 13:49:23.894118 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3438/6894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:23 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:24.918834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:24.919497 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:24.922625 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:49:24.922774 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 (ip 10.222.0.26) !!! Oct 06 13:49:24.930185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:24.930675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:24.931126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:24.931835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:24.932293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:24.932724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:25.116980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:25.126167 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bda0df8c-bce9-4fac-a0f8-e1898d0f7941 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1684 microversion: 2.1 time: 0.211120 Oct 06 13:49:25.126919 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3457/6895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:24 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1684 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:25.170975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "name": "network-vif-unplugged", "status": "completed", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:25.176944 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:49:25.177716 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:49:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 13:49:25.194230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:25.196066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:25.196066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:25.206995 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Creating event network-vif-unplugged:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h1-860556-1 Oct 06 13:49:25.213056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:49:25.225002 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0ba499af-34ff-4439-a5be-67f2881001b3 req-2de09dab-2070-47cb-b6f4-9e2cef04743e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057989 Oct 06 13:49:25.225618 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3439/6896] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:49:26.151241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:26.151784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:26.159116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:26.159612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:26.160081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:26.160897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:26.161379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:26.162377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:26.371793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:26.379548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3378ac63-227a-4ecc-88f4-de3dbbf95f37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1684 microversion: 2.1 time: 0.232351 Oct 06 13:49:26.380914 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3458/6897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:26 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:27.248134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:27.259567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:27.260189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:27.260822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:27.273514 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Creating event network-changed:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h1-860556-1 Oct 06 13:49:27.278866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:49:27.290691 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-e349c775-74e8-490b-bebd-89688fc9c6b5 req-ee1b554c-656c-4816-b7c8-2d286fa5f035 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046705 Oct 06 13:49:27.291287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3440/6898] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:49:27.403090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:27.403709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:27.410583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:27.411070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:27.411528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:27.412327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:27.413431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:27.413910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:27.552549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:27.561640 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-154d7a15-c2a5-4a53-b292-2e2f96e7c24f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1682 microversion: 2.1 time: 0.162338 Oct 06 13:49:27.566154 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3459/6899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:27 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:28.586810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:28.587541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:28.594736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.595248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.595718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:28.596437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.596920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.597374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:28.734586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:28.743297 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-197a444d-b562-4289-882b-d665899667e4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1678 microversion: 2.1 time: 0.160747 Oct 06 13:49:28.743867 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3441/6900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:28 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:28.766439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:28.766978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:28.774024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.774516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.774956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:28.775664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.776126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.776557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:28.839407 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-623a0331-3785-47c0-9a95-bf6eb68e2b8b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action" status: 204 len: 0 microversion: 2.1 time: 0.076765 Oct 06 13:49:28.840446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3460/6901] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:49:28 2022] POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 13:49:28.853127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:28.853779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:28.863845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.864358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.864844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:28.865568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:28.866067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:28.866514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:29.000934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:29.009572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11d4cb98-79b8-427d-a800-c5d679aa8604 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1678 microversion: 2.1 time: 0.162732 Oct 06 13:49:29.010194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3442/6902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:28 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:30.034040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:30.034747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:30.041590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:30.042112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:30.042559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:30.043263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:30.043723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:30.044152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:30.193981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:30.201810 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fc8110d1-d4f0-4e54-9b85-2b2bed2fefdf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1678 microversion: 2.1 time: 0.173058 Oct 06 13:49:30.202394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3461/6903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:30 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:31.229265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:31.229938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:31.237053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.237566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.238056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.238777 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.239257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.240222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.374178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:31.383099 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-060e4f7d-e09e-4fe7-9ea8-60fcc66f1bd4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1657 microversion: 2.1 time: 0.157726 Oct 06 13:49:31.383695 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3443/6904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:31 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:31.405603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:31.406260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:31.414630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.415423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.415870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.416580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.417038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.417462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.525351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "name": "network-vif-plugged", "status": "completed", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:31.535809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.536464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.537558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.549396 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] Creating event network-vif-plugged:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h1-860556-1 Oct 06 13:49:31.554741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-53c8ef8b-1f50-48b8-b73a-33211f4d3881 req-ede4166e-7814-411a-a902-76731bc4bf11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Oct 06 13:49:31.555528 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3444/6905] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:49:31.586697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:31.594948 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fbfe33a-746c-4c31-97dd-f345e9655c72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1657 microversion: 2.1 time: 0.193231 Oct 06 13:49:31.595533 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3462/6906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:31 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1657 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:31.619545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:31.625805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.626319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.626780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.650160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Going to try to start instance {{(pid=129614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 13:49:31.691786 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-934bfb08-c98c-41fc-8858-71ebcc55af1b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action" status: 202 len: 0 microversion: 2.1 time: 0.076432 Oct 06 13:49:31.692401 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3445/6907] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:49:31 2022] POST /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:49:31.702241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:31.702875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:31.710317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.710793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.711300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.712518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:31.712997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:31.713433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:31.730403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:31.934002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:31.942136 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88fb0baa-db02-49a4-804f-fac93342f375 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1666 microversion: 2.1 time: 0.244204 Oct 06 13:49:31.942726 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3463/6908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:31 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1666 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:49:32.965822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:32.966562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:32.973820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:32.974339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:32.974809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:32.975533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:32.976019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:32.976479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:32.995359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:33.116164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:33.124862 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17c5098d-67a3-442d-a67d-b2d7efcbe887 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1670 microversion: 2.1 time: 0.163305 Oct 06 13:49:33.125448 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3446/6909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:32 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:33.147293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:33.148079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:33.155767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:33.156262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:33.156706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:33.157409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:33.157897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:33.158332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:33.187990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:49:33.264802 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f1d991d0-e4e5-4ec9-8f9f-8329be4b668c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 204 len: 0 microversion: 2.1 time: 0.121097 Oct 06 13:49:33.265434 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3464/6910] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:49:33 2022] DELETE /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:49:33.274675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:33.275301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:33.281293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:33.281830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:33.282292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:33.283017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:33.283472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:33.283919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:33.418998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:33.427510 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4cd0ed3b-00b7-4b40-9ce1-246136f3da68 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1676 microversion: 2.1 time: 0.156260 Oct 06 13:49:33.428107 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3447/6911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:33 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:34.451919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:34.452472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:34.459843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:34.460324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:34.460766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:34.461463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:34.461954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:34.462387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:34.594138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:34.602732 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1d87f5a-8209-4bbe-aaee-33a1e31c43e3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1676 microversion: 2.1 time: 0.155421 Oct 06 13:49:34.603317 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3465/6912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:34 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:35.554511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42de88b3-d25e-4b6e-82c9-56e5a453d023", "name": "network-vif-deleted", "tag": "49900e6c-b8ba-4aee-9738-935b8bd7eb8e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:35.578873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:35.580385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:35.581071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:35.595199 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] Creating event network-vif-deleted:49900e6c-b8ba-4aee-9738-935b8bd7eb8e for instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 on n-h1-860556-1 Oct 06 13:49:35.601365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-58bfd200-1a62-4ec1-8b5c-5ddad6d88bf9 req-72aea989-9cac-4e11-a56c-70c2a8b1ddbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051798 Oct 06 13:49:35.602323 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3448/6913] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:49:35.626292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:35.626811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:35.635000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:35.635564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:35.636029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:35.636749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:35.637220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:35.637718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:35.679377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:35.679865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:35.680303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:35.680758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lazy-loading 'fault' on Instance uuid 42de88b3-d25e-4b6e-82c9-56e5a453d023 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:49:35.728373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:35.742463 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9a08f4c8-8d87-4200-a771-5619f595092d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 200 len: 1329 microversion: 2.1 time: 0.119690 Oct 06 13:49:35.745813 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3466/6914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:35 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:49:36.767093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:36.767820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:36.775250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:36.775766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:36.776226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:36.776938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:36.777420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:36.777902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:36.791692 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 HTTP/1.1 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '42de88b3-d25e-4b6e-82c9-56e5a453d023'} Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:49:36.793324 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:49:36.797424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb7ea950-8c05-437e-9b3e-92254d6fd94d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 404 len: 111 microversion: 2.1 time: 0.032011 Oct 06 13:49:36.798909 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3449/6915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:36 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:49:36.814895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:36.815515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:36.823631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:36.824222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:36.824569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:36.825272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:36.825751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:36.826195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:36.842666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 HTTP/1.1 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '42de88b3-d25e-4b6e-82c9-56e5a453d023'} Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:49:36.844320 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-788db4c5-79dd-451e-8cd8-c9f79f0ac048 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 404 len: 111 microversion: 2.1 time: 0.034790 Oct 06 13:49:36.849711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3467/6916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:36 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:49:36.894929 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-547623347", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d830276e-fb4a-4aa7-9e9b-05f020c03c9b"}], "security_groups": [{"name": "tempest-securitygroup--990383096"}], "key_name": "tempest-keypair-1931333948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:36.999784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] validate_networks() for [('d830276e-fb4a-4aa7-9e9b-05f020c03c9b', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:49:37.486132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:49:37.486573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:49:37.487098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:49:37.487546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:49:37.487975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:49:37.497085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:37.497584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:37.498081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:37.498827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:37.499298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:37.499737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:37.520384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:49:37.526960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:49:37.541219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:49:37.543581 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:49:37.594660 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e75ad5f6-1715-41b8-9f4c-79ff31789366 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703640 Oct 06 13:49:37.595323 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3450/6917] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:49:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:49:37.608355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0172a29-503f-4a38-9d08-7236cdd0dea0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:37.608975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0172a29-503f-4a38-9d08-7236cdd0dea0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:37.673699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0172a29-503f-4a38-9d08-7236cdd0dea0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:37.680944 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0172a29-503f-4a38-9d08-7236cdd0dea0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1238 microversion: 2.1 time: 0.076500 Oct 06 13:49:37.681519 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3468/6918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:37 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:38.706052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:38.706724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:38.715365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:38.715902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:38.716366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:38.717134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:38.717615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:38.718105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:38.790686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:38.801249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e9f8c47-5dae-4ed8-925f-356734429580 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1298 microversion: 2.1 time: 0.098931 Oct 06 13:49:38.811739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3451/6919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:38 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:39.826383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:39.827630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:39.830481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:39.836995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:39.837481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:39.837945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:39.838648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:39.839100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:39.839524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:39.982571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:39.991669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a70f2af7-ee13-4957-ad08-cef2f191d5ab tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.169053 Oct 06 13:49:39.992265 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3469/6920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:39 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:40.219607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:40.227503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:40.232186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:40.232948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:40.233406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:40.246592 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] Creating event network-changed:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:49:40.251560 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cb7ef3b4-f618-4896-99ce-44a59d39abdc req-c269a5ce-b8bb-4f4d-8e67-ac72653e7f72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035948 Oct 06 13:49:40.252166 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3452/6921] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:49:41.015923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:41.016553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:41.023666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:41.024147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:41.024582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:41.025277 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:41.025731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:41.026187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:41.158719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:41.166549 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-06a77582-7f83-4701-8925-7e24eb389607 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.154487 Oct 06 13:49:41.167143 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3470/6922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:41 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:42.191989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:42.193273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:42.199936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:42.200447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:42.200916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:42.201635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:42.202172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:42.202616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:42.342804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:42.351000 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b1cc2640-2b78-4627-a036-1fbe988599fc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.164294 Oct 06 13:49:42.351614 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3453/6923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:42 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:43.373546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:43.374194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:43.381715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:43.382224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:43.382666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:43.383362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:43.383818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:43.384244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:43.519200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:43.531081 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-751e3d1e-a47a-40d4-9897-6b56a88073b3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.161362 Oct 06 13:49:43.531668 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3471/6924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:43 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:44.557098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:44.557714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:44.565162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:44.565676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:44.566425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:44.567153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:44.568159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:44.568615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:44.715720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:44.724081 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7e14f51c-f8d1-4834-8536-c703ed4c11a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.170835 Oct 06 13:49:44.724784 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3454/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:44 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:45.748815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:45.749577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:45.757370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:45.758193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:45.758631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:45.759330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:45.759785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:45.760388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:45.894891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:45.903494 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ae5ab2f6-6053-4095-b545-8d48eaded5fb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.158934 Oct 06 13:49:45.904071 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3472/6926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:45 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:46.268968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-plugged", "status": "completed", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:46.280705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:46.281217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:46.281716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:46.293956 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] Creating event network-vif-plugged:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:49:46.298997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5e853fdf-4b50-4b61-8ae4-ebb6dd6db762 req-0586589d-dfc1-4c17-9cec-d154a2f80f03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034329 Oct 06 13:49:46.300007 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3455/6927] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:49:46.927520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:46.928136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:46.936991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:46.937541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:46.938085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:46.938848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:46.939393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:46.939895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:47.089220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:47.097932 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48c8d73e-e7a3-4b27-869d-63d11a65f5a0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1363 microversion: 2.1 time: 0.174075 Oct 06 13:49:47.098761 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3473/6928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:46 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:48.123212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:48.124127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:48.128826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:48.129552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:48.137467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:48.138000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:48.138460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:48.139205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:48.139681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:48.140127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:48.272987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:49:48.280893 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1652c433-5a36-45ea-ba5b-89d0631f8da1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1549 microversion: 2.1 time: 0.159685 Oct 06 13:49:48.281479 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3456/6929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:49:48 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:49:48.306008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:49:48.306654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:49:48.308984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:49:48.315417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:48.316163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:48.316718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:48.317560 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:48.318049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:48.318478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:48.402954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63106ead-44b4-45b5-8ebf-3d8d626609d7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102857 Oct 06 13:49:48.403580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3474/6930] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:49:48 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:49:49.735176 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:49:49.745997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:49:49.746513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:49:49.746977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:49:49.762248 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] Creating event network-changed:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:49:49.768568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b39c5d17-ea65-46d8-9e12-237d07f1ce7b req-c388e014-21f4-4b5b-aae9-a8f379ab7d6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037131 Oct 06 13:49:49.769622 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3457/6931] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:03.915772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=11 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:03.916599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:03.921189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:03.923443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:03.933763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:03.934247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:03.934685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:03.935376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:03.935827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:03.936250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:03.965590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:03.973245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:51:03.979733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:51:03.980159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:51:03.980633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:51:03.981067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:51:03.981475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:51:04.046912 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:51:05.054399 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 46616. Oct 06 13:51:05.057514 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5ef55dea-f277-4a33-81f0-68bd85f9805c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/action" status: 202 len: 0 microversion: 2.1 time: 1.144243 Oct 06 13:51:05.058199 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3475/6932] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:51:03 2022] POST /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/action => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:51:05.065313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=11 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:05.066104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=44 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:05.070823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:05.071551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:05.082379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:05.082906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:05.083405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:05.084265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:05.084640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:05.085168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:05.240473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:05.249533 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f54a5282-b20d-4204-b1dc-e69da94a4ac5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1677 microversion: 2.1 time: 0.186896 Oct 06 13:51:05.250427 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3458/6933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:05 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:51:06.274888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:06.275412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:06.281612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:06.282131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:06.282571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:06.283328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:06.283854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:06.284288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:06.430624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:06.439293 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5af79879-4f3d-466b-9c93-94d1dcbeddf8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1677 microversion: 2.1 time: 0.170538 Oct 06 13:51:06.440473 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3476/6934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:06 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:07.463512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:07.464062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:07.471034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:07.471547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:07.472006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:07.472733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:07.473214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:07.473666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:07.608794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:07.616605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ec61dcb-2e37-45cf-8174-e7e3a1d048f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.157223 Oct 06 13:51:07.617182 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3459/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:07 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:08.641481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:08.642055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:08.648821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:08.649304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:08.649770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:08.650463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:08.651421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:08.651847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:08.784505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:08.793249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82ed10a1-7ba8-4def-81f8-387cb4b9e18c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.155747 Oct 06 13:51:08.793860 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3477/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:08 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:09.816499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:09.817380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:09.823931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:09.824435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:09.824893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:09.828272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:09.828272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:09.828272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:09.957667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:09.965315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c7d367b5-c9f1-47d6-bb3f-d98625de25ea tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.152929 Oct 06 13:51:09.965945 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3460/6937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:09 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:10.988582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:10.989408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:10.996933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:10.997420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:10.997885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:10.998577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:10.999030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:10.999454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:11.131465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:11.140206 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-662ec166-bd38-4c31-b119-c5095b66ab1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.155239 Oct 06 13:51:11.140724 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3478/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:10 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:12.162415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:12.163046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:12.169953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:12.170456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:12.170910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:12.171617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:12.172088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:12.172528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:12.307807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:12.315733 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c4578f8-042a-4c4a-93d0-8c3d828de673 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.157198 Oct 06 13:51:12.316536 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3461/6939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:12 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:13.339461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:13.340074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:13.347008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:13.347493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:13.347932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:13.348630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:13.349089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:13.349520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:13.482009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:13.489910 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-711e4d0d-7418-412c-84f3-7cc3ef5fb8e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.154732 Oct 06 13:51:13.490435 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3479/6940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:13 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:14.513620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:14.514200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:14.521803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:14.522315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:14.522775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:14.523498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:14.524025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:14.524439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:14.656979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:14.664869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0774e86b-50a5-45b6-bfd5-a96f12f815ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.155705 Oct 06 13:51:14.665644 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3462/6941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:14 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:15.688601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:15.689250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:15.696472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:15.696962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:15.697400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:15.698136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:15.698594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:15.699055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:15.832222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:15.840580 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efbf32ca-1f44-40e0-ad71-fd3b3c64d9b9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.155855 Oct 06 13:51:15.841168 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3480/6942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:15 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:16.864187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:16.864827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:16.872610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:16.873130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:16.873574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:16.874318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:16.874799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:16.875252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:17.008340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:17.016097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44f24d73-144d-495b-b83c-649139dea8b1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.155873 Oct 06 13:51:17.016678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3463/6943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:16 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:18.039051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:18.039667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:18.046581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:18.047068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:18.047505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:18.048200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:18.048689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:18.049120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:18.180015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:18.188414 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d57a9649-f61c-43f4-aa97-7e2f7a7edbd3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.153278 Oct 06 13:51:18.188991 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3481/6944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:18 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:19.212291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:19.212932 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:19.220783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:19.221293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:19.221779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:19.222507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:19.222984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:19.223436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:19.367794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:19.378574 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-25fa4d40-95c6-421b-8ca3-48cf786676e1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1682 microversion: 2.1 time: 0.170143 Oct 06 13:51:19.379374 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3464/6945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:19 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:19.939605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:19.950426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:19.950908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:19.951338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:19.963202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Creating event network-vif-unplugged:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h1-860556-1 Oct 06 13:51:19.968940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:51:19.981078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7af37cf5-67fc-42ef-895b-e435c9e33611 req-f496c99c-1967-4353-b74b-a54706dab306 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045332 Oct 06 13:51:19.981842 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3482/6946] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:51:20.408625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:20.410076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:20.422057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:20.422744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:20.423275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:20.424355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:20.424943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:20.425503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:20.654059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:20.661754 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15009987-98fd-4ce1-8ae6-a5d86576d2c0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1681 microversion: 2.1 time: 0.261232 Oct 06 13:51:20.662348 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3465/6947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:20 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:21.687456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:21.688163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:21.694561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:21.695044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:21.695484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:21.696179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:21.696639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:21.697067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:21.845145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:21.853042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f1babd1-8862-4798-8f12-1b0de6ec6224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1679 microversion: 2.1 time: 0.171484 Oct 06 13:51:21.853629 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3483/6948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:21 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:22.014887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:22.025127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:22.025627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:22.026112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:22.038232 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Creating event network-changed:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h1-860556-1 Oct 06 13:51:22.044073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:51:22.054757 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-96a3b354-1efa-4016-87a1-fe13bd774f7d req-34e38269-a5fb-4614-b818-e121b12d4574 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044194 Oct 06 13:51:22.055363 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3466/6949] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:22.930723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:22.931407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:22.938249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:22.938959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:22.939473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:22.940172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:22.940643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:22.941077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.163922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:23.172488 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f3b26f09-0c35-4e9e-8567-d34dceb73a4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1676 microversion: 2.1 time: 0.298981 Oct 06 13:51:23.173093 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3484/6950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:22 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:23.198036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:23.198702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:23.205970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.206492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.206962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.207703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.208187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.208643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.248358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.248872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.249341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.250182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.250719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.251154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.273924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:51:23.279295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:51:23.396401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d804bbb8-8bf8-439e-93ab-d629867290dc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/action" status: 202 len: 0 microversion: 2.1 time: 0.203791 Oct 06 13:51:23.396930 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3467/6951] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:51:23 2022] POST /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:51:23.405863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:23.406575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:23.415108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.415661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.416164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.416959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:23.417443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:23.417924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:23.625767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:23.636128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-118537b6-af82-480b-9506-087f373d6d33 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.234323 Oct 06 13:51:23.636778 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3485/6952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:23 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:24.664137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:24.664893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:24.672638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:24.673151 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:24.673618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:24.674399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:24.674887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:24.675354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:24.871943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:24.882366 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be5c4540-50ee-4017-a629-c70b7ad99ace tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.223344 Oct 06 13:51:24.882977 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3468/6953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:24 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:25.905683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:25.906438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:25.916443 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:25.916948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:25.917398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:25.918647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:25.919112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:25.919547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:26.068439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:26.079036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-plugged", "status": "completed", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:26.080756 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a8ab19e7-45c8-4009-85f9-c9b50e07fe56 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.179013 Oct 06 13:51:26.081996 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3486/6954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:25 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:26.093555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:26.094108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:26.094571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:26.111834 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Creating event network-vif-plugged:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h1-860556-1 Oct 06 13:51:26.120508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:51:26.134623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ef3b17b7-f1f1-49c9-b775-cdc9fbcfb936 req-aafbd671-bea1-48e5-a6a4-a663aed0487a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062540 Oct 06 13:51:26.135392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3469/6955] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:26.912684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:26.926176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:26.926744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:26.927393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:26.944166 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Creating event network-vif-unplugged:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:51:26.950041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:51:26.964240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2415e471-2d6d-4b2c-98db-aa6afb3cce14 req-cc4463eb-12df-43ab-b81f-b30885c615a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055441 Oct 06 13:51:26.965410 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3487/6956] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:27.111392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:27.112100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:27.119588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:27.120746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:27.121229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:27.122002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:27.122513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:27.122971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:27.266791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:27.275753 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8219e721-01e8-4d56-8ae9-75eea040cefd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.168928 Oct 06 13:51:27.276354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3470/6957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:27 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:28.301650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:28.302309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:28.309338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:28.309868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:28.310313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:28.311020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:28.311474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:28.311902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:28.468733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:28.476667 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2aa13ef3-079a-495e-a097-9b47d0a48251 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.180388 Oct 06 13:51:28.477258 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3488/6958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:28 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:28.997001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:29.007933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:29.008441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:29.008903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:29.021518 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Creating event network-changed:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:51:29.027114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:51:29.038058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-20268ac6-a54f-478f-9ee9-f41e707ef446 req-8461a5b5-c684-4a1d-bd07-c3bcc6cb15e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045605 Oct 06 13:51:29.038690 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3471/6959] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:29.501096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:29.501719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:29.508930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:29.509425 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:29.509902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:29.510618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:29.511085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:29.511517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:29.734300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:29.742929 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d578fbca-574d-4527-823d-c10214100ea8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.246053 Oct 06 13:51:29.743753 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3489/6960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:29 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:30.767173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:30.767986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:30.775670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:30.776160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:30.776695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:30.778766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:30.779603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:30.780294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:30.801545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:31.286242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:31.294498 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-edaa8409-c4ba-4ba9-b826-b71f27185628 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1675 microversion: 2.1 time: 0.531615 Oct 06 13:51:31.295016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3472/6961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:30 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1675 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:32.317890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:32.318534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:32.325342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.325865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.326307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.327000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.327472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.327886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.504132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:32.507781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:32.513214 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-137ada0c-9ecb-4ed1-835f-6e213523058a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1668 microversion: 2.1 time: 0.199588 Oct 06 13:51:32.513813 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3490/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:32 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1668 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:32.535987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:32.536626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:32.544266 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.544774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.545237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.545984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.546469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.546923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.687384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:32.695907 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8f5d090-fc7f-43ea-a422-31d1198b99fe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1668 microversion: 2.1 time: 0.163831 Oct 06 13:51:32.696504 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3473/6963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:32 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:32.720206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:32.720957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:32.728603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.729107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.729552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.730390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.730855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.731290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.870616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:32.879770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d002ab35-9cd1-4a76-b144-6d84ecdebf43 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1668 microversion: 2.1 time: 0.163779 Oct 06 13:51:32.880485 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3491/6964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:32 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:32.903560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:32.904124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:32.910721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.911265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.911732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.912564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:32.913046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:32.913504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:32.940254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:51:33.027055 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1339606b-7a40-47e0-bd16-5680a0b158e2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 204 len: 0 microversion: 2.1 time: 0.127673 Oct 06 13:51:33.028328 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3474/6965] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:51:32 2022] DELETE /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:51:33.036185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:33.036810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:33.042902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:33.043395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:33.043839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:33.044547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:33.045009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:33.045446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:33.186760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:33.195117 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c12c411e-8310-4082-b5c9-b1675220b991 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1674 microversion: 2.1 time: 0.162908 Oct 06 13:51:33.195705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3492/6966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:33 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:34.221710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:34.222305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:34.224503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:34.230517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:34.231027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:34.231483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:34.232199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:34.232671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:34.233115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:34.364783 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:34.372487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-335635d5-48a0-4851-9412-485823f5df1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1674 microversion: 2.1 time: 0.155863 Oct 06 13:51:34.373062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3475/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:34 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:34.790198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-plugged", "status": "completed", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:34.796636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=41 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:34.802327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:34.802816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:34.803244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:34.822437 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] Creating event network-vif-plugged:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:51:34.827862 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-75dee739-af7d-4b0a-ac53-7557f84a8c8f req-c9d49eca-0d65-4ee1-b98c-6869ee7f8b60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041339 Oct 06 13:51:34.828806 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3493/6968] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:35.396089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:35.397327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:35.401599 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:35.406178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:35.406879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:35.407499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:35.408414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:35.409100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:35.409709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:35.432222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb", "name": "network-vif-deleted", "tag": "cfc7fdaa-c047-4149-8272-5b3216ea4e17"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:35.445506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:35.446025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:35.446470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:35.465748 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] Creating event network-vif-deleted:cfc7fdaa-c047-4149-8272-5b3216ea4e17 for instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb on n-h2-860556-1 Oct 06 13:51:35.471935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-7fb5ccbe-59bb-446e-b3cc-1434da93fb86 req-ad30f305-a92a-4336-bdc8-a1e7fe6b18c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043711 Oct 06 13:51:35.472994 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3494/6969] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:35.508458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:35.517235 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efac5b15-5426-487a-aa04-8e2e2f9fb0ee tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 200 len: 1607 microversion: 2.1 time: 0.124991 Oct 06 13:51:35.517852 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3476/6970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:35 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 1607 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:36.541122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:36.541860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:36.549263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:36.549798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:36.550251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:36.550961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:36.551426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:36.551862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:36.568337 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb HTTP/1.1 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb'} Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:51:36.570054 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a43d04bb-ba66-4acc-a03b-f6e2829e6611 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 404 len: 111 microversion: 2.1 time: 0.034616 Oct 06 13:51:36.578997 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3495/6971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:36 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:51:36.590363 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:36.591589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:36.599245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:36.599984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:36.600589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:36.601329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:36.601832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:36.602287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:36.617153 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb HTTP/1.1 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb'} Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:51:36.618923 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:51:36.623485 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:51:36.624332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:51:36.625295 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bf45112-cfab-456e-b38a-87f53b681e37 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 404 len: 111 microversion: 2.1 time: 0.039688 Oct 06 13:51:36.625929 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3477/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:36 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:51:36.674609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1033861877", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "d830276e-fb4a-4aa7-9e9b-05f020c03c9b"}], "security_groups": [{"name": "tempest-securitygroup--990383096"}], "key_name": "tempest-keypair-1931333948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:36.783788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] validate_networks() for [('d830276e-fb4a-4aa7-9e9b-05f020c03c9b', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:51:37.169895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:51:37.170323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:51:37.170799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:51:37.171211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:51:37.171644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:51:37.180857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:37.181341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:37.181804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:37.182537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:37.183642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:37.184072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:37.204787 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:51:37.210243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:51:37.223455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:51:37.225775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:51:37.274561 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3edd3503-1b17-4753-b613-cff5cf0b218f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.603915 Oct 06 13:51:37.275545 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3496/6973] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:51:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:51:37.287089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4bc3d97f-43ea-495e-8264-ecf9590caa66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:37.287719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4bc3d97f-43ea-495e-8264-ecf9590caa66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:37.342715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4bc3d97f-43ea-495e-8264-ecf9590caa66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:37.349676 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4bc3d97f-43ea-495e-8264-ecf9590caa66 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1239 microversion: 2.1 time: 0.066906 Oct 06 13:51:37.350272 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3478/6974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:37 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:38.376006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:38.377914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:38.390317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:38.391135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:38.391581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:38.392337 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:38.393922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:38.393922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:38.465793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:38.474427 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c6498ce0-35d7-46c5-9f21-1ffcd7f6cfd9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1309 microversion: 2.1 time: 0.104160 Oct 06 13:51:38.475243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3497/6975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:38 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:39.503867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:39.504494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:39.515298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:39.515730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:39.516187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:39.516912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:39.517416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:39.517888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:39.663260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:39.671382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-52233ea8-18ec-4ec1-9b17-1b882f7a869a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.171245 Oct 06 13:51:39.671791 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3479/6976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:39 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:39.850636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:39.861377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:39.862087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:39.862525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:39.875360 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] Creating event network-changed:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:51:39.880820 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-de6946a5-ca16-4654-9dbc-abf2975c6627 req-1759d08a-e50f-48d9-863d-dd60fad0d04f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Oct 06 13:51:39.881609 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3498/6977] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:40.696089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:40.696718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:40.704328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:40.704827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:40.705285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:40.706027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:40.706501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:40.706942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:40.839273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:40.847119 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-92a6e7f3-8327-4e45-a4d3-13325ed53224 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.155214 Oct 06 13:51:40.847698 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3480/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:40 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:41.873014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:41.873713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:41.879972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:41.880457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:41.880893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:41.881586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:41.882064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:41.882493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:42.010829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:42.018772 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-89368d9c-e3c8-40a9-bad0-000de43bccd2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.151375 Oct 06 13:51:42.019393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3499/6979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:41 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:43.043195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:43.043821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:43.050702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:43.051205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:43.051683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:43.052425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:43.052900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:43.053345 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:43.189868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:43.197869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd347baa-7a7c-4374-8e05-fe12c5a85e35 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.159200 Oct 06 13:51:43.198444 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3481/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:43 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:44.220966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:44.221582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:44.228491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:44.228979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:44.229420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:44.230172 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:44.230634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:44.231069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:44.359301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:44.367306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a40fc9f-6597-4535-a304-3d316ef2f9e0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.150285 Oct 06 13:51:44.367890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3500/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:44 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:45.391860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:45.392483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:45.399370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:45.399875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:45.400330 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:45.401040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:45.401510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:45.402603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:45.536524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:45.544202 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-00dea3ce-1597-4c5a-ad40-3b4b5494940e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.156250 Oct 06 13:51:45.544780 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3482/6982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:45 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:51:46.567752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:46.568456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:46.575292 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:46.575775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:46.576214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:46.576908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:46.577366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:46.577825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:46.712975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:46.722673 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bda47018-f13b-4fc0-a79f-659b666c2311 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.159018 Oct 06 13:51:46.723253 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3501/6983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:46 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:46.851713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "name": "network-vif-plugged", "status": "completed", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:46.864262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:46.864770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:46.865218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:46.876489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] Creating event network-vif-plugged:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:51:46.881728 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-eccb3188-575c-47cc-9ca8-4bff7e3f80bf req-6d0c30ba-9638-473d-88c7-21ee62e7a4aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033788 Oct 06 13:51:46.882597 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3483/6984] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:47.750005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:47.750627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:47.752632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:47.753331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:47.760109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:47.760604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:47.761052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:47.761778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:47.762245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:47.762680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:47.895464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:47.903573 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a317f9a3-de21-45b4-9696-c40c799cf5c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1364 microversion: 2.1 time: 0.158094 Oct 06 13:51:47.904165 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3502/6985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:47 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:48.923765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:51:48.929080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:48.930321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:48.936827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:48.937335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:48.937825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:48.938555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:48.940086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:48.940612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:49.077892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:51:49.085568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a963b62-f490-47be-865d-8a80066706fa tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1550 microversion: 2.1 time: 0.162789 Oct 06 13:51:49.086191 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3484/6986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:51:48 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:51:49.108898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:51:49.109434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:51:49.116194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:49.116677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:49.117114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:49.117887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:49.118287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:49.118712 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:49.203212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7894faea-2e59-4ba7-96e5-1d1eaaa7f223 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098321 Oct 06 13:51:49.203814 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3503/6987] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:51:49 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:51:50.164093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:51:50.174670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:51:50.175165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:51:50.175618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:51:50.188008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] Creating event network-changed:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:51:50.193568 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6b2a9149-5172-4c6c-baa2-9ee5ae02f1d7 req-1752c2ec-67ad-45a6-a1f2-7dce709b1f9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033183 Oct 06 13:51:50.194552 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3485/6988] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:53:03.606570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:03.608521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=56 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:03.610295 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:53:03.610515 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 13:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 (ip 10.222.0.26) !!! Oct 06 13:53:03.620794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:03.621334 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:03.628663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:03.629151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:03.629615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:03.630347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:03.630808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:03.631245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:03.762036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:03.770536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7f786eae-903c-4ee9-bb59-9e22f104c15a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1669 microversion: 2.1 time: 0.168694 Oct 06 13:53:03.771115 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3504/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:03 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:03.791946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=21 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:03.792707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:03.793521 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:53:03.793666 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments (ip 10.222.0.26) !!! Oct 06 13:53:03.794936 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 13:53:03.795186 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 13:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments (ip 10.222.0.26) !!! Oct 06 13:53:03.802455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a05f7b8-d4c7-4f72-9dc9-c93af7680fb3"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:03.804861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:03.815096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:03.815604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:03.816061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:03.816785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:03.817259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:03.817706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:04.073684 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3175c749-0193-434e-969f-f8a343f51307 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284084 Oct 06 13:53:04.074282 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3486/6990] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:53:03 2022] POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:53:14.793145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:14.796006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:14.798813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:14.799474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:14.805132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:14.805625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:14.806099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:14.806829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:14.807269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:14.807700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:14.837007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:14.842964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Old instance type m1.heat2, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 13:53:14.849863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:53:14.850291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:53:14.850770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:53:14.851185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:53:14.851599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:53:14.914249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48e3845c-26b1-4ce0-88ba-0764b6856006 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/action" status: 202 len: 0 microversion: 2.1 time: 0.124928 Oct 06 13:53:14.914874 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3505/6991] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:53:14 2022] POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:53:14.921988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:14.922910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:14.927486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:14.928219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:14.936251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:14.936885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:14.937423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:14.938198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:14.938671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:14.939123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:15.079589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:15.088093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cdd49513-0b24-442e-9e42-15a4267e6a72 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.168616 Oct 06 13:53:15.088808 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3487/6992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:14 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:16.113270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:16.113925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:16.120843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:16.121324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:16.121786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:16.122475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:16.122929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:16.123963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:16.255942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:16.264214 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5bb13ca0-d8c0-41dd-ba05-15717120899c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.155669 Oct 06 13:53:16.264798 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3506/6993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:16 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:17.287474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:17.288135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:17.295160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:17.295658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:17.296113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:17.296831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:17.297302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:17.297820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:17.434009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:17.443311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-30affc06-8f6a-4e4e-97c9-c6162ee4b107 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.159716 Oct 06 13:53:17.444152 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3488/6994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:17 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:18.469476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:18.470130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:18.477582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:18.478100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:18.478591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:18.479333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:18.479842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:18.480280 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:18.622966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:18.631933 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cdd15200-bb4a-43ef-90ff-bdf7425710ef tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.167006 Oct 06 13:53:18.632521 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3507/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:18 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:19.656828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:19.657640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:19.665230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:19.665746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:19.666279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:19.667014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:19.667573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:19.668020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:19.818335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:19.828720 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3fb5e7d6-de76-493a-bbf6-7e1cce45e4bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.176676 Oct 06 13:53:19.829351 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3489/6996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:19 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:20.853075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:20.853692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:20.860781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:20.861274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:20.861719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:20.862449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:20.862910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:20.863344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:21.001265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:21.009570 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-303eef49-460b-4487-be3d-6dc2ba384d53 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1724 microversion: 2.1 time: 0.160707 Oct 06 13:53:21.010189 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3508/6997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:20 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:22.033367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:22.034095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:22.041142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:22.041639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:22.042128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:22.042838 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:22.043307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:22.043749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:22.175564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:22.183743 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da681dbc-ba8f-4725-a4f9-e14eb9c15fdb tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.154860 Oct 06 13:53:22.184331 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3490/6998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:22 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:23.208544 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:23.208959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:23.215556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:23.216040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:23.216480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:23.217179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:23.217634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:23.218104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:23.349861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:23.358238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-175995cc-b822-4754-9bc0-585a28365a23 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.153934 Oct 06 13:53:23.358819 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3509/6999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:23 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:24.382267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:24.382936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:24.390393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:24.390857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:24.391296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:24.392013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:24.392485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:24.392967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:24.523135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:24.532908 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-76e1f6f6-d206-40c1-b56f-572d1f0219e5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.154531 Oct 06 13:53:24.533490 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3491/7000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:24 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:25.557165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:25.557706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:25.564332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:25.564813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:25.565252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:25.565968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:25.566426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:25.566854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:25.696316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:25.705004 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7b566c62-7e77-4b01-8679-f9bd6642aa5e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.152263 Oct 06 13:53:25.705802 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3510/7001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:25 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:26.728540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:26.729174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:26.736515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:26.737020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:26.737483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:26.738293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:26.738770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:26.739253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:26.875707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:26.883927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9b625c83-ad95-45e3-9f67-11afcf9021bc tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.159347 Oct 06 13:53:26.884518 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3492/7002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:26 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:27.907176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:27.907790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:27.914669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:27.915152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:27.915589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:27.916406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:27.916869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:27.917296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:28.046408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:28.054755 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1a3864c7-2ca9-478d-b7f5-8b59f59ed17e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.151547 Oct 06 13:53:28.055329 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3511/7003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:27 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:29.078598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:29.079129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:29.086119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:29.086627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:29.087092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:29.087817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:29.088296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:29.088748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:29.226788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:29.235631 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e14268f-ab72-4e5d-8865-853565c0ff38 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.161160 Oct 06 13:53:29.236217 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3493/7004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:29 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:30.258114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:30.258731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:30.265541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:30.266060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:30.266539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:30.267235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:30.267694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:30.268124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:30.397902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:30.406355 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d8e081ed-a5e5-4256-837c-a6ae006afe70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.152106 Oct 06 13:53:30.407047 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3512/7005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:30 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:31.430400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:31.431031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:31.438530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:31.439055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:31.439512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:31.440235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:31.440712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:31.441159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:31.575499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:31.584382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee1525b1-e67d-4710-aadc-58b006cb1c89 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.157968 Oct 06 13:53:31.584965 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3494/7006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:31 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:32.607819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:32.608450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:32.615372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:32.615869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:32.616319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:32.617024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:32.617492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:32.617971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:32.747047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:32.755487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-46dd49d5-cca7-4cea-9997-50c436fb3c0d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.151527 Oct 06 13:53:32.756076 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3513/7007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:32 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:33.779074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:33.779852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:33.794166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:33.795170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:33.795646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:33.796399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:33.796881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:33.797333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:33.928752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:33.937996 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6ca49a2-0c1d-4efb-9f2b-5dca3dfe9f4f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.162857 Oct 06 13:53:33.938575 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3495/7008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:33 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:34.961743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:34.962386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:34.969224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:34.969705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:34.970325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:34.971011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:34.971468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:34.971894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:35.108175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:35.116364 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7a92c30-2126-4adb-909a-910a53d361b0 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.158489 Oct 06 13:53:35.116940 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3514/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:34 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:36.140253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:36.140882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:36.147727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:36.148226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:36.148679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:36.149387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:36.149893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:36.150341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:36.280768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:36.289008 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f879e3b-b28f-4111-aa12-ee5060563f97 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.153440 Oct 06 13:53:36.289582 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3496/7010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:36 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:37.312757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:37.313372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:37.320602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:37.321088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:37.321529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:37.322265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:37.322729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:37.323159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:37.456400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:37.464790 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-840b6bf6-e3fb-4357-8f7e-8358e3669842 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.156335 Oct 06 13:53:37.465307 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3515/7011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:37 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:38.488290 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:38.489048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:38.496686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:38.497200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:38.497695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:38.498452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:38.499071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:38.499534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:38.634488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:38.644756 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e628f04e-9ca3-4cd8-a8ce-162868be452f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.160647 Oct 06 13:53:38.645353 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3497/7012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:38 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:39.668536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:39.669185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:39.677178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:39.677673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:39.678146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:39.678895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:39.679366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:39.679799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:39.818291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:39.827487 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5122c91f-127c-468a-97ca-420214e46d6b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1729 microversion: 2.1 time: 0.162780 Oct 06 13:53:39.828093 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3516/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:39 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:40.747157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "name": "network-vif-unplugged", "status": "completed", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:40.757439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:40.757973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:40.758487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:40.771042 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Creating event network-vif-unplugged:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h1-860556-1 Oct 06 13:53:40.776677 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] Instance d9950954-d8b4-4c36-915e-5de37a406c86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:53:40.792909 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4bef9fe0-d0f7-48ab-8e39-c7ce290d5ad7 req-be438387-1620-4df0-87f6-a84c07ef9c49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099845 Oct 06 13:53:40.793913 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3498/7014] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:53:40.851279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:40.852009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:40.859911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:40.860339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:40.860782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:40.861493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:40.861982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:40.862417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:41.082168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:41.091365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-095baa16-f3d2-494c-9be8-4405db062fa7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1728 microversion: 2.1 time: 0.243901 Oct 06 13:53:41.092481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3517/7015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:40 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:42.118431 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:42.119193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:42.126634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:42.127148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:42.127614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:42.128340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:42.128821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:42.129273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:42.267894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:42.290883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3f0dcb4f-4052-4d97-b228-49237b82669f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1728 microversion: 2.1 time: 0.177932 Oct 06 13:53:42.291806 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3499/7016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:42 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:42.810477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:42.822738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:42.823221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:42.823661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:42.836537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Creating event network-changed:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h1-860556-1 Oct 06 13:53:42.842963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] Instance d9950954-d8b4-4c36-915e-5de37a406c86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:53:42.847965 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] [21efa6e3-c6e8-4024-ba38-c39586d5e7e9] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:53:43.315591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:43.316339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:43.323244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:43.323748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:43.324199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:43.324912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:43.325382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:43.325860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:43.457073 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:43.465590 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9248668e-e437-4000-8087-e8a6cf4bea7a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.154659 Oct 06 13:53:43.466205 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3500/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:43 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:43.855089 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] [21efa6e3-c6e8-4024-ba38-c39586d5e7e9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 46952. Oct 06 13:53:43.863998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-89e8ed55-3761-44a7-82c4-6be0eb04bf3c req-ef1c4ca0-3f97-44cd-8c84-f4c24b1df6c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.057251 Oct 06 13:53:43.864622 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3518/7018] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:53:44.489511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:44.490406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:44.497472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:44.498613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:44.498613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:44.499575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:44.499760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:44.500207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:44.640285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:44.648935 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5ea2a6c5-e588-4a31-a641-377ce68dc954 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.163410 Oct 06 13:53:44.649529 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3501/7019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:44 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:45.675185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:45.675727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:45.677656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=33 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:45.683664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:45.684146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:45.684580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:45.685276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:45.685798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:45.686229 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:45.689350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:45.821367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:45.829859 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7caf797b-5948-4051-ae99-d9bbd31c3ebd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.161023 Oct 06 13:53:45.830443 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3519/7020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:45 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:46.853291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:46.854257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:46.857108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=31 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:46.863423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:46.863930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:46.864485 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:46.865320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:46.866053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:46.866508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:46.870817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=89 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:53:47.008826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:47.017630 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-923aefbc-e469-452d-b137-b859507a2e4e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.168968 Oct 06 13:53:47.018235 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3502/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:46 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:48.040969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:48.041583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:48.048535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:48.049018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:48.049453 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:48.050181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:48.050637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:48.051060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:48.180860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:48.189998 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-73bb135a-53d0-45d8-855d-00aa5bb75c9a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.152858 Oct 06 13:53:48.190588 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3520/7022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:48 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:49.213094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:49.213717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:49.221671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:49.222214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:49.222671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:49.223503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:49.223998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:49.224496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:49.361245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:49.369637 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-265ea17e-38f2-4105-baab-075f44bd07c1 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.160474 Oct 06 13:53:49.370261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3503/7023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:49 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:50.394006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:50.394628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:50.401108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:50.401595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:50.402074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:50.402778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:50.403262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:50.403889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:50.540611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:50.549621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-90d7f2f9-c24d-4697-899d-8a3fddf58e77 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.160378 Oct 06 13:53:50.550239 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3521/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:50 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:51.574314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:51.574876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:51.581812 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:51.582323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:51.582784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:51.583531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:51.584007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:51.584462 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:51.714254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:51.723263 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eebfe800-71c7-4e31-8209-a6b1ab0ab781 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.152924 Oct 06 13:53:51.723859 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3504/7025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:51 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:52.747214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:52.747827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:52.757692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:52.758212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:52.758647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:52.759351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:52.759805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:52.760230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:52.898168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:52.906979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-374b4d09-9a92-4143-8f68-2d0a85940e4b tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.163667 Oct 06 13:53:52.907557 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3522/7026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:52 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:53.930707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:53.931362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:53.938841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:53.939359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:53.939823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:53.940541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:53.941022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:53.941481 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:54.073359 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:54.082233 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98770f45-a9f7-4054-85ec-7818e34ecafe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1726 microversion: 2.1 time: 0.155422 Oct 06 13:53:54.082813 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3505/7027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:53 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:55.104643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:55.105262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:55.112417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.112962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.113435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.114151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.114605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.115028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.251120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:55.259410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-525fc7ce-1cbe-4748-a6de-4cae1384c76d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1723 microversion: 2.1 time: 0.158799 Oct 06 13:53:55.259990 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3523/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:55 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:55.281906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:55.282466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:55.289418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.289962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.290422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.291129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.291601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.292046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.347128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.347644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.348113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.348877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.349370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.349930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.372504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:53:55.378826 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Getting quotas for user 11b5f0fb4c354e19974d0d078dc95730 and project 2c8122644ca44fda84c874cdfeb6a443. Resources: {'cores', 'ram'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:53:55.490164 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f7cb4c1-fd7d-44e9-abe6-867c31c3355c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/action" status: 202 len: 0 microversion: 2.1 time: 0.211912 Oct 06 13:53:55.494327 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3506/7029] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:53:55 2022] POST /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:53:55.499916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:55.500627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:55.507610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.508267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.508629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.509384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:55.509996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:55.510540 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:55.718529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:55.728021 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e9e8bc81-425a-4d02-86d6-3108b68e59f9 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.232683 Oct 06 13:53:55.728610 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3524/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:55 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:53:56.754574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:56.755369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:56.763060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:56.763731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:56.764201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:56.764941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:56.765423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:56.765919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:56.921534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:56.930895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-33b4f715-a0b6-4a4e-b2fa-5b02dfa5a1d8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.182251 Oct 06 13:53:56.931501 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3507/7031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:56 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:57.955727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:57.956348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:57.963194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:57.963683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:57.964124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:57.964826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:57.965286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:57.965719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:58.112943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:58.122054 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7ff70c8f-eab1-434b-a1b3-249e06fa4c8d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.170761 Oct 06 13:53:58.129906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3525/7032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:57 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:53:58.810422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "name": "network-vif-plugged", "status": "completed", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:53:58.824853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:58.825436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:58.826017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:58.838439 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Creating event network-vif-plugged:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h1-860556-1 Oct 06 13:53:58.844216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] Instance d9950954-d8b4-4c36-915e-5de37a406c86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:53:58.855834 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-63891ba7-4ba8-4fd5-a3f8-a4420655b6d2 req-95afc289-59f4-4757-afab-8732df9f8411 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114597 Oct 06 13:53:58.856481 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3508/7033] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:53:59.146513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:53:59.147815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:53:59.155389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:59.155879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:59.156318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:59.157019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:53:59.157471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:53:59.157928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:53:59.298228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:53:59.307306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-701fb93d-8d71-4769-ba49-281d1c7c37dd tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.164733 Oct 06 13:53:59.307898 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3526/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:53:59 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:00.333097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:00.334739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:00.342775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:00.343804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:00.343950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:00.344664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:00.345162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:00.345891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:00.494998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:00.504558 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cd7cd56-1fc4-484c-abef-4fc7298be48c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.175569 Oct 06 13:54:00.505154 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3509/7035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:00 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:01.121258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "name": "network-vif-unplugged", "status": "completed", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:01.131535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:01.132020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:01.133178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:01.146449 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Creating event network-vif-unplugged:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:54:01.152949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] Instance d9950954-d8b4-4c36-915e-5de37a406c86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:54:01.166736 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e78cf5b7-21c3-47a2-9f18-853d192a298e req-46c1c3ce-113d-43ab-aad5-c0579d6af1fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104686 Oct 06 13:54:01.167367 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3527/7036] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:01.529389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:01.530447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:01.541374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:01.542122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:01.542694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:01.543885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:01.544750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:01.545549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:01.713141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:01.723076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-58afdbfe-58be-4146-b233-20fbb70d33a2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.198916 Oct 06 13:54:01.723683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3510/7037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:01 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:02.748332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:02.749075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:02.756057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:02.756545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:02.756987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:02.757688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:02.758175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:02.758605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:02.907769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:02.917310 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88ff99bb-2be1-46e0-a44b-638271863a1a tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.174068 Oct 06 13:54:02.917924 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3528/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:02 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:03.181978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:03.194476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:03.194987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:03.195473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:03.209120 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Creating event network-changed:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:54:03.214837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] Instance d9950954-d8b4-4c36-915e-5de37a406c86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 13:54:03.228053 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-314fdb45-3bb6-4be0-9e52-c7a4c8ce0ad8 req-5d879f4b-cc05-487f-b3f0-afd5c6ac6858 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049467 Oct 06 13:54:03.228586 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3511/7039] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:03.941920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:03.942473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:03.949656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:03.950199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:03.950652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:03.951390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:03.951866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:03.952296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:04.105956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:04.115722 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43e1771f-4d67-439c-afc6-1371738f9b86 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.178627 Oct 06 13:54:04.116352 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3529/7040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:03 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:05.141050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:05.141807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:05.149303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:05.149843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:05.150317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:05.151049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:05.151534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:05.151990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:05.301841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:05.313057 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-492ebc23-aa51-4536-be25-5518e4dfe8f7 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.175770 Oct 06 13:54:05.323972 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3512/7041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:05 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:06.336805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:06.337422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:06.345953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:06.346293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:06.346800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:06.347485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:06.348087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:06.348531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:06.516859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:06.526278 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93829304-6b28-48dd-80f6-ef7017c0ca5c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.193573 Oct 06 13:54:06.526932 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3530/7042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:06 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:07.551882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:07.552441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:07.554448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:07.560693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:07.561200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:07.561668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:07.562474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:07.562947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:07.563390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:07.709546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:07.717971 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2634d408-6e01-4a18-b703-940bf97d35f8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.170095 Oct 06 13:54:07.719208 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3513/7043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:07 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:08.741136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:08.741779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:08.748839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:08.749373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:08.750418 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:08.751113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:08.751569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:08.751995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:08.890985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:08.898960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4d6d419-39ac-41da-ba63-9818dbe7bd13 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.161895 Oct 06 13:54:08.899544 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3531/7044] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:08 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:09.979501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:09.980044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:09.986788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:09.987297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:09.987761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:09.988496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:09.989008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:09.989437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:10.129802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:10.138247 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ee8a1c07-25d4-4758-871f-c7eff911138d tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.163005 Oct 06 13:54:10.138840 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3514/7045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:09 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:11.162913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:11.163531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:11.170499 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:11.170988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:11.172057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:11.172749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:11.173206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:11.173632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:11.306624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:11.315469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-62b1f621-745f-4d13-b145-23bc633baff3 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.156744 Oct 06 13:54:11.316050 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3532/7046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:11 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:12.339468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:12.340219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:12.347943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:12.348452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:12.348910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:12.349631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:12.350135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:12.350582 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:12.485564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:12.494136 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cf265da0-159a-4407-8020-2e48f56ccb7f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.158569 Oct 06 13:54:12.494727 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3515/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:12 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:13.518688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:13.519264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:13.526214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:13.526699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:13.527133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:13.527832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:13.528286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:13.528711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:13.663742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:13.672501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-946ec177-e566-442f-8aba-44d528ac7b70 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.158521 Oct 06 13:54:13.673073 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3533/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:13 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:54:14.696509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:14.697130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:14.704532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:14.705032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:14.705484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:14.706236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:14.706706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:14.707150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:14.722649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:14.842106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:14.850423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15993b62-e83b-4b1b-bd38-9e169f61cc6e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1722 microversion: 2.1 time: 0.158183 Oct 06 13:54:14.850998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3516/7049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:14 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:15.873847 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:15.875141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:15.878437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=30 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:15.883766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:15.884248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:15.884685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:15.885375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:15.885861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:15.886289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:15.889005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=88 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:16.021918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:16.030536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b7316391-2104-4477-989b-2af5789ce975 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1715 microversion: 2.1 time: 0.160540 Oct 06 13:54:16.031136 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3534/7050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:15 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:16.053940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:16.054576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:16.061671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.062733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.063195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.063913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.064390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.064842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.193605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:16.202192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-20341b78-e767-4fb6-8231-237612138f2f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1715 microversion: 2.1 time: 0.152153 Oct 06 13:54:16.202933 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3517/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:16 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:16.224849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:16.225489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:16.231445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.231905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.232349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.233031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.233486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.234488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.364797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:16.373075 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3a82a27-a1f6-49b1-9934-ad1bf75580f5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1715 microversion: 2.1 time: 0.152127 Oct 06 13:54:16.373659 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3535/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:16 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:16.396067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:16.396590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:16.402632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.403200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.403664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.404377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.404856 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.405307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.429851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:54:16.506883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-69b99581-6209-4acd-8cbf-731488dfdbfe tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 204 len: 0 microversion: 2.1 time: 0.114449 Oct 06 13:54:16.507485 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3518/7053] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:54:16 2022] DELETE /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:54:16.517578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:16.518222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:16.524125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.524610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.525045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.525775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:16.526208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:16.526632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:16.655208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:16.663774 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd9088d2-40c6-43ee-b175-48296534c22f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1721 microversion: 2.1 time: 0.151160 Oct 06 13:54:16.664350 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3536/7054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:16 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:17.688517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:17.689149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:17.692066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:17.697962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:17.698479 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:17.698933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:17.699653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:17.700126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:17.700570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:17.843408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:17.851946 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-080a2b6c-56ea-49a9-b966-a356baa8d4a4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1721 microversion: 2.1 time: 0.167886 Oct 06 13:54:17.852538 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3519/7055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:17 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:18.877001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:18.877690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:18.885189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:18.885689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:18.886252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:18.887496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:18.887972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:18.888416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:18.965254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:18.974510 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-51dc0d38-96ea-44fa-84ac-ffdd313d7469 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1654 microversion: 2.1 time: 0.102654 Oct 06 13:54:18.975219 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3537/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:18 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1654 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:19.432595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9950954-d8b4-4c36-915e-5de37a406c86", "name": "network-vif-deleted", "tag": "4ffc3d60-7604-4f8d-9740-df515d7cc05e"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:19.445211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:19.445857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:19.446430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:19.461687 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] Creating event network-vif-deleted:4ffc3d60-7604-4f8d-9740-df515d7cc05e for instance d9950954-d8b4-4c36-915e-5de37a406c86 on n-h2-860556-1 Oct 06 13:54:19.467382 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-412a0c86-13b0-4f69-a9ea-2f83356968dd req-7fb1fd1d-727c-4e25-a371-1153bdaf65e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038452 Oct 06 13:54:19.468125 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3520/7057] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:19.997341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:19.997983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:20.005223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:20.005813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:20.006258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:20.006961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:20.007416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:20.007894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:20.078509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:20.089785 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c862413e-a410-492e-b581-ecf019399a9c tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1370 microversion: 2.1 time: 0.093636 Oct 06 13:54:20.089785 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3538/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:19 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:21.113703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:21.114466 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:21.121038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:21.121567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:21.122069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:21.122813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:21.123295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:21.123754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:21.190377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:21.199121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e5f45d4-3d70-43dd-a371-d94942374db2 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1370 microversion: 2.1 time: 0.091383 Oct 06 13:54:21.199699 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3521/7059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:21 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:22.223578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:22.224771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:22.230818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:22.231313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:22.231759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:22.232468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:22.232930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:22.233361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:22.298060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:22.308842 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5840cbd0-fa97-40e6-a386-3b99aa5e1276 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1370 microversion: 2.1 time: 0.090763 Oct 06 13:54:22.309440 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3539/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:22 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:23.332770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:23.333447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:23.340697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:23.341209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:23.341674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:23.342422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:23.343414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:23.343875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:23.410867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b5f0fb4c354e19974d0d078dc95730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8122644ca44fda84c874cdfeb6a443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:23.419535 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5204074a-ff9c-40c4-954a-39719f5057f4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 200 len: 1370 microversion: 2.1 time: 0.090672 Oct 06 13:54:23.420150 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3522/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:23 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:24.444168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:24.444964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:24.451022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:24.451515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:24.451955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:24.452652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:24.453113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:24.453542 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:24.466872 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 HTTP/1.1 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'd9950954-d8b4-4c36-915e-5de37a406c86'} Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:24.468557 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0d8c1e9-fbf6-4b24-a473-25e86cc813c4 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 404 len: 111 microversion: 2.1 time: 0.030533 Oct 06 13:54:24.473466 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3540/7062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:24 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:54:24.531521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:24.533810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:24.540895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:24.541401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:24.541893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:24.542618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:24.543098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:24.543546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:24.557454 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments HTTP/1.1 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': 'd9950954-d8b4-4c36-915e-5de37a406c86'} Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:24.559205 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9aacfcf3-8bbc-41bd-ab84-3f7f76997170 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033795 Oct 06 13:54:24.563864 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3523/7063] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:54:24 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:54:27.890999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:27.891517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:27.898500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.898992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.899435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.900140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.900640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.901073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.914775 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 HTTP/1.1 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'd9950954-d8b4-4c36-915e-5de37a406c86'} Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:27.916354 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-020f71d0-4918-4a13-b5d4-f166a59104b5 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 404 len: 111 microversion: 2.1 time: 0.031232 Oct 06 13:54:27.921619 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3541/7064] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:54:27 2022] DELETE /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:27.926962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:27.927631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: d9950954-d8b4-4c36-915e-5de37a406c86] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:27.934281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.934794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.935259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.935983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.936459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.937480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.952424 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 HTTP/1.1 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'd9950954-d8b4-4c36-915e-5de37a406c86'} Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.954074 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance d9950954-d8b4-4c36-915e-5de37a406c86 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-854df7cb-e7f4-4628-8cb0-421da0cad385 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86" status: 404 len: 111 microversion: 2.1 time: 0.032706 Oct 06 13:54:27.961522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3524/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:27 2022] GET /compute/v2.1/servers/d9950954-d8b4-4c36-915e-5de37a406c86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:27.964570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:27.965081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:27.971407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.971904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.972353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.973067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:27.973533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:27.973988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:27.991516 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb HTTP/1.1 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb'} Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:27.993114 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8e499e5d-987c-4407-b0ed-c88e36533419 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 404 len: 111 microversion: 2.1 time: 0.033936 Oct 06 13:54:27.997394 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3542/7066] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:54:27 2022] DELETE /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.004327 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.004970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:28.011187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.011708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.012174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.012914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.013403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.013884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.028927 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb HTTP/1.1 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb'} Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.031181 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8572f084-f874-4b4a-b941-36bded6b7de8 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb" status: 404 len: 111 microversion: 2.1 time: 0.032302 Oct 06 13:54:28.038964 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3525/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:27 2022] GET /compute/v2.1/servers/e2b970a6-07b1-4e3b-bd46-f6f9bbf109eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.041799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.042313 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:28.048947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.049437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.049915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.050620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.051085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.051520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.065922 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 HTTP/1.1 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '42de88b3-d25e-4b6e-82c9-56e5a453d023'} Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:28.067565 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad46a88d-12dc-4c9b-a74f-74cdd0a6500e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 404 len: 111 microversion: 2.1 time: 0.031046 Oct 06 13:54:28.075238 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3543/7068] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:54:28 2022] DELETE /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.077873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.078513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 42de88b3-d25e-4b6e-82c9-56e5a453d023] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:28.084574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.085091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.085556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.086313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.086802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.087253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.101144 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 HTTP/1.1 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '42de88b3-d25e-4b6e-82c9-56e5a453d023'} Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.102745 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 42de88b3-d25e-4b6e-82c9-56e5a453d023 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-812a4fb3-230d-4a1d-94cc-a7482b882a1e tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023" status: 404 len: 111 microversion: 2.1 time: 0.030259 Oct 06 13:54:28.108334 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3526/7069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:28 2022] GET /compute/v2.1/servers/42de88b3-d25e-4b6e-82c9-56e5a453d023 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.114134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.114638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:28.120680 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.121121 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.121562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.122310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.122772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.123205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.140309 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b HTTP/1.1 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '60c58a87-8cce-4929-a4a8-756991c8515b'} Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:28.142577 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:28.147216 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c618c2d0-ade9-47b6-b59b-869940f3858f tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 404 len: 111 microversion: 2.1 time: 0.033887 Oct 06 13:54:28.148505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3544/7070] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:54:28 2022] DELETE /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.152709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.153342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] [instance: 60c58a87-8cce-4929-a4a8-756991c8515b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:28.159468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.159976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.160461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.161167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:28.161643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:28.162122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:28.178607 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] HTTP exception thrown: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Request method failure captured: Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b HTTP/1.1 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPtwuXHBz206zEomcgRyATLcNOdoKsHkarbXsNLSNt3FoquI-JfW67gixrXJKVDzA_u5sw9HfZjEXofQ8hTJeUHdKT2amfh-Coe1TFcGF-5PCYRQ2AJjlcctlrEIRVkJBN6Q3Q3DQ4z_mVKIT0kYmZN03mNQUxurZeiWgLoaoOerTLNs Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c8122644ca44fda84c874cdfeb6a443", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c8122644ca44fda84c874cdfeb6a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c8122644ca44fda84c874cdfeb6a443"}]}] Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2c8122644ca44fda84c874cdfeb6a443 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServerActionsTestJSON-133854681 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 11b5f0fb4c354e19974d0d078dc95730 Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServerActionsTestJSON-133854681-project Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '60c58a87-8cce-4929-a4a8-756991c8515b'} Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:54:28.180187 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Returning 404 to user: Instance 60c58a87-8cce-4929-a4a8-756991c8515b could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:54:28.184095 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-61ee896c-043d-4ceb-b4b0-9017c39e2583 tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b" status: 404 len: 111 microversion: 2.1 time: 0.032803 Oct 06 13:54:28.185564 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3527/7071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:28 2022] GET /compute/v2.1/servers/60c58a87-8cce-4929-a4a8-756991c8515b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:54:28.191387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-66198d3e-e930-4c07-b41e-094e58a1afcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] Calling method '.version_select at 0x7f7d3e3bd0d0>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:28.215231 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-66198d3e-e930-4c07-b41e-094e58a1afcf tempest-ServerActionsTestJSON-133854681 tempest-ServerActionsTestJSON-133854681-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931333948" status: 202 len: 0 microversion: 2.1 time: 0.028212 Oct 06 13:54:28.215817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3545/7072] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Oct 6 13:54:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931333948 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:54:37.888006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-248582711", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "35a7d163-81e7-422e-b2a8-23274689fc72"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:37.942935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] validate_networks() for [('35a7d163-81e7-422e-b2a8-23274689fc72', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:54:38.167656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:38.366428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:54:38.366900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:54:38.367420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:54:38.367849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:54:38.368280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:54:38.378828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:38.379595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:38.380135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:38.380963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:38.381513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:38.382056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:38.401114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Getting quotas for project 2f8b272ef9f845148602b0f8fc85cfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:54:38.407575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Getting quotas for user 6fa5a20aac2d428088f7c0c9f18e8fc0 and project 2f8b272ef9f845148602b0f8fc85cfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:54:38.421823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:54:38.424198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:54:38.471896 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15a7b61d-ffac-4593-9e6a-6cb69d4005e0 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711839 Oct 06 13:54:38.472556 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3528/7073] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:54:38.484363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1436e79d-3d08-4beb-9a63-4cad5638c195 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:38.484994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1436e79d-3d08-4beb-9a63-4cad5638c195 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:38.487968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=45 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:38.488764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:38.549678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1436e79d-3d08-4beb-9a63-4cad5638c195 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:38.557067 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1436e79d-3d08-4beb-9a63-4cad5638c195 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1216 microversion: 2.1 time: 0.077157 Oct 06 13:54:38.568692 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3546/7074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:38 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:39.581942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:39.583518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:39.591015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:39.591535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:39.592000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:39.593441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:39.593950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:39.594399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:39.671450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:39.679895 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d27170f-b0f2-4ab1-abc1-fe46ff9aa6d6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1268 microversion: 2.1 time: 0.103520 Oct 06 13:54:39.680484 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3529/7075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:39 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:40.704369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:40.704897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:40.713003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:40.713167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:40.714086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:40.714940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:40.715442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:40.716020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:40.870062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:40.879566 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45e42d3e-0b78-438a-a960-81d5fd36b68d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.180134 Oct 06 13:54:40.880602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3547/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:40 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:41.326448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824da8fc-8414-46bb-b225-f2f27c6f772d", "tag": "5d63e0ec-6c00-4310-ba77-829730725469"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:41.341818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:41.342475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:41.343362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:41.365014 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] Creating event network-changed:5d63e0ec-6c00-4310-ba77-829730725469 for instance 824da8fc-8414-46bb-b225-f2f27c6f772d on n-h2-860556-1 Oct 06 13:54:41.371080 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ad8205db-32e1-409b-910b-c4c277856eb5 req-5778f79e-1448-48bb-99b2-4c60d3d9c11b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056986 Oct 06 13:54:41.372426 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3530/7077] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:41.904015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:41.904634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:41.912332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:41.912822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:41.913267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:41.913984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:41.914445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:41.914874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:42.042304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:42.050663 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-33a101d1-62b1-4a33-a969-7dafa40122eb tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.150574 Oct 06 13:54:42.051245 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3548/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:41 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:43.079427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:43.080036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:43.086534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:43.087036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:43.087488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:43.088199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:43.088800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:43.089335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:43.226086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:43.234491 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-17417d91-df86-4d63-a05d-ee7fa65fae4b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.161616 Oct 06 13:54:43.235224 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3531/7079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:43 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:44.256536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:44.257131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:44.265289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:44.265800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:44.266234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:44.266937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:44.267389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:44.267812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:44.408646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:44.417656 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-86a602e1-a282-4b0c-9c17-508f117dd503 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.165002 Oct 06 13:54:44.418274 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3549/7080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:44 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:45.441186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:45.441867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:45.449825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:45.450338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:45.450790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:45.451506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:45.452610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:45.453084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:45.591979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:45.600567 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d69bb390-a54f-4c1b-a0ce-2b414eb2a4e2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.163829 Oct 06 13:54:45.601258 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3532/7081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:45 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:54:46.624704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:46.625227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:46.632035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:46.632514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:46.632948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:46.633631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:46.634113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:46.634536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:46.766057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:46.773868 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93c0db09-3784-4351-ad9f-6fe46153c5fe tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.153811 Oct 06 13:54:46.774447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3550/7082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:46 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:47.580012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824da8fc-8414-46bb-b225-f2f27c6f772d", "name": "network-vif-plugged", "status": "completed", "tag": "5d63e0ec-6c00-4310-ba77-829730725469"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:47.590534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:47.591041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:47.591990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:47.604229 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] Creating event network-vif-plugged:5d63e0ec-6c00-4310-ba77-829730725469 for instance 824da8fc-8414-46bb-b225-f2f27c6f772d on n-h2-860556-1 Oct 06 13:54:47.610272 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-52400409-f6b5-4d7b-b595-3aee6f9e2cee req-ec57f944-5f71-4dc4-804d-41a7c5fe3196 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033820 Oct 06 13:54:47.611128 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3533/7083] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:47.797311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:47.797881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:47.804690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:47.805180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:47.805621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:47.806368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:47.806823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:47.807251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:47.939192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:47.947181 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c51e518c-8196-4627-908e-76545a15864c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.154584 Oct 06 13:54:47.947774 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3551/7084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:47 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:48.968736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:48.969426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:48.976004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:48.976720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:48.978551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:48.986229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:48.986757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:48.987215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:48.987936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:48.988408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:48.988853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:49.132902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:49.142496 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0e81a47d-c243-4834-b88a-9ac4502ce463 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1316 microversion: 2.1 time: 0.175470 Oct 06 13:54:49.143090 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3534/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:48 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:54:50.164757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:50.165374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:50.167440 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:54:50.173309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:50.173816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:50.174254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:50.174951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:50.175401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:50.175822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:50.307169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:50.315077 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93096298-42f6-46f2-a485-f03417b5431c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.154440 Oct 06 13:54:50.315655 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3552/7086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:50 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:50.377401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-513017647", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "35a7d163-81e7-422e-b2a8-23274689fc72"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:50.434066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] validate_networks() for [('35a7d163-81e7-422e-b2a8-23274689fc72', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:54:50.812033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:54:50.812497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:54:50.813003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:54:50.813439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:54:50.813926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:54:50.823159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:50.823666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:50.824126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:50.824879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:50.825354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:50.825845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:50.842683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Getting quotas for project 2f8b272ef9f845148602b0f8fc85cfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:54:50.848039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Getting quotas for user 6fa5a20aac2d428088f7c0c9f18e8fc0 and project 2f8b272ef9f845148602b0f8fc85cfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:54:50.860908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:54:50.863243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:54:50.910015 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-95d0dfae-b96b-40eb-b40e-87e204e0d5f3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536198 Oct 06 13:54:50.910686 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3535/7087] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:54:50.922505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-592aff02-620a-4245-ae2e-1dd2f7f214c6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:50.923120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-592aff02-620a-4245-ae2e-1dd2f7f214c6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:50.980491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-592aff02-620a-4245-ae2e-1dd2f7f214c6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:50.988201 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-592aff02-620a-4245-ae2e-1dd2f7f214c6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1216 microversion: 2.1 time: 0.070351 Oct 06 13:54:50.988795 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3553/7088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:50 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:52.011714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:52.012346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:52.019989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:52.020620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:52.021082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:52.021825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:52.022300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:52.022745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:52.086696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:52.094596 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02c5cc44-e3d6-4056-a2ea-3bd61cb6ad46 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1268 microversion: 2.1 time: 0.086796 Oct 06 13:54:52.095219 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3536/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:52 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:53.118755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:53.119798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:53.128908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:53.129881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:53.130431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:53.131231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:53.132076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:53.132728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:53.345904 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:53.353583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-037fb10a-dc25-40b4-b67b-cf95acd5f187 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.238977 Oct 06 13:54:53.354196 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3554/7090] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:53 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:53.607794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6889ab9-07f7-4f76-9cf4-b30e6f541dfb", "tag": "71499da5-71e3-4269-a62e-f3e46f8e3e94"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:53.625755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:53.626271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:53.626711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:53.638950 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] Creating event network-changed:71499da5-71e3-4269-a62e-f3e46f8e3e94 for instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb on n-h1-860556-1 Oct 06 13:54:53.644184 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-070a2c44-812a-41fa-8702-d9a77df3754d req-beaf902a-d5af-4fb9-864d-2320c8de31d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040142 Oct 06 13:54:53.644794 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3537/7091] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:54.377375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:54.378023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:54.384528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:54.385009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:54.385446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:54.386165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:54.386625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:54.387056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:54.517264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:54.524881 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-005d4d56-50fa-4412-b480-159f901f34d3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.152234 Oct 06 13:54:54.525461 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3555/7092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:54 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:55.549389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:55.550145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:55.556904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:55.557475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:55.558005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:55.558786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:55.559468 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:55.559967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:55.709348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:55.717231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59734994-b577-40c9-9c52-a3f862179462 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.173515 Oct 06 13:54:55.718384 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3538/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:55 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:56.741700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:56.742742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:56.750467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:56.750969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:56.751416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:56.752118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:56.752579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:56.753005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:56.919377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:56.928188 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-26355d8c-658f-4c88-ab5b-d08a4486db6b tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.190667 Oct 06 13:54:56.928702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3556/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:56 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:54:57.952587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:57.953231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:57.960009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:57.960514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:57.960977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:57.961698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:57.962202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:57.962652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:58.091713 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:58.099726 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a04d5bf9-7c92-4bae-8e0f-f5ef5254b949 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.151611 Oct 06 13:54:58.100319 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3539/7095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:57 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:54:59.122428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:54:59.123135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:54:59.131693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:59.132095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:59.132543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:59.133263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:59.133730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:59.134181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:59.142143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6889ab9-07f7-4f76-9cf4-b30e6f541dfb", "name": "network-vif-plugged", "status": "completed", "tag": "71499da5-71e3-4269-a62e-f3e46f8e3e94"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:54:59.155663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:54:59.156508 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:54:59.157037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:54:59.169446 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] Creating event network-vif-plugged:71499da5-71e3-4269-a62e-f3e46f8e3e94 for instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb on n-h1-860556-1 Oct 06 13:54:59.175534 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-f784a141-c029-41c5-a5d0-f48ff3da9cf0 req-d8444767-405c-4101-affd-a4040852f364 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038087 Oct 06 13:54:59.176253 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3540/7096] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:54:59.338483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:54:59.349009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a5ff6f4e-6a41-4de3-a253-8999357772bf tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.230767 Oct 06 13:54:59.349642 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3557/7097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:54:59 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:00.385121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:00.386497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:00.394423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:00.394935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:00.395394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:00.396127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:00.396646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:00.397135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:00.558578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:00.567345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22780551-8d2b-4253-be1b-4b3f63faebb2 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1316 microversion: 2.1 time: 0.189232 Oct 06 13:55:00.567928 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3541/7098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:00 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:01.590751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:01.591806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:01.594622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:01.600154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.600641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.601076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:01.601795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.602253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.602679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:01.741767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:01.749625 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d2d04bef-7add-4904-b4c7-1e55005c0ffd tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1504 microversion: 2.1 time: 0.162727 Oct 06 13:55:01.750243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3558/7099] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:01 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:01.772392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:01.772943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:01.774901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:01.775576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:01.784568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.785121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.785716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:01.786546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.787025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.787480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:01.814922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:55:01.895450 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1cb1475d-bd66-4519-a595-9a8bc09c53d9 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 204 len: 0 microversion: 2.1 time: 0.126757 Oct 06 13:55:01.896117 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3542/7100] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:55:01 2022] DELETE /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:55:01.904776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:01.905945 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:01.911860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.912338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.912769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:01.913454 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:01.913946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:01.914371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:02.045400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:02.053713 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45478f1d-fb88-45f2-9a03-5776a3c1e7d1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1510 microversion: 2.1 time: 0.153268 Oct 06 13:55:02.054313 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3559/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:01 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:03.078820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:03.079443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:03.086338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:03.086877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:03.087343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:03.088060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:03.088541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:03.088992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:03.224367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:03.232110 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5e4f70b-baf2-4b97-9bce-1dac927678c7 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1510 microversion: 2.1 time: 0.158329 Oct 06 13:55:03.232737 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3543/7102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:03 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:03.767429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6889ab9-07f7-4f76-9cf4-b30e6f541dfb", "name": "network-vif-deleted", "tag": "71499da5-71e3-4269-a62e-f3e46f8e3e94"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:03.779114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:03.779586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:03.779979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:03.793935 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] Creating event network-vif-deleted:71499da5-71e3-4269-a62e-f3e46f8e3e94 for instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb on n-h1-860556-1 Oct 06 13:55:03.800563 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-157d1a4c-a1fc-4f03-be5f-47bfac233642 req-0f3a5ff1-ddd3-48ee-93f0-9b85322b092e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038021 Oct 06 13:55:03.804602 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3560/7103] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:55:04.255314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:04.255947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:04.263027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:04.263548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:04.264010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:04.264753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:04.265229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:04.265779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:04.303080 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:04.303603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:04.304057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:04.304527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lazy-loading 'fault' on Instance uuid e6889ab9-07f7-4f76-9cf4-b30e6f541dfb {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:55:04.352124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:04.360705 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2c3e51cb-d0b7-495d-8dc8-2656752d9252 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 200 len: 1306 microversion: 2.1 time: 0.109533 Oct 06 13:55:04.368072 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3544/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:04 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:05.386734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:05.387677 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.394543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.395024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.395461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.396155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.396608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.397030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.411931 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb HTTP/1.1 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e6889ab9-07f7-4f76-9cf4-b30e6f541dfb'} Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:05.413574 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 404 to user: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c85200b2-c68c-4bdf-a3a4-0e62f4792db3 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 404 len: 111 microversion: 2.1 time: 0.033480 Oct 06 13:55:05.422204 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3561/7105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:05 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:55:05.424286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:05.424919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.431818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.432318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.432773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.433474 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.433990 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.434456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.569044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:05.577954 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1bd01c91-bc94-4bf4-bc02-ceb0203623de tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.157468 Oct 06 13:55:05.578526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3545/7106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:05 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:05.600359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:05.602751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 71130174-31bc-4956-9144-c1de21b9a817] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.608311 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/71130174-31bc-4956-9144-c1de21b9a817/action HTTP/1.1 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 32 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: {"resize": {"flavorRef": "452"}} Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '71130174-31bc-4956-9144-c1de21b9a817', 'body': {'resize': {'flavorRef': '452'}}} Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:55:05.609896 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 404 to user: Instance 71130174-31bc-4956-9144-c1de21b9a817 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1188af39-52e0-4039-b523-e85d9a77dae6 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "POST /compute/v2.1/servers/71130174-31bc-4956-9144-c1de21b9a817/action" status: 404 len: 111 microversion: 2.1 time: 0.014975 Oct 06 13:55:05.617583 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3562/7107] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:55:05 2022] POST /compute/v2.1/servers/71130174-31bc-4956-9144-c1de21b9a817/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:55:05.624798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:05.625436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.631759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.632263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.632716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.633421 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.634089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.634534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.653456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:05.767832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:05.775981 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb823dec-9216-484d-8896-34b69f0bc473 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.155693 Oct 06 13:55:05.776580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3546/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:05 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:05.799469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:05.800082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.811012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.812385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.813180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.814520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.815390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.816199 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.955529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:05.963541 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-269f0dcb-e370-4a4e-a263-4994c971a225 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.168752 Oct 06 13:55:05.964123 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3563/7109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:05 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:05.986323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f2eca98c-f1ec-44b7-86eb-40bae04f4ef1"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:05.988601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:05.994773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.995285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.995747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:05.996469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:05.996944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:05.997391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.038842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:06.044236 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: request: POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action HTTP/1.1 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 65 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: {"resize": {"flavorRef": "f2eca98c-f1ec-44b7-86eb-40bae04f4ef1"}} Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: exception: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '824da8fc-8414-46bb-b225-f2f27c6f772d', 'body': {'resize': {'flavorRef': 'f2eca98c-f1ec-44b7-86eb-40bae04f4ef1'}}} Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 398, in get_by_flavor_id Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:06.049655 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 325, in _flavor_get_by_flavor_id_from_db Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 400 to user: Flavor f2eca98c-f1ec-44b7-86eb-40bae04f4ef1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7602a2d0-13c2-42c5-b44e-a117c7359032 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action" status: 400 len: 107 microversion: 2.1 time: 0.069061 Oct 06 13:55:06.053861 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3547/7110] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:55:05 2022] POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:55:06.059808 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.060435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.066516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.067009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.067452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.068150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.068609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.069040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.198911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:06.207398 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e943ff1-6963-4a2e-89f1-0296cbb0bbb8 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.151361 Oct 06 13:55:06.207983 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3564/7111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:06 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:06.230960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.231601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.237820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.238337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.238802 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.239531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.240011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.240465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.377262 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:06.385077 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6bf656ae-8c4f-4a02-8d0e-9d5d51b7e5ab tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.158071 Oct 06 13:55:06.385645 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3548/7112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:06 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:06.408668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4af0317-cf8d-4b50-aa93-9d9f0ecbf928 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4af0317-cf8d-4b50-aa93-9d9f0ecbf928 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: request: POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action HTTP/1.1 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 29 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: {"resize": {"flavorRef": ""}} Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '824da8fc-8414-46bb-b225-f2f27c6f772d', 'body': {'resize': {'flavorRef': ''}}} Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise error Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi '' Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.415722 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d4af0317-cf8d-4b50-aa93-9d9f0ecbf928 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d4af0317-cf8d-4b50-aa93-9d9f0ecbf928 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action" status: 400 len: 113 microversion: 2.1 time: 0.011532 Oct 06 13:55:06.419834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3565/7113] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:55:06 2022] POST /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 13:55:06.424189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.424857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.431517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.432025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.432487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.433207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.433687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.434156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.566504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:06.574678 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3bcaffc1-df7b-4ae6-86b4-ce65336c5f60 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1504 microversion: 2.1 time: 0.154453 Oct 06 13:55:06.575195 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3549/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:06 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:06.600703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.601208 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.608820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.609301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.609860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.610459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.610914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.611344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.625338 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb HTTP/1.1 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e6889ab9-07f7-4f76-9cf4-b30e6f541dfb'} Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:55:06.626928 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 404 to user: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e93fe95c-b305-4528-a288-a2331f6afa21 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 404 len: 111 microversion: 2.1 time: 0.032331 Oct 06 13:55:06.631919 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3566/7115] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:55:06 2022] DELETE /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:55:06.638403 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.639044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: e6889ab9-07f7-4f76-9cf4-b30e6f541dfb] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.645228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.645757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.646237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.646963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.647832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.647966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.661583 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb HTTP/1.1 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'e6889ab9-07f7-4f76-9cf4-b30e6f541dfb'} Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:06.663166 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 404 to user: Instance e6889ab9-07f7-4f76-9cf4-b30e6f541dfb could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6c7c80d-17d8-4bb2-9807-5e94ae3b270c tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb" status: 404 len: 111 microversion: 2.1 time: 0.030035 Oct 06 13:55:06.668142 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3550/7116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:06 2022] GET /compute/v2.1/servers/e6889ab9-07f7-4f76-9cf4-b30e6f541dfb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 13:55:06.673637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.674213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.680255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.680742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.681190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.681915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.682378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.682810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.710702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:55:06.737925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=100 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:06.787536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-92819fdb-eadd-43f4-82b4-3480157c63e1 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "DELETE /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 204 len: 0 microversion: 2.1 time: 0.117661 Oct 06 13:55:06.788243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3567/7117] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:55:06 2022] DELETE /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:55:06.797103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:06.797751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:06.803895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.804405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.804865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.805587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:06.806107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:06.806555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:06.941601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:06.949796 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e9af4a50-d610-4a7c-bf31-58f83548bed4 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1510 microversion: 2.1 time: 0.156936 Oct 06 13:55:06.950370 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3551/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:06 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:07.973296 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:07.974026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:07.980784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:07.981262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:07.981696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:07.982427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:07.982897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:07.983319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:08.118381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:08.126771 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b3e5729d-32a8-4fda-8418-6ea911c02021 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1510 microversion: 2.1 time: 0.157769 Oct 06 13:55:08.127347 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3568/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:07 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:08.861383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824da8fc-8414-46bb-b225-f2f27c6f772d", "name": "network-vif-deleted", "tag": "5d63e0ec-6c00-4310-ba77-829730725469"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:08.871635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:08.872139 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:08.872598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:08.890039 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] Creating event network-vif-deleted:5d63e0ec-6c00-4310-ba77-829730725469 for instance 824da8fc-8414-46bb-b225-f2f27c6f772d on n-h2-860556-1 Oct 06 13:55:08.896331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-eb3dcd7c-a219-49a5-a3a4-6b84191c517e req-e553d602-42d2-45f8-b9e0-c8805b88cab9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038739 Oct 06 13:55:08.899989 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3552/7120] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:55:09.150045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:09.150662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:09.153458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:09.159885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:09.160382 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:09.160863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:09.161588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:09.162111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:09.162546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:09.195741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:09.196233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:09.196652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:09.197093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lazy-loading 'fault' on Instance uuid 824da8fc-8414-46bb-b225-f2f27c6f772d {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:55:09.238070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa5a20aac2d428088f7c0c9f18e8fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8b272ef9f845148602b0f8fc85cfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:09.245923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e5cf82af-3cd6-420f-a9da-9cc76ab4ed0d tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 200 len: 1306 microversion: 2.1 time: 0.099765 Oct 06 13:55:09.246504 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3569/7121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:09 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:10.270724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:10.271454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] [instance: 824da8fc-8414-46bb-b225-f2f27c6f772d] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:10.277765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:10.278374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:10.278837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:10.279550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:10.280542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:10.280984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:10.294476 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] HTTP exception thrown: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Request method failure captured: Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d HTTP/1.1 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt4dmm-5h0psychzUyGZs687MZfIQeJLvfGEbaPNjVUlSt7Wpk60RKm88uSG7Q_GfAxkSk5sj3JgJA8941HMZm8YocBn3zgal3vQfQJSi_L4tGpWcKrYQwK3P3Z-KX9PwjaFazFFC8-k1Ji6YyBbdSCTciH_CpoiaNNfoLqdQFH7M7Q Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f8b272ef9f845148602b0f8fc85cfd3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f8b272ef9f845148602b0f8fc85cfd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f8b272ef9f845148602b0f8fc85cfd3"}]}] Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 2f8b272ef9f845148602b0f8fc85cfd3 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-761151680 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6fa5a20aac2d428088f7c0c9f18e8fc0 Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-ServersNegativeTestJSON-761151680-project Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '824da8fc-8414-46bb-b225-f2f27c6f772d'} Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:55:10.296761 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] Returning 404 to user: Instance 824da8fc-8414-46bb-b225-f2f27c6f772d could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22734cb8-527e-4c78-a2a6-4aeb9413c165 tempest-ServersNegativeTestJSON-761151680 tempest-ServersNegativeTestJSON-761151680-project] 10.222.0.26 "GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d" status: 404 len: 111 microversion: 2.1 time: 0.032912 Oct 06 13:55:10.301610 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3553/7122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:10 2022] GET /compute/v2.1/servers/824da8fc-8414-46bb-b225-f2f27c6f772d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:55:42.417343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:42.418491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:42.618348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ea7a1b84-d8b2-439a-9e05-64b06db71f5c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: .version_select at 0x7f7d44d0f0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1387816022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2cvkY2u/1w6HZcd2nLI42KRXREscGCkOtHAu69l7S2mYAJc2+Mf5g/8OhIjCSSq8YnO6t4t15izJfkA45mKx+Lbw3xlqEu9w4DRwABGHTnVkaSCAzmgorZ5iQmZ6Fazg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:42.656061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ea7a1b84-d8b2-439a-9e05-64b06db71f5c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:55:42.662428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ea7a1b84-d8b2-439a-9e05-64b06db71f5c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:55:42.692574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ea7a1b84-d8b2-439a-9e05-64b06db71f5c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.281817 Oct 06 13:55:42.693178 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3570/7123] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:55:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:55:42.748361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1940453109", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1387816022", "networks": [{"uuid": "d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:42.757676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:42.758583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=30 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:42.816134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] validate_networks() for [('d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:55:43.226265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:55:43.226743 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:55:43.227246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:55:43.227674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:55:43.228106 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:55:43.239050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:43.239497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:43.239962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:43.240718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:43.241200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:43.241652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:43.258663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:55:43.264070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:55:43.277514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:55:43.279923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:55:43.329604 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc210b5d-f884-4d57-9386-28bd02ceff46 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585374 Oct 06 13:55:43.330489 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3554/7124] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:55:43.342082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-93f3baf4-d7f6-45dd-a10a-2c9226429048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:43.343493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-93f3baf4-d7f6-45dd-a10a-2c9226429048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:43.406761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-93f3baf4-d7f6-45dd-a10a-2c9226429048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:43.418347 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-93f3baf4-d7f6-45dd-a10a-2c9226429048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1263 microversion: 2.1 time: 0.079978 Oct 06 13:55:43.419902 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3571/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:43 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:55:44.444129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:44.444975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:44.453388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:44.453950 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:44.454418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:44.455162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:44.455639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:44.456245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:44.524497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:44.532789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b56d0889-f319-44be-86c8-b81942a867b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1315 microversion: 2.1 time: 0.093770 Oct 06 13:55:44.533371 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3555/7126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:44 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:45.557816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:45.558958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:45.566683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:45.567431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:45.568038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:45.568910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:45.569545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:45.570012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:45.751391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:45.760073 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a9db4ce2-fde4-4bb3-a1d1-8e0d70af2829 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.207230 Oct 06 13:55:45.761138 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3572/7127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:45 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:46.060888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3987590d-1b8b-4af2-a2a3-a445092ac596", "tag": "6484d816-fc3d-4299-b0e0-01fd42e02c61"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:46.073502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:46.074281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:46.074937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:46.087134 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] Creating event network-changed:6484d816-fc3d-4299-b0e0-01fd42e02c61 for instance 3987590d-1b8b-4af2-a2a3-a445092ac596 on n-h2-860556-1 Oct 06 13:55:46.092436 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9d283122-a8a8-49ac-b46f-31118fb4e317 req-9ae23b20-3e13-4f18-864d-17f2d240fdad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035939 Oct 06 13:55:46.093281 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3556/7128] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:55:46.784596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:46.785221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:46.792535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:46.793029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:46.793469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:46.794217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:46.794676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:46.795107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:46.960207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:46.968523 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a985794-ddcb-4d64-a4d1-6573f7d4f993 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.188479 Oct 06 13:55:46.969130 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3573/7129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:46 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:47.993236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:47.994093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:48.001334 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:48.002084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:48.002564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:48.003352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:48.003834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:48.004288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:48.135994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:48.145127 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea498cc6-0fb4-477d-af9a-bf814bf03fe7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.157051 Oct 06 13:55:48.145701 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3557/7130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:47 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:49.168157 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:49.168711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:49.176515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:49.177008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:49.177452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:49.178191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:49.178656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:49.179088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:49.320342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:49.329281 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4cfb8293-9a8b-4cc7-899f-a4ea9e8a5264 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.165011 Oct 06 13:55:49.329893 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3574/7131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:49 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:50.352233 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:50.352927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:50.360938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:50.361446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:50.361954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:50.362683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:50.363159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:50.363608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:50.505756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:50.513662 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-70a8144a-edd6-4e25-a9b4-197c758568e7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.165586 Oct 06 13:55:50.514339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3558/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:50 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:51.536400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:51.536991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:51.543445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:51.543929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:51.544367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:51.545054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:51.546126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:51.546556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:51.678227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:51.686863 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e14c3bf2-a13f-404f-b104-794146219609 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.153973 Oct 06 13:55:51.687515 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3575/7133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:51 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:51.883519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3987590d-1b8b-4af2-a2a3-a445092ac596", "name": "network-vif-plugged", "status": "completed", "tag": "6484d816-fc3d-4299-b0e0-01fd42e02c61"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:51.894778 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:51.895364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:51.895740 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:51.907192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] Creating event network-vif-plugged:6484d816-fc3d-4299-b0e0-01fd42e02c61 for instance 3987590d-1b8b-4af2-a2a3-a445092ac596 on n-h2-860556-1 Oct 06 13:55:51.912049 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b7280cad-0a9a-4e50-852f-f5e51b2d5b51 req-cd7e172a-5828-4e27-902d-3dd08d021b77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032266 Oct 06 13:55:51.912665 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3559/7134] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:55:52.710969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:52.711586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:52.719143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:52.719625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:52.720065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:52.720758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:52.721215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:52.721641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:52.860032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:52.867973 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0bb9b0c-3b2c-4f8a-b192-ffabb5393896 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1363 microversion: 2.1 time: 0.160981 Oct 06 13:55:52.868567 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3576/7135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:52 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:55:53.888999 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:53.889716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:53.894286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:53.895015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:53.902204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:53.902715 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:53.903181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:53.903906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:53.904387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:53.905347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:54.041442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:54.049896 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b26ad91b-2434-46b5-a7b3-da3a5bb755a2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1555 microversion: 2.1 time: 0.162800 Oct 06 13:55:54.050570 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3560/7136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:53 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:54.069056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:55:54.074416 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:55:54.075030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:54.081488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:54.081991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:54.082429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:54.083116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:54.083565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:54.083988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:54.219811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:55:54.227574 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da295b22-a5e7-4559-8f4f-21bb59854912 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1555 microversion: 2.1 time: 0.159250 Oct 06 13:55:54.228151 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3577/7137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:55:54 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:55:55.938024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d806aa07-fe52-4dfb-bd43-cbebee209759"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:55:55.940439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:55:55.948047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:55.948563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:55.949030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:55.949781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:55:55.950258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:55:55.950711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:55:56.232315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96e5887d-09d0-43b9-8da6-6991678dd97b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298012 Oct 06 13:55:56.232960 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3561/7138] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:55:55 2022] POST /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:06.998652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:06.999322 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:07.002132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:07.003032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:07.009051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:07.009479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:07.009954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:07.010764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:07.011197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:07.011691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:07.097015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lazy-loading 'services' on Instance uuid 3987590d-1b8b-4af2-a2a3-a445092ac596 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:56:07.174041 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9232f861-66f6-49ef-8647-93e5410b9c62 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments/d806aa07-fe52-4dfb-bd43-cbebee209759" status: 202 len: 0 microversion: 2.1 time: 0.178860 Oct 06 13:56:07.175107 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3578/7139] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:56:06 2022] DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments/d806aa07-fe52-4dfb-bd43-cbebee209759 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:56:07.181758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:07.182578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:07.186936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:07.189496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:07.199028 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:07.199540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:07.200087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:07.200828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:07.201549 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:07.201880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:07.237074 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ddd7fbb4-d0a5-48bd-bf17-f7296254f6b5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057316 Oct 06 13:56:07.237723 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3562/7140] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:07 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:08.250837 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:08.253482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:08.260937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:08.261423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:08.261928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:08.262637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:08.263096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:08.263527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:08.295369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41ca7ea2-2fef-46fc-9b5d-f9e2c00b954d tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049170 Oct 06 13:56:08.295955 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3579/7141] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:08 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:09.308624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:09.310883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:09.319114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:09.319633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:09.320102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:09.321105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:09.321586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:09.322068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:09.357376 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-436ff557-0341-4cc8-83f6-b21d690daa0f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052790 Oct 06 13:56:09.358020 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3563/7142] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:09 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:10.370371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:10.372694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:10.380383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:10.380865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:10.381303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:10.382024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:10.382475 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:10.382902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:10.414331 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d49e3f58-57dd-481f-ab24-9a54f0f6c510 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Oct 06 13:56:10.414892 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3580/7143] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:10 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:11.429247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:11.431667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:11.440386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:11.440899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:11.441285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:11.442044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:11.442557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:11.443024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:11.476507 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-439f7b53-3220-494c-9186-651e6c6cf502 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051788 Oct 06 13:56:11.477127 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3564/7144] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:11 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:12.490511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:12.492724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:12.500466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:12.500961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:12.501402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:12.502138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:12.502600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:12.503034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:12.536638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1654d18a-945a-4809-9158-f9d410f9517b tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051109 Oct 06 13:56:12.537211 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3581/7145] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:12 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:56:12.550319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:12.550997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:12.563253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:12.563704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:12.564263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:12.565171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:12.565836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:12.566455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:12.652789 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 is not attached to volume d806aa07-fe52-4dfb-bd43-cbebee209759 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments/d806aa07-fe52-4dfb-bd43-cbebee209759 HTTP/1.1 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 is not attached to volume d806aa07-fe52-4dfb-bd43-cbebee209759 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '3987590d-1b8b-4af2-a2a3-a445092ac596', 'id': 'd806aa07-fe52-4dfb-bd43-cbebee209759'} Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 297, in get_by_volume_and_instance Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d806aa07-fe52-4dfb-bd43-cbebee209759. Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 is not attached to volume d806aa07-fe52-4dfb-bd43-cbebee209759 Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:12.687810 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 is not attached to volume d806aa07-fe52-4dfb-bd43-cbebee209759 Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 is not attached to volume d806aa07-fe52-4dfb-bd43-cbebee209759 {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a558647-fcc8-4bdd-a9a4-d1fa6d9985af tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments/d806aa07-fe52-4dfb-bd43-cbebee209759" status: 404 len: 154 microversion: 2.1 time: 0.144956 Oct 06 13:56:12.693193 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3565/7146] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:56:12 2022] DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596/os-volume_attachments/d806aa07-fe52-4dfb-bd43-cbebee209759 => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:56:16.073525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:16.074100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:16.081797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:16.082293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:16.082751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:16.083452 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:16.083927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:16.084340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:16.115458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:56:16.204699 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-24bb48c4-c46d-4dde-8d50-34c99f40f157 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 204 len: 0 microversion: 2.1 time: 0.135159 Oct 06 13:56:16.205556 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3582/7147] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:56:16 2022] DELETE /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:56:16.216123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:16.217035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:16.228380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:16.229007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:16.229528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:16.230349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:16.230892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:16.231526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:16.369757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:16.378695 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-352c5976-837f-48d8-97f4-4a8cb5663737 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1561 microversion: 2.1 time: 0.168301 Oct 06 13:56:16.379298 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3566/7148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:16 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:17.402451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:17.403153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:17.410146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:17.410628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:17.411067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:17.411760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:17.412215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:17.412634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:17.551248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:17.559431 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ece935c-29e0-4d70-9899-b04d0d844920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1561 microversion: 2.1 time: 0.161247 Oct 06 13:56:17.560028 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3583/7149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:17 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:18.585019 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:18.585656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:18.595136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:18.595540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:18.596001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:18.596736 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:18.597211 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:18.597654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:18.683267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:18.693007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f78c702d-59ad-45cd-b707-14bdbd24a920 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 200 len: 1519 microversion: 2.1 time: 0.111798 Oct 06 13:56:18.693615 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3567/7150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:18 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 1519 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:56:18.704187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3987590d-1b8b-4af2-a2a3-a445092ac596", "name": "network-vif-deleted", "tag": "6484d816-fc3d-4299-b0e0-01fd42e02c61"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:18.716779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:18.717409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:18.717948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:18.731505 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] Creating event network-vif-deleted:6484d816-fc3d-4299-b0e0-01fd42e02c61 for instance 3987590d-1b8b-4af2-a2a3-a445092ac596 on n-h2-860556-1 Oct 06 13:56:18.737259 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b1e5699d-7300-4196-a43d-de21d461f8c1 req-c1876862-acdf-4836-84de-addb56db3518 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037238 Oct 06 13:56:18.738712 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3584/7151] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:19.719009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:19.719646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: 3987590d-1b8b-4af2-a2a3-a445092ac596] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:19.726683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:19.727190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:19.727652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:19.728371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:19.728849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:19.729292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:19.743188 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 HTTP/1.1 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '3987590d-1b8b-4af2-a2a3-a445092ac596'} Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:19.744757 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance 3987590d-1b8b-4af2-a2a3-a445092ac596 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-504a9004-c915-4d0b-acfa-b2ab4617eb76 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596" status: 404 len: 111 microversion: 2.1 time: 0.031772 Oct 06 13:56:19.749654 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3568/7152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:19 2022] GET /compute/v2.1/servers/3987590d-1b8b-4af2-a2a3-a445092ac596 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:56:19.757230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-765fb7c8-5b35-4951-ad9d-04fda5f567c3 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '.version_select at 0x7f7d3ee99040>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:19.777074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-765fb7c8-5b35-4951-ad9d-04fda5f567c3 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1387816022" status: 202 len: 0 microversion: 2.1 time: 0.024891 Oct 06 13:56:19.777870 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3585/7153] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Oct 6 13:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1387816022 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:56:19.797086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: .version_select at 0x7f7d3e736a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-205583556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8VjVv1Eu6jHSU9C8ZX6wNv8EcMfA08EOPiwrsrAeDiz4/3f6vt4nZDQ/2Il9mu/rO4m9r40uUrT+AvOUyESOwe+QvzyPtHG3zB8lSTlBNZsgkPZ4Y+MlN15IcsSzhsgg=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:19.813790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:56:19.819092 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:56:19.833367 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [fb2b4302-a92b-446b-82c7-f28357b34b0e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:56:20.841132 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [fb2b4302-a92b-446b-82c7-f28357b34b0e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47702. Oct 06 13:56:20.857825 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-22a9c6c9-5c9f-4cb7-88d2-ee64f6d18bdc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.064615 Oct 06 13:56:20.858440 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3569/7154] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:56:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:20.911646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-21340778", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-205583556", "networks": [{"uuid": "d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:20.969200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] validate_networks() for [('d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:56:21.455880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:56:21.456314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:56:21.456798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:56:21.457214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:56:21.457631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:56:21.467050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:21.467590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:21.468630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:21.469372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:21.469885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:21.470344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:21.489084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:56:21.494602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:56:21.507959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:56:21.510442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:56:21.556247 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 13:56:22.564997 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47718. Oct 06 13:56:22.569139 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a14eff60-9b7d-4834-9655-fdeb7cb9c030 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662271 Oct 06 13:56:22.569857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3586/7155] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:56:22.583042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5cfc066a-4036-4b07-8a5f-775086447570 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:22.583793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5cfc066a-4036-4b07-8a5f-775086447570 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:22.638280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5cfc066a-4036-4b07-8a5f-775086447570 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:22.646869 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5cfc066a-4036-4b07-8a5f-775086447570 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1260 microversion: 2.1 time: 0.069346 Oct 06 13:56:22.647453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3570/7156] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:22 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1260 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:23.672642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:23.673511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:23.682324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:23.682818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:23.683259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:23.683969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:23.684434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:23.684865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:23.759778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:23.768954 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-02bd25fe-ca7f-42a7-8d8e-564675f3286e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1320 microversion: 2.1 time: 0.102093 Oct 06 13:56:23.770044 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3587/7157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:23 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1320 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:24.794669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:24.795428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:24.803734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:24.804332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:24.804861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:24.805804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:24.806351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:24.806866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:25.068192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:25.076316 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-745dc4cd-dd73-47cd-82ec-3abf8522fa90 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.286661 Oct 06 13:56:25.076737 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3571/7158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:24 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:25.099037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbeb5766-e11b-4427-8a72-12fbb0f82237", "tag": "0bc08511-6a50-4b28-976d-52ed33a5e24b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:25.110640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:25.111124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:25.111556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:25.123961 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] Creating event network-changed:0bc08511-6a50-4b28-976d-52ed33a5e24b for instance dbeb5766-e11b-4427-8a72-12fbb0f82237 on n-h2-860556-1 Oct 06 13:56:25.130674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-72a75219-6b1e-4586-bc58-e7a7fe956ab4 req-82f71baf-2b0f-434e-97e6-e000fc38d747 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Oct 06 13:56:25.131291 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3588/7159] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:56:26.099651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:26.100229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:26.107721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:26.108286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:26.108719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:26.109452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:26.109972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:26.110424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:26.248113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:26.256432 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-469f6624-4f2e-4e5f-a6e2-6212cfcc052e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.160813 Oct 06 13:56:26.257016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3572/7160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:26 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:27.281714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:27.282856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:27.289404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:27.289929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:27.290369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:27.291064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:27.291512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:27.291936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:27.425864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:27.433562 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ce590a4-b514-4a66-bf31-8bcab922487f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.157609 Oct 06 13:56:27.434172 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3589/7161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:27 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:28.457147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:28.457807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:28.465662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:28.466209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:28.466726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:28.467438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:28.468416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:28.468860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:28.604011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:28.612371 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a4087334-ec6f-4ff6-8bfd-7b17b52ea098 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.159633 Oct 06 13:56:28.612948 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3573/7162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:28 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 13:56:29.634873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:29.635492 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:29.643068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:29.643547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:29.643987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:29.644674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:29.645127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:29.645548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:29.776767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:29.785413 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf43e2ac-92c3-486a-a6a5-56cf153e7cdd tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.154356 Oct 06 13:56:29.786022 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3590/7163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:29 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:30.808350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:30.808910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:30.815946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:30.816454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:30.816917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:30.817639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:30.818148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:30.818600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:30.955444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:30.963226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-47896509-6def-4428-a4de-72856e3ac8b9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.158962 Oct 06 13:56:30.963825 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3574/7164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:30 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:31.985611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:31.986272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:31.989058 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:31.990168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:31.996238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:31.996871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:31.997308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:31.998032 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:31.998484 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:31.998922 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:32.099331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbeb5766-e11b-4427-8a72-12fbb0f82237", "name": "network-vif-plugged", "status": "completed", "tag": "0bc08511-6a50-4b28-976d-52ed33a5e24b"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:32.111384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:32.112393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:32.112814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:32.126635 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] Creating event network-vif-plugged:0bc08511-6a50-4b28-976d-52ed33a5e24b for instance dbeb5766-e11b-4427-8a72-12fbb0f82237 on n-h2-860556-1 Oct 06 13:56:32.131977 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2af5874b-f6a7-4f6f-8e08-25b74b2f51dd req-bab266c8-b2ce-4651-884c-f24682121f3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037128 Oct 06 13:56:32.132857 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3575/7165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:32.151579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:32.159559 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9baa2175-b988-433d-9e62-a850ad07307f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.177872 Oct 06 13:56:32.160157 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3591/7166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:31 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:33.181839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:33.188237 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:33.188965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:33.195527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:33.196033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:33.196752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:33.197503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:33.198015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:33.198470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:33.329602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:33.337921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-818089ee-a5ef-4ac3-9a67-a004d52a60c5 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1360 microversion: 2.1 time: 0.157008 Oct 06 13:56:33.339223 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3576/7167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:33 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:34.362449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:34.363069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:34.370975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:34.371488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:34.371931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:34.372622 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:34.373078 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:34.373505 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:34.574230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:34.582090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15c1eb17-359a-4809-96d2-8379c325e508 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1553 microversion: 2.1 time: 0.224262 Oct 06 13:56:34.582667 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3592/7168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:34 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:34.604578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:34.605218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:34.612686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:34.613192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:34.613663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:34.614406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:34.614916 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:34.615366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:34.742278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:34.750040 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-980f7275-c648-4e6f-8ae7-1027cb860808 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1553 microversion: 2.1 time: 0.149293 Oct 06 13:56:34.750620 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3577/7169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:34 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:36.246391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac43af8-a4cf-4e2d-afff-db9befbb6c12"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:36.249474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:36.256271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:36.256749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:36.257184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:36.257915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:36.258370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:36.258790 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:36.509547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:36.520149 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3a920e3b-0965-4aea-b14f-65b887e7bda2 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277538 Oct 06 13:56:36.521283 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3593/7170] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:56:36 2022] POST /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:47.266620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:47.267164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:47.270045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:47.270845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=76 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:47.277181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:47.277695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:47.278188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:47.278911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:47.279389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:47.280377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:47.363807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lazy-loading 'services' on Instance uuid dbeb5766-e11b-4427-8a72-12fbb0f82237 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:56:47.434813 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-dd283813-7cc1-4c76-ae01-665c917667df tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments/6ac43af8-a4cf-4e2d-afff-db9befbb6c12" status: 202 len: 0 microversion: 2.1 time: 0.171985 Oct 06 13:56:47.435464 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3578/7171] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:56:47 2022] DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments/6ac43af8-a4cf-4e2d-afff-db9befbb6c12 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:56:47.443344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:56:47.448140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:47.450616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:47.459865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:47.460349 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:47.460784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:47.461483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:47.461964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:47.462389 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:47.501939 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f71daac-1de5-4b1e-9101-061119223048 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060852 Oct 06 13:56:47.502532 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3594/7172] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:47 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:48.516616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:48.519023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:48.525559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:48.526100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:48.526552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:48.527279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:48.527751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:48.528202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:48.568426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-460a4e04-3d31-4040-9e44-cba97b151c4c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057633 Oct 06 13:56:48.569015 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3579/7173] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:48 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:49.583071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:49.585311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:49.592707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:49.593762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:49.594216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:49.594942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:49.595401 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:49.595836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:49.628594 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4051b30d-84c4-4e2c-b104-914296c18f5e tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Oct 06 13:56:49.629185 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3595/7174] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:49 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:50.640735 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:50.642991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:50.650086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:50.650586 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:50.651037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:50.651759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:50.652227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:50.652673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:50.686765 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-815576d3-7ac0-4204-95e9-d9686a3e5356 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050004 Oct 06 13:56:50.687337 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3580/7175] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:50 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:51.700746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:51.703607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:51.710692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:51.711181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:51.711617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:51.712316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:51.712774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:51.713203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:51.748249 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1c2d5604-d78b-4e07-8a56-da763f558100 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052924 Oct 06 13:56:51.748945 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3596/7176] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:51 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:52.760694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:52.762949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:52.769955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:52.770460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:52.770923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:52.771637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:52.772114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:52.772564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:52.804331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c7d25e83-af71-407d-a5aa-c95e1ea0eacb tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047560 Oct 06 13:56:52.804927 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3581/7177] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:56:52 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:56:52.816236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:52.816830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:52.823957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:52.824441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:52.824879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:52.825579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:52.826066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:52.826496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:52.906105 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 is not attached to volume 6ac43af8-a4cf-4e2d-afff-db9befbb6c12 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments/6ac43af8-a4cf-4e2d-afff-db9befbb6c12 HTTP/1.1 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 is not attached to volume 6ac43af8-a4cf-4e2d-afff-db9befbb6c12 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'dbeb5766-e11b-4427-8a72-12fbb0f82237', 'id': '6ac43af8-a4cf-4e2d-afff-db9befbb6c12'} Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 297, in get_by_volume_and_instance Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ac43af8-a4cf-4e2d-afff-db9befbb6c12. Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 is not attached to volume 6ac43af8-a4cf-4e2d-afff-db9befbb6c12 Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:52.908241 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 is not attached to volume 6ac43af8-a4cf-4e2d-afff-db9befbb6c12 Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 is not attached to volume 6ac43af8-a4cf-4e2d-afff-db9befbb6c12 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2fbdc89-63f2-4547-93b6-49da3cdb91f4 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments/6ac43af8-a4cf-4e2d-afff-db9befbb6c12" status: 404 len: 154 microversion: 2.1 time: 0.097733 Oct 06 13:56:52.912486 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3597/7178] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:56:52 2022] DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237/os-volume_attachments/6ac43af8-a4cf-4e2d-afff-db9befbb6c12 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:56:56.277279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:56.277884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:56.286340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:56.286340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:56.286746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:56.287467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:56.287936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:56.288382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:56.316418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:56:56.414071 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-abd6d25a-c69e-447c-a822-1f98e7af1717 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 204 len: 0 microversion: 2.1 time: 0.139873 Oct 06 13:56:56.414522 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3582/7179] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:56:56 2022] DELETE /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:56:56.423838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:56.424459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:56.431448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:56.431937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:56.432372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:56.433079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:56.433530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:56.434362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:56.577324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:56.585664 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-37830414-5478-48c3-9408-1ed9e6918976 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1559 microversion: 2.1 time: 0.166541 Oct 06 13:56:56.586296 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3598/7180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:56 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:57.610886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:57.611609 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:57.618547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:57.619049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:57.619499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:57.620206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:57.620676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:57.621123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:57.760002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:57.768048 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-91ee75d7-8d28-43be-b272-1fdac6a2868c tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1559 microversion: 2.1 time: 0.162568 Oct 06 13:56:57.768716 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3583/7181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:57 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:58.760427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbeb5766-e11b-4427-8a72-12fbb0f82237", "name": "network-vif-deleted", "tag": "0bc08511-6a50-4b28-976d-52ed33a5e24b"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:56:58.772105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:58.772718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:58.773088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:58.787704 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] Creating event network-vif-deleted:0bc08511-6a50-4b28-976d-52ed33a5e24b for instance dbeb5766-e11b-4427-8a72-12fbb0f82237 on n-h2-860556-1 Oct 06 13:56:58.793923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6ffa0dd1-5a90-4932-ab79-bee261cc6000 req-baa52c1e-0173-4536-a94a-4473732ee48e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038787 Oct 06 13:56:58.794911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:58.797918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3599/7182] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:56:58.799772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:58.808231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:58.808908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:58.809459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:58.810444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:58.811068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:58.811874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:58.883934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:56:58.893315 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-67168a45-76cb-49ec-aec9-01fda143f798 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 200 len: 1345 microversion: 2.1 time: 0.102187 Oct 06 13:56:58.901854 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3584/7183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:58 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:56:59.920159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:59.921463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: dbeb5766-e11b-4427-8a72-12fbb0f82237] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:56:59.932604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:59.933562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:59.934464 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:59.935330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:56:59.935863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:56:59.936806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:56:59.951179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 HTTP/1.1 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'dbeb5766-e11b-4427-8a72-12fbb0f82237'} Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:56:59.953105 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance dbeb5766-e11b-4427-8a72-12fbb0f82237 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-88aefa3d-540d-4fd5-b5e8-1880d8648189 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237" status: 404 len: 111 microversion: 2.1 time: 0.039685 Oct 06 13:56:59.958304 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3600/7184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:56:59 2022] GET /compute/v2.1/servers/dbeb5766-e11b-4427-8a72-12fbb0f82237 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:56:59.964401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eb553c08-5bc2-49ef-afb8-e67ac848d606 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '.version_select at 0x7f7d3dd565e0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:56:59.994447 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eb553c08-5bc2-49ef-afb8-e67ac848d606 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-205583556" status: 202 len: 0 microversion: 2.1 time: 0.034031 Oct 06 13:56:59.995135 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3585/7185] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-205583556 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:57:00.018259 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-be33120b-5639-4f42-9b79-7ce1bb62d6ab tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: .version_select at 0x7f7d3ed05670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-244991578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEe7oxplvk0s/alHy4sYsSlPldnrHWckIv1aFIbtAtfWCsrNvrd1xi9TiJfRlmdRyjUzj75C7bfta7+f2V6rbEnVM6oP4el6CTjS4RGU81z4YpUaK7NqtZG1u/dFT2eJQ=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:00.034535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be33120b-5639-4f42-9b79-7ce1bb62d6ab tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:57:00.040829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-be33120b-5639-4f42-9b79-7ce1bb62d6ab tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:57:00.071320 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-be33120b-5639-4f42-9b79-7ce1bb62d6ab tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057086 Oct 06 13:57:00.072389 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3601/7186] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:57:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:57:00.136825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1344192165", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-244991578", "networks": [{"uuid": "d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:00.194111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] validate_networks() for [('d4a584d1-50bf-4bbb-877b-8c9cdbbc7b7c', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:57:00.580339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:57:00.580729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:57:00.581239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:57:00.581669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:57:00.582142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:57:00.591413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:00.591994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:00.592495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:00.593325 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:00.593904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:00.594727 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:00.612533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:57:00.617866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Getting quotas for user 4d54bf4ad57748779c97309dd570095f and project 10186d8df03442ccb8b88d33d4dc339c. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:57:00.630692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:57:00.633013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:57:00.683515 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ddbd3ca-df18-49d5-ab98-679fed0a0019 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561047 Oct 06 13:57:00.684386 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3586/7187] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:57:00.696116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-922cfb93-8632-4665-8ce7-927f7a6cfbb7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:00.697140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-922cfb93-8632-4665-8ce7-927f7a6cfbb7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:00.759877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-922cfb93-8632-4665-8ce7-927f7a6cfbb7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:00.766960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-922cfb93-8632-4665-8ce7-927f7a6cfbb7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1262 microversion: 2.1 time: 0.074810 Oct 06 13:57:00.767537 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3602/7188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:00 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:01.790504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:01.793634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:01.801754 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:01.802441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:01.803004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:01.804016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:01.804742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:01.806434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:01.882457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:01.892720 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff345c3e-8e5d-470e-adbc-5b55177a5685 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1322 microversion: 2.1 time: 0.107094 Oct 06 13:57:01.893338 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3587/7189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:01 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:02.915889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:02.916721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:02.923851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:02.924335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:02.924771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:02.925471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:02.925980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:02.926553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:03.076980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:03.085979 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2f2e997b-d796-4a08-b956-ad3d9c141596 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.173728 Oct 06 13:57:03.086481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3603/7190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:02 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:03.185358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30eb8f8-5641-45d0-9614-28ee6cb8f32b", "tag": "c3ae1e1f-86b1-49f7-baed-6bf7f6933f01"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:03.198624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:03.199734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:03.200220 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:03.212603 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] Creating event network-changed:c3ae1e1f-86b1-49f7-baed-6bf7f6933f01 for instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b on n-h2-860556-1 Oct 06 13:57:03.226269 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6f3001e3-5919-4058-bffb-bcacccd4530a req-11c96634-e9c6-4a9a-b4d3-29dc3e4d7d1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037534 Oct 06 13:57:03.226953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3588/7191] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:57:04.110974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:04.111589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:04.119081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:04.119569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:04.120006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:04.120704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:04.121156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:04.121581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:04.256507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:04.264398 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ed668b35-e2f4-4a4e-8d6f-01b4cc01a781 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.158034 Oct 06 13:57:04.264969 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3604/7192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:04 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:05.288451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:05.289165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:05.296032 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:05.296538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:05.296995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:05.297708 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:05.298209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:05.298656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:05.431862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:05.440354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ac71831-f05b-44c1-9051-1a420735c818 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.157062 Oct 06 13:57:05.440932 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3589/7193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:05 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:06.464710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:06.465634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:06.473456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:06.474096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:06.474605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:06.475449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:06.476109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:06.476612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:06.614857 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:06.622650 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f4a00c90-47df-43a9-9863-798dbcbfdca8 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.162221 Oct 06 13:57:06.623262 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3605/7194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:06 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:07.645965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:07.646622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:07.653541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:07.654090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:07.654606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:07.655329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:07.655808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:07.656260 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:07.790638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:07.799102 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-41d6c372-c933-4dc7-94f7-feca87a76be9 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.157110 Oct 06 13:57:07.799678 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3590/7195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:07 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:08.272751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30eb8f8-5641-45d0-9614-28ee6cb8f32b", "name": "network-vif-plugged", "status": "completed", "tag": "c3ae1e1f-86b1-49f7-baed-6bf7f6933f01"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:08.285849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:08.286365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:08.286777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:08.298648 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] Creating event network-vif-plugged:c3ae1e1f-86b1-49f7-baed-6bf7f6933f01 for instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b on n-h2-860556-1 Oct 06 13:57:08.303679 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0600a271-31a1-4cf9-96b6-ab5f77121ea3 req-722cf14a-a085-4c39-9bcc-6fee66b1c653 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Oct 06 13:57:08.304287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3606/7196] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:08.822940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:08.825504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:08.830993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:08.831505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:08.832000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:08.832801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:08.833166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:08.833613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:08.966256 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:08.973968 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-34416bc2-5901-4aa3-9809-7c01bca9e9b7 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1362 microversion: 2.1 time: 0.155372 Oct 06 13:57:08.974547 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3591/7197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:08 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:09.997061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:09.997780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:10.005373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:10.005927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:10.006366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:10.007055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:10.007508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:10.007931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:10.143083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:10.150904 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52ea41a0-ce18-494c-9360-ff05106a1567 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1554 microversion: 2.1 time: 0.158182 Oct 06 13:57:10.151490 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3607/7198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:09 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:10.172907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:10.173871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:10.180425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:10.180931 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:10.181391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:10.182140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:10.182617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:10.183285 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:10.311831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:10.319555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e3bcf9fc-2395-4235-b37d-b5aa4e0d52ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1554 microversion: 2.1 time: 0.150465 Oct 06 13:57:10.320132 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3592/7199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:10 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:11.819898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc42764-b23e-4c50-a1c5-74ecac50cce1"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:11.822561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:11.824675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:11.831372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:11.831860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:11.832294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:11.832985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:11.833435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:11.833890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:12.100211 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-234dc8ef-bcfd-429a-b76c-4359d6c91160 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "POST /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284046 Oct 06 13:57:12.100838 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3608/7200] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:57:11 2022] POST /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:23.005752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:23.006267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:23.008225 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.008898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.010628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.011362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.018047 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:23.018551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:23.019009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:23.019722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:23.020191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:23.020674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:23.106253 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lazy-loading 'services' on Instance uuid c30eb8f8-5641-45d0-9614-28ee6cb8f32b {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:57:23.176240 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b44800e3-0200-40ea-a9cf-476f754f4245 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments/dfc42764-b23e-4c50-a1c5-74ecac50cce1" status: 202 len: 0 microversion: 2.1 time: 0.174182 Oct 06 13:57:23.176855 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3593/7201] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:57:23 2022] DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments/dfc42764-b23e-4c50-a1c5-74ecac50cce1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:57:23.183256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.184087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:57:23.188300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:23.190828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:23.199554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:23.200042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:23.200478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:23.201241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:23.201718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:23.202176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:23.243921 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49f87a63-aca8-48a8-9c33-9d77b66282ff tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062395 Oct 06 13:57:23.244674 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3609/7202] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:23 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 13:57:24.258986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:24.261452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:24.269310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:24.269899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:24.270387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:24.271136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:24.271616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:24.272242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:24.308695 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fcb13105-1871-4b87-a272-6b49c4c6602f tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054969 Oct 06 13:57:24.309287 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3594/7203] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:24 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:25.320482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:25.323126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:25.330810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:25.331309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:25.331749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:25.332469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:25.332927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:25.333359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:25.367793 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-72eabfdf-0475-46e9-93c3-6bbf7a8cb8ce tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051266 Oct 06 13:57:25.368400 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3610/7204] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:25 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:26.380447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:26.382817 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:26.390107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:26.390604 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:26.391056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:26.391774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:26.392239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:26.392680 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:26.423945 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0f805bba-6d18-427a-8a1f-10226bab2715 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Oct 06 13:57:26.424533 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3595/7205] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:26 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:27.436369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:27.439777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:27.447275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:27.447764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:27.448211 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:27.448915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:27.449379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:27.449843 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:27.481562 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5405b138-827d-4935-be35-dbb998c77899 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Oct 06 13:57:27.482557 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3611/7206] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:27 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:28.494082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:28.496381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:28.503116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:28.503622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:28.504086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:28.504800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:28.505280 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:28.505753 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:28.534983 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e6ec26e-9b05-4672-bca0-6c1689cb8142 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044945 Oct 06 13:57:28.535549 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3596/7207] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 13:57:28 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 13:57:28.546816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:28.547331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:28.554328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:28.554816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:28.555252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:28.555974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:28.556456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:28.556900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:28.635519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b is not attached to volume dfc42764-b23e-4c50-a1c5-74ecac50cce1 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments/dfc42764-b23e-4c50-a1c5-74ecac50cce1 HTTP/1.1 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b is not attached to volume dfc42764-b23e-4c50-a1c5-74ecac50cce1 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': 'c30eb8f8-5641-45d0-9614-28ee6cb8f32b', 'id': 'dfc42764-b23e-4c50-a1c5-74ecac50cce1'} Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 297, in get_by_volume_and_instance Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dfc42764-b23e-4c50-a1c5-74ecac50cce1. Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b is not attached to volume dfc42764-b23e-4c50-a1c5-74ecac50cce1 Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:57:28.637286 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b is not attached to volume dfc42764-b23e-4c50-a1c5-74ecac50cce1 Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b is not attached to volume dfc42764-b23e-4c50-a1c5-74ecac50cce1 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f92c97b5-58bc-4232-8877-ced0605a5efc tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments/dfc42764-b23e-4c50-a1c5-74ecac50cce1" status: 404 len: 154 microversion: 2.1 time: 0.096633 Oct 06 13:57:28.641517 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3612/7208] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 13:57:28 2022] DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b/os-volume_attachments/dfc42764-b23e-4c50-a1c5-74ecac50cce1 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:57:31.993196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:31.993862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:32.001240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:32.001885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:32.002349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:32.003087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:32.003563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:32.004009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:32.034943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 13:57:32.116693 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3936eb0e-c2ad-4475-af36-234d9fa9b815 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 204 len: 0 microversion: 2.1 time: 0.127089 Oct 06 13:57:32.117363 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3597/7209] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 13:57:31 2022] DELETE /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 13:57:32.127688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:32.128782 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:32.137269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:32.137821 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:32.138266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:32.139500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:32.139954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:32.140407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:32.274832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:32.282845 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6ba833f7-67e5-45c7-bc24-5a0d4c714eaa tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1560 microversion: 2.1 time: 0.160568 Oct 06 13:57:32.283430 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3613/7210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:32 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:33.307190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:33.307897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:33.315175 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:33.315679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:33.316128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:33.316832 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:33.317294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:33.317730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:33.455123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:33.462910 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a290feb3-966c-48a3-9191-a34733c51f24 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1560 microversion: 2.1 time: 0.160063 Oct 06 13:57:33.463491 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3598/7211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:33 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:34.378716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30eb8f8-5641-45d0-9614-28ee6cb8f32b", "name": "network-vif-deleted", "tag": "c3ae1e1f-86b1-49f7-baed-6bf7f6933f01"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:57:34.389713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:34.390160 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:34.390602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:34.403598 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] Creating event network-vif-deleted:c3ae1e1f-86b1-49f7-baed-6bf7f6933f01 for instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b on n-h2-860556-1 Oct 06 13:57:34.410184 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9894e2fb-f558-4b1f-8b69-1e9b9fecb301 req-ad15af69-bbd9-4700-bccd-86552513a06d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Oct 06 13:57:34.410965 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3614/7212] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:57:34.491622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:34.492276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:34.499476 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:34.500034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:34.500487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:34.501224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:34.501702 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:34.502188 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:34.536887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:34.537463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:34.537951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:34.538422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lazy-loading 'fault' on Instance uuid c30eb8f8-5641-45d0-9614-28ee6cb8f32b {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 13:57:34.579644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d54bf4ad57748779c97309dd570095f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10186d8df03442ccb8b88d33d4dc339c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:57:34.587834 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-364eca3a-974a-4c3e-8770-3377f680db45 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 200 len: 1352 microversion: 2.1 time: 0.105963 Oct 06 13:57:34.588433 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3599/7213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:34 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:57:35.613169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:35.613915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] [instance: c30eb8f8-5641-45d0-9614-28ee6cb8f32b] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:57:35.620928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:35.621417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:35.621954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:35.622666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:57:35.623774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:57:35.624256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:57:35.637635 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] HTTP exception thrown: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Request method failure captured: Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b HTTP/1.1 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt5ZAVLTcu0n0XBu5U2xUXSDKmQcLG7_qklls-dft0lBfsFDRhy5e4n_DCFzhfFQa0VeAsXJZAdX8gdua92yBuXCZKbEt_kootpKHfW4wcm3v1Spn1h2pO-2Rolx85Tx_NwnlffvgSgiFOuP_Np0nCzngOM400Ru9Y4CTIvuuoRTYS4 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10186d8df03442ccb8b88d33d4dc339c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10186d8df03442ccb8b88d33d4dc339c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10186d8df03442ccb8b88d33d4dc339c"}]}] Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 10186d8df03442ccb8b88d33d4dc339c Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-66876032 Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 4d54bf4ad57748779c97309dd570095f Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestEncryptedCinderVolumes-66876032-project Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'c30eb8f8-5641-45d0-9614-28ee6cb8f32b'} Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 13:57:35.639441 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Returning 404 to user: Instance c30eb8f8-5641-45d0-9614-28ee6cb8f32b could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d6c38ac2-23f3-4759-b682-7eafa7693199 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b" status: 404 len: 111 microversion: 2.1 time: 0.031969 Oct 06 13:57:35.644258 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3615/7214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:57:35 2022] GET /compute/v2.1/servers/c30eb8f8-5641-45d0-9614-28ee6cb8f32b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 13:57:35.650760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9bad4286-19f2-42dc-9afa-6ce05a2335b0 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] Calling method '.version_select at 0x7f7d3e51a310>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:57:35.671007 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9bad4286-19f2-42dc-9afa-6ce05a2335b0 tempest-TestEncryptedCinderVolumes-66876032 tempest-TestEncryptedCinderVolumes-66876032-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-244991578" status: 202 len: 0 microversion: 2.1 time: 0.023988 Oct 06 13:57:35.671580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3600/7215] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Oct 6 13:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-244991578 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:58:02.973759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd010cd9-d23f-456e-9ea3-9c0d3d27f3e9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: .version_select at 0x7f7d3df41700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-628822270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItVHuiZZzzOMoeIqKRnieIw1MvUh8IBoSyUXEncxqKNdtEIe9fI2MeBtkfe7QjxRaMJso6BG5p5r/wn4AVEph3lnlpb+rxqfLoXB53EMfMXAfwZPxmk0yuDQuz6Q7lXYg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:02.979727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=14 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:02.980444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=34 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:02.992900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dd010cd9-d23f-456e-9ea3-9c0d3d27f3e9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for project 03ee21a5c23448ec9f717de537fbd539. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:58:02.997997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-dd010cd9-d23f-456e-9ea3-9c0d3d27f3e9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for user 2fd477319826419a9d2e4cb37b95bd32 and project 03ee21a5c23448ec9f717de537fbd539. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:58:03.022346 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd010cd9-d23f-456e-9ea3-9c0d3d27f3e9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052405 Oct 06 13:58:03.022948 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3616/7216] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 13:58:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:03.073900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1155168495", "imageRef": "5b7b3b96-4a7c-4c7a-b27f-728a27b86db5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-628822270", "networks": [{"uuid": "87e14b7a-32f8-4d68-8e6c-2145045bd9a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:03.086486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:03.087275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:03.134420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] validate_networks() for [('87e14b7a-32f8-4d68-8e6c-2145045bd9a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 13:58:03.525528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 13:58:03.526000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 13:58:03.526519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 13:58:03.526948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 13:58:03.527374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 13:58:03.536301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:03.536794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:03.537245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:03.538024 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:03.538520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:03.538968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:03.556415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for project 03ee21a5c23448ec9f717de537fbd539. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 13:58:03.562550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for user 2fd477319826419a9d2e4cb37b95bd32 and project 03ee21a5c23448ec9f717de537fbd539. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 13:58:03.575007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 13:58:03.577212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b7b3b96-4a7c-4c7a-b27f-728a27b86db5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 13:58:03.624544 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0b8a848b-27f4-4aa0-9eda-2f797c84bcb7 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554875 Oct 06 13:58:03.625217 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3601/7217] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 13:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 13:58:03.636171 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8282c29-428e-4118-bcf8-c275592c29a9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:03.636884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8282c29-428e-4118-bcf8-c275592c29a9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:03.699112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8282c29-428e-4118-bcf8-c275592c29a9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:03.706733 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8282c29-428e-4118-bcf8-c275592c29a9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1258 microversion: 2.1 time: 0.074469 Oct 06 13:58:03.707343 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3617/7218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:03 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:04.730528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:04.731163 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:04.739065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:04.739673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:04.740213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:04.741066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:04.741675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:04.742232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:04.814607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:04.825398 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab3e410d-3f6a-4f40-a671-b8575f0182ac tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1318 microversion: 2.1 time: 0.099799 Oct 06 13:58:04.826255 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3602/7219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:04 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:05.850220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:05.851882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:05.870696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:05.871426 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:05.872133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:05.874384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:05.875022 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:05.875625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:06.077421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:06.095621 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-48a2b52b-1d4e-4e1b-9656-6593c3e74cd1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.250104 Oct 06 13:58:06.098434 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3618/7220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:05 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:07.004583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:07.027648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:07.028156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:07.028776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:07.066193 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] Creating event network-changed:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 13:58:07.089412 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-2c8d4cbd-2990-4f44-8a63-96dd1848807c req-f7574427-f889-4c21-b06e-d62fdab75e1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088333 Oct 06 13:58:07.090573 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3603/7221] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:07.130415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:07.131122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:07.139689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:07.140184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:07.140628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:07.141340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:07.141826 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:07.142286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:07.325567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:07.334179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-45d3d248-bb60-436b-bdce-2fc34d2de88e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.207662 Oct 06 13:58:07.334786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3619/7222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:07 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:08.360168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:08.360889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:08.368294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:08.369016 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:08.369381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:08.370161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:08.370642 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:08.371096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:08.546700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:08.555230 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae5d5fc4-ca76-4693-a37f-6a7727aa66bb tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.200684 Oct 06 13:58:08.556016 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3604/7223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:08 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:09.579926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:09.580812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:09.588525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:09.589146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:09.589696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:09.590549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:09.591081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:09.592167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:09.761104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:09.773647 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a091a12d-c062-4898-887c-87fbc5ffb359 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.198063 Oct 06 13:58:09.786679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3620/7224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:09 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:10.798781 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:10.799415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:10.807509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:10.808056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:10.808669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:10.809422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:10.810504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:10.811000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:10.967902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:10.976267 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8f7ba1ff-7baa-4ef3-8434-92af6061b547 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.182374 Oct 06 13:58:10.977180 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3605/7225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:10 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:12.003697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:12.004278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:12.011716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:12.012215 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:12.012664 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:12.013386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:12.013880 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:12.014346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:12.155509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:12.163518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-64671742-07b7-4583-b088-b7f5d5a49b0d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.163778 Oct 06 13:58:12.164097 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3621/7226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:11 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:13.187968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:13.188626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:13.195496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:13.195998 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:13.196450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:13.197221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:13.197986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:13.198433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:13.335587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:13.343769 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e8e574b8-9b94-46e1-8048-86ba65e5c903 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.160526 Oct 06 13:58:13.344359 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3606/7227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:13 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:14.367331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:14.367973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:14.370776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:14.376901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:14.377399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:14.378009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:14.378731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:14.379191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:14.379621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:14.512084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:14.520501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fec7ac03-b25e-4ff0-9edd-8f370f0298ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.157052 Oct 06 13:58:14.521078 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3622/7228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:14 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:15.544627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:15.545189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:15.547240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:15.548004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:15.555035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:15.555546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:15.556004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:15.556732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:15.557213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:15.557663 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:15.695180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:15.703587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd80ea26-e9fa-443d-8237-43121009b8b2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.163606 Oct 06 13:58:15.704179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3607/7229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:15 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:16.727061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:16.727523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:16.734244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:16.735057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:16.735357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:16.736068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:16.736518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:16.736944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:16.890173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:16.899060 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c29503be-9cff-40ab-83f0-ef045d3a592d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.175835 Oct 06 13:58:16.900251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3623/7230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:16 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:17.924953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:17.925652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:17.932703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:17.933215 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:17.933670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:17.934533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:17.935529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:17.935977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:18.077133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:18.085335 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-98953020-bc5a-44ee-afc2-7a7b181a9b81 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.166082 Oct 06 13:58:18.085998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3608/7231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:17 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:19.108541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:19.109153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:19.115986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:19.116469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:19.116900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:19.117589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:19.118073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:19.118500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:19.257562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:19.268741 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e2c540ab-aff6-45f2-9c93-6b93c5ca257a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.164118 Oct 06 13:58:19.269393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3624/7232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:19 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:20.294652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:20.295484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:20.304652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:20.305169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:20.305630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:20.306397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:20.306872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:20.307320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:20.444284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:20.454988 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f4900031-c257-43cc-89c7-ecc748aa5c20 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.164870 Oct 06 13:58:20.455592 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3609/7233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:20 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:21.479164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:21.479764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:21.487154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:21.487633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:21.488071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:21.488762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:21.489220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:21.489635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:21.632367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:21.640813 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9184b8db-cb5a-4444-9048-af736326c71f tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.165653 Oct 06 13:58:21.641547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3625/7234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:21 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:22.611056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "name": "network-vif-plugged", "status": "completed", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:22.621373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:22.621897 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:22.622350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:22.636311 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] Creating event network-vif-plugged:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 13:58:22.642563 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7d890fed-0367-4ed3-ac85-ed5bbcdf972a req-f991192a-3da9-445b-a79e-1f658569581b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Oct 06 13:58:22.643190 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3610/7235] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:22.665999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:22.666859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:22.675340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:22.675830 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:22.676261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:22.677046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:22.677491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:22.677947 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:22.830733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:22.839613 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ceffd54-c0a2-4772-83ff-0129cdd553ea tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.178289 Oct 06 13:58:22.839968 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3626/7236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:22 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:23.865212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:23.865967 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:23.872246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:23.872747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:23.873207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:23.873953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:23.874432 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:23.874878 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:24.002690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:24.010423 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-024f0959-e710-4891-a35d-12f877db0a7e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1358 microversion: 2.1 time: 0.150569 Oct 06 13:58:24.010944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3611/7237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:23 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:25.034241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:25.034862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:25.043285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.043722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.044168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.044875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.045971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.046404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.180663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:25.189369 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1780ccb7-7325-4120-96c9-b968da168184 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1548 microversion: 2.1 time: 0.159816 Oct 06 13:58:25.190004 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3627/7238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:25 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:25.212171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:25.212809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:25.219820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.220328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.221009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.221828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.222386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.222937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.356829 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:25.365420 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-914e0647-524d-4b85-8d97-ce3dd0fdf7e1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1548 microversion: 2.1 time: 0.157057 Oct 06 13:58:25.366036 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3612/7239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:25 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:25.387479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:25.392102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:25.392882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Searching by: {'deleted': False, 'project_id': '03ee21a5c23448ec9f717de537fbd539'} {{(pid=129615) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 13:58:25.398336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.398824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.399267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.400402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.400871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.401302 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.426165 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.multi_cell_list [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 13:58:25.454042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e0efb56b-26be-41f6-a654-a0f0d590367d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070349 Oct 06 13:58:25.454652 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3628/7240] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 13:58:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:25.466501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:25.467700 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:25.473903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.474412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.474911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.475635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:25.476121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:25.476570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:25.614074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:25.622009 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0bf1f74-17da-4f1a-9cd4-c97f0a65a7de tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1548 microversion: 2.1 time: 0.159321 Oct 06 13:58:25.622585 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3613/7241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:25 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:27.196602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ceabec-64df-4a2f-a8a3-886b498ef061"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:27.199325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:27.206286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:27.206774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:27.207217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:27.207917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:27.208374 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:27.208801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:27.474701 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9b4d383b-6c5e-492b-97ec-3da15c86d79b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281950 Oct 06 13:58:27.475614 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3629/7242] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 13:58:27 2022] POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:40.579859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:40.580504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:40.582767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:40.583585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=66 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:40.589534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:40.590074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:40.590540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:40.591257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:40.591764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:40.592213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:40.721100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:40.729425 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3142c063-e11f-48d8-abb5-10e586962bfa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1594 microversion: 2.1 time: 0.154243 Oct 06 13:58:40.730049 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3614/7243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:40 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:42.691960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:42.692726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:42.693371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 13:58:42.878781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:42.891024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:42.891520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:42.891958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:42.906586 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] Creating event network-changed:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 13:58:42.911718 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-a833f097-7f91-41bd-b052-51fbb421d071 req-53e07c77-1ad5-4371-9a94-af1361e6207e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221587 Oct 06 13:58:42.912380 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3630/7244] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 13:58:43.712716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-903443821"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:43.713271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:43.722246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:43.722749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:43.723281 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:43.724007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:43.724542 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:43.725271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:43.869004 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.network.security_group_api [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Adding security group 2be3ff89-293a-49ea-9195-8d88fcc70f77 to port db132efb-b80a-4f82-8140-8c302cb4d2c5 Oct 06 13:58:44.191786 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-01325c69-1f78-48c8-8933-b4ac85aba8aa tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action" status: 202 len: 0 microversion: 2.1 time: 0.482978 Oct 06 13:58:44.195417 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3615/7245] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 13:58:43 2022] POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 13:58:44.203143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 13:58:44.203850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 13:58:44.210631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:44.211304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:44.211548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:44.212449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:44.212918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:44.213345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:44.363074 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 13:58:44.371446 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d1afb01e-cc6b-4809-a845-e5e9b98ee9bc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1759 microversion: 2.1 time: 0.174526 Oct 06 13:58:44.372028 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3631/7246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 13:58:44 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 13:58:44.928652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 13:58:44.938267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 13:58:44.938768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 13:58:44.939224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 13:58:44.953023 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] Creating event network-changed:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 13:58:44.958741 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cb76ecb8-66bb-4239-80f5-e13bca97c861 req-2757c3f4-3bd5-461b-b407-92a94eb07746 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Oct 06 13:58:44.959347 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3616/7247] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 13:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:00:56.376964 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:00:56.377958 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:00:56.378449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:00:56.379186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:00:56.380421 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:00:56.380569 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action (ip 10.222.0.26) !!! Oct 06 14:00:56.381762 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:00:56.382512 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action (ip 10.222.0.26) !!! Oct 06 14:00:56.383364 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:00:56.383483 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action (ip 10.222.0.26) !!! Oct 06 14:00:56.389463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:00:56.391825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:00:56.404807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:56.405307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:56.405751 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:56.406474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:56.406938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:56.407373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:56.481974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2ea6557c-6ad9-4346-9e10-2b14b723046e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action" status: 202 len: 0 microversion: 2.1 time: 0.106897 Oct 06 14:00:56.482714 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3632/7248] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:00:56 2022] POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:00:56.489499 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:00:56.490682 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:00:56.491786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:00:56.492548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:00:56.493706 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:00:56.493882 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 (ip 10.222.0.26) !!! Oct 06 14:00:56.495260 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:00:56.495426 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 (ip 10.222.0.26) !!! Oct 06 14:00:56.501384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:00:56.502338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:00:56.516025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:56.516558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:56.517017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:56.517763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:56.518265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:56.518716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:56.682823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:00:56.691783 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cb6aebc3-5ffb-4116-acd6-6593b13b5bc5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1761 microversion: 2.1 time: 0.204260 Oct 06 14:00:56.692548 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3617/7249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:00:56 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1761 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:00:57.720506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:00:57.721390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:00:57.728480 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48402. Oct 06 14:00:57.734815 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48400. Oct 06 14:00:57.740548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:57.741060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:57.742026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:57.742741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:57.743201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:57.743640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:57.893365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:00:57.901853 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-269ceec6-2560-4cff-96c6-b87b43073265 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1766 microversion: 2.1 time: 0.188293 Oct 06 14:00:57.902436 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3633/7250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:00:57 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1766 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:00:58.925360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:00:58.926101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:00:58.937636 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:58.938177 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:58.938669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:58.939402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:00:58.939889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:00:58.940337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:00:58.948709 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48408. Oct 06 14:00:58.949466 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48410. Oct 06 14:00:59.087541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:00:59.095964 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7b2ad23-480b-443c-a59f-26f43ff03be9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1759 microversion: 2.1 time: 0.174645 Oct 06 14:00:59.096551 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3618/7251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:00:58 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:02:43.121432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:02:43.122227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:02:43.127800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-903443821"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:02:43.128343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:43.135617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:43.136108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:43.136556 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:43.137256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:43.137729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:43.138190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:43.324258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Removing security group 2be3ff89-293a-49ea-9195-8d88fcc70f77 from port db132efb-b80a-4f82-8140-8c302cb4d2c5 Oct 06 14:02:43.632143 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-32c5c70c-277d-4cff-a40a-a13c3dcb72c3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action" status: 202 len: 0 microversion: 2.1 time: 0.512530 Oct 06 14:02:43.635854 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3634/7252] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:02:43 2022] POST /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:02:43.642413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:02:43.648982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:02:43.660699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:02:43.664773 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:02:43.665474 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:02:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:02:43.689495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:43.689495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:43.689495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:43.711527 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] Creating event network-changed:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 14:02:43.721842 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7f986817-5891-4f03-8e83-79818e48d735 req-dd606745-84d1-49ea-a77c-ca04bba9374d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085001 Oct 06 14:02:43.723739 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3619/7253] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:02:44.867346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:44.867862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:44.874021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:44.874506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:44.874943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:44.875630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:44.876670 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:44.877373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:44.962923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lazy-loading 'services' on Instance uuid 6d262555-486d-4215-8ce2-fe795fc07de7 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:02:45.036378 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a1aaff48-9e60-44b5-8804-0c07103568f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments/04ceabec-64df-4a2f-a8a3-886b498ef061" status: 202 len: 0 microversion: 2.1 time: 0.173567 Oct 06 14:02:45.037546 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3635/7254] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 14:02:44 2022] DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments/04ceabec-64df-4a2f-a8a3-886b498ef061 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 14:02:45.047517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:45.050839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:45.058371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:45.058889 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:45.059344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:45.060076 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:45.060557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:45.061003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:45.094621 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c84ec351-ce74-453f-965a-1330483b46d0 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051849 Oct 06 14:02:45.095217 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3620/7255] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:45 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:45.738134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:02:45.748661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:45.749220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:45.749730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:45.764065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] Creating event network-changed:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 14:02:45.769232 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-571dcba5-8ff7-4a01-9cb8-1f3ff0252579 req-501033b3-9b00-4286-b5d3-a746c6c43c87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035900 Oct 06 14:02:45.769966 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3636/7256] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:46.107570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:46.110035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:46.117015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:46.117703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:46.118279 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:46.119202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:46.119675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:46.120118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:46.153012 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96d614a2-a3dd-4437-a760-04ed63394e22 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049496 Oct 06 14:02:46.153719 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3621/7257] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:46 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:47.169522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:47.171894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:47.178844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:47.179348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:47.179870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:47.180564 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:47.181064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:47.181496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:47.218433 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1e5dd0e-d2d4-4749-ac9d-218eb9a98618 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054000 Oct 06 14:02:47.219046 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3637/7258] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:47 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:48.231652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:48.233927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:48.241141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:48.241650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:48.242146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:48.242879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:48.243434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:48.244038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:48.275066 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c326338a-c165-4223-84ea-6c589ad197d6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Oct 06 14:02:48.275651 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3622/7259] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:48 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:49.288617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:49.290755 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:49.298461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:49.298942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:49.299380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:49.300073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:49.300637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:49.301257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:49.334158 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-336c2ab8-5ab0-4f2a-b869-f765e899f4f1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049546 Oct 06 14:02:49.334763 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3638/7260] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:49 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:50.346752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:50.348972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:50.356624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:50.357065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:50.357528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:50.358288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:50.358766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:50.359219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:50.391883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4eead9a3-8e77-4342-80cc-cfbc28ab4ff1 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049034 Oct 06 14:02:50.392467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3623/7261] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:02:50 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 14:02:50.403474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:50.403992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:50.410931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:50.411411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:50.411932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:50.412619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:50.413069 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:50.413490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:50.491345 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] HTTP exception thrown: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 is not attached to volume 04ceabec-64df-4a2f-a8a3-886b498ef061 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Request method failure captured: Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: request: DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments/04ceabec-64df-4a2f-a8a3-886b498ef061 HTTP/1.1 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt7b1t77ugihqgtLNzxLoBqkcLAf_cqhsdrsv_6VsrnEpfKkxkh78JgfGIuxHzmQydIcmGrDrCTrLNo3_C5aygwiQm-XCUD-BD_bvH9_yBn8Difkfv6PUGelYBQmdORkM54EykUIQRlTOEL0Nv8beVXS8bGIfD2q76Czm51PENpEFH0 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03ee21a5c23448ec9f717de537fbd539", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}] Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2fd477319826419a9d2e4cb37b95bd32 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 is not attached to volume 04ceabec-64df-4a2f-a8a3-886b498ef061 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'server_id': '6d262555-486d-4215-8ce2-fe795fc07de7', 'id': '04ceabec-64df-4a2f-a8a3-886b498ef061'} Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 297, in get_by_volume_and_instance Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04ceabec-64df-4a2f-a8a3-886b498ef061. Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 is not attached to volume 04ceabec-64df-4a2f-a8a3-886b498ef061 Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:02:50.492959 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 is not attached to volume 04ceabec-64df-4a2f-a8a3-886b498ef061 Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Returning 404 to user: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 is not attached to volume 04ceabec-64df-4a2f-a8a3-886b498ef061 {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e5015cc-2112-4fda-99a0-b03a7dd89baf tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments/04ceabec-64df-4a2f-a8a3-886b498ef061" status: 404 len: 154 microversion: 2.1 time: 0.095410 Oct 06 14:02:50.498244 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3639/7262] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 14:02:50 2022] DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7/os-volume_attachments/04ceabec-64df-4a2f-a8a3-886b498ef061 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:02:53.854408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:53.854989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:53.862494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:53.862996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:53.863458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:53.864182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:53.864655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:53.865129 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:53.892156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:02:53.988146 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4a66589c-3578-4ce7-ae6a-56f766c99749 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 204 len: 0 microversion: 2.1 time: 0.137116 Oct 06 14:02:53.992396 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3624/7263] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:02:53 2022] DELETE /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:02:53.998193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:53.999461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:54.007774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:54.008261 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:54.008710 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:54.009421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:54.009907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:54.010582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:54.149860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:02:54.158566 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0ee41d7d-cbb4-4116-afe5-5ba0a868387d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1554 microversion: 2.1 time: 0.164284 Oct 06 14:02:54.159160 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3640/7264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:02:53 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:02:55.182603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:55.183340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:55.190898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:55.191407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:55.191868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:55.192596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:55.193072 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:55.193525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:55.391574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:02:55.400490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-831bc137-4b0c-4f94-846a-87f0bf1f8fe8 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1554 microversion: 2.1 time: 0.222195 Oct 06 14:02:55.401075 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3625/7265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:02:55 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:02:56.424080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:56.424695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:56.432040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:56.432532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:56.432972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:56.433685 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:56.434179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:56.434604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:56.571203 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:02:56.580464 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b50f6807-aa56-46ea-9be8-1bc725f29db6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 200 len: 1554 microversion: 2.1 time: 0.160223 Oct 06 14:02:56.581068 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3641/7266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:02:56 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:02:56.824847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d262555-486d-4215-8ce2-fe795fc07de7", "name": "network-vif-deleted", "tag": "db132efb-b80a-4f82-8140-8c302cb4d2c5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:02:56.838259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:56.838788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:56.839235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:56.851270 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] Creating event network-vif-deleted:db132efb-b80a-4f82-8140-8c302cb4d2c5 for instance 6d262555-486d-4215-8ce2-fe795fc07de7 on n-h2-860556-1 Oct 06 14:02:56.856346 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b2640359-edc6-4c22-bd9a-e284383e0ad8 req-028ebb68-56ae-40fc-8740-e95d8cccde41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112405 Oct 06 14:02:56.857196 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3626/7267] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:02:57.604641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:57.605295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 6d262555-486d-4215-8ce2-fe795fc07de7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:02:57.613379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:57.614580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:57.615038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:57.615753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:02:57.616216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:02:57.616653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:02:57.632900 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] HTTP exception thrown: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Request method failure captured: Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 HTTP/1.1 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPt7b1t77ugihqgtLNzxLoBqkcLAf_cqhsdrsv_6VsrnEpfKkxkh78JgfGIuxHzmQydIcmGrDrCTrLNo3_C5aygwiQm-XCUD-BD_bvH9_yBn8Difkfv6PUGelYBQmdORkM54EykUIQRlTOEL0Nv8beVXS8bGIfD2q76Czm51PENpEFH0 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03ee21a5c23448ec9f717de537fbd539", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}] Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 2fd477319826419a9d2e4cb37b95bd32 Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '6d262555-486d-4215-8ce2-fe795fc07de7'} Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:02:57.634539 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Returning 404 to user: Instance 6d262555-486d-4215-8ce2-fe795fc07de7 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-99ee8401-9a7c-482b-b5d6-9ce751e01802 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7" status: 404 len: 111 microversion: 2.1 time: 0.035234 Oct 06 14:02:57.639299 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3642/7268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:02:57 2022] GET /compute/v2.1/servers/6d262555-486d-4215-8ce2-fe795fc07de7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:02:57.645519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b0e9c634-509f-476d-9613-86a7976d811d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '.version_select at 0x7f7d3f2064c0>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:02:57.670018 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b0e9c634-509f-476d-9613-86a7976d811d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-628822270" status: 202 len: 0 microversion: 2.1 time: 0.028537 Oct 06 14:02:57.674584 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3627/7269] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 14:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-628822270 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:03:06.940094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-49f5c0a4-2362-4c7d-ac5f-2dcab0acd407 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: .version_select at 0x7f7d3f082d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-704457420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8+eAmL572ZjJSGzfR1mP3X0VY6LpzjzwrvbfgWDbsAE6NReT5V00oV7reprzMoioeGvPB2rfjmFi5YPVfw5QAZszLG4gfbCHQPvlwVaVG/aMdwmGH6HfFVBGg86LhWrg=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:06.961003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-49f5c0a4-2362-4c7d-ac5f-2dcab0acd407 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for project 03ee21a5c23448ec9f717de537fbd539. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:03:06.967289 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-49f5c0a4-2362-4c7d-ac5f-2dcab0acd407 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for user 2fd477319826419a9d2e4cb37b95bd32 and project 03ee21a5c23448ec9f717de537fbd539. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:03:06.999090 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-49f5c0a4-2362-4c7d-ac5f-2dcab0acd407 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063892 Oct 06 14:03:06.999702 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3643/7270] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:03:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:07.061756 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:07.066925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1045317446", "imageRef": "944b72fa-d21a-4534-a376-d18a778fe3f1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-704457420", "networks": [{"uuid": "87e14b7a-32f8-4d68-8e6c-2145045bd9a5"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:07.122884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] validate_networks() for [('87e14b7a-32f8-4d68-8e6c-2145045bd9a5', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:03:07.541577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:03:07.542042 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:03:07.542536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:03:07.542966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:03:07.543392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:03:07.552617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:07.553116 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:07.553561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:07.554333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:07.554805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:07.555246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:07.580764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for project 03ee21a5c23448ec9f717de537fbd539. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:03:07.580764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Getting quotas for user 2fd477319826419a9d2e4cb37b95bd32 and project 03ee21a5c23448ec9f717de537fbd539. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:03:07.590618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:03:07.592946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='944b72fa-d21a-4534-a376-d18a778fe3f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:03:07.640541 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2540856c-2776-4bcd-aebf-4ea718713a87 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580656 Oct 06 14:03:07.641213 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3628/7271] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:03:07.649606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:07.654044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-abe1c78a-f705-45fe-9b3e-368f269e350c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:07.654719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-abe1c78a-f705-45fe-9b3e-368f269e350c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:07.715590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-abe1c78a-f705-45fe-9b3e-368f269e350c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:07.723476 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-abe1c78a-f705-45fe-9b3e-368f269e350c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1258 microversion: 2.1 time: 0.074632 Oct 06 14:03:07.724249 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3644/7272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:07 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:08.747470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:08.748000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:08.755181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:08.755694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:08.756156 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:08.756883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:08.757365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:08.757851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:08.832799 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:08.843640 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b11e3668-484b-4fce-a788-b18265ff48ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1318 microversion: 2.1 time: 0.100973 Oct 06 14:03:08.845080 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3629/7273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:08 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:09.868094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:09.869520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:09.878877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:09.879661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:09.880272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:09.881361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:09.883445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:09.884080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:10.065554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:10.075579 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e26ee45-58b3-4b4f-8f4d-0f5adc911538 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.211613 Oct 06 14:03:10.076647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3645/7274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:09 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:10.429207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:10.452035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:10.452725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:10.453029 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:10.466586 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] Creating event network-changed:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:03:10.472629 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5fb1738f-3e15-43e8-b344-e869f6014f8f req-92321966-b748-4315-9415-57e40b4f29d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048222 Oct 06 14:03:10.473269 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3630/7275] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:11.102996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:11.103714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:11.111140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:11.111749 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:11.112531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:11.113521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:11.114081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:11.114855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:11.284683 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:11.294752 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ddb42960-07b2-4c84-84b1-9882f59603be tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.195645 Oct 06 14:03:11.295451 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3646/7276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:11 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:12.321780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:12.322979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:12.335044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:12.336087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:12.336845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:12.338043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:12.338757 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:12.339438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:12.502501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:12.511097 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e5fd26f2-5b39-44ad-945a-9424aa7af1af tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.195450 Oct 06 14:03:12.512346 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3631/7277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:12 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:03:13.537137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:13.538572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:13.541840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:13.548357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:13.548985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:13.549532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:13.550365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:13.550897 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:13.551397 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:13.713090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:13.722048 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8bb4652-1897-400f-93f0-7cf59ef15757 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.189969 Oct 06 14:03:13.722732 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3647/7278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:13 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:14.746709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:14.747444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:14.750420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:14.757027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:14.757590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:14.758086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:14.758822 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:14.759298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:14.759744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:14.931780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:14.940255 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c28cba1c-cac7-414d-bbdf-98bf3f10e9ca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.198839 Oct 06 14:03:14.941049 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3632/7279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:14 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:15.968197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:15.968976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:15.977769 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:15.978340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:15.978768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:15.979517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:15.979978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:15.980408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:16.132095 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:16.140902 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-21acb9f3-ce2c-4f7b-999d-c1afdc4bf0a5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.176758 Oct 06 14:03:16.141499 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3648/7280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:15 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:17.165095 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:17.165785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:17.172796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:17.173298 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:17.173786 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:17.174657 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:17.176987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:17.177529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:17.323447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:17.332118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf46781d-8916-4a97-8f3c-43a5f9f73bec tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.171335 Oct 06 14:03:17.332709 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3633/7281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:17 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:18.355623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:18.356241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:18.359035 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:18.364577 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:18.365060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:18.365496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:18.366210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:18.366663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:18.367087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:18.496515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:18.504605 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-34e73285-7509-45e8-a093-a899b7b21771 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.153433 Oct 06 14:03:18.505261 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3649/7282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:18 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:19.528309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:19.528943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:19.530849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:19.531519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:19.538954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:19.539460 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:19.539917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:19.540632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:19.541107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:19.541556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:19.668704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:19.676482 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcacfff5-1901-4ce5-bc04-56a8312998ff tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.152104 Oct 06 14:03:19.677058 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3634/7283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:19 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:20.699968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:20.700594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:20.707985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:20.708491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:20.708938 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:20.709674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:20.710141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:20.710609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:20.877867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:20.889254 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6412e7b4-fd52-411a-968e-144758fd2374 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.193414 Oct 06 14:03:20.889880 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3650/7284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:20 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:21.911570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:21.912242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:21.919219 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:21.919718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:21.920174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:21.920875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:21.921344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:21.921819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:22.051461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:22.059408 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1305f63b-54c7-4cc9-a777-fb5e759e940e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.151699 Oct 06 14:03:22.060149 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3635/7285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:21 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:23.083627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:23.084200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:23.091124 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:23.091641 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:23.092083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:23.092772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:23.093225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:23.093651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:23.227920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:23.235469 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1fef07a8-0f2b-4066-86d9-475c36db4cc9 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.156359 Oct 06 14:03:23.236055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3651/7286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:23 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:24.259137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:24.259793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:24.266687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:24.267193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:24.267650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:24.268907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:24.269382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:24.269869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:24.405658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:24.413330 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a8b37e0a-18be-420e-ae71-ec22603abf47 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.158145 Oct 06 14:03:24.413934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3636/7287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:24 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:25.436177 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:25.436908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:25.444274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:25.444757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:25.445187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:25.445925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:25.446378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:25.446798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:25.583139 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:25.591129 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4f5ce000-5487-46a7-89fd-34dae2591052 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.158881 Oct 06 14:03:25.591704 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3652/7288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:25 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:26.614426 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:26.615043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:26.621892 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:26.622389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:26.622842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:26.623545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:26.624013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:26.624452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:26.757096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:26.764811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d1074e38-a941-42f2-b34b-b18c6df8cd8c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.154750 Oct 06 14:03:26.765394 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3637/7289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:26 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:27.787780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:27.788517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:27.795483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:27.796018 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:27.796554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:27.797377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:27.797907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:27.798357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:27.935905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:27.944725 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1337e10-8c03-4249-bd99-b8caea4a28a6 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.160989 Oct 06 14:03:27.945566 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3653/7290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:27 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:27.977229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "name": "network-vif-plugged", "status": "completed", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:27.987523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:27.988030 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:27.988489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:27.999478 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] Creating event network-vif-plugged:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:03:28.005391 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-6c010995-adb4-4233-b77f-30ef8a1ed858 req-d275969d-3964-4f25-9765-c27689a8e0a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095040 Oct 06 14:03:28.006049 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3638/7291] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:28.968916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:28.969554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:28.977271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:28.977906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:28.978290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:28.978990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:28.979527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:28.979964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:29.126937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:29.134724 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-679a02b8-b583-4fc3-b1cc-46d9e9831f4e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1358 microversion: 2.1 time: 0.169705 Oct 06 14:03:29.135298 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3654/7292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:28 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:30.158077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:30.158797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:30.165089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.165589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.166075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.166776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.167247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.167692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.298441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:30.306768 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a0d8a58-e2a7-4456-a37e-01fa5ab235fd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1548 microversion: 2.1 time: 0.154058 Oct 06 14:03:30.307354 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3639/7293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:30 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:30.330028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:30.330726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:30.337625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.338162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.338608 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.339316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.339779 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.340213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.482272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:30.491461 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5bdfda8c-5566-42a5-a682-90719780323b tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1548 microversion: 2.1 time: 0.165602 Oct 06 14:03:30.492051 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3655/7294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:30 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:30.513149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:30.518084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:30.518862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Searching by: {'deleted': False, 'project_id': '03ee21a5c23448ec9f717de537fbd539'} {{(pid=129614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 14:03:30.524105 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.524598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.525045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.525804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.526270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.526710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.551274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.multi_cell_list [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 14:03:30.587931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aa3e57b6-14e9-4afa-a96b-c2c31ffd491e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.078634 Oct 06 14:03:30.588526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3640/7295] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Oct 6 14:03:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:30.600518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:30.601276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:30.608659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.609153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.609599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.610340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:30.610828 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:30.611262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:30.743633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:30.751482 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1e2134ed-b90a-4a3e-9114-d3285de22463 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1548 microversion: 2.1 time: 0.155368 Oct 06 14:03:30.752064 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3656/7296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:30 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:32.284459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21634e41-1f3a-45eb-84a3-b76d9517c567"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:32.286883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:32.293867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:32.294377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:32.294840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:32.295561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:32.296041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:32.296492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:32.559659 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b3955ec3-0fbb-4a3f-a0dd-d3301cdf94d2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278854 Oct 06 14:03:32.560408 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3641/7297] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Oct 6 14:03:32 2022] POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:43.353471 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:43.354193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:43.357034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=19 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:43.357705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=72 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:43.363294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:43.363780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:43.364224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:43.364925 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:43.365380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:43.365835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:43.497283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:43.506284 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4349a2ab-9392-4e1b-bcf2-ce711fdd2539 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1594 microversion: 2.1 time: 0.156667 Oct 06 14:03:43.506862 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3657/7298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:43 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:03:45.560162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:45.560968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=19 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:45.561811 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:03:45.652539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:45.664603 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:45.665247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:45.665705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:45.678462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] Creating event network-changed:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:03:45.683667 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-988b7f9b-bf34-4aeb-aebf-ee9e384dacc9 req-64dc6d9e-8b47-4e13-a080-bd31971d5565 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135460 Oct 06 14:03:45.684276 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3642/7299] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:03:46.679216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-930367363"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:46.679753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:46.686855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:46.687272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:46.687753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:46.689088 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:46.689591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:46.690048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:46.825643 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.network.security_group_api [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Adding security group 139eaa21-eb6b-421f-8bca-6a9d96912f07 to port ba817eba-09c8-483f-91ac-097bddb3deec Oct 06 14:03:47.154917 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe137e8c-2ea6-4694-9428-5550037a7fca tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action" status: 202 len: 0 microversion: 2.1 time: 0.479543 Oct 06 14:03:47.155908 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3658/7300] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:03:46 2022] POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:03:47.167382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:03:47.168123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:03:47.174961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:47.175442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:47.175898 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:47.176626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:47.177343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:47.177529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:47.349291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:03:47.359462 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-77e5d36a-f633-45f5-9caa-5f5c9d137cd2 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1759 microversion: 2.1 time: 0.197254 Oct 06 14:03:47.360186 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3643/7301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:03:47 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:03:47.701678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:03:47.712424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:03:47.712906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:03:47.713343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:03:47.725367 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] Creating event network-changed:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:03:47.731199 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-6d4fb1c2-b5aa-4cd0-b0fd-60e531e8efdc req-55b0bdcb-94d8-4ec5-a054-fc7ad724c5bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Oct 06 14:03:47.731818 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3659/7302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:04:35.512954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:04:35.515319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:35.517943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:04:35.518605 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:04:35.525919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:35.526416 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:35.526868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:35.527583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:35.528056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:35.528495 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:35.604821 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3ae6cbb4-6443-4578-9e65-8b35d7dd6df3 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action" status: 202 len: 0 microversion: 2.1 time: 0.095573 Oct 06 14:04:35.605708 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3644/7303] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:04:35 2022] POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:04:35.612258 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:04:35.613099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:04:35.614499 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:04:35.614784 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 (ip 10.222.0.26) !!! Oct 06 14:04:35.619386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:35.620104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:35.633812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:35.634311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:35.634760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:35.635478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:35.635943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:35.636377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:35.794521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:35.803019 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8425e0bc-2306-4c9c-88d1-377181ad0322 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1751 microversion: 2.1 time: 0.192767 Oct 06 14:04:35.803623 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3660/7304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:35 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:36.828613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:36.829338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:36.836184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:36.836685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:36.837145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:36.837884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:36.838361 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:36.838821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:36.986301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:36.994628 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1ff903e6-73c3-4f33-98cb-ae8e4c11548e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.171520 Oct 06 14:04:36.995209 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3645/7305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:36 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:38.023459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:38.024115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:38.031833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:38.032318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:38.032756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:38.033496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:38.034061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:38.034459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:38.188255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:38.196637 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-536a1dc5-14c8-42a2-943b-5f48855dbda4 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.177122 Oct 06 14:04:38.197272 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3661/7306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:38 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:39.220790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:39.221417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:39.228380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:39.228880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:39.229339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:39.230079 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:39.230664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:39.231122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:39.378068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:39.386914 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7d40a2a9-c84b-499e-943e-fa0dfe6dae92 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.170019 Oct 06 14:04:39.387537 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3646/7307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:39 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:40.410848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:40.411441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:40.418510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:40.418984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:40.419420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:40.420132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:40.420598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:40.421021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:40.574119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:40.583159 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d9c183ad-4c29-4115-85a2-2881db5e4ba5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.176256 Oct 06 14:04:40.583754 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3662/7308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:40 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:41.606789 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:41.607425 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:41.614973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:41.615477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:41.615923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:41.616628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:41.617096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:41.617535 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:41.771784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:41.781802 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-79ab7dbb-1f45-4289-b3d0-41ffcaf36218 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.178823 Oct 06 14:04:41.782398 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3647/7309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:41 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:42.805750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:42.806394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:42.814089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:42.814620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:42.815357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:42.815894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:42.816236 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:42.816654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:42.971750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:42.980317 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4d3ebef-35a5-4b09-89de-05b0d1f93415 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.179160 Oct 06 14:04:42.980906 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3663/7310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:42 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:44.006111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:44.006763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:44.014037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:44.014557 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:44.015008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:44.015800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:44.016270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:44.016711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:44.170202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:44.179957 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd652e06-447f-4314-90da-70c506412135 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.179291 Oct 06 14:04:44.180776 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3648/7311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:43 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:45.207385 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:45.208142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:45.215276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:45.215763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:45.216201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:45.216909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:45.217366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:45.217832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:45.362198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:45.371201 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-16d28fe0-b504-46d2-bc14-abd321fe1350 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.167754 Oct 06 14:04:45.371783 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3664/7312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:45 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:46.404009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:46.404750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:46.412499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:46.413124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:46.413590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:46.414349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:46.414825 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:46.415273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:46.569464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:46.577982 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a80b6f70-21b0-440f-8f50-606bf5156cfd tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1756 microversion: 2.1 time: 0.186069 Oct 06 14:04:46.578560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3649/7313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:46 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:04:47.603546 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:04:47.604162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:04:47.611127 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:47.611607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:47.612044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:47.612729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:04:47.613181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:04:47.613607 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:04:47.758706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:04:47.767117 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-389941c7-3743-48c6-89ee-efc0e4d6209a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1759 microversion: 2.1 time: 0.167526 Oct 06 14:04:47.767703 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3665/7314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:04:47 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:05:51.145808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:05:51.146584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:05:51.151420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-930367363"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:05:51.151993 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:51.159413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:51.159942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:51.160386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:51.161103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:51.161574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:51.162049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:51.294652 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.network.security_group_api [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Removing security group 139eaa21-eb6b-421f-8bca-6a9d96912f07 from port ba817eba-09c8-483f-91ac-097bddb3deec Oct 06 14:05:51.631321 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-44ca59e0-1a17-40f9-917e-5dec18cd21ad tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action" status: 202 len: 0 microversion: 2.1 time: 0.487435 Oct 06 14:05:51.632036 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3650/7315] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:05:51 2022] POST /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:05:51.638784 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:05:51.639881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:05:51.644123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:05:51.655512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:51.656036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:51.656520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:51.674300 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] Creating event network-changed:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:05:51.679549 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4feb3202-4a88-4ab3-a66d-87135bd9eb91 req-95ed7c65-f646-46d1-a2d2-1cbf89805c12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042508 Oct 06 14:05:51.681342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3666/7316] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:52.883919 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:52.884521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:52.890594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:52.891089 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:52.891580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:52.899865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:52.900712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:52.901181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:52.984329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lazy-loading 'services' on Instance uuid 85274aab-3b06-464f-91bd-acbf13536f61 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:05:53.058038 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-435e88c3-c708-4443-b70c-6fcc9e3f8b18 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments/21634e41-1f3a-45eb-84a3-b76d9517c567" status: 202 len: 0 microversion: 2.1 time: 0.178986 Oct 06 14:05:53.058648 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3651/7317] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 14:05:52 2022] DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments/21634e41-1f3a-45eb-84a3-b76d9517c567 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:05:53.074879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:53.077284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:53.084371 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:53.084990 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:53.085438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:53.086180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:53.086638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:53.087099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:53.119973 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10f4bbb4-3385-43ce-9a0a-786c11eb8413 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056464 Oct 06 14:05:53.120557 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3667/7318] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:53 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:05:53.700235 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:05:53.710679 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:53.711343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:53.712926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:53.725801 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] Creating event network-changed:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:05:53.731487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c63f7dca-fcd8-463d-b6a5-5859eab995e5 req-599ccedf-fc0e-48a7-8536-4096456c7c4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035878 Oct 06 14:05:53.732111 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3652/7319] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:54.133100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:54.136153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:54.143233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:54.143883 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:54.144523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:54.145461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:54.145954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:54.146394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:54.181179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00a72414-a3b6-45ea-b4c5-3fd34c06090e tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051670 Oct 06 14:05:54.185340 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3668/7320] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:54 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:55.195180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:55.197551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:55.204160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:55.204628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:55.205081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:55.205815 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:55.206390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:55.207060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:55.243017 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4b701cd8-6011-47fa-9cc9-4019df511fae tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052954 Oct 06 14:05:55.243628 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3653/7321] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:55 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:56.255928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:56.258460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:56.265711 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:56.266228 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:56.266666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:56.267365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:56.267817 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:56.268273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:56.299101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cf2ffd6a-8eb9-415b-b81c-37149436514a tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047144 Oct 06 14:05:56.299668 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3669/7322] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:56 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:57.312393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:57.314566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:57.322347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:57.322854 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:57.323317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:57.324045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:57.324519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:57.324968 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:57.355086 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3a58de40-55d6-477d-b691-bebd7ef5e099 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046803 Oct 06 14:05:57.355666 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3654/7323] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:57 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:05:58.367742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:58.370598 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:58.376874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:58.377390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:58.377901 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:58.378563 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:58.379016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:58.379444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:58.408975 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-617dbb12-e6f7-490f-a417-f76cca4fe946 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045188 Oct 06 14:05:58.409556 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3670/7324] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Oct 6 14:05:58 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 14:05:58.421350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:05:58.421927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:05:58.428869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:58.429372 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:58.429893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:58.431196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:05:58.431681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:05:58.432131 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:05:58.508432 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] HTTP exception thrown: Instance 85274aab-3b06-464f-91bd-acbf13536f61 is not attached to volume 21634e41-1f3a-45eb-84a3-b76d9517c567 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Request method failure captured: Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: request: DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments/21634e41-1f3a-45eb-84a3-b76d9517c567 HTTP/1.1 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt7b1t77ugihqgtLNzxLoBqkcLAf_cqhsdrsv_6VsrnEpfKkxkh78JgfGIuxHzmQydIcmGrDrCTrLNo3_C5aygwiQm-XCUD-BD_bvH9_yBn8Difkfv6PUGelYBQmdORkM54EykUIQRlTOEL0Nv8beVXS8bGIfD2q76Czm51PENpEFH0 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03ee21a5c23448ec9f717de537fbd539", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}] Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2fd477319826419a9d2e4cb37b95bd32 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 85274aab-3b06-464f-91bd-acbf13536f61 is not attached to volume 21634e41-1f3a-45eb-84a3-b76d9517c567 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'server_id': '85274aab-3b06-464f-91bd-acbf13536f61', 'id': '21634e41-1f3a-45eb-84a3-b76d9517c567'} Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 297, in get_by_volume_and_instance Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 21634e41-1f3a-45eb-84a3-b76d9517c567. Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85274aab-3b06-464f-91bd-acbf13536f61 is not attached to volume 21634e41-1f3a-45eb-84a3-b76d9517c567 Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:05:58.510088 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85274aab-3b06-464f-91bd-acbf13536f61 is not attached to volume 21634e41-1f3a-45eb-84a3-b76d9517c567 Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Returning 404 to user: Instance 85274aab-3b06-464f-91bd-acbf13536f61 is not attached to volume 21634e41-1f3a-45eb-84a3-b76d9517c567 {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6729390c-8f58-44c9-b43f-5ab40143dc52 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments/21634e41-1f3a-45eb-84a3-b76d9517c567" status: 404 len: 154 microversion: 2.1 time: 0.094210 Oct 06 14:05:58.514402 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3655/7325] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Oct 6 14:05:58 2022] DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61/os-volume_attachments/21634e41-1f3a-45eb-84a3-b76d9517c567 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:06:01.777093 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:01.777604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:01.784574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:01.785068 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:01.785513 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:01.786242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:01.786702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:01.787131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:01.813592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:06:01.888757 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5deb347-5332-4966-9936-7095284679fc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 204 len: 0 microversion: 2.1 time: 0.115727 Oct 06 14:06:01.889362 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3671/7326] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:06:01 2022] DELETE /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:06:01.898498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:01.899140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:01.906166 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:01.906678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:01.907135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:01.907956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:01.908447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:01.908894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:02.054090 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:02.062293 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-88af180c-14ab-417f-be32-400701f51a9c tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1554 microversion: 2.1 time: 0.168111 Oct 06 14:06:02.062881 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3656/7327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:01 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:03.087028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:03.087642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:03.095487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:03.096640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:03.096640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:03.097285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:03.097635 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:03.098085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:03.231145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:03.238883 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-84b1228e-e595-4fa8-bf52-dfa7cc9e15cc tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1554 microversion: 2.1 time: 0.156168 Oct 06 14:06:03.239468 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3672/7328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:03 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:04.263645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:04.264303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:04.271265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:04.271762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:04.272222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:04.272935 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:04.273401 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:04.273869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:04.347759 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd477319826419a9d2e4cb37b95bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ee21a5c23448ec9f717de537fbd539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:04.357538 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0b6e5a4-f048-4f2a-8d9c-4adb077e99c5 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 200 len: 1512 microversion: 2.1 time: 0.098812 Oct 06 14:06:04.359951 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3657/7329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:04 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:04.391590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85274aab-3b06-464f-91bd-acbf13536f61", "name": "network-vif-deleted", "tag": "ba817eba-09c8-483f-91ac-097bddb3deec"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:04.404248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:04.404720 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:04.405149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:04.418676 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] Creating event network-vif-deleted:ba817eba-09c8-483f-91ac-097bddb3deec for instance 85274aab-3b06-464f-91bd-acbf13536f61 on n-h2-860556-1 Oct 06 14:06:04.424804 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-97cd7a97-6a13-4f36-8d18-3820d3b1e98c req-ce5e9fc2-0f91-40ca-a9d8-47817c925ee0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036887 Oct 06 14:06:04.425428 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3673/7330] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:06:05.383518 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:05.384173 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [instance: 85274aab-3b06-464f-91bd-acbf13536f61] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:05.391299 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:05.391809 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:05.392265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:05.392976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:05.393461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:05.393921 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:05.408027 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] HTTP exception thrown: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Request method failure captured: Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 HTTP/1.1 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPt7b1t77ugihqgtLNzxLoBqkcLAf_cqhsdrsv_6VsrnEpfKkxkh78JgfGIuxHzmQydIcmGrDrCTrLNo3_C5aygwiQm-XCUD-BD_bvH9_yBn8Difkfv6PUGelYBQmdORkM54EykUIQRlTOEL0Nv8beVXS8bGIfD2q76Czm51PENpEFH0 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03ee21a5c23448ec9f717de537fbd539", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03ee21a5c23448ec9f717de537fbd539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03ee21a5c23448ec9f717de537fbd539"}]}] Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 03ee21a5c23448ec9f717de537fbd539 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestMinimumBasicScenario-420685744 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 2fd477319826419a9d2e4cb37b95bd32 Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestMinimumBasicScenario-420685744-project Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '85274aab-3b06-464f-91bd-acbf13536f61'} Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:06:05.409576 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Returning 404 to user: Instance 85274aab-3b06-464f-91bd-acbf13536f61 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2a40f54d-a8d0-41fb-b927-498954213991 tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61" status: 404 len: 111 microversion: 2.1 time: 0.031484 Oct 06 14:06:05.414128 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3658/7331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:05 2022] GET /compute/v2.1/servers/85274aab-3b06-464f-91bd-acbf13536f61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:06:05.421675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b282692b-0a55-4d3c-90d9-bcf0158d120d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] Calling method '.version_select at 0x7f7d3df80f70>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:05.426306 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b282692b-0a55-4d3c-90d9-bcf0158d120d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [c3929226-24b4-48bb-a426-f89436fcc398] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:06:06.435018 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-b282692b-0a55-4d3c-90d9-bcf0158d120d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] [c3929226-24b4-48bb-a426-f89436fcc398] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48918. Oct 06 14:06:06.457886 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b282692b-0a55-4d3c-90d9-bcf0158d120d tempest-TestMinimumBasicScenario-420685744 tempest-TestMinimumBasicScenario-420685744-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-704457420" status: 202 len: 0 microversion: 2.1 time: 1.041082 Oct 06 14:06:06.458713 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3674/7332] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Oct 6 14:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-704457420 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:06:15.517620 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=18 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:15.518410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:15.522035 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:06:15.522189 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Oct 06 14:06:15.523174 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:06:15.523525 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Oct 06 14:06:15.688517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-291baace-716b-42c0-83ff-5233ce79c89a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: .version_select at 0x7f7d3dd05ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1785604980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDxAuRcrTvLigmd+/xBCNjDMOY8Ue5M9ZgfCgKsquzleebMSRQYroS6bLXA/1UDjW65hQFxtbOQsju48l1d3wzTeKFc15F1Kr8Jzw31PXN5MOdn8+enzooioS2EAbMCHw=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:15.705161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-291baace-716b-42c0-83ff-5233ce79c89a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:06:15.710580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-291baace-716b-42c0-83ff-5233ce79c89a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:06:15.739231 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-291baace-716b-42c0-83ff-5233ce79c89a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.227494 Oct 06 14:06:15.739847 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3659/7333] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:06:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:06:21.634699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:21.636746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:21.641375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-780445720", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "2dac4080-7452-40a8-b45c-eaf7b470b065"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1785604980", "security_groups": [{"name": "tempest-secgroup-smoke-1907201826"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:21.780811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] validate_networks() for [('2dac4080-7452-40a8-b45c-eaf7b470b065', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:06:22.362781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:06:22.364028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:06:22.364744 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:06:22.365368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:06:22.366061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:06:22.378507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:22.379072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:22.379747 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:22.380695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:22.381243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:22.385436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:22.422727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:06:22.429274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:06:22.444879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:06:22.448186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:06:22.501007 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15930d6d-0504-4bbf-95d7-01dc8ce96843 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.868626 Oct 06 14:06:22.502510 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3675/7334] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:06:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:06:22.515602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81ba7571-bd3d-44e0-8502-db7708360266 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:22.516860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81ba7571-bd3d-44e0-8502-db7708360266 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:22.592200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81ba7571-bd3d-44e0-8502-db7708360266 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:22.600022 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81ba7571-bd3d-44e0-8502-db7708360266 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1266 microversion: 2.1 time: 0.089767 Oct 06 14:06:22.601432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3660/7335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:22 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:23.632079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:23.632713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:23.648552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:23.649050 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:23.649523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:23.650263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:23.650725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:23.651155 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:23.720866 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:23.730022 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-502a54e9-9ee3-4a93-8260-4662475bb452 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1318 microversion: 2.1 time: 0.108095 Oct 06 14:06:23.745212 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3676/7336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:23 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:24.753877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:24.754504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:24.763374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:24.765022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:24.765632 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:24.766389 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:24.766969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:24.767418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:24.920818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:24.928623 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5a1a8ac4-d24a-4a1e-8e14-907a5af845b5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.178862 Oct 06 14:06:24.929209 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3661/7337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:24 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:25.658216 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576808d6-8946-40d3-92fd-e92b353335d1", "tag": "9fd55fb9-76aa-45d5-9ff3-60002acaeaaa"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:25.669961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:25.670461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:25.670892 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:25.698844 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] Creating event network-changed:9fd55fb9-76aa-45d5-9ff3-60002acaeaaa for instance 576808d6-8946-40d3-92fd-e92b353335d1 on n-h2-860556-1 Oct 06 14:06:25.704743 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c94aa27f-d54d-4ba1-9f2f-99a1757f429c req-76f7094e-0936-4b0f-af01-cdfb7d1c0d2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051138 Oct 06 14:06:25.705470 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3677/7338] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:06:25.952268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:25.952816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:25.960011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:25.960520 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:25.960991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:25.962287 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:25.962773 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:25.963224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:26.111939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:26.119924 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b5cdf6a2-3b59-4a19-bdb1-7cfd12d95d9f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.171633 Oct 06 14:06:26.120589 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3662/7339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:25 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:06:27.146973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:27.147719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:27.154842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:27.155333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:27.155778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:27.156479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:27.156937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:27.157363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:27.296085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:27.303722 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-60d3c1ae-a619-48cb-b2d3-05b7f299911c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.162880 Oct 06 14:06:27.304299 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3678/7340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:27 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:28.327528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:28.328296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:28.335562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:28.336075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:28.336541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:28.337883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:28.338396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:28.339138 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:28.473890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:28.482156 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4f7a5bc8-0013-4682-b997-a3bd42540171 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.158494 Oct 06 14:06:28.482904 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3663/7341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:28 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:29.504967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:29.505541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:29.511571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:29.512056 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:29.512488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:29.513175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:29.513624 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:29.514090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:29.643252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:29.651355 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7acb74a7-4b4c-4b00-9f6b-4a5c26e6ca59 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.150837 Oct 06 14:06:29.652254 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3679/7342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:29 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:30.676976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:30.677611 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:30.683529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:30.684040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:30.684494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:30.685497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:30.685996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:30.686439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:30.831742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:30.840748 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d7f04262-a25a-402b-8fb9-8e779477e137 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.168192 Oct 06 14:06:30.841336 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3664/7343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:30 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:31.863924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:31.864534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:31.871375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:31.871854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:31.872288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:31.872973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:31.873423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:31.873872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:32.004327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:32.012942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fdfad728-68bb-4cc3-87b3-283244671cf1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.152836 Oct 06 14:06:32.013521 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3680/7344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:31 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:06:32.693171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576808d6-8946-40d3-92fd-e92b353335d1", "name": "network-vif-plugged", "status": "completed", "tag": "9fd55fb9-76aa-45d5-9ff3-60002acaeaaa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:32.700925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:32.706354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:32.706855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:32.707331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:32.719072 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] Creating event network-vif-plugged:9fd55fb9-76aa-45d5-9ff3-60002acaeaaa for instance 576808d6-8946-40d3-92fd-e92b353335d1 on n-h2-860556-1 Oct 06 14:06:32.724444 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7f3d158e-d126-44ad-b81e-a6bb9cb0f16c req-26fc2251-ca72-4001-ac9a-0bb0d53ac219 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034790 Oct 06 14:06:32.725231 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3665/7345] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:06:33.035678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:33.036326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:33.038287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:33.038948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:06:33.045449 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:33.045956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:33.046393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:33.047090 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:33.047545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:33.047969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:33.182932 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:33.191093 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-81623d0a-7bb2-48fd-9c4d-8433dcbac018 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.159306 Oct 06 14:06:33.191672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3681/7346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:33 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:34.216555 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:34.217269 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:34.223600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:34.224108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:34.224559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:34.225270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:34.225762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:34.226197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:34.367699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:34.376404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be7dfc8a-bfc7-4585-be6f-6741aa89ba5b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1392 microversion: 2.1 time: 0.165441 Oct 06 14:06:34.376998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3666/7347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:34 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:35.400944 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:35.401561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:35.408976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:35.409467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:35.409948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:35.410666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:35.411130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:35.411594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:35.545533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:35.554873 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b941fd27-522f-4eff-8e89-57ce95f18e54 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1565 microversion: 2.1 time: 0.158458 Oct 06 14:06:35.555997 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3682/7348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:35 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:35.578130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:35.579021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:35.585996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:35.587810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:35.587810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:35.587810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:35.588195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:35.588653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:35.728429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:35.736138 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a67961f0-72a6-4342-8b47-3946042365f4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1565 microversion: 2.1 time: 0.162009 Oct 06 14:06:35.736717 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3667/7349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:35 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:06:37.324119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:06:37.326254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576808d6-8946-40d3-92fd-e92b353335d1", "tag": "9fd55fb9-76aa-45d5-9ff3-60002acaeaaa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:06:37.328059 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:06:37.335524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:37.336045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:37.336496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:37.337210 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:37.337724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:37.338746 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:37.341375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:06:37.341907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:06:37.342370 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:06:37.354032 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] Creating event network-changed:9fd55fb9-76aa-45d5-9ff3-60002acaeaaa for instance 576808d6-8946-40d3-92fd-e92b353335d1 on n-h2-860556-1 Oct 06 14:06:37.359702 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cf75b28f-b505-4377-8559-6e6a69eda213 req-d5e3cc57-2863-4749-a17b-495e495d7131 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041249 Oct 06 14:06:37.360646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3668/7350] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:06:37.500820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:06:37.509135 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3784c973-4d50-4579-b163-c6798e638bc9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1565 microversion: 2.1 time: 0.193102 Oct 06 14:06:37.509836 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3683/7351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:06:37 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:10.811132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:10.812379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=40 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:10.816408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:10.818728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:10.826751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:10.827239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:10.827728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:10.828444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:10.829179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:10.829625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:10.896854 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09edad23-22fe-4680-b2a2-4fbf5420d82d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action" status: 200 len: 24567 microversion: 2.1 time: 0.087716 Oct 06 14:07:10.897853 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3669/7352] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:07:10 2022] POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action => generated 24567 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:07:41.341934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:41.342688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=46 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:41.346770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:41.347340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:41.354976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:41.355472 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:41.355927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:41.356640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:41.357112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:41.357550 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:41.427565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-722d861a-0098-4830-9c93-9161c22e82a6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action" status: 202 len: 0 microversion: 2.1 time: 0.087137 Oct 06 14:07:41.431353 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3684/7353] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:07:41 2022] POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:07:41.438234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:41.439111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:41.441645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:41.442335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:07:41.452147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:41.452653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:41.453104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:41.453847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:41.454583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:41.455794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:41.595002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:41.603363 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3d05b131-822f-4888-9d58-ddca5a924722 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1688 microversion: 2.1 time: 0.169842 Oct 06 14:07:41.604422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3670/7354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:41 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:42.630456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:42.631163 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:42.639462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:42.639951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:42.640489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:42.641212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:42.641668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:42.642644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:42.783813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:42.791815 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a62b21f1-e6f2-4d06-a627-65d98dcd238b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1668 microversion: 2.1 time: 0.165609 Oct 06 14:07:42.792396 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3685/7355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:42 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:43.887628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:43.890121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:43.898358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:43.898871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:43.899960 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:43.900676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:43.901147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:43.901590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:43.970041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-54bad571-bef0-4668-8c4a-20a577567801 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action" status: 200 len: 32644 microversion: 2.1 time: 0.086475 Oct 06 14:07:43.970936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3671/7356] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:07:43 2022] POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action => generated 32644 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:07:43.982286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:43.982856 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:43.989714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:43.990238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:43.990686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:43.991390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:43.991848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:43.992275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:44.063829 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4a181d4f-d528-4985-905d-9575313705aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action" status: 202 len: 0 microversion: 2.1 time: 0.084022 Oct 06 14:07:44.064664 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3686/7357] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:07:43 2022] POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:07:44.074571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:44.075300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:44.082614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:44.083143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:44.083714 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:44.084329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:44.084805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:44.085313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:44.240859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:44.249725 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf54f2a1-81db-4c9c-ba68-0f757595bde6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1675 microversion: 2.1 time: 0.180131 Oct 06 14:07:44.250337 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3672/7358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:44 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:45.275899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:45.276612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:45.283036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:45.283521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:45.283952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:45.284661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:45.285118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:45.285541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:45.533547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:45.541307 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-26c1b16e-1281-467a-be59-2d2eaa35ef15 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1683 microversion: 2.1 time: 0.271453 Oct 06 14:07:45.541909 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3687/7359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:45 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:45.637869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:45.640906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:45.655530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:45.656104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:45.656560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:45.657272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:45.657758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:45.658204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:45.721493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cfae95e4-cace-456f-b2b9-80745db67029 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action" status: 200 len: 38307 microversion: 2.1 time: 0.087977 Oct 06 14:07:45.722185 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3673/7360] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:07:45 2022] POST /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1/action => generated 38307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:07:46.740543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:46.741034 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:46.742709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576808d6-8946-40d3-92fd-e92b353335d1", "tag": "9fd55fb9-76aa-45d5-9ff3-60002acaeaaa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:46.748442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:46.749007 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:46.749517 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:46.750314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:46.750832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:46.751528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:46.754276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:46.754763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:46.755398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:46.768489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] Creating event network-changed:9fd55fb9-76aa-45d5-9ff3-60002acaeaaa for instance 576808d6-8946-40d3-92fd-e92b353335d1 on n-h2-860556-1 Oct 06 14:07:46.773561 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-308a0b2b-3913-42ad-a596-458c051e4d57 req-c7991ca2-8310-4583-9cec-789c06f062c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 Oct 06 14:07:46.775872 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3674/7361] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:07:46.792044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:07:46.887619 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3ffc5671-6f05-4188-9997-062cda6976e2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 204 len: 0 microversion: 2.1 time: 0.150685 Oct 06 14:07:46.891857 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3688/7362] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:07:46 2022] DELETE /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:07:46.902631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:46.904760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:46.923873 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:46.924839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:46.925675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:46.926845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:46.927559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:46.928247 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:47.076865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:47.085598 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-457a543e-d80d-45f1-abda-21262c2f71de tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1689 microversion: 2.1 time: 0.191450 Oct 06 14:07:47.086233 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3675/7363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:46 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:48.111239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:48.111939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:48.118958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:48.119451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:48.119895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:48.120589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:48.121051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:48.121473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:48.273929 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:48.282103 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-79309027-5184-46f4-a0c0-7f1db43b8022 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1689 microversion: 2.1 time: 0.174983 Oct 06 14:07:48.282699 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3689/7364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:48 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:49.267158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576808d6-8946-40d3-92fd-e92b353335d1", "name": "network-vif-deleted", "tag": "9fd55fb9-76aa-45d5-9ff3-60002acaeaaa"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:49.278122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:49.278625 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:49.279077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:49.291082 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] Creating event network-vif-deleted:9fd55fb9-76aa-45d5-9ff3-60002acaeaaa for instance 576808d6-8946-40d3-92fd-e92b353335d1 on n-h2-860556-1 Oct 06 14:07:49.296095 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-0e5bb262-d4c2-47db-8a32-4072d2a6c3a3 req-04f1cb07-79ae-418d-8f66-93009af9e8c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Oct 06 14:07:49.297044 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3676/7365] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:07:49.306767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:49.307404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:49.314804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:49.315274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:49.315714 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:49.316393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:49.316842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:49.317263 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:49.386178 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:07:49.394184 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a9b61f7-e73e-4ab6-a8a6-eb75c6b01ce2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 200 len: 1351 microversion: 2.1 time: 0.093323 Oct 06 14:07:49.395100 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3690/7366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:49 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:07:50.418908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:50.419884 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 576808d6-8946-40d3-92fd-e92b353335d1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:07:50.426332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:50.426835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:50.427312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:50.428036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:07:50.428514 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:07:50.428963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:07:50.443249 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] HTTP exception thrown: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Request method failure captured: Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 HTTP/1.1 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPuDWL-UWhYMcmWgs3jzXMCxNi8alhxBbN1wmuqzbPlP5iKXocAdygFiumlRCkutGYvUiFzIWFeffXG8naPXDXC5CWrev7h9jWumPyE4FBNMlqsTiAz-jzZdJmbDMuR3gZiMmrQLTdf0s6kZsjVKdeYj_pEXNlmdUJdOL0F6Gntwmwf8 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fc9f3196546446f99cad542e4b67ebb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}] Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f599cb7064df49f59cb1459e1262830a Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '576808d6-8946-40d3-92fd-e92b353335d1'} Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:07:50.444924 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Returning 404 to user: Instance 576808d6-8946-40d3-92fd-e92b353335d1 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3391f23b-4363-4f41-afc2-7d1b7a58f400 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1" status: 404 len: 111 microversion: 2.1 time: 0.033535 Oct 06 14:07:50.449933 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3677/7367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:07:50 2022] GET /compute/v2.1/servers/576808d6-8946-40d3-92fd-e92b353335d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:07:53.880691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3e7ee23-8db9-4fe2-875a-0f772d11cc58 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '.version_select at 0x7f7d3dfc6d30>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:07:53.903839 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3e7ee23-8db9-4fe2-875a-0f772d11cc58 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1785604980" status: 202 len: 0 microversion: 2.1 time: 0.027267 Oct 06 14:07:53.904450 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3691/7368] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Oct 6 14:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1785604980 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 14:07:53.935004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a0aa74f-78ba-44c6-a817-d6757302b6d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: .version_select at 0x7f7d3e2e70d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1439677568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4ktUONsvedTs/w9uhIvY2Ss/W9p/vxqc9wLpQkqGZJU4RD+SM3sC0WVsotOJ847MpxUg9WlO6BCWMNyYOrJ3Xx8yvSgH9ix6IU9WIZaHiSPKepO+iAglLz3ZflhBrO7A=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:53.953446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9a0aa74f-78ba-44c6-a817-d6757302b6d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:07:53.959168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9a0aa74f-78ba-44c6-a817-d6757302b6d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:07:53.984121 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a0aa74f-78ba-44c6-a817-d6757302b6d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053733 Oct 06 14:07:53.984732 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3678/7369] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:07:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:07:59.886632 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1482107963", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "9b1727d0-2063-49da-9081-43b3610000f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1439677568", "security_groups": [{"name": "tempest-secgroup-smoke-2067172691"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:07:59.913580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:00.044040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] validate_networks() for [('9b1727d0-2063-49da-9081-43b3610000f6', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:08:00.516697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:08:00.517375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:08:00.518025 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:08:00.519159 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:08:00.519581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:08:00.530501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:00.530987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:00.531420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:00.532204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:00.532654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:00.533268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:00.553871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:08:00.560038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:08:00.574719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:08:00.577530 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:08:00.629840 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e677d450-f8ae-4397-a33d-109098550314 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747424 Oct 06 14:08:00.637188 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3692/7370] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:07:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:08:00.642093 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=32 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:00.654153 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3c4c3fc-900a-4c2a-a2a0-f78ca7fd4d5c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:00.655989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3c4c3fc-900a-4c2a-a2a0-f78ca7fd4d5c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:00.785037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a3c4c3fc-900a-4c2a-a2a0-f78ca7fd4d5c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:00.794997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3c4c3fc-900a-4c2a-a2a0-f78ca7fd4d5c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1267 microversion: 2.1 time: 0.156336 Oct 06 14:08:00.796077 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3679/7371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:00 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:08:01.823310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:01.824662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:01.844610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:01.845436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:01.846113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:01.848852 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:01.850352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:01.851359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:01.956141 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:01.968037 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e71301a7-ec45-4410-854d-81ee8c0124da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1327 microversion: 2.1 time: 0.151264 Oct 06 14:08:01.973356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3693/7372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:01 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1327 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:02.991630 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:02.993040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:03.003879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:03.005020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:03.005718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:03.006875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:03.007559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:03.008785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:03.189031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:03.197586 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd411e6a-04f4-4a29-a26e-fe03a76341dc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.210251 Oct 06 14:08:03.198430 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3680/7373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:02 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:03.630881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7", "tag": "f181c64f-59d4-4b42-8fbe-a98e63f831e6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:08:03.640511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:03.640970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:03.641405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:03.652786 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] Creating event network-changed:f181c64f-59d4-4b42-8fbe-a98e63f831e6 for instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 on n-h2-860556-1 Oct 06 14:08:03.658362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-609c2015-f696-4652-addb-91c66f3a5d5a req-5d4a7522-c00b-4965-8b43-adeb7718dc26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118977 Oct 06 14:08:03.658974 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3694/7374] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:08:04.221851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:04.222640 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:04.229634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:04.230178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:04.230637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:04.231355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:04.231828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:04.232305 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:04.371813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:04.380058 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99d8bd59-f6d8-41ec-b2e5-70ff9ad41882 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.162424 Oct 06 14:08:04.380646 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3681/7375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:04 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:05.403802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:05.404526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:05.411884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:05.412379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:05.412813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:05.413515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:05.413991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:05.414987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:05.556478 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:05.566272 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8927c6a1-dffd-4a6d-be54-57ef4a0dd592 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.167243 Oct 06 14:08:05.566871 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3695/7376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:05 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:06.590908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:06.591660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:06.599180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:06.599712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:06.600190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:06.600934 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:06.601415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:06.602491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:06.748380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:06.756124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ae9045d-911c-4c50-ab5d-9e0b47befdb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.169654 Oct 06 14:08:06.756705 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3682/7377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:06 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:07.779118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:07.779835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:07.786709 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:07.787205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:07.787650 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:07.788359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:07.788820 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:07.789851 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:07.922353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:07.930578 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f8db5954-a1ad-4f99-a9c2-a724dfb77cd3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.154834 Oct 06 14:08:07.931416 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3696/7378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:07 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:08.953498 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:08.954161 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:08.961321 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:08.962159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:08.962616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:08.963324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:08.963794 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:08.964236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:09.100589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:09.108780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5b48ca06-bfb9-4c4b-a2a1-616f717ed0e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.159132 Oct 06 14:08:09.109685 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3683/7379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:08 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:09.227340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7", "name": "network-vif-plugged", "status": "completed", "tag": "f181c64f-59d4-4b42-8fbe-a98e63f831e6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:08:09.238082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:09.238461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:09.238894 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:09.251068 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] Creating event network-vif-plugged:f181c64f-59d4-4b42-8fbe-a98e63f831e6 for instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 on n-h2-860556-1 Oct 06 14:08:09.255898 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-174fb8b5-c91b-4956-b10f-55d31ea1a836 req-2d152d4a-e028-45ce-bd41-55374bf0f0e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Oct 06 14:08:09.256680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3697/7380] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:08:10.134012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:10.134658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:10.141992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:10.142513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:10.142983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:10.143722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:10.144203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:10.144655 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:10.280819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:10.288493 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a8b0dea-fdcc-44dc-a940-354143258a56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1393 microversion: 2.1 time: 0.159139 Oct 06 14:08:10.289074 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3684/7381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:10 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:11.312317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:11.313431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:11.320971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:11.321986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:11.329282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:11.330053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:11.330520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:11.331218 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:11.331675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:11.332104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:11.472380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:11.480340 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c16c881-5d89-4c9c-a68b-25775d4f6eef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1565 microversion: 2.1 time: 0.171267 Oct 06 14:08:11.486743 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3698/7382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:11 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:11.502988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:11.503615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:11.505513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:11.507373 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:11.514606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:11.515069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:11.515538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:11.516320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:11.516787 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:11.517228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:11.662146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:11.670396 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-07ef8ed3-c4bd-4f9e-9126-4e7b61cbfe2d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1565 microversion: 2.1 time: 0.171365 Oct 06 14:08:11.670985 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3685/7383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:11 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:13.368411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7", "tag": "f181c64f-59d4-4b42-8fbe-a98e63f831e6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:08:13.372591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:08:13.373194 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:13.375963 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:13.381909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:13.382496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:13.383776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:13.384589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:13.385130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:13.385636 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:13.388324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:13.388819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:13.389271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:13.401668 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] Creating event network-changed:f181c64f-59d4-4b42-8fbe-a98e63f831e6 for instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 on n-h2-860556-1 Oct 06 14:08:13.408406 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cd743ba0-ac89-4ee8-bea8-71d86c78a1b2 req-fc9c14dc-5ec0-4b4f-919d-983107f1b868 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044105 Oct 06 14:08:13.409132 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3686/7384] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:08:13.541430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:08:13.549653 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-966780e0-fbd6-4a89-9b44-195978b17fb1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1565 microversion: 2.1 time: 0.188362 Oct 06 14:08:13.550281 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3699/7385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:08:13 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:08:44.842126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:44.842885 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=38 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:08:44.847302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:08:44.849537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:08:44.857107 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:44.857600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:44.858077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:44.858810 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:08:44.859275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:08:44.859711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:08:44.927358 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-78fa80eb-7516-4288-b957-c54d617a5d6d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action" status: 200 len: 24571 microversion: 2.1 time: 0.087202 Oct 06 14:08:44.928027 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3687/7386] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:08:44 2022] POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:09:15.348553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:15.349293 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:15.353393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:09:15.356315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:15.363085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:15.363572 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:15.364016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:15.364752 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:15.365214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:15.365649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:15.446519 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-31457975-5b72-4a99-8e2f-e36ab33cda8a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action" status: 202 len: 0 microversion: 2.1 time: 0.099510 Oct 06 14:09:15.447264 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3700/7387] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:09:15 2022] POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:09:15.458588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:15.459470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:15.462201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:15.463234 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:15.469601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:15.470855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:15.470855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:15.471515 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:15.471821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:15.472315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:15.629307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:15.637377 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6ff2111f-be22-4e9a-b34b-64f92eea5055 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1674 microversion: 2.1 time: 0.184093 Oct 06 14:09:15.638012 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3688/7388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:15 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:16.662534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:16.663264 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:16.670072 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:16.670555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:16.670997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:16.671695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:16.672152 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:16.672585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:16.811969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:16.819851 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3aa83da8-d479-4591-b4ab-b9982c5b27a7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.162655 Oct 06 14:09:16.820417 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3701/7389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:16 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:17.846114 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:17.846747 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:17.852828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:17.853331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:17.853820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:17.854532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:17.855704 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:17.856155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:17.988181 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:17.996456 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-48a0f6b9-fbe3-419c-9e93-5f157990f4f6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.155135 Oct 06 14:09:17.997041 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3689/7390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:17 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:19.020639 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:19.021314 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:19.028895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:19.029395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:19.029865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:19.030570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:19.031028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:19.031457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:19.163214 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:19.174043 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e1d7a7ac-17cb-41e4-a9fd-ea8f1d72c312 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.157434 Oct 06 14:09:19.174630 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3702/7391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:19 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:20.198053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:20.199335 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:20.206439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:20.206938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:20.207391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:20.208097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:20.208566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:20.209011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:20.343827 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:20.351640 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6118b788-ca67-41c6-9bba-0aa3434cde1b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.157513 Oct 06 14:09:20.352227 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3690/7392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:20 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:21.376185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:21.376809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:21.383644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:21.384131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:21.384575 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:21.385273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:21.385754 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:21.386192 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:21.524000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:21.532416 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a153b3f2-8932-4998-8387-0523c6ad7a1d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.160221 Oct 06 14:09:21.532986 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3703/7393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:21 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:22.556245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:22.556871 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:22.563846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:22.564342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:22.564797 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:22.565537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:22.566027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:22.566470 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:22.695762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:22.704011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-02e32a73-d5d7-48a5-8f13-ad213779aa6b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.151696 Oct 06 14:09:22.704580 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3691/7394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:22 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:23.727951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:23.728547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:23.736021 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:23.736491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:23.736924 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:23.737611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:23.738092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:23.738522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:23.873250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:23.881004 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2370e823-9fbe-4da8-9b8f-d4c47691b1d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.156921 Oct 06 14:09:23.881587 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3704/7395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:23 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:24.905010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:24.905631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:24.912487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:24.912984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:24.913437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:24.914174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:24.914646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:24.915086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:25.045075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:25.052873 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5dc9a331-0dfd-4692-9fc6-75782091a68b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.152436 Oct 06 14:09:25.053453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3692/7396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:24 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:26.075143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:26.075688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:26.082862 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:26.083355 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:26.083805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:26.084506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:26.084969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:26.085405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:26.216859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:26.224635 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8f55c0ac-4efb-4a41-a2c3-09f32313bff5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1679 microversion: 2.1 time: 0.153473 Oct 06 14:09:26.225213 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3705/7397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:26 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:27.249388 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:09:27.250085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:27.257025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:27.257526 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:27.258013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:27.258728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:27.259203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:27.259652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:27.398035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:09:27.406194 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1c5c8f73-d8c2-4284-b9fd-dbd134e1c87d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1682 microversion: 2.1 time: 0.161205 Oct 06 14:09:27.406778 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3693/7398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:09:27 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:09:59.622504 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:09:59.624614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:09:59.626818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:59.627640 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:09:59.635202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:59.635703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:59.636156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:59.636858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:09:59.637312 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:09:59.637804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:09:59.712963 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0172d4a1-00c3-4ff0-b9a1-33ea3d1ab1ab tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action" status: 200 len: 69086 microversion: 2.1 time: 0.095151 Oct 06 14:09:59.713766 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3706/7399] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:09:59 2022] POST /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7/action => generated 69086 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:10:16.753992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:16.755082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:16.757284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7", "tag": "f181c64f-59d4-4b42-8fbe-a98e63f831e6"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:16.758336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:16.759198 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=36 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:16.760174 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:10:16.760319 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 (ip 10.222.0.26) !!! Oct 06 14:10:16.761500 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:10:16.761621 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 (ip 10.222.0.26) !!! Oct 06 14:10:16.770644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:16.770982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:16.771446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:16.771666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:16.772254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:16.772981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:16.773622 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:16.774101 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:16.780653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:16.781150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:16.781890 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:16.797764 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] Creating event network-changed:f181c64f-59d4-4b42-8fbe-a98e63f831e6 for instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 on n-h2-860556-1 Oct 06 14:10:16.803565 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-e04dd4cf-e460-44ba-bd1d-1bb46d882461 req-a7fca132-d540-4a14-ad8c-7b3f9966cd85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050561 Oct 06 14:10:16.805342 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3707/7400] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:10:16.809769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:10:16.893648 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-aaf58933-50aa-47f3-9c22-810eb67033e1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 204 len: 0 microversion: 2.1 time: 0.142788 Oct 06 14:10:16.894010 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3694/7401] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:10:16 2022] DELETE /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:10:16.903262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:16.904020 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:16.911297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:16.911795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:16.912240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:16.912954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:16.913414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:16.913957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:17.073832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:17.082942 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ce9531df-1411-4fd8-bbe7-5729ca0db22f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1688 microversion: 2.1 time: 0.184317 Oct 06 14:10:17.083535 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3708/7402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:16 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:18.107212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:18.107947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:18.115395 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:18.115876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:18.116333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:18.117055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:18.117671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:18.118003 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:18.260519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:18.269225 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-253d1c7d-ff6e-423d-80a3-6d4d7c92e300 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1688 microversion: 2.1 time: 0.166383 Oct 06 14:10:18.269836 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3695/7403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:18 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:19.294885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:19.295501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:19.302490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:19.302988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:19.303434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:19.304151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:19.304612 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:19.305044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:19.445299 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:19.454742 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8de08e50-c283-49e5-b59b-f66bfa134a0e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 200 len: 1571 microversion: 2.1 time: 0.164240 Oct 06 14:10:19.455333 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3709/7404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:19 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:19.601624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7", "name": "network-vif-deleted", "tag": "f181c64f-59d4-4b42-8fbe-a98e63f831e6"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:19.614261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:19.614764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:19.615216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:19.627855 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] Creating event network-vif-deleted:f181c64f-59d4-4b42-8fbe-a98e63f831e6 for instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 on n-h2-860556-1 Oct 06 14:10:19.633257 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-9868c35d-c5ea-41f3-a836-bc921c3c5467 req-e7451c4f-a738-473d-a7a4-0e904ab57d38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Oct 06 14:10:19.634218 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3696/7405] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:10:20.479082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:20.479727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:20.487118 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:20.487606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:20.488045 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:20.488748 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:20.489202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:20.489628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:20.504336 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] HTTP exception thrown: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Request method failure captured: Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 HTTP/1.1 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPuDWL-UWhYMcmWgs3jzXMCxNi8alhxBbN1wmuqzbPlP5iKXocAdygFiumlRCkutGYvUiFzIWFeffXG8naPXDXC5CWrev7h9jWumPyE4FBNMlqsTiAz-jzZdJmbDMuR3gZiMmrQLTdf0s6kZsjVKdeYj_pEXNlmdUJdOL0F6Gntwmwf8 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fc9f3196546446f99cad542e4b67ebb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}] Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f599cb7064df49f59cb1459e1262830a Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7'} Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:10:20.506444 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Returning 404 to user: Instance ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d37ad46b-df3e-47a0-8bae-3f4657e42bdd tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7" status: 404 len: 111 microversion: 2.1 time: 0.032684 Oct 06 14:10:20.511101 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3710/7406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:20 2022] GET /compute/v2.1/servers/ea4f8f19-0aa3-44d4-9f0c-0cf8553c93d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:10:23.962492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6412ce66-af6a-4fa1-9a48-ba5756f82653 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '.version_select at 0x7f7d3e2e1280>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:23.990278 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6412ce66-af6a-4fa1-9a48-ba5756f82653 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1439677568" status: 202 len: 0 microversion: 2.1 time: 0.033244 Oct 06 14:10:23.994506 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3697/7407] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Oct 6 14:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1439677568 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 14:10:24.023040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ada89855-c229-4c95-bf55-95c3e75995d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: .version_select at 0x7f7d3dfd3af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-901873577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ5jm4H11vnIBGQGWfi4z1pZ3VT7p+WXWlSYH+bZPP9NR+rTx95HkoQN7LOtwYhiIJ5L0kVw0Q7m/zPyakkyc+ZmqgqfrkT97lnAkTLKh819tz6Acn45ANav9hiwmX0XA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:24.044098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ada89855-c229-4c95-bf55-95c3e75995d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:10:24.050910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-ada89855-c229-4c95-bf55-95c3e75995d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:10:24.077916 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ada89855-c229-4c95-bf55-95c3e75995d6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058736 Oct 06 14:10:24.078547 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3711/7408] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:10:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:10:29.913099 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:29.917749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1433076897", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "82bc974b-d2f8-4d25-a20c-e5222a8302ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-901873577", "security_groups": [{"name": "tempest-secgroup-smoke-1092616396"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:30.048324 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] validate_networks() for [('82bc974b-d2f8-4d25-a20c-e5222a8302ce', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:10:30.608408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:10:30.609533 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:10:30.610243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:10:30.610855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:10:30.611769 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:10:30.626484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:30.627227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:30.627869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:30.628830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:30.629617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:30.630102 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:30.657615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:10:30.663853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:10:30.678634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:10:30.681212 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:10:30.753063 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-521716fc-4e7a-4e21-851d-4a06a791a255 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841601 Oct 06 14:10:30.758712 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3698/7409] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:10:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:10:30.765359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=16 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:30.770503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0d33c509-6607-4aac-8f94-770d741718aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:30.771310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0d33c509-6607-4aac-8f94-770d741718aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:30.886271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0d33c509-6607-4aac-8f94-770d741718aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:30.895884 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0d33c509-6607-4aac-8f94-770d741718aa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1266 microversion: 2.1 time: 0.134231 Oct 06 14:10:30.898604 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3712/7410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:30 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:31.922088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:31.922730 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:31.929792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:31.930294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:31.930748 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:31.931472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:31.931949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:31.932398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:32.010246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:32.026698 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-99874b83-b2b2-4e2b-b528-610eb24a1a80 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1326 microversion: 2.1 time: 0.109810 Oct 06 14:10:32.027453 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3699/7411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:31 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:33.053240 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:33.053908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:33.063133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:33.063908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:33.064579 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:33.065978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:33.066840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:33.067268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:33.209728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:33.217825 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-83bc9ef0-c2c4-4985-bb05-a4978fbeda70 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.170115 Oct 06 14:10:33.218588 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3713/7412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:33 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:33.614818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:33.626309 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:33.626949 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:33.627413 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:33.639300 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] Creating event network-changed:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h2-860556-1 Oct 06 14:10:33.644752 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-16d4b70a-6578-487e-abf9-ed24962b7278 req-8a6b9dca-84ad-4185-849d-b729c999e277 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033596 Oct 06 14:10:33.645944 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3700/7413] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:10:34.242014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:34.242637 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:34.250340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:34.250858 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:34.251308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:34.252009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:34.252459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:34.252889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:34.390300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:34.397899 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0e07148b-f998-46e3-adea-994662c3558a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.159867 Oct 06 14:10:34.398481 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3714/7414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:34 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:10:35.422006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:35.422733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:35.428996 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:35.429504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:35.430000 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:35.430718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:35.431203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:35.431652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:35.571448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:35.580151 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4ac24d7f-c331-42e6-88d5-54b3ca79b459 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.163268 Oct 06 14:10:35.580748 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3701/7415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:35 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:36.603309 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:36.603953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:36.611976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:36.612465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:36.612899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:36.613605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:36.614086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:36.614508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:36.766756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:36.774981 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1542e6c1-cb66-4340-a370-13b4fc1f82f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.175496 Oct 06 14:10:36.775592 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3715/7416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:36 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:37.798906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:37.799450 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:37.806471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:37.806972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:37.807430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:37.808143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:37.808619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:37.809082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:37.944496 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:37.953135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-473bc7ea-596d-4809-a946-0a4ae30aae04 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.158188 Oct 06 14:10:37.953722 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3702/7417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:37 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:38.976282 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:38.976962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:38.983816 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:38.984303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:38.984741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:38.985445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:38.985939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:38.986366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:39.121412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:39.129280 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2c277cae-2d30-499f-88ea-c388b9fbc1fa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.156884 Oct 06 14:10:39.129907 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3716/7418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:38 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:40.145896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "name": "network-vif-plugged", "status": "completed", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:40.154480 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:40.155104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:40.155957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:40.156464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:40.157060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:40.164275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:40.164806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:40.165225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:40.165977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:40.166439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:40.166868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:40.169109 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] Creating event network-vif-plugged:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h2-860556-1 Oct 06 14:10:40.174253 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-8854ee5d-5ecf-439c-932e-6a180e906ab8 req-8f18ed44-bb7d-4824-91b7-64dba9f427bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118936 Oct 06 14:10:40.174877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3703/7419] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:10:40.308330 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:40.318552 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9d937424-d5e6-464f-8155-1c623e244cee tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.167867 Oct 06 14:10:40.319163 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3717/7420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:40 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:10:41.339543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:41.340362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:41.346012 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:41.346772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:41.353953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:41.354517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:41.355122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:41.355834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:41.356306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:41.356744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:41.492971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:41.501542 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-eedc6821-beaa-48d1-a47b-1fe94cff1fbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1392 microversion: 2.1 time: 0.163185 Oct 06 14:10:41.502144 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3704/7421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:41 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:42.525098 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:42.525657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:42.527625 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:10:42.534301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:42.534810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:42.535233 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:42.535933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:42.536393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:42.536824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:42.677481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:42.685392 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-22963457-4189-4750-83c7-d2cbfc84c775 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1564 microversion: 2.1 time: 0.164308 Oct 06 14:10:42.686013 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3718/7422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:42 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:42.708414 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:42.709113 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:42.716339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:42.717267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:42.718354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:42.719061 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:42.719540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:42.719991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:42.855365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:42.863300 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e4ef106a-95c3-4803-ab68-5cba62dd5b8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1564 microversion: 2.1 time: 0.159101 Oct 06 14:10:42.863878 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3705/7423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:42 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:10:44.815554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:10:44.816187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:10:44.823432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:44.824600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:44.825053 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:44.825806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:44.826523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:44.826970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:44.871628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:10:44.881486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:10:44.882026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:10:44.882486 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:10:44.896399 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] Creating event network-changed:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h2-860556-1 Oct 06 14:10:44.904141 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-03cb3f08-33dd-49b3-aa39-6c69ba7cf120 req-b9b8316e-d951-4b77-adef-0c9072b05c84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096178 Oct 06 14:10:44.904773 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3706/7424] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:10:44.980291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:10:44.989048 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bf9cb8aa-d547-45fd-a1fe-e4e077241ad2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1564 microversion: 2.1 time: 0.186209 Oct 06 14:10:44.989849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3719/7425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:10:44 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:11:18.316597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:18.317374 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=38 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:18.366578 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:11:18.368903 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:11:18.375075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:18.375577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:18.376035 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:18.376738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:18.377210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:18.377653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:18.444772 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-60ef1d73-74af-40de-8777-49aa6506b82a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action" status: 200 len: 24553 microversion: 2.1 time: 0.129816 Oct 06 14:11:18.445356 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3707/7426] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:11:18 2022] POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action => generated 24553 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:11:57.471328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:57.472079 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=42 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:57.477028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:11:57.479460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:11:57.487380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:57.487865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:57.488300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:57.488995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:57.489448 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:57.489914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:57.570368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:11:57.576561 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Old instance type m1.heat2, new instance type m1.heat {{(pid=129615) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 06 14:11:57.583547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:11:57.583972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:11:57.584447 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:11:57.584859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:11:57.585276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:11:57.648854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f0ccc08-e1b0-4507-8f8b-1b9c83c26c9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action" status: 202 len: 0 microversion: 2.1 time: 0.179355 Oct 06 14:11:57.649472 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3720/7427] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:11:57 2022] POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:11:57.658419 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:11:57.659172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:11:57.661694 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:57.662394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:11:57.669594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:57.670457 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:57.670902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:57.671716 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:57.672195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:57.672643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:57.832573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:11:57.840551 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1e401e89-b839-4489-82f5-26faf03c0bb7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1692 microversion: 2.1 time: 0.186594 Oct 06 14:11:57.841129 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3708/7428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:11:57 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:11:58.865063 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:11:58.865676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:11:58.872662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:58.873202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:58.873633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:58.874376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:11:58.874833 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:11:58.875254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:11:59.015222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:11:59.023737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6bc4d9d7-7a83-46b6-97ae-c1e57049f928 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1692 microversion: 2.1 time: 0.164276 Oct 06 14:11:59.024309 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3721/7429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:11:58 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:00.046834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:00.047465 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:00.053952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:00.054458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:00.054914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:00.055623 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:00.056130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:00.056575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:00.197602 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:00.206627 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5e0aa170-ee5b-4d0c-961f-8ef752c3bcbc tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.162820 Oct 06 14:12:00.207703 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3709/7430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:00 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:01.230387 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:01.231004 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:01.238596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:01.239087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:01.239528 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:01.240221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:01.240682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:01.241112 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:01.382840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:01.390669 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f2c819e-03f8-486f-ad98-55f5fb06ea02 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.164275 Oct 06 14:12:01.391243 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3722/7431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:01 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:02.415859 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:02.416497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:02.423597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:02.424049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:02.425184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:02.425939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:02.426427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:02.426882 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:02.565435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:02.573369 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-217cd07c-3a04-4296-846f-31b8563fd1c7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.161421 Oct 06 14:12:02.573998 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3710/7432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:02 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:03.597352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:03.597975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:03.604845 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:03.605331 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:03.605795 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:03.606496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:03.606955 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:03.607383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:03.746584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:03.755042 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a3dc4795-ec39-4029-a39e-c3806adcf343 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.161550 Oct 06 14:12:03.755613 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3723/7433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:03 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:04.778356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:04.778984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:04.786503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:04.787004 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:04.787459 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:04.788172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:04.788641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:04.789081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:04.924686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:04.933046 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be269e9c-8b8b-4bed-8507-d83482f33ddf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.158605 Oct 06 14:12:04.933628 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3711/7434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:04 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:12:05.956516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:05.957393 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:05.964920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:05.965410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:05.965891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:05.966602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:05.967061 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:05.967487 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:06.102953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:06.110892 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-43b40abd-569b-4d13-a7ae-c4d6368dcefb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.158355 Oct 06 14:12:06.111406 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3724/7435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:05 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:07.214005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:07.214635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:07.221615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:07.222167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:07.222628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:07.223342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:07.223818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:07.224263 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:07.355633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:07.363921 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-070f89da-0fcf-4689-bc41-79d9f5548c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.153889 Oct 06 14:12:07.364504 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3712/7436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:07 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:12:08.387909 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:08.388533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:08.396243 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:08.396733 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:08.397181 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:08.397919 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:08.398380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:08.398811 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:08.539321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:08.547109 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1edf2923-0d57-49cc-931c-e205d8b396c6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.163197 Oct 06 14:12:08.547680 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3725/7437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:08 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:09.570564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:09.571200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:09.578340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:09.578846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:09.579306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:09.580026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:09.580506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:09.580956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:09.716333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:09.724997 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-da1b0840-a06c-4fed-ae7a-f97593a25b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.158253 Oct 06 14:12:09.725594 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3713/7438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:09 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:10.748044 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:10.748810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:10.755882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:10.756369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:10.756810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:10.757549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:10.758046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:10.758477 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:10.899628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:10.907501 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e8bb5f3a-262f-44be-ba65-9f8123016d11 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1697 microversion: 2.1 time: 0.163323 Oct 06 14:12:10.908080 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3726/7439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:10 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:11.931252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:11.931852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:11.938939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:11.939502 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:11.939974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:11.940738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:11.941245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:11.941692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:12.089122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:12.097074 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-095537e5-d503-499d-a2ca-6dfce8b55551 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1696 microversion: 2.1 time: 0.169787 Oct 06 14:12:12.098345 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3714/7440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:11 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:12.475822 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "name": "network-vif-unplugged", "status": "completed", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:12.486404 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:12.486943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:12.487727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:12.499696 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Creating event network-vif-unplugged:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h1-860556-1 Oct 06 14:12:12.506005 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 14:12:12.517440 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-d8d1ec54-6167-4a94-89dd-d60b4b46180d req-4ba62c82-d18f-4bb9-9c5b-3a044f873947 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045293 Oct 06 14:12:12.518128 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3727/7441] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:12:13.121650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:13.122306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:13.129224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:13.130132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:13.130583 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:13.131326 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:13.131798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:13.132239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:13.277746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:13.286126 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-724e83e5-a36b-4ae5-8b30-622674feeaaf tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1696 microversion: 2.1 time: 0.168276 Oct 06 14:12:13.286723 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3715/7442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:13 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:14.309917 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:14.310631 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:14.317476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:14.317992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:14.318436 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:14.319140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:14.319601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:14.320033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:14.460657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:14.468639 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-36a8b633-72c8-4297-8995-720a22fb2afa tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1694 microversion: 2.1 time: 0.163860 Oct 06 14:12:14.469236 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3728/7443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:14 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:14.557180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:14.568328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:14.568888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:14.569424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:14.584037 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Creating event network-changed:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h1-860556-1 Oct 06 14:12:14.590055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860556-1', 'n-h1-860556-1'} {{(pid=129614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 06 14:12:14.601931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ed5b826e-c728-42be-9af2-05f82678b78b req-f7330092-e896-47ef-8d4d-f09d9006b9f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048330 Oct 06 14:12:14.602559 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3716/7444] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:12:15.496689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:15.497308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:15.504444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.505207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.506252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.507024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.507688 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.508424 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.674705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:15.683074 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1b0b3498-ef95-4806-a638-5594bd1e1c9e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1691 microversion: 2.1 time: 0.193805 Oct 06 14:12:15.683665 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3729/7445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:15 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:15.709273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:15.710088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:15.718645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.719169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.719836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.720567 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.721048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.721497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.789912 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bea7ed21-beb0-49ed-b721-ff4014b7876e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action" status: 204 len: 0 microversion: 2.1 time: 0.086420 Oct 06 14:12:15.790602 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3717/7446] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:12:15 2022] POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:12:15.802946 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:15.803570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:15.811615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.811878 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.812606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.814051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:15.815048 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:15.815489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:15.968832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:15.978107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0fc9ee27-d746-499a-a98f-35650bc7e627 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1691 microversion: 2.1 time: 0.183130 Oct 06 14:12:15.978711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3730/7447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:15 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:12:16.001160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:16.002449 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:16.009492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:16.010088 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:16.010761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:16.011647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:16.011971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:16.012435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:16.157985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:16.167220 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f5c02481-912b-4619-81dc-2aafac9b1385 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1691 microversion: 2.1 time: 0.170101 Oct 06 14:12:16.168194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3718/7448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:15 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:17.191360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:17.191974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:17.199485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:17.200000 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:17.200435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:17.201123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:17.201576 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:17.202526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:17.340336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:17.350240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d00e8167-0d66-4e73-9c1a-02f28ab20c55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1691 microversion: 2.1 time: 0.162629 Oct 06 14:12:17.351256 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3731/7449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:17 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:17.555140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "name": "network-vif-plugged", "status": "completed", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:17.566014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:17.566798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:17.567377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:17.579946 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] Creating event network-vif-plugged:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h1-860556-1 Oct 06 14:12:17.585345 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-7435245a-0cd7-4f06-be0b-b47489cb8a30 req-498e5ca4-18a7-4b9c-8933-c57418811487 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034838 Oct 06 14:12:17.586179 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3719/7450] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:12:18.374713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:18.375358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:18.382898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:18.383386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:18.383827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:18.384531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:18.384991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:18.385421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:18.526368 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:18.534636 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1f9e0ea7-79d0-4090-bf38-e9c958407993 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1683 microversion: 2.1 time: 0.163763 Oct 06 14:12:18.535222 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3732/7451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:18 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:42.732365 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=24 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:12:42.733147 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:12:42.737579 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:42.739969 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:42.747947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:42.748445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:42.748896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:42.749648 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:42.750127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:42.750569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:42.813328 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c9934c53-e12f-4f17-b430-b07918b2a6b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action" status: 200 len: 24518 microversion: 2.1 time: 0.082845 Oct 06 14:12:42.814028 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3720/7452] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:12:42 2022] POST /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a/action => generated 24518 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:12:49.832196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:49.833039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:49.835075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:49.836463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=30 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:12:49.837985 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:12:49.844154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:49.844798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:49.845430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:49.846167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:49.846627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:49.847054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:49.847172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:49.847556 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:49.848145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:49.864422 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] Creating event network-changed:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h1-860556-1 Oct 06 14:12:49.870342 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-d7b4b3ae-5829-49f8-8dc3-def27f0e8feb req-39c5c755-dcd2-4fe3-a2ea-f76d3620023a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039674 Oct 06 14:12:49.871725 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3721/7453] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:12:49.876501 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:12:49.976923 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e3270ca1-7928-4b84-acdb-0f65ebf98118 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 204 len: 0 microversion: 2.1 time: 0.148470 Oct 06 14:12:49.978410 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3733/7454] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:12:49 2022] DELETE /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:12:49.987159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:49.987888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:49.994732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:49.995252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:49.995711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:49.996445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:49.996922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:49.997375 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:50.135068 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:50.143045 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bdf9e857-2c43-4af0-920a-6c31f328614e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1689 microversion: 2.1 time: 0.160071 Oct 06 14:12:50.143636 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3722/7455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:49 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:51.167690 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:51.168394 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:51.175442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:51.175937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:51.176372 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:51.177075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:51.177525 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:51.177984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:51.365771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:51.373890 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-23378166-c736-4567-a097-7c4419b6346c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1689 microversion: 2.1 time: 0.211023 Oct 06 14:12:51.374476 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3734/7456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:51 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:51.916037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb123ff-1ece-4ff4-9acd-e2c195dfc07a", "name": "network-vif-deleted", "tag": "9d982838-ceb2-459e-a715-62cb025bbd87"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:51.926731 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:51.927157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:51.927615 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:51.940278 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] Creating event network-vif-deleted:9d982838-ceb2-459e-a715-62cb025bbd87 for instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a on n-h1-860556-1 Oct 06 14:12:51.945782 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-42c0c1d5-8537-4a9b-92e0-e41a133ad691 req-43acd06b-89e2-4528-bb3d-919e19de36b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Oct 06 14:12:51.947392 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3723/7457] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:12:52.397931 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:52.398555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:52.405526 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:52.406051 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:52.406494 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:52.407196 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:52.407655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:52.408085 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:52.441383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:52.441800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:52.442244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:52.442700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lazy-loading 'fault' on Instance uuid fdb123ff-1ece-4ff4-9acd-e2c195dfc07a {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:12:52.490392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:12:52.499009 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-883c0e03-8549-47ed-bb20-2a1e5a792668 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 200 len: 1356 microversion: 2.1 time: 0.105006 Oct 06 14:12:52.499606 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3735/7458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:52 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:12:53.523469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:53.524209 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: fdb123ff-1ece-4ff4-9acd-e2c195dfc07a] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:12:53.531676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:53.532667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:53.532667 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:53.533409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:12:53.533779 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:12:53.534227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:12:53.549352 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] HTTP exception thrown: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Request method failure captured: Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a HTTP/1.1 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPuDWL-UWhYMcmWgs3jzXMCxNi8alhxBbN1wmuqzbPlP5iKXocAdygFiumlRCkutGYvUiFzIWFeffXG8naPXDXC5CWrev7h9jWumPyE4FBNMlqsTiAz-jzZdJmbDMuR3gZiMmrQLTdf0s6kZsjVKdeYj_pEXNlmdUJdOL0F6Gntwmwf8 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fc9f3196546446f99cad542e4b67ebb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}] Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f599cb7064df49f59cb1459e1262830a Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': 'fdb123ff-1ece-4ff4-9acd-e2c195dfc07a'} Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:12:53.551081 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Returning 404 to user: Instance fdb123ff-1ece-4ff4-9acd-e2c195dfc07a could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-68e01ddf-5e60-4ef1-8c2c-3a1c75a7725b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a" status: 404 len: 111 microversion: 2.1 time: 0.033328 Oct 06 14:12:53.556707 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3724/7459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:12:53 2022] GET /compute/v2.1/servers/fdb123ff-1ece-4ff4-9acd-e2c195dfc07a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:12:56.886992 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-930d58da-ac7a-4c49-ad59-cb5cd44100e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '.version_select at 0x7f7d3e3cb820>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:12:56.915535 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-930d58da-ac7a-4c49-ad59-cb5cd44100e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-901873577" status: 202 len: 0 microversion: 2.1 time: 0.034760 Oct 06 14:12:56.916751 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3736/7460] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 14:12:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-901873577 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:12:56.944725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-efa4967c-6a36-47f9-94e9-354a91a03e57 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: .version_select at 0x7f7d3dd978b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-474039896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKu+aq4mS6k/Biz140wH+FMJV4jSo6gY5jud2DBFopcWFY/NdHF5OuAp8Tw/7OdulowGVF2ELaAoqEiAZEeBsml6yDKMPqZsgTj2VS+UI8ewCuBuKYuTtsDiGW1wXwK6g=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:12:56.964447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-efa4967c-6a36-47f9-94e9-354a91a03e57 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:12:56.970646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-efa4967c-6a36-47f9-94e9-354a91a03e57 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:12:56.996426 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-efa4967c-6a36-47f9-94e9-354a91a03e57 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056283 Oct 06 14:12:56.997037 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3725/7461] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:12:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:13:02.939120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:02.943815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-533206737", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "37d069df-868f-4ff7-a251-0c4bbe4e50a6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-474039896", "security_groups": [{"name": "tempest-secgroup-smoke-1825021766"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:13:03.079162 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] validate_networks() for [('37d069df-868f-4ff7-a251-0c4bbe4e50a6', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:13:03.506715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:13:03.507140 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:13:03.507617 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:13:03.508234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:13:03.508708 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:13:03.518493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:03.518991 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:03.519485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:03.520222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:03.521294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:03.521764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:03.541599 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:13:03.547328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:13:03.560643 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:13:03.562981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:13:03.611373 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e7fde0af-1fe4-4004-9110-3288d5e9eed9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674521 Oct 06 14:13:03.612264 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3737/7462] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:13:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:13:03.621944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=16 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:03.628112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ff00a79d-4b6e-479b-bd59-9bbbb9b79119 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:03.628997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ff00a79d-4b6e-479b-bd59-9bbbb9b79119 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:03.755641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ff00a79d-4b6e-479b-bd59-9bbbb9b79119 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:03.764003 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ff00a79d-4b6e-479b-bd59-9bbbb9b79119 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1265 microversion: 2.1 time: 0.144081 Oct 06 14:13:03.764888 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3726/7463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:03 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:04.796515 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:04.798307 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:04.810301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:04.811473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:04.812092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:04.813138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:04.813777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:04.814365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:04.929584 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:04.940284 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38964bd8-a7bf-4b04-998a-f4de8fa915d1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1325 microversion: 2.1 time: 0.156107 Oct 06 14:13:04.941559 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3738/7464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:04 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:05.964940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:05.966241 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:05.974804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:05.975576 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:05.976245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:05.977973 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:05.978619 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:05.979637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:06.167214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:06.176616 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3efb37b9-2e93-40d7-861b-29ecd84c90f5 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.216050 Oct 06 14:13:06.177347 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3727/7465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:05 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:06.742295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92", "tag": "64ec2a9e-497d-4c02-a652-2e92ab783081"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:13:06.757959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:06.758987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:06.759428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:06.771566 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] Creating event network-changed:64ec2a9e-497d-4c02-a652-2e92ab783081 for instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 on n-h2-860556-1 Oct 06 14:13:06.777912 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ff0481f2-ced5-4a6c-908d-3b726e3b3550 req-d1dc63db-4c1c-4f35-a9df-aee01ba5e451 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097370 Oct 06 14:13:06.778647 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3739/7466] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:13:07.201002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:07.202236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:07.211195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:07.211712 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:07.212172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:07.212915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:07.213392 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:07.213868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:07.354547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:07.362041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-763a6dba-ec49-4ea3-bee7-96c453c5bbc8 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.165880 Oct 06 14:13:07.362622 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3728/7467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:07 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:08.388150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:08.388903 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:08.395780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:08.396272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:08.396716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:08.397457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:08.399107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:08.399553 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:08.544114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:08.552477 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e92b6b48-9c04-478d-865d-85696a2319b0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.169830 Oct 06 14:13:08.552812 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3740/7468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:08 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:09.576848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:09.577440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:09.584937 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:09.585441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:09.585927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:09.587306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:09.587780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:09.588227 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:09.733382 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:09.742217 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fc06ebc5-6ef4-4da8-833c-b08c3c5094af tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.169266 Oct 06 14:13:09.743196 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3729/7469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:09 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:10.764761 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:10.765391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:10.772273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:10.772767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:10.773212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:10.774498 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:10.774980 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:10.775402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:10.914126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:10.923850 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4e0acb60-2466-4116-b61c-e96ef7c7323d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.162903 Oct 06 14:13:10.924438 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3741/7470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:10 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:11.948855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:11.949489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:11.958057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:11.958687 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:11.959159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:11.959975 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:11.960590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:11.961043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:12.110203 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:12.117940 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4d2a3a85-9095-4e9f-b758-3a6f8dbd5321 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.174565 Oct 06 14:13:12.119049 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3730/7471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:11 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:12.687774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92", "name": "network-vif-plugged", "status": "completed", "tag": "64ec2a9e-497d-4c02-a652-2e92ab783081"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:13:12.698434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:12.698850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:12.699338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:12.714874 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] Creating event network-vif-plugged:64ec2a9e-497d-4c02-a652-2e92ab783081 for instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 on n-h2-860556-1 Oct 06 14:13:12.720128 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b87b1ba2-74f4-4957-b19b-0da8e88673a3 req-d9603342-a573-4be5-8957-fba226169295 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036081 Oct 06 14:13:12.720813 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3742/7472] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:13:13.141340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:13.142005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:13.144867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:13.150772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:13.151272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:13.151840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:13.152553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:13.153022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:13.153464 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:13.293499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:13.305777 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e343924-c82f-46d3-b051-52eb40c9bbf2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1391 microversion: 2.1 time: 0.168133 Oct 06 14:13:13.307381 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3731/7473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:13 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:14.326359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:14.327145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:14.332887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:14.333629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:14.341646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:14.342166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:14.342603 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:14.343304 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:14.343764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:14.344191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:14.480123 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:14.488107 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-82048d0d-d35a-4d5e-8b08-171861607465 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1564 microversion: 2.1 time: 0.162721 Oct 06 14:13:14.488691 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3743/7474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:14 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:14.510749 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:14.511379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:14.513433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:14.519638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:14.520141 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:14.520601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:14.521319 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:14.521834 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:14.522282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:14.658060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:14.665900 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a3487708-5a78-44ed-a4e6-7b43cf3ac9a2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1564 microversion: 2.1 time: 0.159128 Oct 06 14:13:14.666487 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3732/7475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:14 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:13:16.352582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:13:16.358689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92", "tag": "64ec2a9e-497d-4c02-a652-2e92ab783081"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:13:16.363522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:16.372814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:16.373435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:16.373928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:16.374246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:16.374571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:16.375111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:16.375395 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:16.375959 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:16.376702 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:16.387612 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] Creating event network-changed:64ec2a9e-497d-4c02-a652-2e92ab783081 for instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 on n-h2-860556-1 Oct 06 14:13:16.393001 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1d766acf-a969-4bce-99d3-62a99faab069 req-dfbc5ce3-6d00-467f-8ff6-305b097f09ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037927 Oct 06 14:13:16.394124 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3733/7476] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:13:16.522213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:13:16.530830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97423d14-2c5a-4687-8f2e-f630f4ed39c1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1564 microversion: 2.1 time: 0.182118 Oct 06 14:13:16.537471 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3744/7477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:13:16 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:13:49.837025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:49.837792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=38 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:13:49.838907 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:13:49.838907 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:13:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action (ip 10.222.0.26) !!! Oct 06 14:13:49.844336 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:13:49.846634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:13:49.856025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:49.856524 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:49.856976 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:49.857678 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:13:49.858190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:13:49.858634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:13:49.925729 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8e02a5d2-cb9a-4ab4-bbd5-a77169a53f47 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action" status: 200 len: 24565 microversion: 2.1 time: 0.090542 Oct 06 14:13:49.926660 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3734/7478] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:13:49 2022] POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action => generated 24565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:14:20.357669 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:14:20.358627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=36 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:14:20.364238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:14:20.372928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:20.373483 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:20.373948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:20.397174 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Going to try to stop instance {{(pid=129615) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 14:14:20.439899 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3c504316-ca8b-4d55-8eaf-ff3463d25af2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action" status: 202 len: 0 microversion: 2.1 time: 0.083849 Oct 06 14:14:20.440505 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3745/7479] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:14:20 2022] POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:14:20.450513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:20.451244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:20.454672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:14:20.455813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:14:20.465675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:20.466210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:20.466662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:20.467383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:20.467852 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:20.468291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:20.610050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:20.617865 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-732fdca3-4673-426e-8b95-53eabafb6643 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.172698 Oct 06 14:14:20.618432 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3735/7480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:20 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:21.645473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:21.646810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:21.656406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:21.657065 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:21.657874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:21.659135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:21.659939 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:21.660738 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:21.796596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:21.804362 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bfec014d-ff07-4802-b2ab-37cad02d49c9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.165480 Oct 06 14:14:21.804943 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3746/7481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:21 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:22.830053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:22.830685 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:22.838091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:22.839313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:22.839780 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:22.840487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:22.840956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:22.841400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:22.974531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:22.982294 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-587fd408-82d6-46a6-8e97-8a4a9f8679e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.156159 Oct 06 14:14:22.982888 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3736/7482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:22 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:24.006335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:24.006950 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:24.014120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:24.014615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:24.015055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:24.015797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:24.016253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:24.016682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:24.156967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:24.164667 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-76127e90-5e89-4773-8103-6e7001b71189 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.162303 Oct 06 14:14:24.165251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3747/7483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:24 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:25.188762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:25.189386 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:25.196185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:25.196681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:25.197134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:25.198499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:25.198978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:25.199412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:25.329144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:25.337549 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f3cee07-5ef4-4c5d-b6d7-d1933ee5452d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.152635 Oct 06 14:14:25.338155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3737/7484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:25 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:26.361655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:26.362402 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:26.369315 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:26.372001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:26.372001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:26.372001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:26.372001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:26.372001 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:26.511406 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:26.519295 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-10ca75a0-0a7c-4c8e-b7dd-3f4c1880bee3 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.161553 Oct 06 14:14:26.519879 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3748/7485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:26 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:27.543034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:27.543662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:27.550692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:27.551194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:27.551652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:27.552366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:27.552844 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:27.553293 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:27.686297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:27.694034 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-cd4da22c-9ca2-43cf-8cea-dc449a413959 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.155478 Oct 06 14:14:27.694618 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3738/7486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:27 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:28.718288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:28.718895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:28.725104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:28.725583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:28.726317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:28.726842 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:28.727273 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:28.727695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:28.858668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:28.866372 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44f7b961-a22d-4bb8-89aa-094a798fbedb tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.151901 Oct 06 14:14:28.866945 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3749/7487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:28 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:29.890348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:29.890987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:29.897191 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:29.897699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:29.898194 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:29.898912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:29.899394 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:29.899841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:30.034591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:30.042474 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-414f7fc0-8527-436f-b713-844d83b94660 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.156172 Oct 06 14:14:30.043053 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3739/7488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:29 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:31.066271 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:31.067167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:31.074933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:31.075412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:31.075872 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:31.076567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:31.077013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:31.077434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:31.207593 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:31.216124 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8a9ac034-bc69-4c99-8a44-3087781e27f9 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.154168 Oct 06 14:14:31.216706 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3750/7489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:31 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:32.240451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:32.241120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:32.248686 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:32.249381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:32.249645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:32.250409 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:32.250851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:32.251291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:32.391357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:32.399144 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a824746c-e1b5-4cf6-8618-67c1cc9df971 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.162597 Oct 06 14:14:32.399724 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3740/7490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:32 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:33.423301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:33.423970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:33.430758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:33.431246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:33.431687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:33.432384 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:33.432844 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:33.433276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:33.565502 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:33.573397 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c3ed14f8-ead7-4e46-bec7-6d96e2b54f16 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.153976 Oct 06 14:14:33.573999 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3751/7491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:33 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:34.597988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:34.598541 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:34.605601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:34.606135 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:34.606590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:34.607296 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:34.607764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:34.608205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:34.738558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:34.746261 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c701fb06-4996-4e75-a75a-e29de439056e tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.152272 Oct 06 14:14:34.746846 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3741/7492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:34 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:35.770251 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:35.770874 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:35.778715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:35.779230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:35.779658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:35.780363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:35.780823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:35.781254 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:35.929190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:35.937227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-67be750e-27c7-45ee-a5f0-e4be48092d55 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1692 microversion: 2.1 time: 0.170854 Oct 06 14:14:35.937834 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3752/7493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:35 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:36.961729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:36.962376 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:36.969860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:36.970360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:36.970813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:36.971522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:36.971987 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:36.972427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:37.103273 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:37.111072 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c6c35131-6e07-4515-be47-afce0a7f35a0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1669 microversion: 2.1 time: 0.153605 Oct 06 14:14:37.111648 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3742/7494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:36 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:14:38.208301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:14:38.211083 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:38.218912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:38.219414 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:38.219861 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:38.220586 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:38.221046 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:38.221473 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:38.285116 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41620be8-76bd-4ccf-9c04-c733058792d2 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action" status: 200 len: 35294 microversion: 2.1 time: 0.080744 Oct 06 14:14:38.285830 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3753/7495] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:14:38 2022] POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action => generated 35294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:14:38.298902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:14:38.308214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:38.308734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:38.309201 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:38.342049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Going to try to start instance {{(pid=129614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 14:14:38.391479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b68892ee-ccf9-4e0b-a79e-9bb0018d798f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action" status: 202 len: 0 microversion: 2.1 time: 0.096509 Oct 06 14:14:38.392397 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3743/7496] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:14:38 2022] POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:14:38.401077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:38.402614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:38.410006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:38.410507 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:38.410956 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:38.411818 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:38.412230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:38.413460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:38.549370 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:38.557292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7324a045-134d-4f30-b1f0-04804d15951a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1678 microversion: 2.1 time: 0.160643 Oct 06 14:14:38.557935 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3754/7497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:38 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:39.582962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:39.583962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:39.590824 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:39.591331 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:39.591792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:39.592507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:39.592986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:39.593435 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:39.733589 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:39.741295 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ba6dd6ea-c0af-46ff-81df-dabaf628e992 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1678 microversion: 2.1 time: 0.163439 Oct 06 14:14:39.742002 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3744/7498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:39 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:14:40.764609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:14:40.765272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:14:40.775521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:40.776040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:40.776524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:40.777230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:14:40.777689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:14:40.778145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:14:40.908266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:14:40.916055 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-13199708-62a2-42c7-b758-e48b5b15d92a tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1682 microversion: 2.1 time: 0.155346 Oct 06 14:14:40.916646 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3755/7499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:14:40 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:13.131880 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:13.134143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:13.136670 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=20 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:13.137339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:13.143592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:13.144091 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:13.144536 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:13.145242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:13.145709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:13.146171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:13.217226 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6865324-44b1-4d85-9805-64b8f9ba3fe1 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action" status: 200 len: 59859 microversion: 2.1 time: 0.088607 Oct 06 14:15:13.217946 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3745/7500] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:15:13 2022] POST /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92/action => generated 59859 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:15:30.779164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:30.779681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:30.785711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92", "tag": "64ec2a9e-497d-4c02-a652-2e92ab783081"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:30.792147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=22 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:30.792994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:30.797192 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:30.798002 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=4 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:30.799154 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:15:30.799337 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:15:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:15:30.800899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:30.801082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:30.801600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:30.802339 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:30.802796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:30.803219 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:30.814190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:30.814684 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:30.815349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:30.827949 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] Creating event network-changed:64ec2a9e-497d-4c02-a652-2e92ab783081 for instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 on n-h2-860556-1 Oct 06 14:15:30.833340 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-aad72f6f-621d-48c2-b8cb-a388af17eb94 req-d732f5f1-3212-4873-8678-73193b820c18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051589 Oct 06 14:15:30.834515 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3746/7501] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:15:30.838609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:15:30.930756 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-301eea2a-f513-4947-b302-ca40fd4e1116 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 204 len: 0 microversion: 2.1 time: 0.155163 Oct 06 14:15:30.934976 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3756/7502] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:15:30 2022] DELETE /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:15:30.941043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:30.941776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:30.948568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:30.949071 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:30.949530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:30.950506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:30.950776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:30.951226 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:31.089644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:31.098487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4521e9d9-d252-45e9-ae3e-167a2febbe9c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1688 microversion: 2.1 time: 0.161910 Oct 06 14:15:31.099171 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3747/7503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:30 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:32.122905 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:32.123620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:32.131433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:32.131921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:32.132359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:32.133055 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:32.133509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:32.133979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:32.266066 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:32.273891 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e00a92a-fd85-40b3-b496-3c185681cf8b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1688 microversion: 2.1 time: 0.155245 Oct 06 14:15:32.274518 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3757/7504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:32 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:33.197387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92", "name": "network-vif-deleted", "tag": "64ec2a9e-497d-4c02-a652-2e92ab783081"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:33.208816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:33.209588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:33.210070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:33.221901 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] Creating event network-vif-deleted:64ec2a9e-497d-4c02-a652-2e92ab783081 for instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 on n-h2-860556-1 Oct 06 14:15:33.227326 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-98380d12-8e25-4791-b1df-b230f2f6d4a8 req-8a6570dd-ba56-4963-843b-499c5d8b9664 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Oct 06 14:15:33.228321 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3748/7505] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:15:33.299535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:33.300329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:33.307647 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:33.308230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:33.308824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:33.309663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:33.310221 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:33.310676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:33.342940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:33.343444 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:33.343982 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:33.344459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lazy-loading 'fault' on Instance uuid 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:15:33.387136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:33.395402 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cbae680a-3993-496b-aa91-89d7619a8835 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 200 len: 1355 microversion: 2.1 time: 0.101363 Oct 06 14:15:33.395963 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3758/7506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:33 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:34.421872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:34.422595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:34.429117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:34.429616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:34.430097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:34.430805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:34.431307 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:34.431816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:34.446516 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] HTTP exception thrown: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Request method failure captured: Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 HTTP/1.1 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPuDWL-UWhYMcmWgs3jzXMCxNi8alhxBbN1wmuqzbPlP5iKXocAdygFiumlRCkutGYvUiFzIWFeffXG8naPXDXC5CWrev7h9jWumPyE4FBNMlqsTiAz-jzZdJmbDMuR3gZiMmrQLTdf0s6kZsjVKdeYj_pEXNlmdUJdOL0F6Gntwmwf8 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fc9f3196546446f99cad542e4b67ebb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}] Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: f599cb7064df49f59cb1459e1262830a Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92'} Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:15:34.448284 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Returning 404 to user: Instance 26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3642dc78-c5a4-4897-b9a0-55c908a14f66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92" status: 404 len: 111 microversion: 2.1 time: 0.032856 Oct 06 14:15:34.453775 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3749/7507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:34 2022] GET /compute/v2.1/servers/26c7c7d5-68c0-4a7f-ba76-6cd999d6ef92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:15:37.449249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-1dfc8c31-2180-414b-ad08-49fd562b644b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '.version_select at 0x7f7d3de48310>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:37.455155 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1dfc8c31-2180-414b-ad08-49fd562b644b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [c3929226-24b4-48bb-a426-f89436fcc398] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:15:38.462885 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-1dfc8c31-2180-414b-ad08-49fd562b644b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [c3929226-24b4-48bb-a426-f89436fcc398] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49930. Oct 06 14:15:38.484435 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-1dfc8c31-2180-414b-ad08-49fd562b644b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-474039896" status: 202 len: 0 microversion: 2.1 time: 1.038346 Oct 06 14:15:38.485023 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3759/7508] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 14:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-474039896 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:15:38.518315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9067fb00-6ba6-45a6-aa12-1411c3946a6c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: .version_select at 0x7f7d3de2cee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-877900275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuozVY63LmcLWeTchLx5EYwoiYcNM3edSbnwJFs6wSX+/b5Fc7yA7UyRzxiWLOndURA7tArpZNWrife3GiJXVJ7nAmeQOSUe2jngSftv4uETZj0Zy6JdTIShuxOrFwIiQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:38.536808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9067fb00-6ba6-45a6-aa12-1411c3946a6c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:15:38.542337 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-9067fb00-6ba6-45a6-aa12-1411c3946a6c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:15:38.570709 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9067fb00-6ba6-45a6-aa12-1411c3946a6c tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056806 Oct 06 14:15:38.571338 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3750/7509] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:15:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:15:44.297024 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:44.301519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1450145151", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "networks": [{"uuid": "1f68cbaa-8976-4110-a450-290aa90e1d0a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-877900275", "security_groups": [{"name": "tempest-secgroup-smoke-1255596598"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:44.428800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] validate_networks() for [('1f68cbaa-8976-4110-a450-290aa90e1d0a', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:15:44.879071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:15:44.879510 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:15:44.879988 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:15:44.880409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:15:44.881057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:15:44.892794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:44.893421 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:44.893954 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:44.894693 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:44.895153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:44.895758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:44.925771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:15:44.932531 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Getting quotas for user f599cb7064df49f59cb1459e1262830a and project 6fc9f3196546446f99cad542e4b67ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:15:44.954491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:15:44.956846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:15:45.020870 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:15:46.029482 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [6ccedf9c-d2db-44b7-9b66-7fb575e9cc62] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49980. Oct 06 14:15:46.034702 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2d1c82c5-96bd-4051-a8dc-4eeb3ba39617 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.740150 Oct 06 14:15:46.035598 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3760/7510] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:15:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:15:46.045302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:46.050184 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-14743bbe-d1d8-4b0c-be4d-502673fb6642 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:46.051017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-14743bbe-d1d8-4b0c-be4d-502673fb6642 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:46.112180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-14743bbe-d1d8-4b0c-be4d-502673fb6642 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:46.119913 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-14743bbe-d1d8-4b0c-be4d-502673fb6642 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1266 microversion: 2.1 time: 0.076347 Oct 06 14:15:46.120700 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3751/7511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:46 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:47.145096 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:47.145724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:47.152512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:47.153002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:47.153437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:47.154524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:47.154975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:47.155398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:47.225284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:47.233643 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a18e4edd-64ae-46c8-b53d-48941a837b66 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1318 microversion: 2.1 time: 0.094535 Oct 06 14:15:47.235318 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3761/7512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:47 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:48.257858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:48.258574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:48.266440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:48.266943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:48.267397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:48.268127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:48.268580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:48.269022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:48.510720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:48.519824 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-1a609419-c3ec-4433-ab4e-7888f3b89957 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.266229 Oct 06 14:15:48.521155 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3752/7513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:48 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:49.191134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08dc42e-10ba-438c-a2c1-7b38cbd5a150", "tag": "a111c807-6c59-4d9a-b15a-1e970faf2eb5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:49.200846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:49.201326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:49.201840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:49.483780 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] Creating event network-changed:a111c807-6c59-4d9a-b15a-1e970faf2eb5 for instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 on n-h2-860556-1 Oct 06 14:15:49.488768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-dbbf0383-2198-4e6b-a10e-6363ad74dfa4 req-0764c753-e149-47ca-9d25-804e5281f73d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361593 Oct 06 14:15:49.489387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3762/7514] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:15:49.543472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:49.544078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:49.551179 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:49.551675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:49.552124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:49.552841 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:49.553310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:49.553770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:49.716357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:49.726811 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0a24347a-69ae-40e1-93ea-4a4c303486d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.187150 Oct 06 14:15:49.727501 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3753/7515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:49 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:50.752409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:50.753019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:50.759386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:50.759855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:50.760291 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:50.760981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:50.761439 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:50.761895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:50.894609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:50.902310 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e99cacb-34aa-402a-939f-9e804678a855 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.155093 Oct 06 14:15:50.902890 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3763/7516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:50 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:51.927584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:51.927584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:51.934062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:51.934574 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:51.935721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:51.935721 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:51.936206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:51.936646 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:52.141278 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:52.148989 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15818070-d8e5-4263-af9b-9655eeeab721 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.227451 Oct 06 14:15:52.149571 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3754/7517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:51 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:53.174342 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:53.174798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:53.181627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:53.182146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:53.182581 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:53.183272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:53.183736 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:53.184142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:53.318895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:53.326801 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-de0199ba-8892-4e38-acfd-ea66596d1cad tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.158448 Oct 06 14:15:53.327377 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3764/7518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:53 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:54.350597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:54.351230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:54.358126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:54.358629 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:54.359117 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:54.359831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:54.360343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:54.360823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:54.496342 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:54.504101 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-37a568e1-076f-4537-8499-ba444c496731 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.157424 Oct 06 14:15:54.504697 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3755/7519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:54 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:55.369967 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:55.370716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:55.423654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08dc42e-10ba-438c-a2c1-7b38cbd5a150", "name": "network-vif-plugged", "status": "completed", "tag": "a111c807-6c59-4d9a-b15a-1e970faf2eb5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:55.435565 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:55.436052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:55.436604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:55.448277 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] Creating event network-vif-plugged:a111c807-6c59-4d9a-b15a-1e970faf2eb5 for instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 on n-h2-860556-1 Oct 06 14:15:55.453328 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-086fe5d3-6b5c-4493-b1ef-195d2e29c0ad req-fcb14ce0-7639-48e4-9c7f-3f026e99fff4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088599 Oct 06 14:15:55.454582 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3765/7520] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:15:55.527928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:55.528600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:55.535681 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:55.536254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:55.536808 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:55.537631 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:55.538196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:55.538710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:55.711355 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:55.718982 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a9cd87cb-d31a-4845-83b7-25f47798ae39 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.195158 Oct 06 14:15:55.719562 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3756/7521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:55 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:56.743673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:56.744283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:56.753316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:56.753829 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:56.754270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:56.754961 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:56.755415 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:56.755841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:56.893365 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:56.901181 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a478531a-68f1-41e2-8c7b-9901e8f9d2d0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1392 microversion: 2.1 time: 0.162625 Oct 06 14:15:56.901994 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3766/7522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:56 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:57.924521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:57.925174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:57.927118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=6 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:15:57.933268 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:57.933798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:57.934249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:57.934953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:57.935427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:57.935863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:58.066487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:58.074179 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f3cc979a-d093-4ffd-9952-69838b89b500 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1564 microversion: 2.1 time: 0.153586 Oct 06 14:15:58.074753 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3757/7523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:57 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:58.096981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:58.097595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:58.103569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:58.104052 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:58.104489 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:58.105179 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:58.105633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:58.106111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:58.246073 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:15:58.254561 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-15da2607-f676-424e-bb9d-1eec53e1639f tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1564 microversion: 2.1 time: 0.161914 Oct 06 14:15:58.255130 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3767/7524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:58 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:15:59.864121 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:15:59.864991 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:15:59.865953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08dc42e-10ba-438c-a2c1-7b38cbd5a150", "tag": "a111c807-6c59-4d9a-b15a-1e970faf2eb5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:15:59.871861 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:59.872607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:59.873062 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:59.873814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:59.874484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:59.875077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:59.876614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:15:59.877105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:15:59.877548 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:15:59.890076 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] Creating event network-changed:a111c807-6c59-4d9a-b15a-1e970faf2eb5 for instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 on n-h2-860556-1 Oct 06 14:15:59.895227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-05faa047-3d3a-49b1-a310-a998f89b8989 req-f8fd9f70-0f36-4ccf-92e2-bc483ef95f3b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032904 Oct 06 14:15:59.895848 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3768/7525] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:16:00.094906 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:16:00.103563 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-8ebb9f42-9d78-436e-97f5-3f959fa2ea56 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1564 microversion: 2.1 time: 0.244677 Oct 06 14:16:00.104157 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3758/7526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:15:59 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:16:33.403518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:16:33.404270 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=38 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:16:33.598512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:16:33.600899 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:16:33.609815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:16:33.610306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:16:33.610740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:16:33.611427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:16:33.611879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:16:33.612301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:16:33.678537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e83f5a65-6518-4146-a48d-6599b6311b38 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action" status: 200 len: 24576 microversion: 2.1 time: 0.277392 Oct 06 14:16:33.679084 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3769/7527] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:16:33 2022] POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action => generated 24576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:17:03.939928 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:03.940560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:03.942926 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:03.943755 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=42 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:03.949785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:03.950302 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:03.950767 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:03.951487 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:03.951964 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:03.953005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:03.976922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lazy-loading 'flavor' on Instance uuid e08dc42e-10ba-438c-a2c1-7b38cbd5a150 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:17:04.051404 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-109c9ee9-47e2-4dc9-8d0f-df21894e58f7 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action" status: 202 len: 0 microversion: 2.1 time: 0.116251 Oct 06 14:17:04.052073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3759/7528] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:17:03 2022] POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:17:04.063156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:04.063951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:04.067200 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:04.067973 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:04.078623 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:04.079120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:04.079567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:04.080286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:04.080750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:04.081185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:04.220321 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:04.228240 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-930c6636-07e8-434b-8128-018fcf78e350 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1691 microversion: 2.1 time: 0.171435 Oct 06 14:17:04.228816 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3770/7529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:04 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:05.256075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:05.256978 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:05.263378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:05.263881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:05.264339 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:05.265059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:05.265551 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:05.266094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:05.406424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:05.417041 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-08080839-1416-459a-9aa4-fd117953c785 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1691 microversion: 2.1 time: 0.166439 Oct 06 14:17:05.417906 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3760/7530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:05 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:06.441986 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:06.442602 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:06.450773 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:06.451644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:06.452445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:06.453168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:06.453658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:06.454431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:06.600295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:06.608131 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5be4acb0-8e33-4ef2-b523-affebd82a6da tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1674 microversion: 2.1 time: 0.170094 Oct 06 14:17:06.609290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3771/7531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:06 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:07.709023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:07.711617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:07.719052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.719552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.720009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:07.720717 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.721186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.721628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:07.783720 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ab8cb63f-cbed-4355-a38e-60eb4df613ef tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action" status: 200 len: 38445 microversion: 2.1 time: 0.078403 Oct 06 14:17:07.784409 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3761/7532] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:17:07 2022] POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action => generated 38445 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:17:07.796652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:07.797332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:07.805234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.805912 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.806566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:07.807468 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.807935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.808367 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:07.877236 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3cc3708e-bcfe-476a-8be8-61a03107fde4 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action" status: 202 len: 0 microversion: 2.1 time: 0.084560 Oct 06 14:17:07.877909 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3772/7533] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:17:07 2022] POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:17:07.886971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:07.887734 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:07.896217 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.896738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.897197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:07.897953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:07.898429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:07.898877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:08.099044 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:08.106991 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-54379c6e-f501-4a55-8b66-4edf55221468 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1680 microversion: 2.1 time: 0.224188 Oct 06 14:17:08.107814 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3762/7534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:07 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:17:09.133949 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:09.134649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:09.141536 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:09.142036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:09.142479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:09.143167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:09.143619 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:09.144043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:09.279373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:09.287359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-120e1113-31bf-4201-bd0c-fae75285996b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1680 microversion: 2.1 time: 0.158509 Oct 06 14:17:09.287943 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3773/7535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:09 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:10.311033 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:10.311668 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:10.319635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:10.320306 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:10.320907 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:10.321760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:10.322243 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:10.322696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:10.462228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:10.473858 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5973a31c-2636-4b77-a305-14cf014fcf2b tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1683 microversion: 2.1 time: 0.166624 Oct 06 14:17:10.474560 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3763/7536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:10 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:10.576456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:10.579305 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:10.586676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:10.587168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:10.587606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:10.588300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:10.588756 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:10.589186 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:10.649297 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4d00f378-47c2-4e26-8055-40706e3c7223 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action" status: 200 len: 38445 microversion: 2.1 time: 0.076550 Oct 06 14:17:10.650447 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3774/7537] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:17:10 2022] POST /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150/action => generated 38445 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 14:17:11.659289 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:11.660420 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:11.661409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08dc42e-10ba-438c-a2c1-7b38cbd5a150", "tag": "a111c807-6c59-4d9a-b15a-1e970faf2eb5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:11.663399 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:17:11.663545 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 (ip 10.222.0.26) !!! Oct 06 14:17:11.674103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:11.674596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:11.675037 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:11.678813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:11.679346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:11.679813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:11.680561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:11.681046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:11.681500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:11.691301 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] Creating event network-changed:a111c807-6c59-4d9a-b15a-1e970faf2eb5 for instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 on n-h2-860556-1 Oct 06 14:17:11.696296 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-b81a6dfe-1133-412f-a622-73cd911318e7 req-b330c86d-36cc-465d-99b7-f0d6445121bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038895 Oct 06 14:17:11.697251 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3775/7538] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:17:11.715207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:17:11.807975 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3b491808-2607-436a-afe6-8a096cdcb5e6 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 204 len: 0 microversion: 2.1 time: 0.153112 Oct 06 14:17:11.808883 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3764/7539] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:17:11 2022] DELETE /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:17:11.818493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:11.819595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:11.826380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:11.826966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:11.828610 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:11.829407 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:11.829977 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:11.830684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:12.004481 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:12.012709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-20a2a401-982e-43a8-be15-1465f61f176d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1689 microversion: 2.1 time: 0.199115 Oct 06 14:17:12.013336 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3776/7540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:11 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:13.038914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:13.039656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:13.046480 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:13.046972 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:13.047427 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:13.048134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:13.048600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:13.049041 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:13.245762 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:13.253772 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-96addf3a-8f3b-49d8-bf91-fd245107b44d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1689 microversion: 2.1 time: 0.219220 Oct 06 14:17:13.254357 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3765/7541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:13 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:14.231373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08dc42e-10ba-438c-a2c1-7b38cbd5a150", "name": "network-vif-deleted", "tag": "a111c807-6c59-4d9a-b15a-1e970faf2eb5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:14.247529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:14.248003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:14.248428 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:14.262282 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] Creating event network-vif-deleted:a111c807-6c59-4d9a-b15a-1e970faf2eb5 for instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 on n-h2-860556-1 Oct 06 14:17:14.268420 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-64147e11-63c8-42df-a65a-4aae6a1a030e req-f96424f9-642f-42c2-a858-9819d1279ec1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044757 Oct 06 14:17:14.269039 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3777/7542] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:17:14.282187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:14.283332 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:14.294429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:14.294954 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:14.296910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:14.296910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:14.297438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:14.298001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:14.375350 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f599cb7064df49f59cb1459e1262830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc9f3196546446f99cad542e4b67ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:14.386572 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0fbae93f-8356-4058-b770-3f0d5d503e9d tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 200 len: 1351 microversion: 2.1 time: 0.111824 Oct 06 14:17:14.387180 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3766/7543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:14 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:15.411760 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:15.412488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] [instance: e08dc42e-10ba-438c-a2c1-7b38cbd5a150] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:15.419514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:15.419997 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:15.420460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:15.421706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:15.422184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:15.422609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:15.436112 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] HTTP exception thrown: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Request method failure captured: Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 HTTP/1.1 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPuDWL-UWhYMcmWgs3jzXMCxNi8alhxBbN1wmuqzbPlP5iKXocAdygFiumlRCkutGYvUiFzIWFeffXG8naPXDXC5CWrev7h9jWumPyE4FBNMlqsTiAz-jzZdJmbDMuR3gZiMmrQLTdf0s6kZsjVKdeYj_pEXNlmdUJdOL0F6Gntwmwf8 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fc9f3196546446f99cad542e4b67ebb", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fc9f3196546446f99cad542e4b67ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fc9f3196546446f99cad542e4b67ebb"}]}] Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 6fc9f3196546446f99cad542e4b67ebb Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-28227239 Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: f599cb7064df49f59cb1459e1262830a Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestNetworkAdvancedServerOps-28227239-project Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'e08dc42e-10ba-438c-a2c1-7b38cbd5a150'} Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:17:15.438459 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Returning 404 to user: Instance e08dc42e-10ba-438c-a2c1-7b38cbd5a150 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-41881ec3-7e6f-4c62-b7f9-fa9c1808e4e0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150" status: 404 len: 111 microversion: 2.1 time: 0.032968 Oct 06 14:17:15.443891 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3778/7544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:15 2022] GET /compute/v2.1/servers/e08dc42e-10ba-438c-a2c1-7b38cbd5a150 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:17:18.957858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-003a18c7-8d27-4eea-b3a2-6bcc5e09ffb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] Calling method '.version_select at 0x7f7d3def2e50>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:18.987823 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-003a18c7-8d27-4eea-b3a2-6bcc5e09ffb0 tempest-TestNetworkAdvancedServerOps-28227239 tempest-TestNetworkAdvancedServerOps-28227239-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-877900275" status: 202 len: 0 microversion: 2.1 time: 0.033787 Oct 06 14:17:18.989596 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3767/7545] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Oct 6 14:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-877900275 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:17:30.621629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=18 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:30.622916 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:30.843681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc5ff977-dfa2-4d01-873c-3097169aaf9c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'create', calling method: .version_select at 0x7f7d3e3494c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1768293102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoW3w0wYryYrT10zXvA0XjW18c72f2hxxDXzT9/RR4k2BcPy8YN5RPIsUwyxSD7dAZRdgObEnSAEmHEZ3E8q8iXuoVtNLbckqjUQif+TWm7G8vptAYqHr+2qov12UTZHA=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:30.860987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bc5ff977-dfa2-4d01-873c-3097169aaf9c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:17:30.866918 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-bc5ff977-dfa2-4d01-873c-3097169aaf9c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for user 687835d7c64c4056a18c01d1ae9c3bc7 and project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:17:30.903550 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc5ff977-dfa2-4d01-873c-3097169aaf9c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287421 Oct 06 14:17:30.904191 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3779/7546] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:17:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:17:31.932358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:31.933122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:31.937626 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-932554219", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1768293102", "security_groups": [{"name": "tempest-secgroup-smoke-1818230999"}], "networks": [{"uuid": "991ea55f-2773-45be-9184-e28d1c3c344d"}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:32.052440 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] validate_networks() for [('991ea55f-2773-45be-9184-e28d1c3c344d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:17:32.544913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:17:32.545364 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:17:32.546119 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:17:32.546558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:17:32.546997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:17:32.556563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:32.557065 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:32.557519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:32.558354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:32.558900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:32.559344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:32.578912 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:17:32.584848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for user 687835d7c64c4056a18c01d1ae9c3bc7 and project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:17:32.599013 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:17:32.601347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:17:32.654065 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b971a61d-a2a7-4944-871b-e4fc1568dec3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723296 Oct 06 14:17:32.654889 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3768/7547] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:17:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:17:32.669242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dde08833-ee97-4b87-9ef1-d42b3483dc5f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:32.670813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dde08833-ee97-4b87-9ef1-d42b3483dc5f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:32.727578 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dde08833-ee97-4b87-9ef1-d42b3483dc5f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:32.735279 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dde08833-ee97-4b87-9ef1-d42b3483dc5f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1246 microversion: 2.1 time: 0.072140 Oct 06 14:17:32.735882 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3780/7548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:32 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:33.759492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7f062ad5-d016-4deb-a4eb-9cadc505c1e3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:33.760697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7f062ad5-d016-4deb-a4eb-9cadc505c1e3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:33.827606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7f062ad5-d016-4deb-a4eb-9cadc505c1e3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:33.835124 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7f062ad5-d016-4deb-a4eb-9cadc505c1e3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1246 microversion: 2.1 time: 0.081562 Oct 06 14:17:33.836084 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3769/7549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:33 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:34.859288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5f748565-7ae3-4e2c-b80a-29718d604e8f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:34.859898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5f748565-7ae3-4e2c-b80a-29718d604e8f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:34.917679 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5f748565-7ae3-4e2c-b80a-29718d604e8f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:34.925359 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5f748565-7ae3-4e2c-b80a-29718d604e8f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1246 microversion: 2.1 time: 0.070402 Oct 06 14:17:34.926527 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3781/7550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:34 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:17:35.960276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a82f6cba-890e-4533-9f6e-33a2cda5c407 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:35.962229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a82f6cba-890e-4533-9f6e-33a2cda5c407 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:36.017890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a82f6cba-890e-4533-9f6e-33a2cda5c407 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:36.025349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a82f6cba-890e-4533-9f6e-33a2cda5c407 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1246 microversion: 2.1 time: 0.073035 Oct 06 14:17:36.025969 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3770/7551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:35 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:37.049673 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:37.050317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:37.057969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:37.058458 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:37.058898 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:37.059592 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:37.060047 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:37.060532 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:37.121884 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:37.129678 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d96f1e88-6093-4193-9824-89028652310c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1250 microversion: 2.1 time: 0.084068 Oct 06 14:17:37.130287 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3782/7552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:37 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:38.152585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:38.153221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:38.162513 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:38.163297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:38.163796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:38.164534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:38.165023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:38.165471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:38.233312 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:38.242881 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea2b007a-9e56-4bac-9632-56f031db570d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1304 microversion: 2.1 time: 0.094002 Oct 06 14:17:38.243482 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3771/7553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:38 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:39.267106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:39.267674 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:39.274605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:39.275075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:39.275509 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:39.276212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:39.276662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:39.277089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:39.338506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:39.357455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:39.358328 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:39.359472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:39.378388 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] Creating event network-changed:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:17:39.395831 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5d61f6ab-07ad-4405-bbe3-82c66ca9179b req-ba86c4df-4164-4a7c-a56e-f5b04a05d400 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061638 Oct 06 14:17:39.396863 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3772/7554] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:17:39.429889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:39.438644 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5df6ac6f-ff18-40ae-b3b6-ee5cf15d176d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.176093 Oct 06 14:17:39.439235 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3783/7555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:39 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:40.462239 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:40.462958 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:40.469564 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:40.470104 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:40.470647 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:40.471320 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:40.471800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:40.472300 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:40.610546 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:40.618451 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b9d7a897-8975-4b1d-be65-0da9d09f2cfa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.161588 Oct 06 14:17:40.619048 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3773/7556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:40 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:41.643043 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:41.643687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:41.650663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:41.651146 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:41.651580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:41.652352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:41.652804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:41.653230 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:42.149725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:42.158433 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e4eed62f-9967-43f2-aff7-71cfe29157af tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.519796 Oct 06 14:17:42.159010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3784/7557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:41 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:43.182423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:43.183050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:43.185947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:43.191726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:43.192224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:43.192672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:43.193379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:43.193908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:43.194351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:43.325830 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:43.334076 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2138dba1-8757-490a-93d8-eae4418fb0e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.155530 Oct 06 14:17:43.334653 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3774/7558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:43 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:44.017467 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "name": "network-vif-plugged", "status": "completed", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:44.029405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:44.029930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:44.030375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:44.044960 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] Creating event network-vif-plugged:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:17:44.051561 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-4ca4eb42-91fa-4ecf-852d-003692d147d5 req-7766ee3a-05ac-4596-abb6-e6dbc8132867 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037627 Oct 06 14:17:44.052548 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3785/7559] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:17:44.356446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:44.357259 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:44.364941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:44.365444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:44.365930 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:44.366643 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:44.367112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:44.367592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:44.501351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:44.509072 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-343e3fe5-ca07-406d-8fed-af9dec087199 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.156496 Oct 06 14:17:44.509651 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3775/7560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:44 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:45.529694 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=8 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:45.534666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:45.535373 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:45.541871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:45.542357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:45.542791 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:45.543474 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:45.543923 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:45.544343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:45.684813 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:45.692768 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-65b7e675-1ad8-476c-b024-ffb3995b1517 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1372 microversion: 2.1 time: 0.164097 Oct 06 14:17:45.693344 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3786/7561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:45 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:46.716522 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:46.717082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:46.719837 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:17:46.725195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:46.725698 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:46.726178 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:46.726887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:46.727360 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:46.727807 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:46.865167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:46.873117 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-13bc35c6-5e30-4643-ae9b-c1582ceefb8c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1555 microversion: 2.1 time: 0.160628 Oct 06 14:17:46.873689 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3776/7562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:46 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:46.895794 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:17:46.896408 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:17:46.903187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:46.903675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:46.904119 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:46.904810 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:46.905275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:46.905703 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:47.039767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:17:47.048141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-042643ce-1527-4ead-9dcc-6b8b61592452 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1555 microversion: 2.1 time: 0.156178 Oct 06 14:17:47.048711 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3787/7563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:17:46 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:17:48.717133 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:17:48.728022 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:17:48.728628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:17:48.729154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:17:48.741029 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] Creating event network-changed:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:17:48.746349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5d90e3a5-2d41-4ca3-bcc5-5066bc8f69e9 req-89db44aa-1651-4a7c-9737-51e73f89c444 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032985 Oct 06 14:17:48.747062 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3777/7564] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:20:15.109931 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:20:15.111138 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:20:15.111739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:15.112783 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=32 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:15.113387 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:20:15.113537 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action (ip 10.222.0.26) !!! Oct 06 14:20:15.114707 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:20:15.114857 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action (ip 10.222.0.26) !!! Oct 06 14:20:15.115709 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:20:15.115843 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action (ip 10.222.0.26) !!! Oct 06 14:20:15.120151 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:20:15.120692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:15.132659 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:15.133153 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:15.133595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:15.134343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:15.134804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:15.135245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:15.160232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lazy-loading 'flavor' on Instance uuid 0d177da1-be3c-4754-93ac-575b1ebc2d03 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:20:15.484457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ab2b8047-5845-4fdb-a2ff-8f937d7361dc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action" status: 202 len: 0 microversion: 2.1 time: 0.375997 Oct 06 14:20:15.485094 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3788/7565] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:20:15 2022] POST /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:20:15.491766 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:20:15.492591 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:20:15.493218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:15.493995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=36 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:15.495082 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:20:15.495502 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 (ip 10.222.0.26) !!! Oct 06 14:20:15.498008 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:20:15.498140 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 (ip 10.222.0.26) !!! Oct 06 14:20:15.506132 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:15.506876 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:15.522917 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:15.523417 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:15.523868 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:15.524584 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:15.525057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:15.525500 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:15.716791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:15.724701 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ae9762f4-a9fc-446f-ae38-a879dcdec742 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.235019 Oct 06 14:20:15.725282 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3778/7566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:15 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:16.751176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:16.751839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:16.760774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:16.761266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:16.761705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:16.762451 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:16.762906 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:16.763332 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:16.767186 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50366. Oct 06 14:20:16.770230 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50368. Oct 06 14:20:16.904653 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:16.910404 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-70adba2e-3027-4584-8a03-55246fd2a914 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.165396 Oct 06 14:20:16.910986 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3789/7567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:16 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:17.934246 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:17.934911 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:17.944939 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:17.945444 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:17.945951 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:17.946673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:17.947150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:17.947593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:17.952193 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50374. Oct 06 14:20:17.953009 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50372. Oct 06 14:20:18.086058 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:18.094093 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e64cf16f-e068-4759-b33f-ab75cb3fdfbd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.163715 Oct 06 14:20:18.094683 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3779/7568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:17 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:19.118476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:19.119106 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:19.125998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:19.126491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:19.126933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:19.127630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:19.128089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:19.128521 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:19.260609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:19.268536 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c4b23f3d-bfaf-41b6-94ee-9b78ebe7b73e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.154592 Oct 06 14:20:19.269114 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3790/7569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:19 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:20.292265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:20.293124 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:20.299902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:20.300406 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:20.300867 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:20.301585 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:20.302120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:20.302552 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:20.437591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:20.445487 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ea84f6fc-9ea1-4380-a532-0f8f1bef333c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.157186 Oct 06 14:20:20.446102 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3780/7570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:20 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:21.469855 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:21.470479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:21.478142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:21.478638 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:21.479082 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:21.479780 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:21.480241 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:21.480671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:21.616031 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:21.623803 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-386d68b8-f37a-4c78-9e35-a16e12a08324 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.158760 Oct 06 14:20:21.624385 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3791/7571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:21 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:22.647283 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:22.647896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:22.654946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:22.655453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:22.655908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:22.656653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:22.657150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:22.657613 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:22.794791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:22.803109 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a90ab078-db2c-43bf-8b6c-5f2f6ba2639c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.159752 Oct 06 14:20:22.803690 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3781/7572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:22 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:23.827109 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:23.827730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:23.835768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:23.836257 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:23.836699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:23.837399 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:23.838134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:23.838566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:23.969223 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:23.977144 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a0d5e4ab-91e7-444e-9258-d770365e0249 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.154011 Oct 06 14:20:23.977723 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3792/7573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:23 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:25.001008 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:25.001635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:25.008891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:25.009402 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:25.009890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:25.010610 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:25.011078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:25.011519 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:25.148015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:25.156026 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-83234ba0-e730-43c4-9eec-58bd04efa17d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.158997 Oct 06 14:20:25.156637 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3782/7574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:24 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:26.179362 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:26.179981 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:26.187049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:26.187534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:26.187969 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:26.188656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:26.189115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:26.189552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:26.339518 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:26.348646 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-838b52a4-aaa5-48a6-b030-163a6e5184fc tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.173100 Oct 06 14:20:26.349234 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3793/7575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:26 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:27.371509 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:27.372144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:27.379202 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:27.380251 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:27.380706 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:27.381415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:27.381918 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:27.382358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:27.515763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:27.524434 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d457630f-e9e6-4840-9cdb-7ef87baf99c3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1700 microversion: 2.1 time: 0.156833 Oct 06 14:20:27.525006 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3783/7576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:27 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:28.546671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:28.547295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:28.554279 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:28.554763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:28.555205 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:28.555920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:28.556381 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:28.556807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:28.693441 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:28.701276 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8fbc101e-7793-4ba6-bef1-52cd9c9c3531 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1700 microversion: 2.1 time: 0.158498 Oct 06 14:20:28.701877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3794/7577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:28 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:29.725400 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:29.726066 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:29.733006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:29.733545 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:29.734039 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:29.734760 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:29.735242 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:29.735692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:29.872366 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:29.880284 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-086dd9dd-448c-418a-a1d0-6b936ee4e5d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1700 microversion: 2.1 time: 0.159302 Oct 06 14:20:29.880868 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3784/7578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:29 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:30.897725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "name": "network-vif-plugged", "status": "completed", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:20:30.903270 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:30.904695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:30.909193 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:30.909776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:30.910417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:30.914120 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:30.914864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:30.915507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:30.916274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:30.916751 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:30.917197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:30.922604 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] Creating event network-vif-plugged:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:20:30.928548 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-eb184ba0-48cd-4661-bd0f-1b5135c57085 req-82deae79-9726-4495-bb3d-11dcffd008ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Oct 06 14:20:30.929285 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3795/7579] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:20:31.063245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:31.071576 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7cad8320-d6a4-40f8-8b1b-8951304a996e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1700 microversion: 2.1 time: 0.172213 Oct 06 14:20:31.072584 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3785/7580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:30 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1700 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:32.096465 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:32.097183 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:32.103739 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:32.104227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:32.104675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:32.105380 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:32.105999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:32.106434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:32.245508 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:32.253898 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bffebf58-6e99-4b9c-96bc-d9889c59e435 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.162423 Oct 06 14:20:32.254501 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3796/7581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:32 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:33.278313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:33.278947 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:33.288944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:33.289473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:33.290023 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:33.290785 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:33.291267 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:33.291758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:33.445103 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:33.453724 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-571bcec1-3a47-48ab-8dfd-2c4fb67eedaa tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.179113 Oct 06 14:20:33.454339 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3786/7582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:33 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:34.483734 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:34.485023 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:34.492781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:34.493910 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:34.494272 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:34.495180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:34.495648 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:34.496087 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:34.656777 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:34.668034 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b0debc76-b91a-467e-9f3b-4de892677334 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.190195 Oct 06 14:20:34.668373 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3797/7583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:34 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:35.692297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:35.693075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:35.700070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:35.700596 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:35.701059 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:35.701862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:35.702301 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:35.702790 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:35.849277 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:35.857987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9a6adc35-a93c-4f1d-9690-8d746fb83ae2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.170490 Oct 06 14:20:35.859313 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3787/7584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:35 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:36.883325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:36.883936 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:36.891352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:36.891846 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:36.892294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:36.893014 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:36.893766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:36.894378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:37.059363 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:37.068614 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6bb74187-9f4f-4e24-b74e-37849c01b0f5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.189595 Oct 06 14:20:37.069431 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3798/7585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:36 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:38.098385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:38.099140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:38.108006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:38.108530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:38.108997 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:38.109745 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:38.110238 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:38.110692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:38.311624 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:38.321796 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-81cc4818-c346-475f-b60a-6a2679a5dc0e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.228379 Oct 06 14:20:38.322687 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3788/7586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:38 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:39.348086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:39.349432 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:39.358848 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:39.359490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:39.360033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:39.360759 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:39.361220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:39.361652 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:39.533325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:39.542396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-0dcb9881-b94e-47ff-b8e5-5b68945a471c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.197999 Oct 06 14:20:39.543010 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3799/7587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:39 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:40.565877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:40.568169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:40.584853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:40.585608 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:40.586390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:40.587314 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:40.588043 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:40.588503 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:40.738528 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:40.746979 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-10a8fb94-acaf-4496-b57f-fbc08b91f651 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.185587 Oct 06 14:20:40.747802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3789/7588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:40 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:41.777574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:41.778284 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:41.785168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:41.786231 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:41.786642 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:41.787346 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:41.787805 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:41.788232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:41.922378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:41.930634 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9adff027-6314-44b0-b88b-f1a758382525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1695 microversion: 2.1 time: 0.157027 Oct 06 14:20:41.931213 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3800/7589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:41 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:42.954971 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:42.955600 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:42.962276 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:42.962784 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:42.963510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:42.964213 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:42.964692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:42.965140 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:43.101848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:43.109558 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9160e85c-74a8-4bab-8581-e3250f1f4c8b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1677 microversion: 2.1 time: 0.159522 Oct 06 14:20:43.110178 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3790/7590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:42 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:44.132987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:44.133600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:44.140645 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:44.141130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:44.141567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:44.142287 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:44.142838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:44.143268 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:44.279705 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:44.287379 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a4f5b303-f7c1-4760-9626-7db832c74854 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1677 microversion: 2.1 time: 0.158783 Oct 06 14:20:44.287970 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3801/7591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:44 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:45.311261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:45.311956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:45.318881 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.319387 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.319846 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.320559 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.321045 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.321492 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.460265 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:45.468170 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fded7a69-1c1c-4602-9864-6ac72037bfc5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1620 microversion: 2.1 time: 0.160788 Oct 06 14:20:45.468758 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3791/7592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:45 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1620 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:45.490558 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:20:45.491170 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:45.494039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=29 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:45.499386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.499875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.500319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.501019 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.501479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.501953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.505423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:45.591164 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 14:20:45.659994 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-69e8baba-3d1f-4003-8cc6-d8328488adec tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action" status: 202 len: 0 microversion: 2.1 time: 0.173363 Oct 06 14:20:45.661140 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3802/7593] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:20:45 2022] POST /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:20:45.669434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:45.670094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:45.673001 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=29 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:45.680229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.680819 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.681341 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.682275 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:45.682801 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:45.683367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:45.686231 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=85 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:20:45.821979 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:45.830252 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f0b337b4-5bcf-42de-a812-bab6c94f218a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1628 microversion: 2.1 time: 0.164712 Oct 06 14:20:45.830831 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3792/7594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:45 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1628 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:46.856209 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:46.856840 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:46.862921 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:46.863411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:46.864427 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:46.865122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:46.865585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:46.866039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:47.015527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:47.027791 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "name": "network-vif-unplugged", "status": "completed", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:20:47.037946 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4ed7e417-5d19-4aee-a0b9-db2c0044a7e5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.186520 Oct 06 14:20:47.039393 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3803/7595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:46 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:47.040193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:47.040768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:47.041770 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:47.056544 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] Creating event network-vif-unplugged:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:20:47.060525 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] [5def7e9c-8f12-49ca-96c6-076815ab24f3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:20:48.067571 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:48.068135 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:48.068870 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] [5def7e9c-8f12-49ca-96c6-076815ab24f3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50532. Oct 06 14:20:48.072851 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-cee71ec2-0826-46f4-845b-821b308a0705 req-3581d3bf-4486-4a44-a1ac-d608f0f17610 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.048915 Oct 06 14:20:48.073569 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3793/7596] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:20:48.076057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:48.076379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:48.076666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:48.077412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:48.077907 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:48.078347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:48.221957 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:48.230937 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fd8e03b0-ce50-41c8-9154-07c0ca31e3d8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.167427 Oct 06 14:20:48.231814 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3804/7597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:48 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:20:49.257683 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:49.258437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:49.264900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:49.265412 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:49.266060 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:49.266804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:49.267286 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:49.267742 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:49.433692 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:49.441674 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bf15aa8d-63aa-4874-aae6-f250278cff5e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.189655 Oct 06 14:20:49.442936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3794/7598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:49 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:50.466692 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:50.468433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:50.476716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:50.477651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:50.478775 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:50.479927 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:50.480911 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:50.481663 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:50.640514 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:50.649724 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-714ebe94-2c25-43c4-bb53-ad451b057b18 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.187339 Oct 06 14:20:50.650534 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3805/7599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:50 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:51.673656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:51.674329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:51.682221 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:51.682732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:51.683199 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:51.683936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:51.684560 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:51.684857 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:51.858739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:51.867349 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-11dcbb2d-a10c-45a4-8d05-35ef2c27077c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.197569 Oct 06 14:20:51.868316 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3795/7600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:51 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:52.893559 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:52.894627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:52.902781 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:52.903281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:52.903801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:52.905130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:52.905655 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:52.906116 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:53.054125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:53.068826 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a447920d-05ec-4141-b266-a980c89e62ef tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.179132 Oct 06 14:20:53.070572 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3806/7601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:52 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:54.093505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:54.094719 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:54.103069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:54.103592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:54.104055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:54.104922 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:54.105575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:54.106146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:54.264381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:54.272844 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5250674e-7b7d-4e94-8b9d-91496484535f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.183524 Oct 06 14:20:54.289194 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3796/7602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:54 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:55.296614 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:55.297412 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:55.304301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:55.304798 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:55.305242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:55.306013 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:55.306476 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:55.306908 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:55.454943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:55.463872 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1327be2-20a4-4756-a622-0eea96f24462 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.171200 Oct 06 14:20:55.476765 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3807/7603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:55 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:56.488085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:56.488729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:56.495653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:56.496154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:56.496614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:56.497323 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:56.497886 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:56.498357 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:56.630063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:56.637688 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d49e7384-57f5-46c7-8c33-37a2488e31e2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.153556 Oct 06 14:20:56.638286 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3797/7604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:56 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:57.663629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:57.664366 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:57.671972 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:57.672463 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:57.672900 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:57.673600 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:57.674094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:57.674522 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:57.808698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:57.816531 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ca409b73-6715-4737-ae61-a199ac7a4bb9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.157318 Oct 06 14:20:57.817170 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3808/7605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:57 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:20:58.840160 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:20:58.840840 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:20:58.848371 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:58.848863 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:58.849310 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:58.850048 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:20:58.850517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:20:58.850953 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:20:58.994344 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:20:59.002133 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-16193628-0c9e-42a4-9021-5f122763e5c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.166200 Oct 06 14:20:59.002714 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3798/7606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:20:58 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:00.026569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:00.027185 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:00.034283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:00.034768 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:00.035207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:00.036488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:00.036943 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:00.037378 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:00.170601 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:00.178521 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dee10f6c-04c6-4f7e-82a0-c2b4abfede82 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.155792 Oct 06 14:21:00.179109 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3809/7607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:00 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:01.201695 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:01.202367 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:01.209391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:01.209963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:01.210410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:01.211134 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:01.211617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:01.212067 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:01.346218 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:01.354401 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bcd3e6a4-aeb7-49b1-94ff-5dcc418269ca tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.156623 Oct 06 14:21:01.354981 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3799/7608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:01 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:02.378288 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:02.378893 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:02.386405 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:02.386896 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:02.387340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:02.388040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:02.388503 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:02.388934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:02.520030 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:02.527876 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-4eb0427f-51fa-485a-bd3c-59363852796b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.153570 Oct 06 14:21:02.528446 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3810/7609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:02 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:03.552451 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:03.553077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:03.560196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:03.560707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:03.561164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:03.561923 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:03.562398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:03.562847 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:03.702874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:03.711489 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b30e382-c5d3-4d38-a33f-af0ed0fa96d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.162888 Oct 06 14:21:03.712091 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3800/7610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:03 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:04.735437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:04.736027 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:04.742722 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:04.743204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:04.743646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:04.744340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:04.744800 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:04.745225 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:04.877585 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:04.886065 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b1291087-9ee0-4063-94e3-a4d7a97f87d7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.154613 Oct 06 14:21:04.886642 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3811/7611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:04 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:05.141224 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "name": "network-vif-plugged", "status": "completed", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:21:05.151354 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:05.151848 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:05.152294 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:05.163105 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] Creating event network-vif-plugged:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:21:05.168495 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-afd90074-948d-48b5-be4c-de13e309f62d req-87c35857-dbaf-4aa1-9f08-759a747930fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096572 Oct 06 14:21:05.169073 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3801/7612] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:21:05.910113 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:05.911253 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:05.918202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:05.918697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:05.919142 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:05.919841 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:05.920300 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:05.920730 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:06.056488 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:06.064537 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-da73ea68-7f31-4c1a-990d-0427324e3431 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.158353 Oct 06 14:21:06.065048 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3812/7613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:05 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:07.090005 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:07.090910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:07.108171 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:07.108691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:07.109148 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:07.109908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:07.110385 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:07.110828 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:07.257031 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:07.264931 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4e5e9718-a8cc-4305-b4ff-527e2e2fa50f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1686 microversion: 2.1 time: 0.180371 Oct 06 14:21:07.265457 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3802/7614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:07 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:21:08.288968 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:21:08.289587 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:21:08.296629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:08.297184 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:08.297496 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:08.298217 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:21:08.298676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:21:08.299103 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:21:08.429049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:21:08.436907 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-bc4f0b6f-3416-49a0-b248-74b5b65b2615 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1673 microversion: 2.1 time: 0.152448 Oct 06 14:21:08.437492 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3813/7615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:21:08 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:22:53.279649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=21 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:22:53.280915 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:22:53.281678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:22:53.281870 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=57 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:22:53.288454 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:53.289338 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:22:53.309347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:53.309879 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:53.310380 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:53.311053 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:53.311525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:53.311963 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:53.340860 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:22:53.356865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:22:53.369104 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:53.369595 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:53.370091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:53.381773 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] Creating event network-changed:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:22:53.387770 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-0293b74a-ca07-46bb-a3b3-44121c628d36 req-37ec6035-960b-4f15-9359-b1a828e97d9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108653 Oct 06 14:22:53.388601 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3814/7616] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:22:53.425490 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2f736ae-eff3-4e60-a509-1aff176ba2e0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 204 len: 0 microversion: 2.1 time: 0.148350 Oct 06 14:22:53.426489 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3803/7617] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:22:53 2022] DELETE /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:22:53.435877 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:53.437582 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:22:53.444429 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:53.445198 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:53.445881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:53.447442 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:53.448136 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:53.448742 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:53.597344 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:22:53.605402 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-629c811e-3433-4900-9cda-3050ef098b98 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.174491 Oct 06 14:22:53.606124 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3815/7618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:22:53 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:22:54.630788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:54.631506 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:22:54.638705 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:54.639206 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:54.639660 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:54.644569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:54.644569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:54.644569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:54.782598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:22:54.791196 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c7a01169-ec09-4369-acf4-c3a03662d21d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1679 microversion: 2.1 time: 0.164591 Oct 06 14:22:54.791781 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3804/7619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:22:54 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:22:55.479500 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d177da1-be3c-4754-93ac-575b1ebc2d03", "name": "network-vif-deleted", "tag": "9c7ab512-1b5f-4b58-939c-c7c697970a66"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:22:55.491213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:55.491786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:55.492224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:55.504827 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] Creating event network-vif-deleted:9c7ab512-1b5f-4b58-939c-c7c697970a66 for instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 on n-h2-860556-1 Oct 06 14:22:55.510638 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-f2e85065-5b82-4291-9e86-c58efb92355a req-13202fb2-a07d-460a-8546-c57514a6c1eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Oct 06 14:22:55.511290 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3816/7620] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:22:55.815836 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:55.816738 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:22:55.824143 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:55.824744 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:55.825297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:55.826214 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:55.826908 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:55.827436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:55.863346 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:55.863816 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:55.864274 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:55.864746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lazy-loading 'fault' on Instance uuid 0d177da1-be3c-4754-93ac-575b1ebc2d03 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:22:55.913651 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:22:55.921525 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-792e82ab-9d40-46be-9d09-ebe7d214b989 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 200 len: 1336 microversion: 2.1 time: 0.110473 Oct 06 14:22:55.922120 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3805/7621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:22:55 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:22:56.948570 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:56.949276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0d177da1-be3c-4754-93ac-575b1ebc2d03] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:22:56.955491 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:56.956541 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:56.956975 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:56.957661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:22:56.958143 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:22:56.958566 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:22:56.972085 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] HTTP exception thrown: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Request method failure captured: Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 HTTP/1.1 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPuN0L9zPNwaugRtrKJ44WTeWAt9OpBAJjvz7221AYpzqHN1_BXDOs3VeSIIshnCJDPfRMbaj5llOwr6-P-hNT2tmxRZhp0A4w6UUg9pGMvjdPEdk_9mGQPRY8uQPGahrQYqlSfAi65im6D-OSetE-MCnp0ePN8n5VR9p8t0ueHrt2GM Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 0fecd4e1260c48a6a080fc14bef28faa Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestShelveInstance-722416629 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0fecd4e1260c48a6a080fc14bef28faa", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0fecd4e1260c48a6a080fc14bef28faa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0fecd4e1260c48a6a080fc14bef28faa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0fecd4e1260c48a6a080fc14bef28faa"}]}] Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestShelveInstance-722416629 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 0fecd4e1260c48a6a080fc14bef28faa Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestShelveInstance-722416629 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestShelveInstance-722416629-project Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 687835d7c64c4056a18c01d1ae9c3bc7 Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestShelveInstance-722416629-project Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': '0d177da1-be3c-4754-93ac-575b1ebc2d03'} Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:22:56.973706 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Returning 404 to user: Instance 0d177da1-be3c-4754-93ac-575b1ebc2d03 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-dd33d2aa-5550-4f02-89c1-a9bf64395868 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03" status: 404 len: 111 microversion: 2.1 time: 0.031746 Oct 06 14:22:56.979516 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3817/7622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:22:56 2022] GET /compute/v2.1/servers/0d177da1-be3c-4754-93ac-575b1ebc2d03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:22:57.140798 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ed9115f7-0f98-4fcc-a9d3-072468b645c6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '.version_select at 0x7f7d3c46cf70>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:22:57.167028 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ed9115f7-0f98-4fcc-a9d3-072468b645c6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1768293102" status: 202 len: 0 microversion: 2.1 time: 0.030105 Oct 06 14:22:57.167675 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3806/7623] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Oct 6 14:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1768293102 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:22:57.193666 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7385354b-e00d-4a86-b2dd-11219537c086 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'create', calling method: .version_select at 0x7f7d3ed7ca60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1919914572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKUHDH8LhYWVD8SoUFQUX1T8DUR394XkECvIFHujO7l0QFJCn5HYWRaB33g6EWZD8qPKyXO3WA/ngVw6ylsiuKClokGKAd+uXWQLEX3b8WEErpjTyBCu6YX/Ybtrf10Cw=="}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:22:57.210865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7385354b-e00d-4a86-b2dd-11219537c086 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:22:57.216942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-7385354b-e00d-4a86-b2dd-11219537c086 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for user 687835d7c64c4056a18c01d1ae9c3bc7 and project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'key_pairs'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:22:57.244447 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7385354b-e00d-4a86-b2dd-11219537c086 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055244 Oct 06 14:22:57.245060 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3818/7624] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:22:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:23:13.479100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:13.479862 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:13.484063 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-53716479", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1919914572", "security_groups": [{"name": "tempest-secgroup-smoke-1326310837"}], "networks": [{"uuid": "991ea55f-2773-45be-9184-e28d1c3c344d"}], "block_device_mapping_v2": [{"uuid": "c12c9ce9-9d3c-438d-8f43-790bf37c6994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:23:13.603980 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.network.neutron [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] validate_networks() for [('991ea55f-2773-45be-9184-e28d1c3c344d', None, None, None, None, None)] {{(pid=129614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:23:14.342458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Flavor limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:23:14.342900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Image limits 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:23:14.343415 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Flavor pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:23:14.343823 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Image pref 0:0:0 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:23:14.344252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.virt.hardware [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:23:14.353750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:14.354190 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:14.354641 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:14.355384 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:14.355858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:14.356297 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:14.374477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:23:14.380006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Getting quotas for user 687835d7c64c4056a18c01d1ae9c3bc7 and project 0fecd4e1260c48a6a080fc14bef28faa. Resources: {'ram', 'cores', 'instances'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:23:14.440543 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Going to run 1 instances... {{(pid=129614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:23:14.442729 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c12c9ce9-9d3c-438d-8f43-790bf37c6994',volume_size=None,volume_type=None)] {{(pid=129614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:23:14.571980 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-982f5d88-a7ce-4d4b-a699-6a75063314d4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.094619 Oct 06 14:23:14.572967 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3807/7625] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:23:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:23:14.583237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=12 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:14.584376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:14.585092 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:14.589057 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-186f3071-6572-49ba-92d8-f31ef205753c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:14.589668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-186f3071-6572-49ba-92d8-f31ef205753c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:14.646836 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-186f3071-6572-49ba-92d8-f31ef205753c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:14.653809 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-186f3071-6572-49ba-92d8-f31ef205753c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1087 microversion: 2.1 time: 0.072482 Oct 06 14:23:14.654377 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3819/7626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:14 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:15.677252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e7baf866-8c8e-404c-aeff-97d556f1a8c9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:15.677940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e7baf866-8c8e-404c-aeff-97d556f1a8c9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:15.731540 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-e7baf866-8c8e-404c-aeff-97d556f1a8c9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:15.739174 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e7baf866-8c8e-404c-aeff-97d556f1a8c9 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1087 microversion: 2.1 time: 0.066663 Oct 06 14:23:15.739752 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3808/7627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:15 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:16.762224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-beaccb94-a71b-491d-8a72-e5ac332fdeae tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:16.762849 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-beaccb94-a71b-491d-8a72-e5ac332fdeae tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:16.821656 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-beaccb94-a71b-491d-8a72-e5ac332fdeae tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:16.829396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-beaccb94-a71b-491d-8a72-e5ac332fdeae tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1087 microversion: 2.1 time: 0.071121 Oct 06 14:23:16.830047 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3820/7628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:16 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:17.853168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a5f5ea32-e337-4341-b2e8-cd47e96f589d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:17.853864 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a5f5ea32-e337-4341-b2e8-cd47e96f589d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:17.907818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a5f5ea32-e337-4341-b2e8-cd47e96f589d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:17.916331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a5f5ea32-e337-4341-b2e8-cd47e96f589d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1087 microversion: 2.1 time: 0.066793 Oct 06 14:23:17.917019 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3809/7629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:17 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:18.940649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:18.941266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:18.949003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:18.949201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:18.949646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:18.950376 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:18.950895 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:18.951327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:19.013824 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:19.022105 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-8df98710-bb64-45ca-94a0-271a2ead01cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1137 microversion: 2.1 time: 0.085427 Oct 06 14:23:19.022688 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3821/7630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:18 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:20.046627 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:20.047257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:20.058530 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:20.059271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:20.059741 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:20.060566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:20.060962 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:20.061469 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:20.144612 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:20.152518 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-39e7bd6b-52be-4b98-bcc4-da40b818c425 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1203 microversion: 2.1 time: 0.110162 Oct 06 14:23:20.153133 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3810/7631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:20 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1203 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:21.178461 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:21.179239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:21.192173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:21.192815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:21.193353 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:21.195340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:21.196077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:21.196729 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:21.404071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:21.413821 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a27a8393-87fa-434a-92f5-f92d6e2d7464 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1271 microversion: 2.1 time: 0.240088 Oct 06 14:23:21.414518 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3822/7632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:21 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:21.451011 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:23:21.463126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:21.464020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:21.464764 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:21.479771 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] Creating event network-changed:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h1-860556-1 Oct 06 14:23:21.485279 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b71f6ce7-d368-473d-b418-ce086977e9ed req-93c49af4-37fe-4581-875c-6081ff4bb9d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040140 Oct 06 14:23:21.485936 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3811/7633] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:23:22.436609 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:22.437446 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:22.444875 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:22.445460 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:22.446071 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:22.446902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:22.447469 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:22.448009 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:22.593189 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:22.601202 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-52529ec4-0a46-4612-accc-85cab3c178c5 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1271 microversion: 2.1 time: 0.168568 Oct 06 14:23:22.601849 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3823/7634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:22 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:23.625944 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:23.626701 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:23.635566 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:23.636453 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:23.636925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:23.637665 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:23.638208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:23.638658 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:23.780329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:23.793529 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b6156ca5-9309-46b6-913e-192753be4964 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1271 microversion: 2.1 time: 0.172587 Oct 06 14:23:23.794234 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3812/7635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:23 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:24.817377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:24.818064 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:24.826039 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:24.826535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:24.826978 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:24.827814 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:24.828357 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:24.828882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:24.966383 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:24.974227 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-91e593ff-0137-4875-b876-57f8259fd343 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1271 microversion: 2.1 time: 0.161468 Oct 06 14:23:24.974817 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3824/7636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:24 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:25.997725 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:25.998304 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:26.000291 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:26.006424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:26.006936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:26.007390 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:26.008109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:26.008575 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:26.009014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:26.426956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:26.435201 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5f905908-73d2-402a-9ff2-42daca3c82e4 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.441342 Oct 06 14:23:26.435832 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3813/7637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:25 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:27.456351 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=4 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:27.460482 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:27.461125 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:27.467671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:27.468156 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:27.468591 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:27.469294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:27.469764 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:27.470195 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:27.605129 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:27.613643 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f05f9a6c-dffc-44eb-8c36-7c58749537c8 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.158986 Oct 06 14:23:27.614387 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3825/7638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:27 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:28.636901 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:28.637525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:28.640443 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=10 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:23:28.646086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:28.646598 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:28.647049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:28.647851 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:28.648347 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:28.648793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:28.804085 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:28.812216 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-59a008c0-003f-442a-9226-4fa3ddf8cb6d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.179103 Oct 06 14:23:28.812914 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3814/7639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:28 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:29.836455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:29.837076 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:29.844333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:29.844850 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:29.845294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:29.846543 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:29.847003 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:29.847433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:29.979138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:29.987058 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5654873d-6acb-4fb3-8c49-843ea28ae2e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.154622 Oct 06 14:23:29.987636 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3826/7640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:29 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:31.009229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:31.009893 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:31.016842 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:31.017358 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:31.017913 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:31.018634 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:31.019111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:31.019558 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:31.159149 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:31.167497 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-49a33f56-cb5e-41f4-b2c3-a370f2bf5525 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.162135 Oct 06 14:23:31.168074 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3815/7641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:31 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:32.191033 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:32.191799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:32.198725 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:32.199212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:32.199651 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:32.200347 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:32.200799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:32.201222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:32.333668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:32.341951 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7a564070-5a84-41b2-84d9-cf1568deb26d tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.155276 Oct 06 14:23:32.342531 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3827/7642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:32 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:33.365493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:33.366136 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:33.373021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:33.373517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:33.374006 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:33.374720 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:33.375187 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:33.375628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:33.505940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:33.513625 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-15d30893-4419-4ed4-9831-77e00b13c3b1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.152693 Oct 06 14:23:33.514241 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3816/7643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:33 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:34.536111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:34.536838 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:34.543984 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:34.544413 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:34.544930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:34.545613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:34.546108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:34.546549 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:34.691002 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:34.699139 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-63b02542-5df7-47cc-b302-3d5260851752 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.167027 Oct 06 14:23:34.699728 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3828/7644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:34 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:35.722318 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:35.722955 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:35.731965 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:35.732473 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:35.732940 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:35.733697 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:35.734196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:35.734644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:35.867303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:35.875142 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c03e187d-5652-4a84-9154-f3c562c5303e tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.156875 Oct 06 14:23:35.875721 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3817/7645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:35 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:36.597430 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "name": "network-vif-plugged", "status": "completed", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:23:36.608091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:36.608605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:36.609049 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:36.621438 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] Creating event network-vif-plugged:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h1-860556-1 Oct 06 14:23:36.626516 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-5b676d89-20cb-48ec-bac6-95a1e6d4c2cf req-263202f8-2e6d-4295-83c0-35da7334d322 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033398 Oct 06 14:23:36.627121 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3829/7646] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:23:36.898959 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:36.899588 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:36.906671 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:36.907672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:36.908845 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:36.909532 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:36.910036 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:36.910484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:37.047649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:37.055663 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7bd8427f-2755-4082-bd60-0211472e94c2 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.160619 Oct 06 14:23:37.056254 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3818/7647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:36 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:38.079657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:38.080398 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:38.086684 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:38.087176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:38.087616 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:38.088325 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:38.088785 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:38.089213 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:38.235201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:38.243842 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7bbe1698-b9e5-494e-bf21-9bf9efb9fb91 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1259 microversion: 2.1 time: 0.169527 Oct 06 14:23:38.244444 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3830/7648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:38 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:39.266475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:39.267137 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:39.274086 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:39.274592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:39.275051 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:39.275768 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:39.276244 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:39.276693 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:39.409399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:39.417198 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-2d637880-fd74-4aae-a4ff-d61d51735716 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1443 microversion: 2.1 time: 0.154648 Oct 06 14:23:39.417798 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3819/7649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:39 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:39.440628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:23:39.441250 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:23:39.448204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:39.448626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:39.449067 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:39.449786 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:39.450252 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:39.450682 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:39.584102 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:23:39.592258 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a64a646f-357d-4ac8-8f18-5e0f301f1e65 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1443 microversion: 2.1 time: 0.155590 Oct 06 14:23:39.592847 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3831/7650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:23:39 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:23:41.244182 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:23:41.254956 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:23:41.255531 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:23:41.255995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:23:41.268181 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] Creating event network-changed:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h1-860556-1 Oct 06 14:23:41.273322 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1e507227-6975-4f7c-9f65-ab22969ae12a req-30197bbd-1387-4500-864c-79359a75fbee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Oct 06 14:23:41.274168 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3820/7651] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:25:38.546140 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:25:38.547220 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:25:38.547802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=30 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:25:38.548539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=62 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:25:38.549553 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:25:38.549797 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action (ip 10.222.0.26) !!! Oct 06 14:25:38.551420 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:25:38.551566 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action (ip 10.222.0.26) !!! Oct 06 14:25:38.555998 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:25:38.556537 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:38.566825 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:38.567311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:38.567753 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:38.568479 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:38.568940 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:38.569369 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:38.593700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lazy-loading 'flavor' on Instance uuid 0519b882-e66e-47e9-b81b-39fe13ef1442 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:25:38.663889 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-01df0ec8-2acf-4cc2-859a-a8142c33f231 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action" status: 202 len: 0 microversion: 2.1 time: 0.119583 Oct 06 14:25:38.664735 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3832/7652] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:25:38 2022] POST /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:25:38.671503 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:25:38.672348 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:25:38.672948 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:25:38.673855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=60 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:25:38.675179 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:25:38.675330 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 (ip 10.222.0.26) !!! Oct 06 14:25:38.678226 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:25:38.678537 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 (ip 10.222.0.26) !!! Oct 06 14:25:38.697025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:38.697763 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:38.708927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:38.709437 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:38.710075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:38.710644 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:38.711100 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:38.711548 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:38.908849 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:38.917206 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f6366838-098d-49e6-bd62-f5ea79328478 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.248143 Oct 06 14:25:38.917802 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3821/7653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:38 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:39.943539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:39.944246 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:39.953797 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:39.954285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:39.954723 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:39.955423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:39.955879 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:39.956308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:39.957004 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50962. Oct 06 14:25:39.957707 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50964. Oct 06 14:25:40.137913 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:40.145953 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-38f649cb-7a56-4d29-aa9f-158292962958 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.209047 Oct 06 14:25:40.146536 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3833/7654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:39 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:41.168593 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:41.169249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:41.183208 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:41.183710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:41.184164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:41.184874 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:41.185343 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:41.185803 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:41.190949 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50972. Oct 06 14:25:41.191937 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50974. Oct 06 14:25:41.320831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:41.328587 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d8138756-ecfd-4613-8d57-f656c5f1a6ba tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.163991 Oct 06 14:25:41.329200 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3822/7655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:41 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:42.353054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:42.353668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:42.360933 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:42.361423 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:42.361926 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:42.362629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:42.363089 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:42.363520 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:42.499668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:42.507769 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-44a7d7be-f010-47fd-9008-1f7b581a119a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.158635 Oct 06 14:25:42.508356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3834/7656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:42 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:43.531569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:43.532252 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:43.539887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:43.540393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:43.540850 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:43.541883 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:43.542070 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:43.542872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:43.680057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:43.687883 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fde7dee6-f39c-433e-a99d-15678788dd31 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.160297 Oct 06 14:25:43.688464 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3823/7657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:43 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:44.710974 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:44.711590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:44.718750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:44.719237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:44.719678 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:44.720377 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:44.720835 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:44.721266 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:44.859717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:44.868078 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fe72bff7-63bc-449d-99d7-148375756207 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.161065 Oct 06 14:25:44.868651 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3835/7658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:44 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:45.891710 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:45.892447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:45.899445 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:45.899943 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:45.900398 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:45.901369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:45.901570 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:45.902038 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:46.045111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:46.060257 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9c0bf855-e312-48f2-ac12-0551366e0e99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.172394 Oct 06 14:25:46.060845 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3824/7659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:45 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:47.084131 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:47.084741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:47.091539 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:47.092275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:47.092713 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:47.093403 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:47.093888 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:47.094318 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:47.226970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:47.234854 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-eaedf970-3662-44ac-993a-bc1292590b86 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.155345 Oct 06 14:25:47.235432 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3836/7660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:47 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:48.259015 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:48.259633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:48.266538 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:48.267040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:48.267504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:48.268207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:48.268676 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:48.269118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:48.403617 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:48.411478 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-09694086-013d-48c3-84fb-02002ce02359 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.156978 Oct 06 14:25:48.412086 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3825/7661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:48 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:49.434662 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:49.435283 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:49.442326 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:49.442812 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:49.443281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:49.443979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:49.444438 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:49.444865 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:49.577935 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:49.586212 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-133ed5d1-4e1c-42b3-939d-efcf8c8680cd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.155457 Oct 06 14:25:49.586786 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3837/7662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:49 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:50.610078 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:50.610726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:50.618711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:50.619282 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:50.619682 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:50.620550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:50.621056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:50.621675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:50.757169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:50.765376 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4223a616-a62d-4fdd-907d-828f553bacf1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.159277 Oct 06 14:25:50.765991 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3826/7663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:50 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:51.788606 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:51.789328 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:51.797400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:51.798011 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:51.798545 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:51.799343 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:51.799930 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:51.800220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:51.936758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:51.945449 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-c0ca17e7-643d-4a95-b014-d1efed04c910 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.161352 Oct 06 14:25:51.946288 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3838/7664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:51 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:52.969590 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:52.970292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:52.977069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:52.977577 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:52.978087 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:52.979172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:52.979902 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:52.980356 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:53.127097 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:53.135841 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-770743c1-1336-47c1-99aa-3c464940754b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1569 microversion: 2.1 time: 0.170416 Oct 06 14:25:53.136422 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3827/7665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:52 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:53.158028 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:25:53.158633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:53.165417 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:53.165948 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:53.166386 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:53.167080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:53.167534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:53.167966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:53.197462 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129615) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 14:25:53.263807 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b27714d2-1f6f-486c-9913-d2c4efd71b15 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "POST /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action" status: 202 len: 0 microversion: 2.1 time: 0.109795 Oct 06 14:25:53.264654 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3839/7666] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:25:53 2022] POST /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:25:53.273158 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:53.274007 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:53.281040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:53.281690 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:53.282196 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:53.282920 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:53.283511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:53.284056 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:53.430378 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:53.440135 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d013531a-373e-4854-9c16-bf3eaaba263a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1577 microversion: 2.1 time: 0.171072 Oct 06 14:25:53.440877 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3828/7667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:53 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:54.466012 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:54.466633 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:54.473042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:54.473529 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:54.473995 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:54.474757 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:54.475220 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:54.475661 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:54.617490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:54.625401 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9c768015-6698-45f6-a7a2-00033f36cefb tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1519 microversion: 2.1 time: 0.164268 Oct 06 14:25:54.626020 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3840/7668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:54 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:55.242313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "name": "network-vif-unplugged", "status": "completed", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:25:55.253404 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:55.253946 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:55.254407 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:55.266989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.compute.server_external_events [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] Unable to find a host for instance 0519b882-e66e-47e9-b81b-39fe13ef1442. Dropping event network-vif-unplugged {{(pid=129614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 14:25:55.268047 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-5d6441ea-9275-4c56-90f5-1adbaffae8c7 req-b222f25d-6233-4764-b273-32c1dc5f8c06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030606 Oct 06 14:25:55.268766 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3829/7669] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 06 14:25:55.651212 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:55.651839 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:55.658999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:55.659490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:55.659937 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:55.660646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:55.661107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:55.662134 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:55.793077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:55.801092 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-97d97d68-576a-41ba-837a-56e76ab504bd tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1519 microversion: 2.1 time: 0.153759 Oct 06 14:25:55.801672 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3841/7670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:55 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:56.824547 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:56.825230 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:56.832448 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:56.832896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:56.834010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:56.834728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:56.835205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:56.835656 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:56.976772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:56.985178 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-db74589c-20b5-456b-8a28-88d813983367 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1519 microversion: 2.1 time: 0.164507 Oct 06 14:25:56.985805 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3830/7671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:56 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:58.009457 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:58.010169 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:58.016966 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:58.017456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:58.017934 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:58.018675 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:58.019138 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:58.019569 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:58.152654 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:58.160586 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-efb533ba-be74-4e56-a99d-87c88134933a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1519 microversion: 2.1 time: 0.155777 Oct 06 14:25:58.161309 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3842/7672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:58 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:25:59.182891 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:25:59.183529 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:25:59.190521 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:59.191026 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:59.191483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:59.192229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:25:59.192703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:25:59.193157 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:25:59.340601 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:25:59.349250 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f06ea760-0a5a-4f41-8d48-666eb374e52b tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.169663 Oct 06 14:25:59.350137 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3831/7673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:25:59 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:00.156392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:26:00.167359 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:00.167859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:00.168294 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:00.180555 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] Creating event network-changed:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h2-860556-1 Oct 06 14:26:00.186507 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ff8b5f96-f1c6-4942-b160-e5187e907837 req-a3bc7111-1d21-47d3-9872-034a610652e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033822 Oct 06 14:26:00.187132 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3843/7674] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:26:00.372429 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:00.373082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:00.380254 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:00.380672 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:00.381127 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:00.381875 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:00.382352 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:00.382793 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:00.628915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:00.638099 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d70b2bd-2419-43af-ade9-ddb91d652d1a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.269410 Oct 06 14:26:00.638787 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3832/7675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:00 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:01.663626 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:01.664335 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:01.670788 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:01.671275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:01.671717 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:01.672410 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:01.672868 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:01.673297 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:01.810333 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:01.818755 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d5923b2f-6385-4be1-b1d5-c7821d6d2c12 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.160876 Oct 06 14:26:01.819346 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3844/7676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:01 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:02.842925 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:02.843483 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:02.851069 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:02.851568 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:02.852021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:02.852724 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:02.853193 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:02.853633 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:02.982232 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:02.989950 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3195ec7f-6d97-4f78-8f5e-7429e3ca3320 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.151222 Oct 06 14:26:02.990526 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3833/7677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:02 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:04.012618 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:04.013154 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:04.020278 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:04.020792 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:04.021235 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:04.021971 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:04.022434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:04.022867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:04.157120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:04.165830 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-5211a608-f2bf-4986-b99e-0f76b519c984 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.157208 Oct 06 14:26:04.166408 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3845/7678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:04 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:05.192858 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:05.193493 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:05.200461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:05.200961 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:05.201423 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:05.202169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:05.202649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:05.203096 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:05.335927 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:05.344118 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-05492db1-ece9-4074-9402-6f46578ac42c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.155124 Oct 06 14:26:05.344707 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3834/7679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:05 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:06.368038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:06.368695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:06.376201 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:06.376696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:06.377137 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:06.377882 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:06.378340 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:06.378771 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:06.384247 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:26:06.514727 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:06.523259 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-808bc623-f93f-4296-a17d-b00fa116520a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.159295 Oct 06 14:26:06.523831 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3846/7680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:06 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:07.545595 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:07.546308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:07.553711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:07.554248 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:07.554711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:07.555433 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:07.555915 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:07.556362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:07.688463 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:07.696929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-add91315-444b-4fe1-b652-5d1504271ed6 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.155282 Oct 06 14:26:07.697509 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3835/7681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:07 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:08.719724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:08.720450 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:08.723317 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:26:08.729887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:08.730388 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:08.730827 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:08.731535 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:08.731987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:08.732411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:08.862793 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:08.871141 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-971687f1-dd6a-41ad-93ed-931a4d58265c tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.155625 Oct 06 14:26:08.871721 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3847/7682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:08 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:09.895112 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:09.896258 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:09.898970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=31 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:26:09.904381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:09.904888 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:09.905349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:09.906170 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:09.906650 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:09.907098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:09.909887 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=87 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:26:10.041313 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:10.049148 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-3c5b21b7-0682-4099-9b89-b8b81ce0be81 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.157958 Oct 06 14:26:10.049727 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3836/7683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:09 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:10.690870 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "name": "network-vif-plugged", "status": "completed", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:26:10.702485 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:10.702953 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:10.703420 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:10.715735 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] Creating event network-vif-plugged:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h2-860556-1 Oct 06 14:26:10.721085 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-25597ddc-345d-465a-80f5-cdb8db58cee5 req-3d0a6fed-cc5b-404f-b339-08218a53c7dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086760 Oct 06 14:26:10.721691 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3848/7684] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:26:11.073111 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:11.073674 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:11.080662 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:11.081167 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:11.081628 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:11.082383 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:11.083471 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:11.084130 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:11.220405 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:11.228266 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-258be46f-7414-407d-80b2-414982ce0490 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.159159 Oct 06 14:26:11.229029 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3837/7685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:11 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:26:12.253697 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:12.254527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:12.260732 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:12.261222 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:12.261665 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:12.262396 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:12.262859 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:12.263290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:12.398615 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:12.407365 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cc186315-2c21-4cf6-a1b0-51abbde4d287 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1575 microversion: 2.1 time: 0.158752 Oct 06 14:26:12.407965 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3849/7686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:12 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:26:13.430896 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:26:13.431539 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:26:13.438488 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:13.438995 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:13.439458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:13.440174 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:26:13.440649 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:26:13.441098 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:26:13.572525 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:26:13.580301 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-fd72d11a-f4b9-4a7c-a579-61dfda8b52d0 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1562 microversion: 2.1 time: 0.153299 Oct 06 14:26:13.580890 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3838/7687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:26:13 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:27.579799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=5 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:27.581167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=18 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:27.581914 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=5 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:27.582752 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=17 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:27.584084 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:27:27.584226 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:27:27.588881 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:27.589611 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:27.601070 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:27.601649 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:27.602306 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:27.603269 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:27.603815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:27.604324 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:27.638676 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Going to try to terminate instance {{(pid=129615) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:27:27.651050 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:27:27.662381 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:27.663351 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:27.663804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:27.676186 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] Creating event network-changed:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h2-860556-1 Oct 06 14:27:27.687435 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-a74891ce-6270-403f-9509-82894e81f95a req-e62b8a0f-f0c9-4756-b1e2-75b001fc1d7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107416 Oct 06 14:27:27.688293 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3839/7688] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:27:27.729719 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-3d40b3bd-9236-4ca6-82ad-aba91d60961a tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 204 len: 0 microversion: 2.1 time: 0.151196 Oct 06 14:27:27.730918 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3850/7689] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:27:27 2022] DELETE /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:27:27.740410 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:27.741145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:27.748869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:27.749422 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:27.751075 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:27.751942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:27.752814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:27.753292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:27.923562 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:27.932100 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-5d3ca752-a65d-44e3-8400-a36c4e563028 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.196760 Oct 06 14:27:27.932874 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3840/7690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:27 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:28.956352 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:28.957132 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:28.965766 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:28.966256 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:28.966689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:28.967695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:28.968409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:28.968831 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:29.144551 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:29.152466 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9f718c54-0ee3-4dd8-a906-c0139f854bd7 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1568 microversion: 2.1 time: 0.200498 Oct 06 14:27:29.153044 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3851/7691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:28 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:30.115818 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519b882-e66e-47e9-b81b-39fe13ef1442", "name": "network-vif-deleted", "tag": "75c9e265-354f-4aa0-8980-652e8d6a65fd"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:27:30.126728 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:30.127165 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:30.127618 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:30.139479 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] Creating event network-vif-deleted:75c9e265-354f-4aa0-8980-652e8d6a65fd for instance 0519b882-e66e-47e9-b81b-39fe13ef1442 on n-h2-860556-1 Oct 06 14:27:30.144859 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-ddce9352-5a9a-47b0-b875-58cfaaece165 req-e0ffff0d-64e1-4e01-a5de-eb40223951b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Oct 06 14:27:30.145576 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3841/7692] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:27:30.177207 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:30.177951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:30.185105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:30.185596 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:30.186060 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:30.186763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:30.187262 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:30.187686 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:30.251867 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:30.260730 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a01a50b1-9a79-4c76-9b18-468b7f72d6e1 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1218 microversion: 2.1 time: 0.088178 Oct 06 14:27:30.261456 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3852/7693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:30 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:27:31.289512 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:31.290155 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:31.296472 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:31.296982 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:31.297477 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:31.298229 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:31.298709 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:31.299154 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:31.366411 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:31.374372 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-9380213f-8ca1-4b08-a772-2d3479b4ed99 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1218 microversion: 2.1 time: 0.090870 Oct 06 14:27:31.374950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3842/7694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:31 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:32.397799 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:32.398456 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:32.405433 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:32.406107 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:32.406554 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:32.407260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:32.407718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:32.408145 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:32.472411 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:32.480720 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-17afa21d-0e66-4adc-af02-7ef8154ec9db tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1218 microversion: 2.1 time: 0.087241 Oct 06 14:27:32.481426 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3853/7695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:32 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:33.504126 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:33.504772 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:33.512820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:33.513428 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:33.513983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:33.514792 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:33.515340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:33.515877 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:33.587941 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:33.596192 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d13bb60f-1704-419b-93fe-6c7724cb5277 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1218 microversion: 2.1 time: 0.096132 Oct 06 14:27:33.596846 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3843/7696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:33 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:34.619928 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:34.621239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:34.633130 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:34.634148 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:34.635166 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:34.635914 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:34.636350 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:34.636778 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:34.674762 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:34.675249 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:34.675681 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:34.676323 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.objects.instance [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lazy-loading 'fault' on Instance uuid 0519b882-e66e-47e9-b81b-39fe13ef1442 {{(pid=129615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:27:34.730434 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687835d7c64c4056a18c01d1ae9c3bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fecd4e1260c48a6a080fc14bef28faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:34.739866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b88c1e87-8b3c-4e9c-af2d-67afefdbf690 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 200 len: 1223 microversion: 2.1 time: 0.123897 Oct 06 14:27:34.741101 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3854/7697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:34 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:35.765439 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:35.766108 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] [instance: 0519b882-e66e-47e9-b81b-39fe13ef1442] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:35.773614 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:35.774144 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:35.774606 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:35.775329 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:35.775805 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:35.776250 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:35.790605 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] HTTP exception thrown: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Request method failure captured: Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 HTTP/1.1 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPuN0L9zPNwaugRtrKJ44WTeWAt9OpBAJjvz7221AYpzqHN1_BXDOs3VeSIIshnCJDPfRMbaj5llOwr6-P-hNT2tmxRZhp0A4w6UUg9pGMvjdPEdk_9mGQPRY8uQPGahrQYqlSfAi65im6D-OSetE-MCnp0ePN8n5VR9p8t0ueHrt2GM Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 0fecd4e1260c48a6a080fc14bef28faa Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestShelveInstance-722416629 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0fecd4e1260c48a6a080fc14bef28faa", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0fecd4e1260c48a6a080fc14bef28faa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0fecd4e1260c48a6a080fc14bef28faa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0fecd4e1260c48a6a080fc14bef28faa"}]}] Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestShelveInstance-722416629 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 0fecd4e1260c48a6a080fc14bef28faa Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestShelveInstance-722416629 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestShelveInstance-722416629-project Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 687835d7c64c4056a18c01d1ae9c3bc7 Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestShelveInstance-722416629-project Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0519b882-e66e-47e9-b81b-39fe13ef1442'} Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:27:35.792308 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Returning 404 to user: Instance 0519b882-e66e-47e9-b81b-39fe13ef1442 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ac4ecdc1-d59b-493c-a119-4439b3a27fe3 tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442" status: 404 len: 111 microversion: 2.1 time: 0.032315 Oct 06 14:27:35.798733 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3844/7698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:35 2022] GET /compute/v2.1/servers/0519b882-e66e-47e9-b81b-39fe13ef1442 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:27:35.960538 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-80a6ed6b-d590-4f3c-8196-f9829b3e955f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] Calling method '.version_select at 0x7f7d3e4d0670>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:35.992237 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-80a6ed6b-d590-4f3c-8196-f9829b3e955f tempest-TestShelveInstance-722416629 tempest-TestShelveInstance-722416629-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919914572" status: 202 len: 0 microversion: 2.1 time: 0.036128 Oct 06 14:27:35.993017 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3855/7699] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Oct 6 14:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1919914572 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 14:27:53.328796 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=12 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:53.329550 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=24 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:53.506523 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-65a4c09b-8392-44c1-930b-8509affbd5ad tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Action: 'create', calling method: .version_select at 0x7f7d3c4b14c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1333961557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4pL8XqLWJY5H0Qr9l8x/oH0qF6vD7+KwmH+6Z161YH1bYzdQP9FYSQmuMiERS5I+glw/0z+4mB6AEk75Q7XPpa3pFb2+LgqK2zPvZsRn9O+bLms+25cJjX1JLhvWMWdQ=="}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:27:53.524216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-65a4c09b-8392-44c1-930b-8509affbd5ad tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:27:53.530240 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.quota [None req-65a4c09b-8392-44c1-930b-8509affbd5ad tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for user 6e865b1c49d24463aabb34e9e29aea7c and project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'key_pairs'} {{(pid=129614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:27:53.559507 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-65a4c09b-8392-44c1-930b-8509affbd5ad tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.235855 Oct 06 14:27:53.560131 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3845/7700] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Oct 6 14:27:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:27:54.527574 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-178775497", "imageRef": "9c012702-c0af-44bb-9be6-c3831386ffe2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1333961557", "security_groups": [{"name": "tempest-secgroup-smoke-1872633083"}], "networks": [{"uuid": "b281051d-81ff-45f1-8f55-b1f79455ced0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:27:54.537391 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:54.538224 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:27:54.635512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] validate_networks() for [('b281051d-81ff-45f1-8f55-b1f79455ced0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:27:55.152303 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:27:55.152731 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:27:55.153274 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:27:55.153691 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:27:55.154133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:27:55.163524 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:55.164008 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:55.164445 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:55.165167 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:55.165628 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:55.166077 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:55.184455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:27:55.189970 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for user 6e865b1c49d24463aabb34e9e29aea7c and project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:27:55.204336 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:27:55.206644 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c012702-c0af-44bb-9be6-c3831386ffe2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:27:55.253959 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-f783a226-9079-4a2f-8c34-b090b620ddfe tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730408 Oct 06 14:27:55.255439 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3856/7701] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:27:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:27:55.267393 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-941ce34c-ff25-4bb2-add3-24c4041ccbd3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:55.268020 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-941ce34c-ff25-4bb2-add3-24c4041ccbd3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:55.326461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-941ce34c-ff25-4bb2-add3-24c4041ccbd3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:55.334306 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-941ce34c-ff25-4bb2-add3-24c4041ccbd3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1248 microversion: 2.1 time: 0.071427 Oct 06 14:27:55.334910 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3846/7702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:55 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:56.357075 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-95794393-685f-418e-b9a3-159c50a2c848 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:56.357700 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-95794393-685f-418e-b9a3-159c50a2c848 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:56.414506 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-95794393-685f-418e-b9a3-159c50a2c848 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:56.425518 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-95794393-685f-418e-b9a3-159c50a2c848 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1248 microversion: 2.1 time: 0.072298 Oct 06 14:27:56.426158 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3857/7703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:56 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1248 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:57.448152 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f27ff0b9-deb2-4578-b6d9-91aa34a07e18 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:57.448820 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f27ff0b9-deb2-4578-b6d9-91aa34a07e18 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:57.502115 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f27ff0b9-deb2-4578-b6d9-91aa34a07e18 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:57.510406 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f27ff0b9-deb2-4578-b6d9-91aa34a07e18 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1248 microversion: 2.1 time: 0.066108 Oct 06 14:27:57.511061 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3847/7704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:57 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:58.534534 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-d52cf24a-dcc6-4c7a-8daf-7fee8f00a26f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:58.535147 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-d52cf24a-dcc6-4c7a-8daf-7fee8f00a26f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:58.588588 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-d52cf24a-dcc6-4c7a-8daf-7fee8f00a26f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:58.596832 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-d52cf24a-dcc6-4c7a-8daf-7fee8f00a26f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1248 microversion: 2.1 time: 0.066206 Oct 06 14:27:58.597427 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3858/7705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:58 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:27:59.620800 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:27:59.621430 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:27:59.631776 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:59.632292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:59.632746 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:59.633461 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:27:59.633983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:27:59.634434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:27:59.697040 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:27:59.704675 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-27a52824-cad3-41bd-ab89-30e4bca9d599 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1252 microversion: 2.1 time: 0.087794 Oct 06 14:27:59.705261 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3848/7706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:27:59 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:00.728555 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:00.729180 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:00.736629 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:00.737126 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:00.737567 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:00.738308 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:00.738772 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:00.739716 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:00.818459 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:00.830972 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-6f647835-bc08-452f-9c25-ef426ba7a91f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1306 microversion: 2.1 time: 0.106462 Oct 06 14:28:00.831580 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3859/7707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:00 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:01.855507 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:01.856150 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:01.863397 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:01.863835 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:01.864295 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:01.865025 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:01.865505 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:01.865974 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:02.119109 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:02.126951 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-85445712-250f-4aa8-bb06-f8938af0b24e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.275490 Oct 06 14:28:02.127533 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3849/7708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:01 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:02.340062 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:28:02.349889 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:02.350422 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:02.350864 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:02.362049 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] Creating event network-changed:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:28:02.367608 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-2e6458cf-7165-4b3f-9a3b-bf68381ea8e4 req-e5a9c9d9-d452-42a2-af7b-615ec8f4fc6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104671 Oct 06 14:28:02.368183 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3860/7709] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:28:03.157169 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:03.157831 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:03.165446 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:03.165989 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:03.166452 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:03.167164 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:03.167638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:03.168084 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:03.296292 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:03.304555 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c5e21fb9-a3e4-4bab-ae0e-c8148ccd79a3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.151414 Oct 06 14:28:03.305131 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3850/7710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:03 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:04.329016 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:04.329873 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:04.338364 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:04.338871 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:04.339290 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:04.339996 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:04.340455 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:04.340885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:04.482227 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:04.490589 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-2e0af60c-9610-4da9-9e7a-aac1834ca15f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.166733 Oct 06 14:28:04.491477 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3861/7711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:04 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:05.514122 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:05.514758 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:05.521984 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:05.522438 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:05.522904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:05.523638 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:05.524118 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:05.524569 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:05.660561 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:05.668846 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-d9d6d4fb-82f5-4ef3-a227-86fbd0c00ecf tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.158788 Oct 06 14:28:05.669427 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3851/7712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:05 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:06.692470 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:06.693120 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:06.695122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:28:06.701242 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:06.701724 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:06.702190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:06.702886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:06.703348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:06.703776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:06.834689 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:06.842313 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-b9271257-5769-4629-8be0-2acea6631216 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.153822 Oct 06 14:28:06.842885 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3862/7713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:06 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:07.865821 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:07.866447 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:07.869128 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=8 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:28:07.874510 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:07.875010 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:07.875467 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:07.876172 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:07.876639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:07.877082 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:08.014123 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:08.022514 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-be9307ef-f5df-483e-bce3-be0e9ef1c5a2 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.160615 Oct 06 14:28:08.023083 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3852/7714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:07 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:09.044562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:09.045197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:09.048144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=10 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:28:09.053776 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:09.054275 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:09.054721 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:09.055437 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:09.055902 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:09.056338 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:09.185985 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "name": "network-vif-plugged", "status": "completed", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:28:09.190807 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:09.199737 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6cc4d7d-b9e8-4cb8-adf4-a8dde4a3a729 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.159098 Oct 06 14:28:09.201904 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:09.202055 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3863/7715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:09 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:09.202168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:09.202168 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:09.217379 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] Creating event network-vif-plugged:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:28:09.224018 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-b09f243d-90fb-44d8-82fa-326de14f85fe req-f2ab1575-db55-4acd-aec3-a273a2757546 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043129 Oct 06 14:28:09.224953 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3853/7716] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:28:10.225519 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:10.226158 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:10.232232 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:10.232715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:10.233149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:10.233863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:10.234319 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:10.234743 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:10.367206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:10.375794 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-053c8109-ceb5-40f1-931f-f031ad4bdd3a tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1374 microversion: 2.1 time: 0.154794 Oct 06 14:28:10.376383 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3864/7717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:10 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:11.400534 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:11.401257 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:11.407691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:11.408204 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:11.408664 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:11.409379 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:11.409900 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:11.410349 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:11.548491 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:11.556793 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-f8aa4d77-72d0-40af-9663-2874608b6e7e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1559 microversion: 2.1 time: 0.161948 Oct 06 14:28:11.557377 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3854/7718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:11 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:11.578719 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:28:11.579341 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:28:11.586175 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:11.586668 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:11.587108 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:11.587802 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:11.588260 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:11.588696 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:11.724547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:28:11.732283 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ad4a1d92-438c-4ce9-a13f-3d62d909b01d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1559 microversion: 2.1 time: 0.157416 Oct 06 14:28:11.732877 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3865/7719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:28:11 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:28:13.346722 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:28:13.356703 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:28:13.357200 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:28:13.357652 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:28:13.369458 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] Creating event network-changed:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:28:13.374562 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-1b46103d-7e4e-47f0-a1d5-1596ed109221 req-60349c3d-56e6-4411-a1a7-14bc06c0e27e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031728 Oct 06 14:28:13.375220 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3855/7720] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:30:40.321050 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:30:40.321948 n-d-860556-1 devstack@n-api.service[129615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 06 14:30:40.322758 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:40.323523 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=40 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:40.325210 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:30:40.325419 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095/action (ip 10.222.0.26) !!! Oct 06 14:30:40.327587 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:30:40.327717 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095/action (ip 10.222.0.26) !!! Oct 06 14:30:40.329364 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:30:40.329486 n-d-860556-1 devstack@n-api.service[129615]: Thu Oct 6 14:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095/action (ip 10.222.0.26) !!! Oct 06 14:30:40.338621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-912165094"}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:30:40.340976 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:30:40.352191 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:30:40.352687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:30:40.353122 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:30:40.353860 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:30:40.354310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:30:40.354750 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:30:40.711295 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-30b53e37-d072-469e-b6e2-aefc58acbfd7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "POST /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095/action" status: 202 len: 0 microversion: 2.1 time: 0.392038 Oct 06 14:30:40.711992 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3866/7721] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:30:40 2022] POST /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 14:30:47.789018 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:30:47.789870 n-d-860556-1 devstack@n-api.service[129614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 14:30:47.790475 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:47.791594 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=40 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:47.792518 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 14:30:47.792676 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:30:47.795905 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:30:47.796046 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:30:47.797895 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 06 14:30:47.798045 n-d-860556-1 devstack@n-api.service[129614]: Thu Oct 6 14:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 06 14:30:47.814288 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "name": "network-vif-plugged", "status": "completed", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:30:47.835489 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:30:47.835981 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:30:47.836436 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:30:47.847162 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] Creating event network-vif-plugged:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:30:47.854794 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-c7edff8d-9c84-441b-9a65-6afec0f71d06 req-ea5cdf73-3df1-441a-a6cf-0e83502d640f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067590 Oct 06 14:30:47.856467 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3856/7722] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:30:59.421286 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:59.422086 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:30:59.427295 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1764796059", "imageRef": "a022dccf-811d-4613-a80b-f8fe4eb44b16", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1333961557", "security_groups": [{"name": "tempest-secgroup-smoke-1872633083"}], "networks": [{"uuid": "b281051d-81ff-45f1-8f55-b1f79455ced0"}]}} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:30:59.452800 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e16abb-baeb-4cd5-91b1-1e3847803846] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 51528. Oct 06 14:30:59.453618 n-d-860556-1 devstack@n-api.service[129615]: INFO oslo.messaging._drivers.impl_rabbit [-] [eec28631-0e77-48f5-abd7-de8f0ef40d58] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 51526. Oct 06 14:30:59.536767 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.network.neutron [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] validate_networks() for [('b281051d-81ff-45f1-8f55-b1f79455ced0', None, None, None, None, None)] {{(pid=129615) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 14:30:59.906265 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Flavor limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 14:30:59.906728 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Image limits 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 14:30:59.907206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Flavor pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 14:30:59.907621 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Image pref 0:0:0 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 14:30:59.908038 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.virt.hardware [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 14:30:59.916796 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:30:59.917281 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:30:59.918361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:30:59.919091 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:30:59.919552 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:30:59.919979 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:30:59.936583 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 14:30:59.941809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.quota [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Getting quotas for user 6e865b1c49d24463aabb34e9e29aea7c and project 68ca09bf54c24fb9926771dd5ec70141. Resources: {'ram', 'cores', 'instances'} {{(pid=129615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 14:30:59.953958 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Going to run 1 instances... {{(pid=129615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 14:30:59.956409 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a022dccf-811d-4613-a80b-f8fe4eb44b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 14:31:00.003974 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-9e005dc9-865a-4715-8f8a-e19428997007 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.584755 Oct 06 14:31:00.004635 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3867/7723] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Oct 6 14:30:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 14:31:00.016909 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6a02535e-3409-4c39-834c-82edb0553da4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:00.017637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6a02535e-3409-4c39-834c-82edb0553da4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:00.023899 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:31:00.024739 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:31:00.050648 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c105151-4309-4443-bc6d-e6d45bfef16f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 51542. Oct 06 14:31:00.051433 n-d-860556-1 devstack@n-api.service[129614]: INFO oslo.messaging._drivers.impl_rabbit [-] [30fa43e2-77cc-4745-9ea7-a44690ff16e0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 51540. Oct 06 14:31:00.154707 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6a02535e-3409-4c39-834c-82edb0553da4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:00.162341 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6a02535e-3409-4c39-834c-82edb0553da4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1249 microversion: 2.1 time: 0.149613 Oct 06 14:31:00.163000 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3857/7724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:00 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 14:31:01.184657 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:01.185435 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:01.193036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:01.193613 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:01.194173 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:01.194960 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:01.195741 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:01.196176 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:01.288562 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:01.297866 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e86e7035-5997-4fb5-9ffb-1add5b42b0d4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1309 microversion: 2.1 time: 0.117007 Oct 06 14:31:01.298560 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3868/7725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:01 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:02.320571 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:02.322046 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:02.330527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:02.331501 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:02.332210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:02.333340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:02.334391 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:02.335210 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:02.499146 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:02.507043 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-bb557139-e246-44a7-9642-c6ba7fadfcfd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.190415 Oct 06 14:31:02.507840 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3858/7726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:02 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:03.530493 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:03.531238 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:03.538234 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:03.539100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:03.539604 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:03.540547 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:03.541100 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:03.541605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:03.685392 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:03.693097 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-7134748d-62a2-4d37-9171-964ede2f49c7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.166494 Oct 06 14:31:03.693681 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3869/7727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:03 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:03.789195 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "name": "network-vif-unplugged", "status": "completed", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:31:03.803639 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:03.804052 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:03.804872 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:03.823929 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.compute.server_external_events [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] Creating event network-vif-unplugged:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:31:03.831987 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [req-4197105f-83b2-40f9-a4da-e7ec863531f7 req-7db2a567-ad73-4aa7-adb5-46e22c92b5ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045114 Oct 06 14:31:03.833254 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3859/7728] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:31:04.719962 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:04.720573 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:04.727375 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:04.727869 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:04.728327 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:04.729237 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:04.729964 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:04.730699 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:04.869114 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:04.877394 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-a6b3a753-1c40-4567-9d75-c7138a3f971c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.164656 Oct 06 14:31:04.878021 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3870/7729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:04 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:05.901563 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:05.902434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:05.910696 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:05.911216 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:05.911675 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:05.912399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:05.912869 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:05.913315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:06.089340 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:06.098094 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-a2268fab-160f-471a-abcf-937700e95ae3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.201070 Oct 06 14:31:06.098864 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3860/7730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:05 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:07.127823 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:07.129115 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:07.136081 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:07.137190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:07.137630 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:07.138360 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:07.138819 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:07.139248 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:07.285379 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:07.293101 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-e16f087e-3d06-4c70-84b6-fb888a9e4f00 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.169229 Oct 06 14:31:07.293677 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3871/7731] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:07 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:08.316988 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:08.318945 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:08.327635 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:08.328368 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:08.328994 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:08.329788 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:08.330272 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:08.330718 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:08.475408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:08.483331 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-4685a096-d75f-4762-9a61-70f90f0a8b0d tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.171269 Oct 06 14:31:08.483916 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3861/7732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:08 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:09.506952 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:09.508105 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:09.518348 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:09.519036 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:09.520080 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:09.521099 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:09.521627 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:09.522168 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:09.670687 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:09.678709 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cacbd677-0c9b-4a74-b83d-a214a6849b1f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.176535 Oct 06 14:31:09.679304 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3872/7733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:09 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:10.701957 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:10.702616 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:10.705455 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell0:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:31:10.710895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:10.711408 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:10.711866 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:10.712580 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:10.713057 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:10.713504 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:10.851855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:10.859707 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0254e206-a09d-416a-9736-39bdc89cd3e3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.162212 Oct 06 14:31:10.860305 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3862/7734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:10 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:11.840951 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:31:11.846580 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=2 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:31:11.847206 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell0:SELECT=6 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:31:11.854999 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:11.855490 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:11.856512 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:11.868252 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] Creating event network-changed:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:31:11.873292 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-3741853d-b643-4f62-8700-0a89b8281077 req-992822ca-9005-4128-b66c-0dd4048424a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Oct 06 14:31:11.873947 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3873/7735] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:31:11.883014 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:11.883853 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:11.890895 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:11.891499 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:11.892027 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:11.892814 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:11.893484 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:11.893992 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:12.098017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:12.105830 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-7b8b34d7-6c42-4af4-a840-2cca10b17390 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.226753 Oct 06 14:31:12.106421 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3863/7736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:11 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:13.129887 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:13.130590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:13.136740 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:13.137255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:13.137695 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:13.138400 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:13.138863 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:13.139285 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:13.276594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:13.284786 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-785152eb-6dd3-48e2-9f80-189f2e8c49f6 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.160024 Oct 06 14:31:13.285356 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3874/7737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:13 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:14.307765 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:14.308396 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:14.315399 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:14.315905 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:14.316362 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:14.317074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:14.317553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:14.318034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:14.452942 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:14.460665 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-887f7df1-5cf2-4052-bcc8-b6c515a0cc6e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.156797 Oct 06 14:31:14.461242 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3864/7738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:14 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:15.485026 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:15.485671 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:15.492594 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:15.493084 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:15.493527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:15.494255 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:15.494715 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:15.495149 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:15.634658 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:15.642423 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-fb3009a1-d4c6-428e-8dff-4e01a60d5314 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.161937 Oct 06 14:31:15.643001 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3875/7739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:15 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:16.665245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:16.665936 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:16.673418 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:16.673970 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:16.674441 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:16.675159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:16.675637 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:16.676094 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:16.811142 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:16.819365 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b045a648-db3b-4536-a060-6030fe303974 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.158013 Oct 06 14:31:16.819950 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3865/7740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:16 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:16.919006 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "name": "network-vif-plugged", "status": "completed", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:31:16.928390 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:16.928891 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:16.929310 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:16.940457 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] Creating event network-vif-plugged:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:31:16.945410 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-43f4c178-1544-469f-90ca-31181b2c2116 req-0287e524-1a5f-4242-a799-ac8abf7e0119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084974 Oct 06 14:31:16.946116 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3876/7741] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:31:17.842180 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:17.842843 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:17.850017 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:17.850516 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:17.850983 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:17.851689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:17.852162 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:17.852607 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:17.986573 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:17.994160 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-6d2e710c-f867-4798-9070-86f4b2c167ee tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1375 microversion: 2.1 time: 0.155864 Oct 06 14:31:17.994734 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3866/7742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:17 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:19.019144 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:19.019774 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:19.026041 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:19.026527 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:19.026965 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:19.028301 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:19.028763 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:19.029197 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:19.158267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:19.166014 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-ff27c5bc-f276-4e0d-94d9-34fd4cc8a88f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1560 microversion: 2.1 time: 0.152040 Oct 06 14:31:19.166589 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3877/7743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:19 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:19.188456 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:31:19.189145 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:31:19.196021 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:19.196527 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:19.196986 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:19.197711 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:19.198197 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:19.198645 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:19.327553 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:31:19.335354 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-c1844bdc-1e68-4a1e-a4fb-bebdb0d24a86 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1560 microversion: 2.1 time: 0.151362 Oct 06 14:31:19.335934 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3867/7744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:31:19 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:31:20.904920 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:31:20.915698 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:31:20.916267 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:31:20.916801 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:31:20.931396 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] Creating event network-changed:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:31:20.937405 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-88bbc0aa-2263-4ee5-93ab-d717e8f059ee req-f43d848a-1873-4172-8a4a-fa481bf00715 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036262 Oct 06 14:31:20.938811 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3878/7745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:32:49.196732 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=24 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:32:49.197494 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=56 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:32:49.202591 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1378428721"}} {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:32:49.204894 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:32:49.212009 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:32:49.212517 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:32:49.212977 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:32:49.213691 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:32:49.214207 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:32:49.214653 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:32:49.419891 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-e07b99a6-87d2-4d79-896c-cdaf29a01214 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "POST /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1/action" status: 202 len: 0 microversion: 2.1 time: 0.224884 Oct 06 14:32:49.420555 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3868/7746] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Oct 6 14:32:49 2022] POST /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 06 14:32:55.409054 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:32:55.409832 n-d-860556-1 devstack@n-api.service[129615]: DEBUG dbcounter [-] [129615] Writing DB stats nova_cell1:SELECT=56 {{(pid=129615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:32:55.419667 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "name": "network-vif-plugged", "status": "completed", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:32:55.449276 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:32:55.452646 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:32:55.453466 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:32:55.476031 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] Creating event network-vif-plugged:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:32:55.484925 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ba6762a6-c410-4b56-ad36-43d2132273ad req-db16b441-5a35-460b-9fad-952115c19fc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078016 Oct 06 14:32:55.486472 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3879/7747] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:33:04.067497 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_api:SELECT=2 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:33:04.068303 n-d-860556-1 devstack@n-api.service[129614]: DEBUG dbcounter [-] [129614] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 14:33:04.072369 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:04.073037 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:04.082185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:04.082924 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:04.083592 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:04.084333 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:04.084813 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:04.085434 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:04.115348 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:33:04.131239 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:33:04.142190 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:04.142983 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:04.143605 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:04.157127 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] Creating event network-changed:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:33:04.162674 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-9bd0d363-fde2-447c-936a-91657f257e0f req-3b8c56f0-7d2e-414e-b2c5-a72b03ad241e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094163 Oct 06 14:33:04.166815 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3880/7748] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:33:04.202885 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-118e059a-8bcb-4935-a4cf-778e2b63008c tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 204 len: 0 microversion: 2.1 time: 0.136695 Oct 06 14:33:04.206827 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3869/7749] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:33:04 2022] DELETE /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:33:04.212987 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:04.213885 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:04.221345 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:04.222042 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:04.222815 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:04.223620 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:04.224187 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:04.224718 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:04.363245 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:33:04.371306 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-57408ff2-206a-4791-aea4-ecacf0c01883 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1684 microversion: 2.1 time: 0.162980 Oct 06 14:33:04.371884 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3881/7750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:04 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:33:05.395839 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:05.396673 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:05.403699 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:05.404205 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:05.404666 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:05.405966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:05.406442 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:05.406890 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:05.542317 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:33:05.551508 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-43181f92-ea16-4111-a200-ad2f30e20e4e tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1684 microversion: 2.1 time: 0.160000 Oct 06 14:33:05.552728 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3870/7751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:05 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:33:06.524111 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11dd285-25d1-4b15-ab31-50614e04e3b1", "name": "network-vif-deleted", "tag": "6d1f2bb5-7f4b-4f28-8748-fae82777a09f"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:33:06.535809 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:06.536589 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:06.537204 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:06.551398 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] Creating event network-vif-deleted:6d1f2bb5-7f4b-4f28-8748-fae82777a09f for instance d11dd285-25d1-4b15-ab31-50614e04e3b1 on n-h1-860556-1 Oct 06 14:33:06.557666 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-202667db-884b-4a11-a334-f214fafc3579 req-f1e9b892-7ac6-4e24-9fef-e93850a97ac8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098531 Oct 06 14:33:06.561905 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3882/7752] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:33:06.576186 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:06.576938 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:06.584804 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:06.585572 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:06.586055 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:06.586774 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:06.587245 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:06.587689 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:06.623249 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:06.624271 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:06.624726 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:06.625185 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.objects.instance [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lazy-loading 'fault' on Instance uuid d11dd285-25d1-4b15-ab31-50614e04e3b1 {{(pid=129614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1104}} Oct 06 14:33:06.665458 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:33:06.674430 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-29b97131-9f1b-41a0-b322-9da9c2f232f4 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 200 len: 1339 microversion: 2.1 time: 0.103174 Oct 06 14:33:06.675023 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3871/7753] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:06 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:33:07.697015 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:07.697726 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: d11dd285-25d1-4b15-ab31-50614e04e3b1] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:07.705358 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:07.705886 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:07.706329 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:07.707029 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:07.707511 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:07.707942 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:07.721179 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.wsgi [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] HTTP exception thrown: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Request method failure captured: Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: request: GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 HTTP/1.1 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Accept: application/json Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Accept-Encoding: identity Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Connection: close Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Content-Length: 0 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Content-Type: application/json Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Host: 10.222.0.26 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: Openstack-System-Scope: None Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: User-Agent: python-urllib3/1.26.12 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Auth-Token: gAAAAABjPuXkolRiXdKk5GAc0LR90pObhL61fjc0nPoRiZfZKopFN0zfDnR1xwDcb7JRxVuDpNzYo4KP0UWtC92Z5Zx6CcZdNVl5-58TEZdSvYQ-o8aK1-oi2rG5_l-vD2uFPXLrKAFx5yDJqs6Jno9aNAtCtXu0ljmYU1p9P8cSxHVckQb5MVI Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Id: None Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Domain-Name: None Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Identity-Status: Confirmed Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Is-Admin-Project: True Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Id: default Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Domain-Name: Default Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Id: 68ca09bf54c24fb9926771dd5ec70141 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Project-Name: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Role: member,reader Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Roles: member,reader Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68ca09bf54c24fb9926771dd5ec70141", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68ca09bf54c24fb9926771dd5ec70141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68ca09bf54c24fb9926771dd5ec70141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68ca09bf54c24fb9926771dd5ec70141"}]}] Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Id: 68ca09bf54c24fb9926771dd5ec70141 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-Tenant-Name: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-User: tempest-TestSnapshotPattern-23401211-project Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Id: default Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-User-Domain-Name: Default Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-User-Id: 6e865b1c49d24463aabb34e9e29aea7c Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: X-User-Name: tempest-TestSnapshotPattern-23401211-project Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: method: > Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: exception: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: action_args: {'id': 'd11dd285-25d1-4b15-ab31-50614e04e3b1'} Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:33:07.723133 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: ERROR nova.api.openstack.wsgi Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Returning 404 to user: Instance d11dd285-25d1-4b15-ab31-50614e04e3b1 could not be found. {{(pid=129615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-cb911563-9361-41a2-a114-3b1c9cf26de7 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1" status: 404 len: 111 microversion: 2.1 time: 0.031821 Oct 06 14:33:07.729150 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3883/7754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:07 2022] GET /compute/v2.1/servers/d11dd285-25d1-4b15-ab31-50614e04e3b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:33:09.051554 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:09.052077 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:09.053854 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:33:09.059737 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:09.060511 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:09.060766 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:09.062159 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:09.062910 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:09.063315 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:09.064431 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:09.065094 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:09.065704 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:09.078773 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] Creating event network-changed:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:33:09.085075 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-c6bfe50c-50c9-49c4-8b34-80f18a014948 req-4d9f4aca-5e46-4d9f-8fc3-ff21a354ed1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033798 Oct 06 14:33:09.085075 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3884/7755] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 14:33:09.091855 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Going to try to terminate instance {{(pid=129614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 14:33:09.183011 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-b27eae18-681c-4777-b122-14f298e6fe69 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 204 len: 0 microversion: 2.1 time: 0.134680 Oct 06 14:33:09.193834 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3872/7756] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Oct 6 14:33:09 2022] DELETE /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 14:33:09.195590 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:09.196361 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.compute.api [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129615) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:09.204040 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:09.204533 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:09.204994 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:09.205707 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:09.206202 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:09.206634 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:09.339804 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.policy [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129615) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:33:09.348115 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-18cfd03f-2edd-460c-87cd-ecc56fd794f3 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1683 microversion: 2.1 time: 0.157557 Oct 06 14:33:09.348679 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3885/7757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:09 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:33:10.373074 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:10.374377 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:10.381236 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:10.381761 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:10.382228 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:10.382952 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:10.383424 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:10.383865 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:10.624966 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.policy [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e865b1c49d24463aabb34e9e29aea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ca09bf54c24fb9926771dd5ec70141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 14:33:10.632780 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-0d93cac2-be26-4536-b9de-e32672014b8f tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 200 len: 1683 microversion: 2.1 time: 0.263919 Oct 06 14:33:10.648788 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3873/7758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:10 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 1683 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 14:33:10.858311 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db45452-131a-4640-a2e1-4792038e8095", "name": "network-vif-deleted", "tag": "21138ff1-8239-425f-b648-fe2060fa3ac5"}]} {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 14:33:10.870316 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:10.870806 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:10.871244 n-d-860556-1 devstack@n-api.service[129615]: DEBUG oslo_concurrency.lockutils [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:10.882763 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.compute.server_external_events [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] Creating event network-vif-deleted:21138ff1-8239-425f-b648-fe2060fa3ac5 for instance 0db45452-131a-4640-a2e1-4792038e8095 on n-h2-860556-1 Oct 06 14:33:10.888582 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [req-ddcb45af-647e-4b7d-8a01-60ac7a2aa024 req-f0d17867-3de9-4f7b-a60f-6602a89e818b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Oct 06 14:33:10.889705 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3886/7759] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Oct 6 14:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 14:33:11.657587 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '>' {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:11.658261 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.compute.api [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] [instance: 0db45452-131a-4640-a2e1-4792038e8095] Fetching instance by UUID {{(pid=129614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 14:33:11.665049 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:11.665537 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:11.666034 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:11.666750 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Acquiring lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 14:33:11.667222 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 14:33:11.667669 n-d-860556-1 devstack@n-api.service[129614]: DEBUG oslo_concurrency.lockutils [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Lock "ff6b8823-9a07-4510-8f08-d09c3334b0d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 14:33:11.681475 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.wsgi [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] HTTP exception thrown: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Request method failure captured: Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: request: GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 HTTP/1.1 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Accept: application/json Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Accept-Encoding: identity Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Connection: close Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Content-Length: 0 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Content-Type: application/json Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Host: 10.222.0.26 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: Openstack-System-Scope: None Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: User-Agent: python-urllib3/1.26.12 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Auth-Token: gAAAAABjPuXkolRiXdKk5GAc0LR90pObhL61fjc0nPoRiZfZKopFN0zfDnR1xwDcb7JRxVuDpNzYo4KP0UWtC92Z5Zx6CcZdNVl5-58TEZdSvYQ-o8aK1-oi2rG5_l-vD2uFPXLrKAFx5yDJqs6Jno9aNAtCtXu0ljmYU1p9P8cSxHVckQb5MVI Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Id: None Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Domain-Name: None Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Identity-Status: Confirmed Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Is-Admin-Project: True Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Id: default Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Domain-Name: Default Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Id: 68ca09bf54c24fb9926771dd5ec70141 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Project-Name: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Role: member,reader Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Roles: member,reader Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68ca09bf54c24fb9926771dd5ec70141", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68ca09bf54c24fb9926771dd5ec70141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68ca09bf54c24fb9926771dd5ec70141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68ca09bf54c24fb9926771dd5ec70141"}]}] Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Id: 68ca09bf54c24fb9926771dd5ec70141 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-Tenant-Name: tempest-TestSnapshotPattern-23401211 Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-User: tempest-TestSnapshotPattern-23401211-project Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Id: default Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-User-Domain-Name: Default Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-User-Id: 6e865b1c49d24463aabb34e9e29aea7c Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: X-User-Name: tempest-TestSnapshotPattern-23401211-project Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: method: > Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: exception: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: action_args: {'id': '0db45452-131a-4640-a2e1-4792038e8095'} Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: {{(pid=129614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 14:33:11.683189 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: ERROR nova.api.openstack.wsgi Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: DEBUG nova.api.openstack.wsgi [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Returning 404 to user: Instance 0db45452-131a-4640-a2e1-4792038e8095 could not be found. {{(pid=129614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: INFO nova.api.openstack.requestlog [None req-ce1f26ee-7698-4bba-9fd3-c36c770ea1bd tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 06 14:33:11.689597 n-d-860556-1 devstack@n-api.service[129614]: [pid: 129614|app: 0|req: 3874/7760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Oct 6 14:33:11 2022] GET /compute/v2.1/servers/0db45452-131a-4640-a2e1-4792038e8095 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 14:33:11.846770 n-d-860556-1 devstack@n-api.service[129615]: DEBUG nova.api.openstack.wsgi [None req-00fe74f6-526a-4f01-aa0e-c4626334f391 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] Calling method '.version_select at 0x7f7d4579ee50>' {{(pid=129615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 14:33:11.872883 n-d-860556-1 devstack@n-api.service[129615]: INFO nova.api.openstack.requestlog [None req-00fe74f6-526a-4f01-aa0e-c4626334f391 tempest-TestSnapshotPattern-23401211 tempest-TestSnapshotPattern-23401211-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1333961557" status: 202 len: 0 microversion: 2.1 time: 0.030695 Oct 06 14:33:11.873542 n-d-860556-1 devstack@n-api.service[129615]: [pid: 129615|app: 0|req: 3887/7761] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Oct 6 14:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1333961557 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)